00:00:00.000 Started by upstream project "autotest-per-patch" build number 130871 00:00:00.000 originally caused by: 00:00:00.000 Started by user sys_sgci 00:00:00.092 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-uring-vg-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-vg.groovy 00:00:00.093 The recommended git tool is: git 00:00:00.093 using credential 00000000-0000-0000-0000-000000000002 00:00:00.095 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-uring-vg-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.150 Fetching changes from the remote Git repository 00:00:00.152 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.209 Using shallow fetch with depth 1 00:00:00.209 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.209 > git --version # timeout=10 00:00:00.255 > git --version # 'git version 2.39.2' 00:00:00.255 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.288 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.288 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:08.132 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:08.142 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:08.153 Checking out Revision f95f9907808933a1db7196e15e13478e0f322ee7 (FETCH_HEAD) 00:00:08.153 > git config core.sparsecheckout # timeout=10 00:00:08.163 > git read-tree -mu HEAD # timeout=10 00:00:08.180 > git checkout -f f95f9907808933a1db7196e15e13478e0f322ee7 # timeout=5 00:00:08.200 Commit message: "Revert "autotest-phy: replace deprecated label for nvmf-cvl"" 00:00:08.201 > git rev-list --no-walk 67cd2f1639a8077ee9fc0f9259e068d0e5b67761 # timeout=10 00:00:08.420 [Pipeline] Start of Pipeline 00:00:08.432 [Pipeline] library 00:00:08.434 Loading library shm_lib@master 00:00:08.434 Library shm_lib@master is cached. Copying from home. 00:00:08.447 [Pipeline] node 00:00:08.458 Running on VM-host-SM9 in /var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2 00:00:08.459 [Pipeline] { 00:00:08.467 [Pipeline] catchError 00:00:08.468 [Pipeline] { 00:00:08.477 [Pipeline] wrap 00:00:08.484 [Pipeline] { 00:00:08.489 [Pipeline] stage 00:00:08.491 [Pipeline] { (Prologue) 00:00:08.503 [Pipeline] echo 00:00:08.504 Node: VM-host-SM9 00:00:08.508 [Pipeline] cleanWs 00:00:08.515 [WS-CLEANUP] Deleting project workspace... 00:00:08.515 [WS-CLEANUP] Deferred wipeout is used... 00:00:08.521 [WS-CLEANUP] done 00:00:08.825 [Pipeline] setCustomBuildProperty 00:00:08.935 [Pipeline] httpRequest 00:00:09.791 [Pipeline] echo 00:00:09.792 Sorcerer 10.211.164.101 is alive 00:00:09.800 [Pipeline] retry 00:00:09.802 [Pipeline] { 00:00:09.812 [Pipeline] httpRequest 00:00:09.816 HttpMethod: GET 00:00:09.816 URL: http://10.211.164.101/packages/jbp_f95f9907808933a1db7196e15e13478e0f322ee7.tar.gz 00:00:09.816 Sending request to url: http://10.211.164.101/packages/jbp_f95f9907808933a1db7196e15e13478e0f322ee7.tar.gz 00:00:09.830 Response Code: HTTP/1.1 200 OK 00:00:09.831 Success: Status code 200 is in the accepted range: 200,404 00:00:09.831 Saving response body to /var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2/jbp_f95f9907808933a1db7196e15e13478e0f322ee7.tar.gz 00:00:11.567 [Pipeline] } 00:00:11.581 [Pipeline] // retry 00:00:11.587 [Pipeline] sh 00:00:11.873 + tar --no-same-owner -xf jbp_f95f9907808933a1db7196e15e13478e0f322ee7.tar.gz 00:00:11.899 [Pipeline] httpRequest 00:00:12.905 [Pipeline] echo 00:00:12.907 Sorcerer 10.211.164.101 is alive 00:00:12.916 [Pipeline] retry 00:00:12.918 [Pipeline] { 00:00:12.928 [Pipeline] httpRequest 00:00:12.931 HttpMethod: GET 00:00:12.932 URL: http://10.211.164.101/packages/spdk_d16db39ee342e0479057d263a9944f38a2a1af94.tar.gz 00:00:12.933 Sending request to url: http://10.211.164.101/packages/spdk_d16db39ee342e0479057d263a9944f38a2a1af94.tar.gz 00:00:12.950 Response Code: HTTP/1.1 200 OK 00:00:12.951 Success: Status code 200 is in the accepted range: 200,404 00:00:12.951 Saving response body to /var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2/spdk_d16db39ee342e0479057d263a9944f38a2a1af94.tar.gz 00:03:07.412 [Pipeline] } 00:03:07.429 [Pipeline] // retry 00:03:07.437 [Pipeline] sh 00:03:07.717 + tar --no-same-owner -xf spdk_d16db39ee342e0479057d263a9944f38a2a1af94.tar.gz 00:03:11.014 [Pipeline] sh 00:03:11.290 + git -C spdk log --oneline -n5 00:03:11.290 d16db39ee bdev/nvme: removed 'multipath' param from spdk_bdev_nvme_create() 00:03:11.290 32fb30b70 bdev/nvme: changed default config to multipath 00:03:11.290 397c5fc31 bdev/nvme: ctrl config consistency check 00:03:11.290 3950cd1bb bdev/nvme: Change spdk_bdev_reset() to succeed if at least one nvme_ctrlr is reconnected 00:03:11.290 f9141d271 test/blob: Add BLOCKLEN macro in blob_ut 00:03:11.306 [Pipeline] writeFile 00:03:11.320 [Pipeline] sh 00:03:11.599 + jbp/jenkins/jjb-config/jobs/scripts/autorun_quirks.sh 00:03:11.610 [Pipeline] sh 00:03:11.888 + cat autorun-spdk.conf 00:03:11.888 SPDK_RUN_FUNCTIONAL_TEST=1 00:03:11.888 SPDK_TEST_NVMF=1 00:03:11.888 SPDK_TEST_NVMF_TRANSPORT=tcp 00:03:11.888 SPDK_TEST_URING=1 00:03:11.888 SPDK_TEST_USDT=1 00:03:11.888 SPDK_RUN_UBSAN=1 00:03:11.888 NET_TYPE=virt 00:03:11.888 SPDK_ABI_DIR=/home/vagrant/spdk_repo/spdk-abi 00:03:11.895 RUN_NIGHTLY=0 00:03:11.897 [Pipeline] } 00:03:11.912 [Pipeline] // stage 00:03:11.924 [Pipeline] stage 00:03:11.926 [Pipeline] { (Run VM) 00:03:11.937 [Pipeline] sh 00:03:12.215 + jbp/jenkins/jjb-config/jobs/scripts/prepare_nvme.sh 00:03:12.215 + echo 'Start stage prepare_nvme.sh' 00:03:12.215 Start stage prepare_nvme.sh 00:03:12.215 + [[ -n 1 ]] 00:03:12.215 + disk_prefix=ex1 00:03:12.215 + [[ -n /var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2 ]] 00:03:12.215 + [[ -e /var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2/autorun-spdk.conf ]] 00:03:12.215 + source /var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2/autorun-spdk.conf 00:03:12.215 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:03:12.216 ++ SPDK_TEST_NVMF=1 00:03:12.216 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:03:12.216 ++ SPDK_TEST_URING=1 00:03:12.216 ++ SPDK_TEST_USDT=1 00:03:12.216 ++ SPDK_RUN_UBSAN=1 00:03:12.216 ++ NET_TYPE=virt 00:03:12.216 ++ SPDK_ABI_DIR=/home/vagrant/spdk_repo/spdk-abi 00:03:12.216 ++ RUN_NIGHTLY=0 00:03:12.216 + cd /var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2 00:03:12.216 + nvme_files=() 00:03:12.216 + declare -A nvme_files 00:03:12.216 + backend_dir=/var/lib/libvirt/images/backends 00:03:12.216 + nvme_files['nvme.img']=5G 00:03:12.216 + nvme_files['nvme-cmb.img']=5G 00:03:12.216 + nvme_files['nvme-multi0.img']=4G 00:03:12.216 + nvme_files['nvme-multi1.img']=4G 00:03:12.216 + nvme_files['nvme-multi2.img']=4G 00:03:12.216 + nvme_files['nvme-openstack.img']=8G 00:03:12.216 + nvme_files['nvme-zns.img']=5G 00:03:12.216 + (( SPDK_TEST_NVME_PMR == 1 )) 00:03:12.216 + (( SPDK_TEST_FTL == 1 )) 00:03:12.216 + (( SPDK_TEST_NVME_FDP == 1 )) 00:03:12.216 + [[ ! -d /var/lib/libvirt/images/backends ]] 00:03:12.216 + for nvme in "${!nvme_files[@]}" 00:03:12.216 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex1-nvme-multi2.img -s 4G 00:03:12.216 Formatting '/var/lib/libvirt/images/backends/ex1-nvme-multi2.img', fmt=raw size=4294967296 preallocation=falloc 00:03:12.216 + for nvme in "${!nvme_files[@]}" 00:03:12.216 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex1-nvme-cmb.img -s 5G 00:03:12.216 Formatting '/var/lib/libvirt/images/backends/ex1-nvme-cmb.img', fmt=raw size=5368709120 preallocation=falloc 00:03:12.216 + for nvme in "${!nvme_files[@]}" 00:03:12.216 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex1-nvme-openstack.img -s 8G 00:03:12.474 Formatting '/var/lib/libvirt/images/backends/ex1-nvme-openstack.img', fmt=raw size=8589934592 preallocation=falloc 00:03:12.474 + for nvme in "${!nvme_files[@]}" 00:03:12.474 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex1-nvme-zns.img -s 5G 00:03:12.474 Formatting '/var/lib/libvirt/images/backends/ex1-nvme-zns.img', fmt=raw size=5368709120 preallocation=falloc 00:03:12.474 + for nvme in "${!nvme_files[@]}" 00:03:12.474 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex1-nvme-multi1.img -s 4G 00:03:12.474 Formatting '/var/lib/libvirt/images/backends/ex1-nvme-multi1.img', fmt=raw size=4294967296 preallocation=falloc 00:03:12.474 + for nvme in "${!nvme_files[@]}" 00:03:12.474 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex1-nvme-multi0.img -s 4G 00:03:12.732 Formatting '/var/lib/libvirt/images/backends/ex1-nvme-multi0.img', fmt=raw size=4294967296 preallocation=falloc 00:03:12.732 + for nvme in "${!nvme_files[@]}" 00:03:12.732 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex1-nvme.img -s 5G 00:03:12.991 Formatting '/var/lib/libvirt/images/backends/ex1-nvme.img', fmt=raw size=5368709120 preallocation=falloc 00:03:12.991 ++ sudo grep -rl ex1-nvme.img /etc/libvirt/qemu 00:03:12.991 + echo 'End stage prepare_nvme.sh' 00:03:12.991 End stage prepare_nvme.sh 00:03:13.001 [Pipeline] sh 00:03:13.280 + DISTRO=fedora39 CPUS=10 RAM=12288 jbp/jenkins/jjb-config/jobs/scripts/vagrant_create_vm.sh 00:03:13.280 Setup: -n 10 -s 12288 -x http://proxy-dmz.intel.com:911 -p libvirt --qemu-emulator=/usr/local/qemu/vanilla-v8.0.0/bin/qemu-system-x86_64 --nic-model=e1000 -b /var/lib/libvirt/images/backends/ex1-nvme.img -b /var/lib/libvirt/images/backends/ex1-nvme-multi0.img,nvme,/var/lib/libvirt/images/backends/ex1-nvme-multi1.img:/var/lib/libvirt/images/backends/ex1-nvme-multi2.img -H -a -v -f fedora39 00:03:13.280 00:03:13.280 DIR=/var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2/spdk/scripts/vagrant 00:03:13.280 SPDK_DIR=/var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2/spdk 00:03:13.280 VAGRANT_TARGET=/var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2 00:03:13.280 HELP=0 00:03:13.280 DRY_RUN=0 00:03:13.280 NVME_FILE=/var/lib/libvirt/images/backends/ex1-nvme.img,/var/lib/libvirt/images/backends/ex1-nvme-multi0.img, 00:03:13.280 NVME_DISKS_TYPE=nvme,nvme, 00:03:13.280 NVME_AUTO_CREATE=0 00:03:13.280 NVME_DISKS_NAMESPACES=,/var/lib/libvirt/images/backends/ex1-nvme-multi1.img:/var/lib/libvirt/images/backends/ex1-nvme-multi2.img, 00:03:13.281 NVME_CMB=,, 00:03:13.281 NVME_PMR=,, 00:03:13.281 NVME_ZNS=,, 00:03:13.281 NVME_MS=,, 00:03:13.281 NVME_FDP=,, 00:03:13.281 SPDK_VAGRANT_DISTRO=fedora39 00:03:13.281 SPDK_VAGRANT_VMCPU=10 00:03:13.281 SPDK_VAGRANT_VMRAM=12288 00:03:13.281 SPDK_VAGRANT_PROVIDER=libvirt 00:03:13.281 SPDK_VAGRANT_HTTP_PROXY=http://proxy-dmz.intel.com:911 00:03:13.281 SPDK_QEMU_EMULATOR=/usr/local/qemu/vanilla-v8.0.0/bin/qemu-system-x86_64 00:03:13.281 SPDK_OPENSTACK_NETWORK=0 00:03:13.281 VAGRANT_PACKAGE_BOX=0 00:03:13.281 VAGRANTFILE=/var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2/spdk/scripts/vagrant/Vagrantfile 00:03:13.281 FORCE_DISTRO=true 00:03:13.281 VAGRANT_BOX_VERSION= 00:03:13.281 EXTRA_VAGRANTFILES= 00:03:13.281 NIC_MODEL=e1000 00:03:13.281 00:03:13.281 mkdir: created directory '/var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2/fedora39-libvirt' 00:03:13.281 /var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2/fedora39-libvirt /var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2 00:03:16.567 Bringing machine 'default' up with 'libvirt' provider... 00:03:17.138 ==> default: Creating image (snapshot of base box volume). 00:03:17.138 ==> default: Creating domain with the following settings... 00:03:17.138 ==> default: -- Name: fedora39-39-1.5-1721788873-2326_default_1728299638_e020da96915a22daccbe 00:03:17.138 ==> default: -- Domain type: kvm 00:03:17.138 ==> default: -- Cpus: 10 00:03:17.138 ==> default: -- Feature: acpi 00:03:17.138 ==> default: -- Feature: apic 00:03:17.138 ==> default: -- Feature: pae 00:03:17.138 ==> default: -- Memory: 12288M 00:03:17.138 ==> default: -- Memory Backing: hugepages: 00:03:17.138 ==> default: -- Management MAC: 00:03:17.138 ==> default: -- Loader: 00:03:17.138 ==> default: -- Nvram: 00:03:17.139 ==> default: -- Base box: spdk/fedora39 00:03:17.139 ==> default: -- Storage pool: default 00:03:17.139 ==> default: -- Image: /var/lib/libvirt/images/fedora39-39-1.5-1721788873-2326_default_1728299638_e020da96915a22daccbe.img (20G) 00:03:17.139 ==> default: -- Volume Cache: default 00:03:17.139 ==> default: -- Kernel: 00:03:17.139 ==> default: -- Initrd: 00:03:17.139 ==> default: -- Graphics Type: vnc 00:03:17.139 ==> default: -- Graphics Port: -1 00:03:17.139 ==> default: -- Graphics IP: 127.0.0.1 00:03:17.139 ==> default: -- Graphics Password: Not defined 00:03:17.139 ==> default: -- Video Type: cirrus 00:03:17.139 ==> default: -- Video VRAM: 9216 00:03:17.139 ==> default: -- Sound Type: 00:03:17.139 ==> default: -- Keymap: en-us 00:03:17.139 ==> default: -- TPM Path: 00:03:17.139 ==> default: -- INPUT: type=mouse, bus=ps2 00:03:17.139 ==> default: -- Command line args: 00:03:17.139 ==> default: -> value=-device, 00:03:17.139 ==> default: -> value=nvme,id=nvme-0,serial=12340,addr=0x10, 00:03:17.139 ==> default: -> value=-drive, 00:03:17.139 ==> default: -> value=format=raw,file=/var/lib/libvirt/images/backends/ex1-nvme.img,if=none,id=nvme-0-drive0, 00:03:17.139 ==> default: -> value=-device, 00:03:17.139 ==> default: -> value=nvme-ns,drive=nvme-0-drive0,bus=nvme-0,nsid=1,zoned=false,logical_block_size=4096,physical_block_size=4096, 00:03:17.139 ==> default: -> value=-device, 00:03:17.139 ==> default: -> value=nvme,id=nvme-1,serial=12341,addr=0x11, 00:03:17.139 ==> default: -> value=-drive, 00:03:17.139 ==> default: -> value=format=raw,file=/var/lib/libvirt/images/backends/ex1-nvme-multi0.img,if=none,id=nvme-1-drive0, 00:03:17.139 ==> default: -> value=-device, 00:03:17.139 ==> default: -> value=nvme-ns,drive=nvme-1-drive0,bus=nvme-1,nsid=1,zoned=false,logical_block_size=4096,physical_block_size=4096, 00:03:17.139 ==> default: -> value=-drive, 00:03:17.139 ==> default: -> value=format=raw,file=/var/lib/libvirt/images/backends/ex1-nvme-multi1.img,if=none,id=nvme-1-drive1, 00:03:17.139 ==> default: -> value=-device, 00:03:17.139 ==> default: -> value=nvme-ns,drive=nvme-1-drive1,bus=nvme-1,nsid=2,zoned=false,logical_block_size=4096,physical_block_size=4096, 00:03:17.139 ==> default: -> value=-drive, 00:03:17.139 ==> default: -> value=format=raw,file=/var/lib/libvirt/images/backends/ex1-nvme-multi2.img,if=none,id=nvme-1-drive2, 00:03:17.139 ==> default: -> value=-device, 00:03:17.139 ==> default: -> value=nvme-ns,drive=nvme-1-drive2,bus=nvme-1,nsid=3,zoned=false,logical_block_size=4096,physical_block_size=4096, 00:03:17.139 ==> default: Creating shared folders metadata... 00:03:17.139 ==> default: Starting domain. 00:03:18.516 ==> default: Waiting for domain to get an IP address... 00:03:36.595 ==> default: Waiting for SSH to become available... 00:03:36.595 ==> default: Configuring and enabling network interfaces... 00:03:39.877 default: SSH address: 192.168.121.148:22 00:03:39.877 default: SSH username: vagrant 00:03:39.877 default: SSH auth method: private key 00:03:41.780 ==> default: Rsyncing folder: /mnt/jenkins_nvme/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2/spdk/ => /home/vagrant/spdk_repo/spdk 00:03:49.926 ==> default: Mounting SSHFS shared folder... 00:03:50.494 ==> default: Mounting folder via SSHFS: /mnt/jenkins_nvme/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2/fedora39-libvirt/output => /home/vagrant/spdk_repo/output 00:03:50.494 ==> default: Checking Mount.. 00:03:51.873 ==> default: Folder Successfully Mounted! 00:03:51.873 ==> default: Running provisioner: file... 00:03:52.442 default: ~/.gitconfig => .gitconfig 00:03:53.009 00:03:53.009 SUCCESS! 00:03:53.010 00:03:53.010 cd to /var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2/fedora39-libvirt and type "vagrant ssh" to use. 00:03:53.010 Use vagrant "suspend" and vagrant "resume" to stop and start. 00:03:53.010 Use vagrant "destroy" followed by "rm -rf /var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2/fedora39-libvirt" to destroy all trace of vm. 00:03:53.010 00:03:53.018 [Pipeline] } 00:03:53.032 [Pipeline] // stage 00:03:53.040 [Pipeline] dir 00:03:53.041 Running in /var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2/fedora39-libvirt 00:03:53.043 [Pipeline] { 00:03:53.055 [Pipeline] catchError 00:03:53.057 [Pipeline] { 00:03:53.070 [Pipeline] sh 00:03:53.350 + vagrant ssh-config --host vagrant 00:03:53.350 + sed -ne /^Host/,$p 00:03:53.350 + tee ssh_conf 00:03:56.668 Host vagrant 00:03:56.668 HostName 192.168.121.148 00:03:56.668 User vagrant 00:03:56.668 Port 22 00:03:56.668 UserKnownHostsFile /dev/null 00:03:56.668 StrictHostKeyChecking no 00:03:56.668 PasswordAuthentication no 00:03:56.668 IdentityFile /var/lib/libvirt/images/.vagrant.d/boxes/spdk-VAGRANTSLASH-fedora39/39-1.5-1721788873-2326/libvirt/fedora39 00:03:56.668 IdentitiesOnly yes 00:03:56.668 LogLevel FATAL 00:03:56.668 ForwardAgent yes 00:03:56.668 ForwardX11 yes 00:03:56.668 00:03:56.683 [Pipeline] withEnv 00:03:56.685 [Pipeline] { 00:03:56.699 [Pipeline] sh 00:03:56.979 + /usr/local/bin/ssh -t -F ssh_conf vagrant@vagrant #!/bin/bash 00:03:56.979 source /etc/os-release 00:03:56.979 [[ -e /image.version ]] && img=$(< /image.version) 00:03:56.979 # Minimal, systemd-like check. 00:03:56.979 if [[ -e /.dockerenv ]]; then 00:03:56.979 # Clear garbage from the node's name: 00:03:56.979 # agt-er_autotest_547-896 -> autotest_547-896 00:03:56.979 # $HOSTNAME is the actual container id 00:03:56.979 agent=$HOSTNAME@${DOCKER_SWARM_PLUGIN_JENKINS_AGENT_NAME#*_} 00:03:56.979 if grep -q "/etc/hostname" /proc/self/mountinfo; then 00:03:56.979 # We can assume this is a mount from a host where container is running, 00:03:56.979 # so fetch its hostname to easily identify the target swarm worker. 00:03:56.979 container="$(< /etc/hostname) ($agent)" 00:03:56.979 else 00:03:56.979 # Fallback 00:03:56.979 container=$agent 00:03:56.979 fi 00:03:56.979 fi 00:03:56.979 echo "${NAME} ${VERSION_ID}|$(uname -r)|${img:-N/A}|${container:-N/A}" 00:03:56.979 00:03:57.249 [Pipeline] } 00:03:57.265 [Pipeline] // withEnv 00:03:57.273 [Pipeline] setCustomBuildProperty 00:03:57.288 [Pipeline] stage 00:03:57.290 [Pipeline] { (Tests) 00:03:57.306 [Pipeline] sh 00:03:57.586 + scp -F ssh_conf -r /var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2/jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh vagrant@vagrant:./ 00:03:57.859 [Pipeline] sh 00:03:58.138 + scp -F ssh_conf -r /var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2/jbp/jenkins/jjb-config/jobs/scripts/pkgdep-autoruner.sh vagrant@vagrant:./ 00:03:58.412 [Pipeline] timeout 00:03:58.412 Timeout set to expire in 1 hr 0 min 00:03:58.414 [Pipeline] { 00:03:58.427 [Pipeline] sh 00:03:58.710 + /usr/local/bin/ssh -t -F ssh_conf vagrant@vagrant git -C spdk_repo/spdk reset --hard 00:03:59.295 HEAD is now at d16db39ee bdev/nvme: removed 'multipath' param from spdk_bdev_nvme_create() 00:03:59.307 [Pipeline] sh 00:03:59.587 + /usr/local/bin/ssh -t -F ssh_conf vagrant@vagrant sudo chown vagrant:vagrant spdk_repo 00:03:59.859 [Pipeline] sh 00:04:00.138 + scp -F ssh_conf -r /var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2/autorun-spdk.conf vagrant@vagrant:spdk_repo 00:04:00.413 [Pipeline] sh 00:04:00.693 + /usr/local/bin/ssh -t -F ssh_conf vagrant@vagrant JOB_BASE_NAME=nvmf-tcp-uring-vg-autotest ./autoruner.sh spdk_repo 00:04:00.952 ++ readlink -f spdk_repo 00:04:00.952 + DIR_ROOT=/home/vagrant/spdk_repo 00:04:00.952 + [[ -n /home/vagrant/spdk_repo ]] 00:04:00.952 + DIR_SPDK=/home/vagrant/spdk_repo/spdk 00:04:00.952 + DIR_OUTPUT=/home/vagrant/spdk_repo/output 00:04:00.952 + [[ -d /home/vagrant/spdk_repo/spdk ]] 00:04:00.952 + [[ ! -d /home/vagrant/spdk_repo/output ]] 00:04:00.952 + [[ -d /home/vagrant/spdk_repo/output ]] 00:04:00.952 + [[ nvmf-tcp-uring-vg-autotest == pkgdep-* ]] 00:04:00.952 + cd /home/vagrant/spdk_repo 00:04:00.952 + source /etc/os-release 00:04:00.952 ++ NAME='Fedora Linux' 00:04:00.952 ++ VERSION='39 (Cloud Edition)' 00:04:00.952 ++ ID=fedora 00:04:00.952 ++ VERSION_ID=39 00:04:00.952 ++ VERSION_CODENAME= 00:04:00.952 ++ PLATFORM_ID=platform:f39 00:04:00.952 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:04:00.952 ++ ANSI_COLOR='0;38;2;60;110;180' 00:04:00.952 ++ LOGO=fedora-logo-icon 00:04:00.952 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:04:00.952 ++ HOME_URL=https://fedoraproject.org/ 00:04:00.952 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:04:00.952 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:04:00.952 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:04:00.952 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:04:00.952 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:04:00.952 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:04:00.952 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:04:00.952 ++ SUPPORT_END=2024-11-12 00:04:00.952 ++ VARIANT='Cloud Edition' 00:04:00.952 ++ VARIANT_ID=cloud 00:04:00.952 + uname -a 00:04:00.952 Linux fedora39-cloud-1721788873-2326 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:04:00.952 + sudo /home/vagrant/spdk_repo/spdk/scripts/setup.sh status 00:04:01.210 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:04:01.210 Hugepages 00:04:01.210 node hugesize free / total 00:04:01.210 node0 1048576kB 0 / 0 00:04:01.210 node0 2048kB 0 / 0 00:04:01.210 00:04:01.210 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:01.469 virtio 0000:00:03.0 1af4 1001 unknown virtio-pci - vda 00:04:01.469 NVMe 0000:00:10.0 1b36 0010 unknown nvme nvme0 nvme0n1 00:04:01.469 NVMe 0000:00:11.0 1b36 0010 unknown nvme nvme1 nvme1n1 nvme1n2 nvme1n3 00:04:01.469 + rm -f /tmp/spdk-ld-path 00:04:01.469 + source autorun-spdk.conf 00:04:01.469 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:04:01.469 ++ SPDK_TEST_NVMF=1 00:04:01.469 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:04:01.469 ++ SPDK_TEST_URING=1 00:04:01.469 ++ SPDK_TEST_USDT=1 00:04:01.469 ++ SPDK_RUN_UBSAN=1 00:04:01.469 ++ NET_TYPE=virt 00:04:01.469 ++ SPDK_ABI_DIR=/home/vagrant/spdk_repo/spdk-abi 00:04:01.469 ++ RUN_NIGHTLY=0 00:04:01.469 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:04:01.469 + [[ -n '' ]] 00:04:01.469 + sudo git config --global --add safe.directory /home/vagrant/spdk_repo/spdk 00:04:01.469 + for M in /var/spdk/build-*-manifest.txt 00:04:01.469 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:04:01.469 + cp /var/spdk/build-kernel-manifest.txt /home/vagrant/spdk_repo/output/ 00:04:01.469 + for M in /var/spdk/build-*-manifest.txt 00:04:01.469 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:04:01.469 + cp /var/spdk/build-pkg-manifest.txt /home/vagrant/spdk_repo/output/ 00:04:01.469 + for M in /var/spdk/build-*-manifest.txt 00:04:01.469 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:04:01.469 + cp /var/spdk/build-repo-manifest.txt /home/vagrant/spdk_repo/output/ 00:04:01.469 ++ uname 00:04:01.469 + [[ Linux == \L\i\n\u\x ]] 00:04:01.469 + sudo dmesg -T 00:04:01.469 + sudo dmesg --clear 00:04:01.469 + dmesg_pid=5271 00:04:01.469 + [[ Fedora Linux == FreeBSD ]] 00:04:01.469 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:04:01.469 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:04:01.469 + sudo dmesg -Tw 00:04:01.469 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:04:01.469 + [[ -x /usr/src/fio-static/fio ]] 00:04:01.469 + export FIO_BIN=/usr/src/fio-static/fio 00:04:01.469 + FIO_BIN=/usr/src/fio-static/fio 00:04:01.469 + [[ '' == \/\q\e\m\u\_\v\f\i\o\/* ]] 00:04:01.469 + [[ ! -v VFIO_QEMU_BIN ]] 00:04:01.469 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:04:01.469 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:04:01.469 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:04:01.469 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:04:01.469 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:04:01.469 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:04:01.469 + spdk/autorun.sh /home/vagrant/spdk_repo/autorun-spdk.conf 00:04:01.469 Test configuration: 00:04:01.469 SPDK_RUN_FUNCTIONAL_TEST=1 00:04:01.469 SPDK_TEST_NVMF=1 00:04:01.469 SPDK_TEST_NVMF_TRANSPORT=tcp 00:04:01.469 SPDK_TEST_URING=1 00:04:01.469 SPDK_TEST_USDT=1 00:04:01.469 SPDK_RUN_UBSAN=1 00:04:01.469 NET_TYPE=virt 00:04:01.469 SPDK_ABI_DIR=/home/vagrant/spdk_repo/spdk-abi 00:04:01.728 RUN_NIGHTLY=0 11:14:43 -- common/autotest_common.sh@1680 -- $ [[ n == y ]] 00:04:01.728 11:14:43 -- common/autobuild_common.sh@15 -- $ source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:04:01.728 11:14:43 -- scripts/common.sh@15 -- $ shopt -s extglob 00:04:01.728 11:14:43 -- scripts/common.sh@544 -- $ [[ -e /bin/wpdk_common.sh ]] 00:04:01.728 11:14:43 -- scripts/common.sh@552 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:01.728 11:14:43 -- scripts/common.sh@553 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:01.728 11:14:43 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/vagrant/.local/bin:/home/vagrant/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:01.728 11:14:43 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/vagrant/.local/bin:/home/vagrant/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:01.728 11:14:43 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/vagrant/.local/bin:/home/vagrant/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:01.728 11:14:43 -- paths/export.sh@5 -- $ export PATH 00:04:01.728 11:14:43 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/vagrant/.local/bin:/home/vagrant/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:01.728 11:14:43 -- common/autobuild_common.sh@485 -- $ out=/home/vagrant/spdk_repo/spdk/../output 00:04:01.728 11:14:43 -- common/autobuild_common.sh@486 -- $ date +%s 00:04:01.728 11:14:43 -- common/autobuild_common.sh@486 -- $ mktemp -dt spdk_1728299683.XXXXXX 00:04:01.728 11:14:43 -- common/autobuild_common.sh@486 -- $ SPDK_WORKSPACE=/tmp/spdk_1728299683.oDRtvG 00:04:01.728 11:14:43 -- common/autobuild_common.sh@488 -- $ [[ -n '' ]] 00:04:01.728 11:14:43 -- common/autobuild_common.sh@492 -- $ '[' -n '' ']' 00:04:01.728 11:14:43 -- common/autobuild_common.sh@495 -- $ scanbuild_exclude='--exclude /home/vagrant/spdk_repo/spdk/dpdk/' 00:04:01.728 11:14:43 -- common/autobuild_common.sh@499 -- $ scanbuild_exclude+=' --exclude /home/vagrant/spdk_repo/spdk/xnvme --exclude /tmp' 00:04:01.728 11:14:43 -- common/autobuild_common.sh@501 -- $ scanbuild='scan-build -o /home/vagrant/spdk_repo/spdk/../output/scan-build-tmp --exclude /home/vagrant/spdk_repo/spdk/dpdk/ --exclude /home/vagrant/spdk_repo/spdk/xnvme --exclude /tmp --status-bugs' 00:04:01.728 11:14:43 -- common/autobuild_common.sh@502 -- $ get_config_params 00:04:01.728 11:14:43 -- common/autotest_common.sh@407 -- $ xtrace_disable 00:04:01.728 11:14:43 -- common/autotest_common.sh@10 -- $ set +x 00:04:01.728 11:14:43 -- common/autobuild_common.sh@502 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-usdt --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-uring' 00:04:01.728 11:14:43 -- common/autobuild_common.sh@504 -- $ start_monitor_resources 00:04:01.728 11:14:43 -- pm/common@17 -- $ local monitor 00:04:01.728 11:14:43 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:04:01.728 11:14:43 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:04:01.728 11:14:43 -- pm/common@25 -- $ sleep 1 00:04:01.728 11:14:43 -- pm/common@21 -- $ date +%s 00:04:01.728 11:14:43 -- pm/common@21 -- $ date +%s 00:04:01.728 11:14:43 -- pm/common@21 -- $ /home/vagrant/spdk_repo/spdk/scripts/perf/pm/collect-cpu-load -d /home/vagrant/spdk_repo/spdk/../output/power -l -p monitor.autobuild.sh.1728299683 00:04:01.728 11:14:43 -- pm/common@21 -- $ /home/vagrant/spdk_repo/spdk/scripts/perf/pm/collect-vmstat -d /home/vagrant/spdk_repo/spdk/../output/power -l -p monitor.autobuild.sh.1728299683 00:04:01.728 Redirecting to /home/vagrant/spdk_repo/spdk/../output/power/monitor.autobuild.sh.1728299683_collect-cpu-load.pm.log 00:04:01.728 Redirecting to /home/vagrant/spdk_repo/spdk/../output/power/monitor.autobuild.sh.1728299683_collect-vmstat.pm.log 00:04:02.665 11:14:44 -- common/autobuild_common.sh@505 -- $ trap stop_monitor_resources EXIT 00:04:02.665 11:14:44 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:04:02.665 11:14:44 -- spdk/autobuild.sh@12 -- $ umask 022 00:04:02.665 11:14:44 -- spdk/autobuild.sh@13 -- $ cd /home/vagrant/spdk_repo/spdk 00:04:02.665 11:14:44 -- spdk/autobuild.sh@16 -- $ date -u 00:04:02.665 Mon Oct 7 11:14:44 AM UTC 2024 00:04:02.665 11:14:44 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:04:02.665 v25.01-pre-38-gd16db39ee 00:04:02.665 11:14:44 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:04:02.665 11:14:44 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:04:02.665 11:14:44 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:04:02.665 11:14:44 -- common/autotest_common.sh@1101 -- $ '[' 3 -le 1 ']' 00:04:02.665 11:14:44 -- common/autotest_common.sh@1107 -- $ xtrace_disable 00:04:02.665 11:14:44 -- common/autotest_common.sh@10 -- $ set +x 00:04:02.665 ************************************ 00:04:02.665 START TEST ubsan 00:04:02.665 ************************************ 00:04:02.665 using ubsan 00:04:02.665 11:14:44 ubsan -- common/autotest_common.sh@1125 -- $ echo 'using ubsan' 00:04:02.665 00:04:02.665 real 0m0.000s 00:04:02.665 user 0m0.000s 00:04:02.665 sys 0m0.000s 00:04:02.665 11:14:44 ubsan -- common/autotest_common.sh@1126 -- $ xtrace_disable 00:04:02.665 11:14:44 ubsan -- common/autotest_common.sh@10 -- $ set +x 00:04:02.665 ************************************ 00:04:02.665 END TEST ubsan 00:04:02.665 ************************************ 00:04:02.665 11:14:44 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:04:02.665 11:14:44 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:04:02.665 11:14:44 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:04:02.665 11:14:44 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:04:02.665 11:14:44 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:04:02.665 11:14:44 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:04:02.665 11:14:44 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:04:02.665 11:14:44 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:04:02.665 11:14:44 -- spdk/autobuild.sh@67 -- $ /home/vagrant/spdk_repo/spdk/configure --enable-debug --enable-werror --with-rdma --with-usdt --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-uring --with-shared 00:04:02.924 Using default SPDK env in /home/vagrant/spdk_repo/spdk/lib/env_dpdk 00:04:02.924 Using default DPDK in /home/vagrant/spdk_repo/spdk/dpdk/build 00:04:03.182 Using 'verbs' RDMA provider 00:04:19.000 Configuring ISA-L (logfile: /home/vagrant/spdk_repo/spdk/.spdk-isal.log)...done. 00:04:31.201 Configuring ISA-L-crypto (logfile: /home/vagrant/spdk_repo/spdk/.spdk-isal-crypto.log)...done. 00:04:31.201 Creating mk/config.mk...done. 00:04:31.201 Creating mk/cc.flags.mk...done. 00:04:31.201 Type 'make' to build. 00:04:31.202 11:15:12 -- spdk/autobuild.sh@70 -- $ run_test make make -j10 00:04:31.202 11:15:12 -- common/autotest_common.sh@1101 -- $ '[' 3 -le 1 ']' 00:04:31.202 11:15:12 -- common/autotest_common.sh@1107 -- $ xtrace_disable 00:04:31.202 11:15:12 -- common/autotest_common.sh@10 -- $ set +x 00:04:31.202 ************************************ 00:04:31.202 START TEST make 00:04:31.202 ************************************ 00:04:31.202 11:15:12 make -- common/autotest_common.sh@1125 -- $ make -j10 00:04:31.202 make[1]: Nothing to be done for 'all'. 00:04:46.076 The Meson build system 00:04:46.076 Version: 1.5.0 00:04:46.076 Source dir: /home/vagrant/spdk_repo/spdk/dpdk 00:04:46.076 Build dir: /home/vagrant/spdk_repo/spdk/dpdk/build-tmp 00:04:46.076 Build type: native build 00:04:46.076 Program cat found: YES (/usr/bin/cat) 00:04:46.076 Project name: DPDK 00:04:46.076 Project version: 24.03.0 00:04:46.076 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:04:46.076 C linker for the host machine: cc ld.bfd 2.40-14 00:04:46.076 Host machine cpu family: x86_64 00:04:46.076 Host machine cpu: x86_64 00:04:46.076 Message: ## Building in Developer Mode ## 00:04:46.076 Program pkg-config found: YES (/usr/bin/pkg-config) 00:04:46.076 Program check-symbols.sh found: YES (/home/vagrant/spdk_repo/spdk/dpdk/buildtools/check-symbols.sh) 00:04:46.076 Program options-ibverbs-static.sh found: YES (/home/vagrant/spdk_repo/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:04:46.076 Program python3 found: YES (/usr/bin/python3) 00:04:46.076 Program cat found: YES (/usr/bin/cat) 00:04:46.076 Compiler for C supports arguments -march=native: YES 00:04:46.076 Checking for size of "void *" : 8 00:04:46.076 Checking for size of "void *" : 8 (cached) 00:04:46.076 Compiler for C supports link arguments -Wl,--undefined-version: YES 00:04:46.076 Library m found: YES 00:04:46.076 Library numa found: YES 00:04:46.076 Has header "numaif.h" : YES 00:04:46.076 Library fdt found: NO 00:04:46.076 Library execinfo found: NO 00:04:46.076 Has header "execinfo.h" : YES 00:04:46.076 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:04:46.076 Run-time dependency libarchive found: NO (tried pkgconfig) 00:04:46.076 Run-time dependency libbsd found: NO (tried pkgconfig) 00:04:46.076 Run-time dependency jansson found: NO (tried pkgconfig) 00:04:46.076 Run-time dependency openssl found: YES 3.1.1 00:04:46.076 Run-time dependency libpcap found: YES 1.10.4 00:04:46.076 Has header "pcap.h" with dependency libpcap: YES 00:04:46.076 Compiler for C supports arguments -Wcast-qual: YES 00:04:46.076 Compiler for C supports arguments -Wdeprecated: YES 00:04:46.076 Compiler for C supports arguments -Wformat: YES 00:04:46.076 Compiler for C supports arguments -Wformat-nonliteral: NO 00:04:46.076 Compiler for C supports arguments -Wformat-security: NO 00:04:46.076 Compiler for C supports arguments -Wmissing-declarations: YES 00:04:46.076 Compiler for C supports arguments -Wmissing-prototypes: YES 00:04:46.076 Compiler for C supports arguments -Wnested-externs: YES 00:04:46.076 Compiler for C supports arguments -Wold-style-definition: YES 00:04:46.076 Compiler for C supports arguments -Wpointer-arith: YES 00:04:46.076 Compiler for C supports arguments -Wsign-compare: YES 00:04:46.076 Compiler for C supports arguments -Wstrict-prototypes: YES 00:04:46.076 Compiler for C supports arguments -Wundef: YES 00:04:46.076 Compiler for C supports arguments -Wwrite-strings: YES 00:04:46.076 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:04:46.076 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:04:46.076 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:04:46.076 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:04:46.076 Program objdump found: YES (/usr/bin/objdump) 00:04:46.076 Compiler for C supports arguments -mavx512f: YES 00:04:46.076 Checking if "AVX512 checking" compiles: YES 00:04:46.076 Fetching value of define "__SSE4_2__" : 1 00:04:46.076 Fetching value of define "__AES__" : 1 00:04:46.076 Fetching value of define "__AVX__" : 1 00:04:46.076 Fetching value of define "__AVX2__" : 1 00:04:46.076 Fetching value of define "__AVX512BW__" : (undefined) 00:04:46.076 Fetching value of define "__AVX512CD__" : (undefined) 00:04:46.076 Fetching value of define "__AVX512DQ__" : (undefined) 00:04:46.076 Fetching value of define "__AVX512F__" : (undefined) 00:04:46.076 Fetching value of define "__AVX512VL__" : (undefined) 00:04:46.076 Fetching value of define "__PCLMUL__" : 1 00:04:46.076 Fetching value of define "__RDRND__" : 1 00:04:46.076 Fetching value of define "__RDSEED__" : 1 00:04:46.076 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:04:46.076 Fetching value of define "__znver1__" : (undefined) 00:04:46.076 Fetching value of define "__znver2__" : (undefined) 00:04:46.076 Fetching value of define "__znver3__" : (undefined) 00:04:46.076 Fetching value of define "__znver4__" : (undefined) 00:04:46.076 Compiler for C supports arguments -Wno-format-truncation: YES 00:04:46.076 Message: lib/log: Defining dependency "log" 00:04:46.076 Message: lib/kvargs: Defining dependency "kvargs" 00:04:46.076 Message: lib/telemetry: Defining dependency "telemetry" 00:04:46.076 Checking for function "getentropy" : NO 00:04:46.076 Message: lib/eal: Defining dependency "eal" 00:04:46.076 Message: lib/ring: Defining dependency "ring" 00:04:46.077 Message: lib/rcu: Defining dependency "rcu" 00:04:46.077 Message: lib/mempool: Defining dependency "mempool" 00:04:46.077 Message: lib/mbuf: Defining dependency "mbuf" 00:04:46.077 Fetching value of define "__PCLMUL__" : 1 (cached) 00:04:46.077 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:04:46.077 Compiler for C supports arguments -mpclmul: YES 00:04:46.077 Compiler for C supports arguments -maes: YES 00:04:46.077 Compiler for C supports arguments -mavx512f: YES (cached) 00:04:46.077 Compiler for C supports arguments -mavx512bw: YES 00:04:46.077 Compiler for C supports arguments -mavx512dq: YES 00:04:46.077 Compiler for C supports arguments -mavx512vl: YES 00:04:46.077 Compiler for C supports arguments -mvpclmulqdq: YES 00:04:46.077 Compiler for C supports arguments -mavx2: YES 00:04:46.077 Compiler for C supports arguments -mavx: YES 00:04:46.077 Message: lib/net: Defining dependency "net" 00:04:46.077 Message: lib/meter: Defining dependency "meter" 00:04:46.077 Message: lib/ethdev: Defining dependency "ethdev" 00:04:46.077 Message: lib/pci: Defining dependency "pci" 00:04:46.077 Message: lib/cmdline: Defining dependency "cmdline" 00:04:46.077 Message: lib/hash: Defining dependency "hash" 00:04:46.077 Message: lib/timer: Defining dependency "timer" 00:04:46.077 Message: lib/compressdev: Defining dependency "compressdev" 00:04:46.077 Message: lib/cryptodev: Defining dependency "cryptodev" 00:04:46.077 Message: lib/dmadev: Defining dependency "dmadev" 00:04:46.077 Compiler for C supports arguments -Wno-cast-qual: YES 00:04:46.077 Message: lib/power: Defining dependency "power" 00:04:46.077 Message: lib/reorder: Defining dependency "reorder" 00:04:46.077 Message: lib/security: Defining dependency "security" 00:04:46.077 Has header "linux/userfaultfd.h" : YES 00:04:46.077 Has header "linux/vduse.h" : YES 00:04:46.077 Message: lib/vhost: Defining dependency "vhost" 00:04:46.077 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:04:46.077 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:04:46.077 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:04:46.077 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:04:46.077 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:04:46.077 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:04:46.077 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:04:46.077 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:04:46.077 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:04:46.077 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:04:46.077 Program doxygen found: YES (/usr/local/bin/doxygen) 00:04:46.077 Configuring doxy-api-html.conf using configuration 00:04:46.077 Configuring doxy-api-man.conf using configuration 00:04:46.077 Program mandb found: YES (/usr/bin/mandb) 00:04:46.077 Program sphinx-build found: NO 00:04:46.077 Configuring rte_build_config.h using configuration 00:04:46.077 Message: 00:04:46.077 ================= 00:04:46.077 Applications Enabled 00:04:46.077 ================= 00:04:46.077 00:04:46.077 apps: 00:04:46.077 00:04:46.077 00:04:46.077 Message: 00:04:46.077 ================= 00:04:46.077 Libraries Enabled 00:04:46.077 ================= 00:04:46.077 00:04:46.077 libs: 00:04:46.077 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:04:46.077 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:04:46.077 cryptodev, dmadev, power, reorder, security, vhost, 00:04:46.077 00:04:46.077 Message: 00:04:46.077 =============== 00:04:46.077 Drivers Enabled 00:04:46.077 =============== 00:04:46.077 00:04:46.077 common: 00:04:46.077 00:04:46.077 bus: 00:04:46.077 pci, vdev, 00:04:46.077 mempool: 00:04:46.077 ring, 00:04:46.077 dma: 00:04:46.077 00:04:46.077 net: 00:04:46.077 00:04:46.077 crypto: 00:04:46.077 00:04:46.077 compress: 00:04:46.077 00:04:46.077 vdpa: 00:04:46.077 00:04:46.077 00:04:46.077 Message: 00:04:46.077 ================= 00:04:46.077 Content Skipped 00:04:46.077 ================= 00:04:46.077 00:04:46.077 apps: 00:04:46.077 dumpcap: explicitly disabled via build config 00:04:46.077 graph: explicitly disabled via build config 00:04:46.077 pdump: explicitly disabled via build config 00:04:46.077 proc-info: explicitly disabled via build config 00:04:46.077 test-acl: explicitly disabled via build config 00:04:46.077 test-bbdev: explicitly disabled via build config 00:04:46.077 test-cmdline: explicitly disabled via build config 00:04:46.077 test-compress-perf: explicitly disabled via build config 00:04:46.077 test-crypto-perf: explicitly disabled via build config 00:04:46.077 test-dma-perf: explicitly disabled via build config 00:04:46.077 test-eventdev: explicitly disabled via build config 00:04:46.077 test-fib: explicitly disabled via build config 00:04:46.077 test-flow-perf: explicitly disabled via build config 00:04:46.077 test-gpudev: explicitly disabled via build config 00:04:46.077 test-mldev: explicitly disabled via build config 00:04:46.077 test-pipeline: explicitly disabled via build config 00:04:46.077 test-pmd: explicitly disabled via build config 00:04:46.077 test-regex: explicitly disabled via build config 00:04:46.077 test-sad: explicitly disabled via build config 00:04:46.077 test-security-perf: explicitly disabled via build config 00:04:46.077 00:04:46.077 libs: 00:04:46.077 argparse: explicitly disabled via build config 00:04:46.077 metrics: explicitly disabled via build config 00:04:46.077 acl: explicitly disabled via build config 00:04:46.077 bbdev: explicitly disabled via build config 00:04:46.077 bitratestats: explicitly disabled via build config 00:04:46.077 bpf: explicitly disabled via build config 00:04:46.077 cfgfile: explicitly disabled via build config 00:04:46.077 distributor: explicitly disabled via build config 00:04:46.077 efd: explicitly disabled via build config 00:04:46.077 eventdev: explicitly disabled via build config 00:04:46.077 dispatcher: explicitly disabled via build config 00:04:46.077 gpudev: explicitly disabled via build config 00:04:46.077 gro: explicitly disabled via build config 00:04:46.077 gso: explicitly disabled via build config 00:04:46.077 ip_frag: explicitly disabled via build config 00:04:46.077 jobstats: explicitly disabled via build config 00:04:46.077 latencystats: explicitly disabled via build config 00:04:46.077 lpm: explicitly disabled via build config 00:04:46.077 member: explicitly disabled via build config 00:04:46.077 pcapng: explicitly disabled via build config 00:04:46.077 rawdev: explicitly disabled via build config 00:04:46.077 regexdev: explicitly disabled via build config 00:04:46.077 mldev: explicitly disabled via build config 00:04:46.077 rib: explicitly disabled via build config 00:04:46.077 sched: explicitly disabled via build config 00:04:46.077 stack: explicitly disabled via build config 00:04:46.077 ipsec: explicitly disabled via build config 00:04:46.077 pdcp: explicitly disabled via build config 00:04:46.077 fib: explicitly disabled via build config 00:04:46.077 port: explicitly disabled via build config 00:04:46.077 pdump: explicitly disabled via build config 00:04:46.077 table: explicitly disabled via build config 00:04:46.077 pipeline: explicitly disabled via build config 00:04:46.077 graph: explicitly disabled via build config 00:04:46.077 node: explicitly disabled via build config 00:04:46.077 00:04:46.077 drivers: 00:04:46.077 common/cpt: not in enabled drivers build config 00:04:46.077 common/dpaax: not in enabled drivers build config 00:04:46.077 common/iavf: not in enabled drivers build config 00:04:46.077 common/idpf: not in enabled drivers build config 00:04:46.077 common/ionic: not in enabled drivers build config 00:04:46.077 common/mvep: not in enabled drivers build config 00:04:46.077 common/octeontx: not in enabled drivers build config 00:04:46.077 bus/auxiliary: not in enabled drivers build config 00:04:46.077 bus/cdx: not in enabled drivers build config 00:04:46.077 bus/dpaa: not in enabled drivers build config 00:04:46.077 bus/fslmc: not in enabled drivers build config 00:04:46.077 bus/ifpga: not in enabled drivers build config 00:04:46.077 bus/platform: not in enabled drivers build config 00:04:46.077 bus/uacce: not in enabled drivers build config 00:04:46.077 bus/vmbus: not in enabled drivers build config 00:04:46.077 common/cnxk: not in enabled drivers build config 00:04:46.077 common/mlx5: not in enabled drivers build config 00:04:46.077 common/nfp: not in enabled drivers build config 00:04:46.077 common/nitrox: not in enabled drivers build config 00:04:46.077 common/qat: not in enabled drivers build config 00:04:46.077 common/sfc_efx: not in enabled drivers build config 00:04:46.077 mempool/bucket: not in enabled drivers build config 00:04:46.077 mempool/cnxk: not in enabled drivers build config 00:04:46.077 mempool/dpaa: not in enabled drivers build config 00:04:46.077 mempool/dpaa2: not in enabled drivers build config 00:04:46.077 mempool/octeontx: not in enabled drivers build config 00:04:46.077 mempool/stack: not in enabled drivers build config 00:04:46.077 dma/cnxk: not in enabled drivers build config 00:04:46.077 dma/dpaa: not in enabled drivers build config 00:04:46.077 dma/dpaa2: not in enabled drivers build config 00:04:46.077 dma/hisilicon: not in enabled drivers build config 00:04:46.077 dma/idxd: not in enabled drivers build config 00:04:46.077 dma/ioat: not in enabled drivers build config 00:04:46.077 dma/skeleton: not in enabled drivers build config 00:04:46.077 net/af_packet: not in enabled drivers build config 00:04:46.077 net/af_xdp: not in enabled drivers build config 00:04:46.077 net/ark: not in enabled drivers build config 00:04:46.077 net/atlantic: not in enabled drivers build config 00:04:46.077 net/avp: not in enabled drivers build config 00:04:46.077 net/axgbe: not in enabled drivers build config 00:04:46.077 net/bnx2x: not in enabled drivers build config 00:04:46.077 net/bnxt: not in enabled drivers build config 00:04:46.078 net/bonding: not in enabled drivers build config 00:04:46.078 net/cnxk: not in enabled drivers build config 00:04:46.078 net/cpfl: not in enabled drivers build config 00:04:46.078 net/cxgbe: not in enabled drivers build config 00:04:46.078 net/dpaa: not in enabled drivers build config 00:04:46.078 net/dpaa2: not in enabled drivers build config 00:04:46.078 net/e1000: not in enabled drivers build config 00:04:46.078 net/ena: not in enabled drivers build config 00:04:46.078 net/enetc: not in enabled drivers build config 00:04:46.078 net/enetfec: not in enabled drivers build config 00:04:46.078 net/enic: not in enabled drivers build config 00:04:46.078 net/failsafe: not in enabled drivers build config 00:04:46.078 net/fm10k: not in enabled drivers build config 00:04:46.078 net/gve: not in enabled drivers build config 00:04:46.078 net/hinic: not in enabled drivers build config 00:04:46.078 net/hns3: not in enabled drivers build config 00:04:46.078 net/i40e: not in enabled drivers build config 00:04:46.078 net/iavf: not in enabled drivers build config 00:04:46.078 net/ice: not in enabled drivers build config 00:04:46.078 net/idpf: not in enabled drivers build config 00:04:46.078 net/igc: not in enabled drivers build config 00:04:46.078 net/ionic: not in enabled drivers build config 00:04:46.078 net/ipn3ke: not in enabled drivers build config 00:04:46.078 net/ixgbe: not in enabled drivers build config 00:04:46.078 net/mana: not in enabled drivers build config 00:04:46.078 net/memif: not in enabled drivers build config 00:04:46.078 net/mlx4: not in enabled drivers build config 00:04:46.078 net/mlx5: not in enabled drivers build config 00:04:46.078 net/mvneta: not in enabled drivers build config 00:04:46.078 net/mvpp2: not in enabled drivers build config 00:04:46.078 net/netvsc: not in enabled drivers build config 00:04:46.078 net/nfb: not in enabled drivers build config 00:04:46.078 net/nfp: not in enabled drivers build config 00:04:46.078 net/ngbe: not in enabled drivers build config 00:04:46.078 net/null: not in enabled drivers build config 00:04:46.078 net/octeontx: not in enabled drivers build config 00:04:46.078 net/octeon_ep: not in enabled drivers build config 00:04:46.078 net/pcap: not in enabled drivers build config 00:04:46.078 net/pfe: not in enabled drivers build config 00:04:46.078 net/qede: not in enabled drivers build config 00:04:46.078 net/ring: not in enabled drivers build config 00:04:46.078 net/sfc: not in enabled drivers build config 00:04:46.078 net/softnic: not in enabled drivers build config 00:04:46.078 net/tap: not in enabled drivers build config 00:04:46.078 net/thunderx: not in enabled drivers build config 00:04:46.078 net/txgbe: not in enabled drivers build config 00:04:46.078 net/vdev_netvsc: not in enabled drivers build config 00:04:46.078 net/vhost: not in enabled drivers build config 00:04:46.078 net/virtio: not in enabled drivers build config 00:04:46.078 net/vmxnet3: not in enabled drivers build config 00:04:46.078 raw/*: missing internal dependency, "rawdev" 00:04:46.078 crypto/armv8: not in enabled drivers build config 00:04:46.078 crypto/bcmfs: not in enabled drivers build config 00:04:46.078 crypto/caam_jr: not in enabled drivers build config 00:04:46.078 crypto/ccp: not in enabled drivers build config 00:04:46.078 crypto/cnxk: not in enabled drivers build config 00:04:46.078 crypto/dpaa_sec: not in enabled drivers build config 00:04:46.078 crypto/dpaa2_sec: not in enabled drivers build config 00:04:46.078 crypto/ipsec_mb: not in enabled drivers build config 00:04:46.078 crypto/mlx5: not in enabled drivers build config 00:04:46.078 crypto/mvsam: not in enabled drivers build config 00:04:46.078 crypto/nitrox: not in enabled drivers build config 00:04:46.078 crypto/null: not in enabled drivers build config 00:04:46.078 crypto/octeontx: not in enabled drivers build config 00:04:46.078 crypto/openssl: not in enabled drivers build config 00:04:46.078 crypto/scheduler: not in enabled drivers build config 00:04:46.078 crypto/uadk: not in enabled drivers build config 00:04:46.078 crypto/virtio: not in enabled drivers build config 00:04:46.078 compress/isal: not in enabled drivers build config 00:04:46.078 compress/mlx5: not in enabled drivers build config 00:04:46.078 compress/nitrox: not in enabled drivers build config 00:04:46.078 compress/octeontx: not in enabled drivers build config 00:04:46.078 compress/zlib: not in enabled drivers build config 00:04:46.078 regex/*: missing internal dependency, "regexdev" 00:04:46.078 ml/*: missing internal dependency, "mldev" 00:04:46.078 vdpa/ifc: not in enabled drivers build config 00:04:46.078 vdpa/mlx5: not in enabled drivers build config 00:04:46.078 vdpa/nfp: not in enabled drivers build config 00:04:46.078 vdpa/sfc: not in enabled drivers build config 00:04:46.078 event/*: missing internal dependency, "eventdev" 00:04:46.078 baseband/*: missing internal dependency, "bbdev" 00:04:46.078 gpu/*: missing internal dependency, "gpudev" 00:04:46.078 00:04:46.078 00:04:46.078 Build targets in project: 85 00:04:46.078 00:04:46.078 DPDK 24.03.0 00:04:46.078 00:04:46.078 User defined options 00:04:46.078 buildtype : debug 00:04:46.078 default_library : shared 00:04:46.078 libdir : lib 00:04:46.078 prefix : /home/vagrant/spdk_repo/spdk/dpdk/build 00:04:46.078 c_args : -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds -fPIC -Werror 00:04:46.078 c_link_args : 00:04:46.078 cpu_instruction_set: native 00:04:46.078 disable_apps : dumpcap,graph,pdump,proc-info,test-acl,test-bbdev,test-cmdline,test-compress-perf,test-crypto-perf,test-dma-perf,test-eventdev,test-fib,test-flow-perf,test-gpudev,test-mldev,test-pipeline,test-pmd,test-regex,test-sad,test-security-perf,test 00:04:46.078 disable_libs : acl,argparse,bbdev,bitratestats,bpf,cfgfile,dispatcher,distributor,efd,eventdev,fib,gpudev,graph,gro,gso,ip_frag,ipsec,jobstats,latencystats,lpm,member,metrics,mldev,node,pcapng,pdcp,pdump,pipeline,port,rawdev,regexdev,rib,sched,stack,table 00:04:46.078 enable_docs : false 00:04:46.078 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:04:46.078 enable_kmods : false 00:04:46.078 max_lcores : 128 00:04:46.078 tests : false 00:04:46.078 00:04:46.078 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:04:46.078 ninja: Entering directory `/home/vagrant/spdk_repo/spdk/dpdk/build-tmp' 00:04:46.078 [1/268] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:04:46.078 [2/268] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:04:46.078 [3/268] Linking static target lib/librte_kvargs.a 00:04:46.078 [4/268] Compiling C object lib/librte_log.a.p/log_log.c.o 00:04:46.078 [5/268] Linking static target lib/librte_log.a 00:04:46.078 [6/268] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:04:46.078 [7/268] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:04:46.078 [8/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:04:46.078 [9/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:04:46.078 [10/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:04:46.078 [11/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:04:46.078 [12/268] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:04:46.078 [13/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:04:46.078 [14/268] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:04:46.078 [15/268] Linking static target lib/librte_telemetry.a 00:04:46.078 [16/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:04:46.078 [17/268] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:04:46.078 [18/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:04:46.078 [19/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:04:46.078 [20/268] Linking target lib/librte_log.so.24.1 00:04:46.078 [21/268] Generating symbol file lib/librte_log.so.24.1.p/librte_log.so.24.1.symbols 00:04:46.078 [22/268] Linking target lib/librte_kvargs.so.24.1 00:04:46.371 [23/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:04:46.371 [24/268] Generating symbol file lib/librte_kvargs.so.24.1.p/librte_kvargs.so.24.1.symbols 00:04:46.371 [25/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:04:46.371 [26/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:04:46.637 [27/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:04:46.637 [28/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:04:46.637 [29/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:04:46.637 [30/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:04:46.637 [31/268] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:04:46.637 [32/268] Linking target lib/librte_telemetry.so.24.1 00:04:46.637 [33/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:04:46.894 [34/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:04:46.894 [35/268] Generating symbol file lib/librte_telemetry.so.24.1.p/librte_telemetry.so.24.1.symbols 00:04:46.894 [36/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:04:47.151 [37/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:04:47.408 [38/268] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:04:47.408 [39/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:04:47.408 [40/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:04:47.408 [41/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:04:47.408 [42/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:04:47.408 [43/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:04:47.408 [44/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:04:47.408 [45/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:04:47.666 [46/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:04:47.666 [47/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:04:47.923 [48/268] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:04:47.923 [49/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:04:48.203 [50/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:04:48.204 [51/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:04:48.204 [52/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:04:48.461 [53/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:04:48.461 [54/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:04:48.461 [55/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:04:48.461 [56/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:04:48.461 [57/268] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:04:48.719 [58/268] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:04:48.976 [59/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:04:48.976 [60/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:04:48.977 [61/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:04:48.977 [62/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:04:48.977 [63/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:04:49.234 [64/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:04:49.234 [65/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:04:49.492 [66/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:04:49.492 [67/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:04:49.492 [68/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:04:49.492 [69/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:04:49.750 [70/268] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:04:49.750 [71/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:04:49.750 [72/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:04:49.750 [73/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:04:49.750 [74/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:04:49.750 [75/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:04:49.750 [76/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:04:50.007 [77/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:04:50.007 [78/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:04:50.265 [79/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:04:50.265 [80/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:04:50.265 [81/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:04:50.523 [82/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:04:50.523 [83/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:04:50.523 [84/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:04:50.523 [85/268] Linking static target lib/librte_eal.a 00:04:50.780 [86/268] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:04:50.780 [87/268] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:04:50.780 [88/268] Linking static target lib/librte_rcu.a 00:04:50.780 [89/268] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:04:50.780 [90/268] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:04:50.780 [91/268] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:04:50.780 [92/268] Linking static target lib/librte_ring.a 00:04:51.038 [93/268] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:04:51.038 [94/268] Linking static target lib/librte_mempool.a 00:04:51.038 [95/268] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:04:51.296 [96/268] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:04:51.296 [97/268] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:04:51.296 [98/268] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:04:51.296 [99/268] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:04:51.296 [100/268] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:04:51.296 [101/268] Linking static target lib/net/libnet_crc_avx512_lib.a 00:04:51.566 [102/268] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:04:51.566 [103/268] Linking static target lib/librte_mbuf.a 00:04:51.566 [104/268] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:04:51.837 [105/268] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:04:51.837 [106/268] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:04:51.837 [107/268] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:04:51.837 [108/268] Linking static target lib/librte_meter.a 00:04:52.095 [109/268] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:04:52.095 [110/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:04:52.095 [111/268] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:04:52.354 [112/268] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:04:52.354 [113/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:04:52.354 [114/268] Linking static target lib/librte_net.a 00:04:52.354 [115/268] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:04:52.354 [116/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:04:52.611 [117/268] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:04:52.611 [118/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:04:52.869 [119/268] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:04:52.869 [120/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:04:53.128 [121/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:04:53.418 [122/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:04:53.418 [123/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:04:53.677 [124/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:04:53.677 [125/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:04:53.677 [126/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:04:53.677 [127/268] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:04:53.677 [128/268] Linking static target lib/librte_pci.a 00:04:53.935 [129/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:04:53.935 [130/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:04:53.935 [131/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:04:53.935 [132/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:04:53.935 [133/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:04:53.935 [134/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:04:53.935 [135/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:04:54.193 [136/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:04:54.193 [137/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:04:54.193 [138/268] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:04:54.193 [139/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:04:54.193 [140/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:04:54.193 [141/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:04:54.193 [142/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:04:54.193 [143/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:04:54.193 [144/268] Compiling C object lib/librte_hash.a.p/hash_rte_hash_crc.c.o 00:04:54.451 [145/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_linux_ethtool.c.o 00:04:54.451 [146/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:04:54.451 [147/268] Linking static target lib/librte_ethdev.a 00:04:54.451 [148/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:04:54.710 [149/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:04:54.710 [150/268] Linking static target lib/librte_cmdline.a 00:04:54.710 [151/268] Compiling C object lib/librte_hash.a.p/hash_rte_thash_gfni.c.o 00:04:54.968 [152/268] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:04:54.968 [153/268] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:04:55.227 [154/268] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:04:55.227 [155/268] Linking static target lib/librte_timer.a 00:04:55.227 [156/268] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:04:55.227 [157/268] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:04:55.227 [158/268] Linking static target lib/librte_hash.a 00:04:55.484 [159/268] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:04:55.484 [160/268] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:04:55.484 [161/268] Linking static target lib/librte_compressdev.a 00:04:55.743 [162/268] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:04:55.743 [163/268] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:04:55.743 [164/268] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:04:56.037 [165/268] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:04:56.037 [166/268] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:04:56.294 [167/268] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:04:56.294 [168/268] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:04:56.295 [169/268] Linking static target lib/librte_dmadev.a 00:04:56.295 [170/268] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:04:56.295 [171/268] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:04:56.552 [172/268] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:04:56.552 [173/268] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:04:56.552 [174/268] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:04:56.552 [175/268] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:04:56.552 [176/268] Linking static target lib/librte_cryptodev.a 00:04:56.552 [177/268] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:04:56.809 [178/268] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:04:57.066 [179/268] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:04:57.067 [180/268] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:04:57.067 [181/268] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:04:57.067 [182/268] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:04:57.324 [183/268] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:04:57.324 [184/268] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:04:57.324 [185/268] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:04:57.324 [186/268] Linking static target lib/librte_power.a 00:04:57.582 [187/268] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:04:57.839 [188/268] Linking static target lib/librte_reorder.a 00:04:57.839 [189/268] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:04:57.839 [190/268] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:04:57.839 [191/268] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:04:57.839 [192/268] Linking static target lib/librte_security.a 00:04:58.096 [193/268] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:04:58.354 [194/268] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:04:58.354 [195/268] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:04:58.611 [196/268] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:04:58.611 [197/268] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:04:58.869 [198/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:04:58.869 [199/268] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:04:59.128 [200/268] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:04:59.128 [201/268] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:04:59.386 [202/268] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:04:59.386 [203/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:04:59.644 [204/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:04:59.644 [205/268] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:04:59.644 [206/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:04:59.902 [207/268] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:04:59.902 [208/268] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:04:59.902 [209/268] Linking static target drivers/libtmp_rte_bus_vdev.a 00:04:59.902 [210/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:04:59.902 [211/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:05:00.160 [212/268] Linking static target drivers/libtmp_rte_bus_pci.a 00:05:00.160 [213/268] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:05:00.160 [214/268] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:05:00.160 [215/268] Linking static target drivers/librte_bus_vdev.a 00:05:00.160 [216/268] Compiling C object drivers/librte_bus_vdev.so.24.1.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:05:00.160 [217/268] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:05:00.160 [218/268] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:05:00.419 [219/268] Compiling C object drivers/librte_bus_pci.so.24.1.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:05:00.419 [220/268] Linking static target drivers/librte_bus_pci.a 00:05:00.419 [221/268] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:05:00.419 [222/268] Linking static target drivers/libtmp_rte_mempool_ring.a 00:05:00.419 [223/268] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:05:00.419 [224/268] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:05:00.677 [225/268] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:05:00.677 [226/268] Compiling C object drivers/librte_mempool_ring.so.24.1.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:05:00.677 [227/268] Linking static target drivers/librte_mempool_ring.a 00:05:00.937 [228/268] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:05:01.195 [229/268] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:05:01.195 [230/268] Linking static target lib/librte_vhost.a 00:05:02.129 [231/268] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:05:02.129 [232/268] Linking target lib/librte_eal.so.24.1 00:05:02.386 [233/268] Generating symbol file lib/librte_eal.so.24.1.p/librte_eal.so.24.1.symbols 00:05:02.386 [234/268] Linking target lib/librte_pci.so.24.1 00:05:02.386 [235/268] Linking target lib/librte_timer.so.24.1 00:05:02.386 [236/268] Linking target lib/librte_meter.so.24.1 00:05:02.386 [237/268] Linking target lib/librte_ring.so.24.1 00:05:02.386 [238/268] Linking target lib/librte_dmadev.so.24.1 00:05:02.386 [239/268] Linking target drivers/librte_bus_vdev.so.24.1 00:05:02.645 [240/268] Generating symbol file lib/librte_ring.so.24.1.p/librte_ring.so.24.1.symbols 00:05:02.645 [241/268] Generating symbol file lib/librte_dmadev.so.24.1.p/librte_dmadev.so.24.1.symbols 00:05:02.645 [242/268] Generating symbol file lib/librte_pci.so.24.1.p/librte_pci.so.24.1.symbols 00:05:02.645 [243/268] Generating symbol file lib/librte_timer.so.24.1.p/librte_timer.so.24.1.symbols 00:05:02.645 [244/268] Linking target lib/librte_mempool.so.24.1 00:05:02.645 [245/268] Generating symbol file lib/librte_meter.so.24.1.p/librte_meter.so.24.1.symbols 00:05:02.645 [246/268] Linking target drivers/librte_bus_pci.so.24.1 00:05:02.645 [247/268] Linking target lib/librte_rcu.so.24.1 00:05:02.645 [248/268] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:05:02.645 [249/268] Generating symbol file lib/librte_mempool.so.24.1.p/librte_mempool.so.24.1.symbols 00:05:02.903 [250/268] Generating symbol file lib/librte_rcu.so.24.1.p/librte_rcu.so.24.1.symbols 00:05:02.903 [251/268] Linking target drivers/librte_mempool_ring.so.24.1 00:05:02.903 [252/268] Linking target lib/librte_mbuf.so.24.1 00:05:02.903 [253/268] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:05:02.903 [254/268] Generating symbol file lib/librte_mbuf.so.24.1.p/librte_mbuf.so.24.1.symbols 00:05:02.903 [255/268] Linking target lib/librte_compressdev.so.24.1 00:05:02.903 [256/268] Linking target lib/librte_reorder.so.24.1 00:05:02.903 [257/268] Linking target lib/librte_net.so.24.1 00:05:02.903 [258/268] Linking target lib/librte_cryptodev.so.24.1 00:05:03.161 [259/268] Generating symbol file lib/librte_cryptodev.so.24.1.p/librte_cryptodev.so.24.1.symbols 00:05:03.161 [260/268] Generating symbol file lib/librte_net.so.24.1.p/librte_net.so.24.1.symbols 00:05:03.161 [261/268] Linking target lib/librte_security.so.24.1 00:05:03.161 [262/268] Linking target lib/librte_hash.so.24.1 00:05:03.161 [263/268] Linking target lib/librte_cmdline.so.24.1 00:05:03.161 [264/268] Linking target lib/librte_ethdev.so.24.1 00:05:03.420 [265/268] Generating symbol file lib/librte_hash.so.24.1.p/librte_hash.so.24.1.symbols 00:05:03.420 [266/268] Generating symbol file lib/librte_ethdev.so.24.1.p/librte_ethdev.so.24.1.symbols 00:05:03.420 [267/268] Linking target lib/librte_power.so.24.1 00:05:03.420 [268/268] Linking target lib/librte_vhost.so.24.1 00:05:03.420 INFO: autodetecting backend as ninja 00:05:03.420 INFO: calculating backend command to run: /usr/local/bin/ninja -C /home/vagrant/spdk_repo/spdk/dpdk/build-tmp -j 10 00:05:29.964 CC lib/ut/ut.o 00:05:29.964 CC lib/log/log.o 00:05:29.964 CC lib/log/log_flags.o 00:05:29.964 CC lib/log/log_deprecated.o 00:05:29.964 CC lib/ut_mock/mock.o 00:05:29.964 LIB libspdk_ut.a 00:05:29.964 SO libspdk_ut.so.2.0 00:05:29.964 LIB libspdk_ut_mock.a 00:05:29.964 SO libspdk_ut_mock.so.6.0 00:05:29.964 LIB libspdk_log.a 00:05:29.964 SYMLINK libspdk_ut.so 00:05:29.964 SYMLINK libspdk_ut_mock.so 00:05:29.964 SO libspdk_log.so.7.0 00:05:29.964 SYMLINK libspdk_log.so 00:05:29.964 CXX lib/trace_parser/trace.o 00:05:29.964 CC lib/dma/dma.o 00:05:29.964 CC lib/util/base64.o 00:05:29.964 CC lib/util/cpuset.o 00:05:29.964 CC lib/util/bit_array.o 00:05:29.964 CC lib/util/crc32.o 00:05:29.964 CC lib/util/crc16.o 00:05:29.964 CC lib/util/crc32c.o 00:05:29.964 CC lib/ioat/ioat.o 00:05:29.964 CC lib/vfio_user/host/vfio_user_pci.o 00:05:29.964 CC lib/util/crc32_ieee.o 00:05:29.964 CC lib/util/crc64.o 00:05:29.964 CC lib/util/dif.o 00:05:29.964 CC lib/util/fd.o 00:05:29.964 CC lib/vfio_user/host/vfio_user.o 00:05:29.964 LIB libspdk_dma.a 00:05:29.964 CC lib/util/fd_group.o 00:05:29.964 CC lib/util/file.o 00:05:29.964 CC lib/util/hexlify.o 00:05:29.964 SO libspdk_dma.so.5.0 00:05:29.964 CC lib/util/iov.o 00:05:29.964 SYMLINK libspdk_dma.so 00:05:29.964 CC lib/util/math.o 00:05:29.964 LIB libspdk_ioat.a 00:05:29.964 CC lib/util/net.o 00:05:29.964 CC lib/util/pipe.o 00:05:29.964 SO libspdk_ioat.so.7.0 00:05:29.964 CC lib/util/strerror_tls.o 00:05:29.964 CC lib/util/string.o 00:05:29.964 LIB libspdk_vfio_user.a 00:05:29.964 CC lib/util/uuid.o 00:05:29.964 SYMLINK libspdk_ioat.so 00:05:29.964 CC lib/util/xor.o 00:05:29.964 SO libspdk_vfio_user.so.5.0 00:05:29.964 CC lib/util/zipf.o 00:05:29.964 CC lib/util/md5.o 00:05:29.964 SYMLINK libspdk_vfio_user.so 00:05:29.964 LIB libspdk_util.a 00:05:30.222 SO libspdk_util.so.10.0 00:05:30.222 SYMLINK libspdk_util.so 00:05:30.479 LIB libspdk_trace_parser.a 00:05:30.479 SO libspdk_trace_parser.so.6.0 00:05:30.479 SYMLINK libspdk_trace_parser.so 00:05:30.479 CC lib/rdma_utils/rdma_utils.o 00:05:30.479 CC lib/conf/conf.o 00:05:30.479 CC lib/idxd/idxd.o 00:05:30.479 CC lib/idxd/idxd_user.o 00:05:30.479 CC lib/vmd/vmd.o 00:05:30.479 CC lib/idxd/idxd_kernel.o 00:05:30.479 CC lib/json/json_parse.o 00:05:30.479 CC lib/json/json_util.o 00:05:30.479 CC lib/env_dpdk/env.o 00:05:30.479 CC lib/rdma_provider/common.o 00:05:30.738 LIB libspdk_conf.a 00:05:30.738 SO libspdk_conf.so.6.0 00:05:30.996 LIB libspdk_rdma_utils.a 00:05:30.996 CC lib/env_dpdk/memory.o 00:05:30.996 CC lib/env_dpdk/pci.o 00:05:30.996 SO libspdk_rdma_utils.so.1.0 00:05:30.996 SYMLINK libspdk_conf.so 00:05:30.996 CC lib/json/json_write.o 00:05:30.996 SYMLINK libspdk_rdma_utils.so 00:05:30.996 CC lib/rdma_provider/rdma_provider_verbs.o 00:05:30.996 CC lib/env_dpdk/init.o 00:05:30.996 CC lib/vmd/led.o 00:05:30.996 CC lib/env_dpdk/threads.o 00:05:31.254 LIB libspdk_rdma_provider.a 00:05:31.254 SO libspdk_rdma_provider.so.6.0 00:05:31.254 CC lib/env_dpdk/pci_ioat.o 00:05:31.254 SYMLINK libspdk_rdma_provider.so 00:05:31.254 LIB libspdk_vmd.a 00:05:31.254 CC lib/env_dpdk/pci_virtio.o 00:05:31.254 CC lib/env_dpdk/pci_vmd.o 00:05:31.254 SO libspdk_vmd.so.6.0 00:05:31.254 CC lib/env_dpdk/pci_idxd.o 00:05:31.254 CC lib/env_dpdk/pci_event.o 00:05:31.513 SYMLINK libspdk_vmd.so 00:05:31.513 CC lib/env_dpdk/sigbus_handler.o 00:05:31.513 LIB libspdk_json.a 00:05:31.513 CC lib/env_dpdk/pci_dpdk.o 00:05:31.513 CC lib/env_dpdk/pci_dpdk_2207.o 00:05:31.513 SO libspdk_json.so.6.0 00:05:31.513 CC lib/env_dpdk/pci_dpdk_2211.o 00:05:31.513 SYMLINK libspdk_json.so 00:05:31.513 LIB libspdk_idxd.a 00:05:31.771 SO libspdk_idxd.so.12.1 00:05:31.771 SYMLINK libspdk_idxd.so 00:05:31.771 CC lib/jsonrpc/jsonrpc_server.o 00:05:31.771 CC lib/jsonrpc/jsonrpc_client.o 00:05:31.771 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:05:31.771 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:05:32.029 LIB libspdk_jsonrpc.a 00:05:32.029 SO libspdk_jsonrpc.so.6.0 00:05:32.029 LIB libspdk_env_dpdk.a 00:05:32.287 SYMLINK libspdk_jsonrpc.so 00:05:32.287 SO libspdk_env_dpdk.so.15.0 00:05:32.287 SYMLINK libspdk_env_dpdk.so 00:05:32.545 CC lib/rpc/rpc.o 00:05:32.803 LIB libspdk_rpc.a 00:05:32.803 SO libspdk_rpc.so.6.0 00:05:32.803 SYMLINK libspdk_rpc.so 00:05:33.061 CC lib/notify/notify.o 00:05:33.061 CC lib/notify/notify_rpc.o 00:05:33.061 CC lib/keyring/keyring.o 00:05:33.061 CC lib/keyring/keyring_rpc.o 00:05:33.061 CC lib/trace/trace.o 00:05:33.061 CC lib/trace/trace_flags.o 00:05:33.061 CC lib/trace/trace_rpc.o 00:05:33.319 LIB libspdk_notify.a 00:05:33.319 SO libspdk_notify.so.6.0 00:05:33.319 SYMLINK libspdk_notify.so 00:05:33.319 LIB libspdk_trace.a 00:05:33.319 SO libspdk_trace.so.11.0 00:05:33.319 LIB libspdk_keyring.a 00:05:33.319 SYMLINK libspdk_trace.so 00:05:33.319 SO libspdk_keyring.so.2.0 00:05:33.577 SYMLINK libspdk_keyring.so 00:05:33.577 CC lib/thread/thread.o 00:05:33.577 CC lib/thread/iobuf.o 00:05:33.577 CC lib/sock/sock.o 00:05:33.577 CC lib/sock/sock_rpc.o 00:05:34.511 LIB libspdk_sock.a 00:05:34.511 SO libspdk_sock.so.10.0 00:05:34.511 SYMLINK libspdk_sock.so 00:05:34.769 CC lib/nvme/nvme_ctrlr_cmd.o 00:05:34.769 CC lib/nvme/nvme_ctrlr.o 00:05:34.769 CC lib/nvme/nvme_fabric.o 00:05:34.769 CC lib/nvme/nvme_ns.o 00:05:34.769 CC lib/nvme/nvme_ns_cmd.o 00:05:34.769 CC lib/nvme/nvme_pcie_common.o 00:05:34.769 CC lib/nvme/nvme_pcie.o 00:05:34.769 CC lib/nvme/nvme_qpair.o 00:05:34.769 CC lib/nvme/nvme.o 00:05:35.702 CC lib/nvme/nvme_quirks.o 00:05:35.702 LIB libspdk_thread.a 00:05:35.702 CC lib/nvme/nvme_transport.o 00:05:35.702 CC lib/nvme/nvme_discovery.o 00:05:35.702 SO libspdk_thread.so.10.2 00:05:35.959 SYMLINK libspdk_thread.so 00:05:35.959 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:05:35.959 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:05:35.959 CC lib/nvme/nvme_tcp.o 00:05:36.217 CC lib/nvme/nvme_opal.o 00:05:36.476 CC lib/nvme/nvme_io_msg.o 00:05:36.476 CC lib/nvme/nvme_poll_group.o 00:05:36.734 CC lib/nvme/nvme_zns.o 00:05:36.734 CC lib/accel/accel.o 00:05:36.734 CC lib/nvme/nvme_stubs.o 00:05:36.734 CC lib/nvme/nvme_auth.o 00:05:36.992 CC lib/nvme/nvme_cuse.o 00:05:37.557 CC lib/blob/blobstore.o 00:05:37.557 CC lib/init/json_config.o 00:05:37.557 CC lib/virtio/virtio.o 00:05:37.557 CC lib/fsdev/fsdev.o 00:05:37.844 CC lib/fsdev/fsdev_io.o 00:05:37.844 CC lib/init/subsystem.o 00:05:37.844 CC lib/virtio/virtio_vhost_user.o 00:05:38.102 CC lib/fsdev/fsdev_rpc.o 00:05:38.102 CC lib/init/subsystem_rpc.o 00:05:38.102 CC lib/accel/accel_rpc.o 00:05:38.361 CC lib/accel/accel_sw.o 00:05:38.361 CC lib/init/rpc.o 00:05:38.361 CC lib/virtio/virtio_vfio_user.o 00:05:38.361 CC lib/virtio/virtio_pci.o 00:05:38.361 CC lib/nvme/nvme_rdma.o 00:05:38.361 CC lib/blob/request.o 00:05:38.361 CC lib/blob/zeroes.o 00:05:38.620 LIB libspdk_fsdev.a 00:05:38.620 LIB libspdk_init.a 00:05:38.620 SO libspdk_init.so.6.0 00:05:38.620 SO libspdk_fsdev.so.1.0 00:05:38.620 CC lib/blob/blob_bs_dev.o 00:05:38.620 LIB libspdk_accel.a 00:05:38.620 SYMLINK libspdk_init.so 00:05:38.620 SO libspdk_accel.so.16.0 00:05:38.620 SYMLINK libspdk_fsdev.so 00:05:38.878 LIB libspdk_virtio.a 00:05:38.878 SYMLINK libspdk_accel.so 00:05:38.878 SO libspdk_virtio.so.7.0 00:05:38.878 CC lib/event/app.o 00:05:38.878 CC lib/event/reactor.o 00:05:38.878 CC lib/event/log_rpc.o 00:05:38.878 CC lib/event/app_rpc.o 00:05:38.878 SYMLINK libspdk_virtio.so 00:05:38.878 CC lib/event/scheduler_static.o 00:05:38.878 CC lib/fuse_dispatcher/fuse_dispatcher.o 00:05:39.136 CC lib/bdev/bdev.o 00:05:39.136 CC lib/bdev/bdev_rpc.o 00:05:39.136 CC lib/bdev/bdev_zone.o 00:05:39.136 CC lib/bdev/part.o 00:05:39.136 CC lib/bdev/scsi_nvme.o 00:05:39.703 LIB libspdk_event.a 00:05:39.703 LIB libspdk_fuse_dispatcher.a 00:05:39.703 SO libspdk_event.so.15.0 00:05:39.703 SO libspdk_fuse_dispatcher.so.1.0 00:05:39.703 SYMLINK libspdk_fuse_dispatcher.so 00:05:39.703 SYMLINK libspdk_event.so 00:05:40.269 LIB libspdk_nvme.a 00:05:40.269 SO libspdk_nvme.so.14.0 00:05:40.527 SYMLINK libspdk_nvme.so 00:05:41.461 LIB libspdk_blob.a 00:05:41.461 SO libspdk_blob.so.11.0 00:05:41.461 SYMLINK libspdk_blob.so 00:05:41.719 CC lib/lvol/lvol.o 00:05:41.719 CC lib/blobfs/blobfs.o 00:05:41.719 CC lib/blobfs/tree.o 00:05:41.976 LIB libspdk_bdev.a 00:05:42.234 SO libspdk_bdev.so.17.0 00:05:42.234 SYMLINK libspdk_bdev.so 00:05:42.492 CC lib/nvmf/ctrlr_discovery.o 00:05:42.492 CC lib/nvmf/ctrlr.o 00:05:42.492 CC lib/nvmf/ctrlr_bdev.o 00:05:42.492 CC lib/nvmf/subsystem.o 00:05:42.492 CC lib/scsi/dev.o 00:05:42.492 CC lib/ftl/ftl_core.o 00:05:42.492 CC lib/nbd/nbd.o 00:05:42.492 CC lib/ublk/ublk.o 00:05:42.752 LIB libspdk_blobfs.a 00:05:42.752 SO libspdk_blobfs.so.10.0 00:05:42.752 CC lib/scsi/lun.o 00:05:42.752 SYMLINK libspdk_blobfs.so 00:05:42.752 CC lib/scsi/port.o 00:05:43.030 LIB libspdk_lvol.a 00:05:43.030 SO libspdk_lvol.so.10.0 00:05:43.030 SYMLINK libspdk_lvol.so 00:05:43.030 CC lib/scsi/scsi.o 00:05:43.288 CC lib/nbd/nbd_rpc.o 00:05:43.288 CC lib/ftl/ftl_init.o 00:05:43.288 CC lib/ftl/ftl_layout.o 00:05:43.288 CC lib/scsi/scsi_bdev.o 00:05:43.288 CC lib/nvmf/nvmf.o 00:05:43.288 CC lib/nvmf/nvmf_rpc.o 00:05:43.288 CC lib/ublk/ublk_rpc.o 00:05:43.288 CC lib/ftl/ftl_debug.o 00:05:43.546 CC lib/ftl/ftl_io.o 00:05:43.546 LIB libspdk_nbd.a 00:05:43.546 SO libspdk_nbd.so.7.0 00:05:43.546 SYMLINK libspdk_nbd.so 00:05:43.546 CC lib/ftl/ftl_sb.o 00:05:43.803 LIB libspdk_ublk.a 00:05:43.803 CC lib/ftl/ftl_l2p.o 00:05:43.803 SO libspdk_ublk.so.3.0 00:05:43.803 CC lib/ftl/ftl_l2p_flat.o 00:05:43.803 CC lib/scsi/scsi_pr.o 00:05:43.803 SYMLINK libspdk_ublk.so 00:05:43.803 CC lib/scsi/scsi_rpc.o 00:05:43.803 CC lib/ftl/ftl_nv_cache.o 00:05:44.062 CC lib/ftl/ftl_band.o 00:05:44.062 CC lib/ftl/ftl_band_ops.o 00:05:44.062 CC lib/ftl/ftl_writer.o 00:05:44.062 CC lib/ftl/ftl_rq.o 00:05:44.062 CC lib/scsi/task.o 00:05:44.320 CC lib/ftl/ftl_reloc.o 00:05:44.320 CC lib/ftl/ftl_l2p_cache.o 00:05:44.320 CC lib/ftl/ftl_p2l.o 00:05:44.320 CC lib/ftl/ftl_p2l_log.o 00:05:44.320 CC lib/ftl/mngt/ftl_mngt.o 00:05:44.320 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:05:44.320 LIB libspdk_scsi.a 00:05:44.320 CC lib/nvmf/transport.o 00:05:44.320 CC lib/nvmf/tcp.o 00:05:44.577 SO libspdk_scsi.so.9.0 00:05:44.577 SYMLINK libspdk_scsi.so 00:05:44.577 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:05:44.577 CC lib/nvmf/stubs.o 00:05:44.577 CC lib/ftl/mngt/ftl_mngt_startup.o 00:05:44.835 CC lib/nvmf/mdns_server.o 00:05:44.835 CC lib/nvmf/rdma.o 00:05:44.835 CC lib/nvmf/auth.o 00:05:44.835 CC lib/ftl/mngt/ftl_mngt_md.o 00:05:44.835 CC lib/iscsi/conn.o 00:05:45.094 CC lib/ftl/mngt/ftl_mngt_misc.o 00:05:45.094 CC lib/vhost/vhost.o 00:05:45.094 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:05:45.353 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:05:45.353 CC lib/ftl/mngt/ftl_mngt_band.o 00:05:45.353 CC lib/iscsi/init_grp.o 00:05:45.353 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:05:45.610 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:05:45.610 CC lib/vhost/vhost_rpc.o 00:05:45.610 CC lib/vhost/vhost_scsi.o 00:05:45.610 CC lib/vhost/vhost_blk.o 00:05:45.869 CC lib/vhost/rte_vhost_user.o 00:05:45.869 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:05:45.869 CC lib/iscsi/iscsi.o 00:05:46.127 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:05:46.127 CC lib/ftl/utils/ftl_conf.o 00:05:46.385 CC lib/ftl/utils/ftl_md.o 00:05:46.385 CC lib/ftl/utils/ftl_mempool.o 00:05:46.385 CC lib/iscsi/param.o 00:05:46.385 CC lib/ftl/utils/ftl_bitmap.o 00:05:46.642 CC lib/ftl/utils/ftl_property.o 00:05:46.642 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:05:46.900 CC lib/iscsi/portal_grp.o 00:05:46.900 CC lib/iscsi/tgt_node.o 00:05:46.900 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:05:46.900 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:05:46.900 CC lib/iscsi/iscsi_subsystem.o 00:05:47.158 CC lib/iscsi/iscsi_rpc.o 00:05:47.158 LIB libspdk_vhost.a 00:05:47.158 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:05:47.158 CC lib/iscsi/task.o 00:05:47.158 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:05:47.158 SO libspdk_vhost.so.8.0 00:05:47.158 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:05:47.416 SYMLINK libspdk_vhost.so 00:05:47.416 CC lib/ftl/upgrade/ftl_trim_upgrade.o 00:05:47.416 CC lib/ftl/upgrade/ftl_sb_v3.o 00:05:47.416 CC lib/ftl/upgrade/ftl_sb_v5.o 00:05:47.416 CC lib/ftl/nvc/ftl_nvc_dev.o 00:05:47.416 LIB libspdk_nvmf.a 00:05:47.416 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:05:47.416 CC lib/ftl/nvc/ftl_nvc_bdev_non_vss.o 00:05:47.416 CC lib/ftl/nvc/ftl_nvc_bdev_common.o 00:05:47.417 CC lib/ftl/base/ftl_base_dev.o 00:05:47.417 CC lib/ftl/base/ftl_base_bdev.o 00:05:47.417 SO libspdk_nvmf.so.19.0 00:05:47.674 CC lib/ftl/ftl_trace.o 00:05:47.674 LIB libspdk_iscsi.a 00:05:47.674 SYMLINK libspdk_nvmf.so 00:05:47.674 SO libspdk_iscsi.so.8.0 00:05:47.932 LIB libspdk_ftl.a 00:05:47.932 SYMLINK libspdk_iscsi.so 00:05:48.190 SO libspdk_ftl.so.9.0 00:05:48.755 SYMLINK libspdk_ftl.so 00:05:49.014 CC module/env_dpdk/env_dpdk_rpc.o 00:05:49.014 CC module/blob/bdev/blob_bdev.o 00:05:49.014 CC module/sock/posix/posix.o 00:05:49.014 CC module/fsdev/aio/fsdev_aio.o 00:05:49.014 CC module/keyring/linux/keyring.o 00:05:49.014 CC module/accel/dsa/accel_dsa.o 00:05:49.014 CC module/accel/error/accel_error.o 00:05:49.014 CC module/keyring/file/keyring.o 00:05:49.014 CC module/scheduler/dynamic/scheduler_dynamic.o 00:05:49.014 CC module/accel/ioat/accel_ioat.o 00:05:49.272 LIB libspdk_env_dpdk_rpc.a 00:05:49.272 SO libspdk_env_dpdk_rpc.so.6.0 00:05:49.272 SYMLINK libspdk_env_dpdk_rpc.so 00:05:49.272 CC module/keyring/file/keyring_rpc.o 00:05:49.272 CC module/keyring/linux/keyring_rpc.o 00:05:49.272 CC module/accel/error/accel_error_rpc.o 00:05:49.530 CC module/fsdev/aio/fsdev_aio_rpc.o 00:05:49.530 CC module/accel/ioat/accel_ioat_rpc.o 00:05:49.530 LIB libspdk_scheduler_dynamic.a 00:05:49.530 SO libspdk_scheduler_dynamic.so.4.0 00:05:49.530 LIB libspdk_blob_bdev.a 00:05:49.530 LIB libspdk_keyring_file.a 00:05:49.530 SO libspdk_blob_bdev.so.11.0 00:05:49.530 LIB libspdk_keyring_linux.a 00:05:49.530 SO libspdk_keyring_file.so.2.0 00:05:49.530 CC module/accel/dsa/accel_dsa_rpc.o 00:05:49.530 SO libspdk_keyring_linux.so.1.0 00:05:49.788 LIB libspdk_accel_error.a 00:05:49.788 SYMLINK libspdk_scheduler_dynamic.so 00:05:49.788 SYMLINK libspdk_keyring_file.so 00:05:49.788 SYMLINK libspdk_blob_bdev.so 00:05:49.788 LIB libspdk_accel_ioat.a 00:05:49.788 SO libspdk_accel_error.so.2.0 00:05:49.788 CC module/fsdev/aio/linux_aio_mgr.o 00:05:49.788 SYMLINK libspdk_keyring_linux.so 00:05:49.788 SO libspdk_accel_ioat.so.6.0 00:05:49.788 LIB libspdk_accel_dsa.a 00:05:49.788 SYMLINK libspdk_accel_error.so 00:05:49.788 SO libspdk_accel_dsa.so.5.0 00:05:49.788 SYMLINK libspdk_accel_ioat.so 00:05:50.046 SYMLINK libspdk_accel_dsa.so 00:05:50.046 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:05:50.046 CC module/sock/uring/uring.o 00:05:50.046 CC module/accel/iaa/accel_iaa.o 00:05:50.046 CC module/bdev/delay/vbdev_delay.o 00:05:50.046 CC module/scheduler/gscheduler/gscheduler.o 00:05:50.304 CC module/bdev/error/vbdev_error.o 00:05:50.304 LIB libspdk_scheduler_dpdk_governor.a 00:05:50.304 CC module/blobfs/bdev/blobfs_bdev.o 00:05:50.304 SO libspdk_scheduler_dpdk_governor.so.4.0 00:05:50.304 CC module/bdev/gpt/gpt.o 00:05:50.304 LIB libspdk_fsdev_aio.a 00:05:50.304 SYMLINK libspdk_scheduler_dpdk_governor.so 00:05:50.304 CC module/bdev/gpt/vbdev_gpt.o 00:05:50.304 SO libspdk_fsdev_aio.so.1.0 00:05:50.304 LIB libspdk_sock_posix.a 00:05:50.562 CC module/accel/iaa/accel_iaa_rpc.o 00:05:50.562 LIB libspdk_scheduler_gscheduler.a 00:05:50.562 SYMLINK libspdk_fsdev_aio.so 00:05:50.562 CC module/bdev/error/vbdev_error_rpc.o 00:05:50.562 SO libspdk_sock_posix.so.6.0 00:05:50.562 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:05:50.562 SO libspdk_scheduler_gscheduler.so.4.0 00:05:50.562 CC module/bdev/delay/vbdev_delay_rpc.o 00:05:50.562 SYMLINK libspdk_scheduler_gscheduler.so 00:05:50.562 SYMLINK libspdk_sock_posix.so 00:05:50.562 LIB libspdk_bdev_error.a 00:05:50.562 LIB libspdk_bdev_gpt.a 00:05:50.819 LIB libspdk_accel_iaa.a 00:05:50.819 SO libspdk_bdev_error.so.6.0 00:05:50.819 SO libspdk_bdev_gpt.so.6.0 00:05:50.819 SO libspdk_accel_iaa.so.3.0 00:05:50.819 LIB libspdk_bdev_delay.a 00:05:50.819 SYMLINK libspdk_bdev_error.so 00:05:50.819 LIB libspdk_blobfs_bdev.a 00:05:50.819 SYMLINK libspdk_bdev_gpt.so 00:05:50.819 CC module/bdev/lvol/vbdev_lvol.o 00:05:50.819 SYMLINK libspdk_accel_iaa.so 00:05:50.819 SO libspdk_bdev_delay.so.6.0 00:05:50.819 CC module/bdev/malloc/bdev_malloc.o 00:05:50.819 CC module/bdev/null/bdev_null.o 00:05:50.819 SO libspdk_blobfs_bdev.so.6.0 00:05:50.819 CC module/bdev/nvme/bdev_nvme.o 00:05:51.077 SYMLINK libspdk_bdev_delay.so 00:05:51.077 CC module/bdev/nvme/bdev_nvme_rpc.o 00:05:51.077 SYMLINK libspdk_blobfs_bdev.so 00:05:51.077 CC module/bdev/malloc/bdev_malloc_rpc.o 00:05:51.077 CC module/bdev/passthru/vbdev_passthru.o 00:05:51.077 CC module/bdev/split/vbdev_split.o 00:05:51.077 CC module/bdev/raid/bdev_raid.o 00:05:51.335 LIB libspdk_sock_uring.a 00:05:51.335 CC module/bdev/null/bdev_null_rpc.o 00:05:51.335 SO libspdk_sock_uring.so.5.0 00:05:51.335 CC module/bdev/split/vbdev_split_rpc.o 00:05:51.335 LIB libspdk_bdev_malloc.a 00:05:51.335 SYMLINK libspdk_sock_uring.so 00:05:51.335 CC module/bdev/raid/bdev_raid_rpc.o 00:05:51.335 SO libspdk_bdev_malloc.so.6.0 00:05:51.623 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:05:51.623 LIB libspdk_bdev_null.a 00:05:51.623 CC module/bdev/raid/bdev_raid_sb.o 00:05:51.623 SYMLINK libspdk_bdev_malloc.so 00:05:51.623 SO libspdk_bdev_null.so.6.0 00:05:51.623 LIB libspdk_bdev_split.a 00:05:51.623 SO libspdk_bdev_split.so.6.0 00:05:51.623 SYMLINK libspdk_bdev_null.so 00:05:51.623 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:05:51.623 SYMLINK libspdk_bdev_split.so 00:05:51.881 CC module/bdev/zone_block/vbdev_zone_block.o 00:05:51.881 CC module/bdev/raid/raid0.o 00:05:51.881 CC module/bdev/uring/bdev_uring.o 00:05:51.881 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:05:51.881 CC module/bdev/aio/bdev_aio.o 00:05:52.139 LIB libspdk_bdev_passthru.a 00:05:52.139 LIB libspdk_bdev_lvol.a 00:05:52.139 CC module/bdev/ftl/bdev_ftl.o 00:05:52.139 SO libspdk_bdev_passthru.so.6.0 00:05:52.139 SO libspdk_bdev_lvol.so.6.0 00:05:52.139 CC module/bdev/uring/bdev_uring_rpc.o 00:05:52.139 SYMLINK libspdk_bdev_passthru.so 00:05:52.139 SYMLINK libspdk_bdev_lvol.so 00:05:52.139 CC module/bdev/raid/raid1.o 00:05:52.397 LIB libspdk_bdev_zone_block.a 00:05:52.397 SO libspdk_bdev_zone_block.so.6.0 00:05:52.397 CC module/bdev/nvme/nvme_rpc.o 00:05:52.397 LIB libspdk_bdev_uring.a 00:05:52.397 CC module/bdev/ftl/bdev_ftl_rpc.o 00:05:52.397 SYMLINK libspdk_bdev_zone_block.so 00:05:52.397 CC module/bdev/raid/concat.o 00:05:52.397 SO libspdk_bdev_uring.so.6.0 00:05:52.397 CC module/bdev/virtio/bdev_virtio_scsi.o 00:05:52.397 CC module/bdev/iscsi/bdev_iscsi.o 00:05:52.397 SYMLINK libspdk_bdev_uring.so 00:05:52.397 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:05:52.655 CC module/bdev/nvme/bdev_mdns_client.o 00:05:52.655 CC module/bdev/aio/bdev_aio_rpc.o 00:05:52.655 CC module/bdev/virtio/bdev_virtio_blk.o 00:05:52.655 CC module/bdev/nvme/vbdev_opal.o 00:05:52.655 LIB libspdk_bdev_raid.a 00:05:52.656 CC module/bdev/virtio/bdev_virtio_rpc.o 00:05:52.914 LIB libspdk_bdev_ftl.a 00:05:52.914 SO libspdk_bdev_raid.so.6.0 00:05:52.914 SO libspdk_bdev_ftl.so.6.0 00:05:52.914 LIB libspdk_bdev_aio.a 00:05:52.914 CC module/bdev/nvme/vbdev_opal_rpc.o 00:05:52.914 SO libspdk_bdev_aio.so.6.0 00:05:52.914 SYMLINK libspdk_bdev_ftl.so 00:05:52.914 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:05:52.914 SYMLINK libspdk_bdev_raid.so 00:05:53.173 SYMLINK libspdk_bdev_aio.so 00:05:53.173 LIB libspdk_bdev_iscsi.a 00:05:53.173 SO libspdk_bdev_iscsi.so.6.0 00:05:53.173 SYMLINK libspdk_bdev_iscsi.so 00:05:53.431 LIB libspdk_bdev_virtio.a 00:05:53.431 SO libspdk_bdev_virtio.so.6.0 00:05:53.431 SYMLINK libspdk_bdev_virtio.so 00:05:53.997 LIB libspdk_bdev_nvme.a 00:05:53.997 SO libspdk_bdev_nvme.so.7.0 00:05:53.997 SYMLINK libspdk_bdev_nvme.so 00:05:54.563 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:05:54.563 CC module/event/subsystems/iobuf/iobuf.o 00:05:54.563 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:05:54.563 CC module/event/subsystems/keyring/keyring.o 00:05:54.563 CC module/event/subsystems/vmd/vmd.o 00:05:54.563 CC module/event/subsystems/vmd/vmd_rpc.o 00:05:54.563 CC module/event/subsystems/sock/sock.o 00:05:54.563 CC module/event/subsystems/fsdev/fsdev.o 00:05:54.563 CC module/event/subsystems/scheduler/scheduler.o 00:05:54.822 LIB libspdk_event_keyring.a 00:05:54.822 LIB libspdk_event_vhost_blk.a 00:05:54.822 LIB libspdk_event_sock.a 00:05:54.822 LIB libspdk_event_vmd.a 00:05:54.822 LIB libspdk_event_scheduler.a 00:05:54.822 SO libspdk_event_keyring.so.1.0 00:05:54.822 SO libspdk_event_vhost_blk.so.3.0 00:05:54.822 LIB libspdk_event_iobuf.a 00:05:54.822 SO libspdk_event_scheduler.so.4.0 00:05:54.822 SO libspdk_event_sock.so.5.0 00:05:54.822 SO libspdk_event_vmd.so.6.0 00:05:54.822 LIB libspdk_event_fsdev.a 00:05:54.822 SO libspdk_event_iobuf.so.3.0 00:05:54.822 SO libspdk_event_fsdev.so.1.0 00:05:54.822 SYMLINK libspdk_event_keyring.so 00:05:54.822 SYMLINK libspdk_event_vhost_blk.so 00:05:54.822 SYMLINK libspdk_event_scheduler.so 00:05:54.822 SYMLINK libspdk_event_vmd.so 00:05:54.822 SYMLINK libspdk_event_sock.so 00:05:54.822 SYMLINK libspdk_event_fsdev.so 00:05:55.085 SYMLINK libspdk_event_iobuf.so 00:05:55.085 CC module/event/subsystems/accel/accel.o 00:05:55.343 LIB libspdk_event_accel.a 00:05:55.343 SO libspdk_event_accel.so.6.0 00:05:55.651 SYMLINK libspdk_event_accel.so 00:05:55.651 CC module/event/subsystems/bdev/bdev.o 00:05:55.941 LIB libspdk_event_bdev.a 00:05:55.941 SO libspdk_event_bdev.so.6.0 00:05:56.199 SYMLINK libspdk_event_bdev.so 00:05:56.199 CC module/event/subsystems/ublk/ublk.o 00:05:56.199 CC module/event/subsystems/nbd/nbd.o 00:05:56.199 CC module/event/subsystems/scsi/scsi.o 00:05:56.199 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:05:56.199 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:05:56.457 LIB libspdk_event_ublk.a 00:05:56.457 LIB libspdk_event_nbd.a 00:05:56.457 LIB libspdk_event_scsi.a 00:05:56.457 SO libspdk_event_ublk.so.3.0 00:05:56.715 SO libspdk_event_nbd.so.6.0 00:05:56.715 SO libspdk_event_scsi.so.6.0 00:05:56.715 SYMLINK libspdk_event_ublk.so 00:05:56.715 SYMLINK libspdk_event_scsi.so 00:05:56.715 SYMLINK libspdk_event_nbd.so 00:05:56.715 LIB libspdk_event_nvmf.a 00:05:56.715 SO libspdk_event_nvmf.so.6.0 00:05:56.715 SYMLINK libspdk_event_nvmf.so 00:05:56.973 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:05:56.973 CC module/event/subsystems/iscsi/iscsi.o 00:05:56.973 LIB libspdk_event_vhost_scsi.a 00:05:56.973 SO libspdk_event_vhost_scsi.so.3.0 00:05:57.230 LIB libspdk_event_iscsi.a 00:05:57.230 SYMLINK libspdk_event_vhost_scsi.so 00:05:57.230 SO libspdk_event_iscsi.so.6.0 00:05:57.230 SYMLINK libspdk_event_iscsi.so 00:05:57.230 SO libspdk.so.6.0 00:05:57.230 SYMLINK libspdk.so 00:05:57.488 CC test/rpc_client/rpc_client_test.o 00:05:57.488 TEST_HEADER include/spdk/accel.h 00:05:57.488 CXX app/trace/trace.o 00:05:57.488 TEST_HEADER include/spdk/accel_module.h 00:05:57.488 TEST_HEADER include/spdk/assert.h 00:05:57.488 TEST_HEADER include/spdk/barrier.h 00:05:57.488 TEST_HEADER include/spdk/base64.h 00:05:57.488 TEST_HEADER include/spdk/bdev.h 00:05:57.488 TEST_HEADER include/spdk/bdev_module.h 00:05:57.488 TEST_HEADER include/spdk/bdev_zone.h 00:05:57.488 TEST_HEADER include/spdk/bit_array.h 00:05:57.488 TEST_HEADER include/spdk/bit_pool.h 00:05:57.488 TEST_HEADER include/spdk/blob_bdev.h 00:05:57.488 TEST_HEADER include/spdk/blobfs_bdev.h 00:05:57.488 TEST_HEADER include/spdk/blobfs.h 00:05:57.488 TEST_HEADER include/spdk/blob.h 00:05:57.488 TEST_HEADER include/spdk/conf.h 00:05:57.488 CC examples/interrupt_tgt/interrupt_tgt.o 00:05:57.488 TEST_HEADER include/spdk/config.h 00:05:57.488 TEST_HEADER include/spdk/cpuset.h 00:05:57.488 TEST_HEADER include/spdk/crc16.h 00:05:57.488 TEST_HEADER include/spdk/crc32.h 00:05:57.488 TEST_HEADER include/spdk/crc64.h 00:05:57.488 TEST_HEADER include/spdk/dif.h 00:05:57.488 TEST_HEADER include/spdk/dma.h 00:05:57.488 TEST_HEADER include/spdk/endian.h 00:05:57.488 TEST_HEADER include/spdk/env_dpdk.h 00:05:57.488 TEST_HEADER include/spdk/env.h 00:05:57.488 TEST_HEADER include/spdk/event.h 00:05:57.488 TEST_HEADER include/spdk/fd_group.h 00:05:57.746 TEST_HEADER include/spdk/fd.h 00:05:57.746 TEST_HEADER include/spdk/file.h 00:05:57.746 TEST_HEADER include/spdk/fsdev.h 00:05:57.746 TEST_HEADER include/spdk/fsdev_module.h 00:05:57.746 TEST_HEADER include/spdk/ftl.h 00:05:57.746 TEST_HEADER include/spdk/fuse_dispatcher.h 00:05:57.746 TEST_HEADER include/spdk/gpt_spec.h 00:05:57.746 TEST_HEADER include/spdk/hexlify.h 00:05:57.746 TEST_HEADER include/spdk/histogram_data.h 00:05:57.747 TEST_HEADER include/spdk/idxd.h 00:05:57.747 TEST_HEADER include/spdk/idxd_spec.h 00:05:57.747 TEST_HEADER include/spdk/init.h 00:05:57.747 TEST_HEADER include/spdk/ioat.h 00:05:57.747 CC test/thread/poller_perf/poller_perf.o 00:05:57.747 TEST_HEADER include/spdk/ioat_spec.h 00:05:57.747 CC examples/util/zipf/zipf.o 00:05:57.747 CC examples/ioat/perf/perf.o 00:05:57.747 TEST_HEADER include/spdk/iscsi_spec.h 00:05:57.747 TEST_HEADER include/spdk/json.h 00:05:57.747 TEST_HEADER include/spdk/jsonrpc.h 00:05:57.747 TEST_HEADER include/spdk/keyring.h 00:05:57.747 TEST_HEADER include/spdk/keyring_module.h 00:05:57.747 TEST_HEADER include/spdk/likely.h 00:05:57.747 TEST_HEADER include/spdk/log.h 00:05:57.747 TEST_HEADER include/spdk/lvol.h 00:05:57.747 CC test/dma/test_dma/test_dma.o 00:05:57.747 TEST_HEADER include/spdk/md5.h 00:05:57.747 TEST_HEADER include/spdk/memory.h 00:05:57.747 TEST_HEADER include/spdk/mmio.h 00:05:57.747 TEST_HEADER include/spdk/nbd.h 00:05:57.747 TEST_HEADER include/spdk/net.h 00:05:57.747 TEST_HEADER include/spdk/notify.h 00:05:57.747 TEST_HEADER include/spdk/nvme.h 00:05:57.747 TEST_HEADER include/spdk/nvme_intel.h 00:05:57.747 TEST_HEADER include/spdk/nvme_ocssd.h 00:05:57.747 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:05:57.747 TEST_HEADER include/spdk/nvme_spec.h 00:05:57.747 CC test/app/bdev_svc/bdev_svc.o 00:05:57.747 TEST_HEADER include/spdk/nvme_zns.h 00:05:57.747 TEST_HEADER include/spdk/nvmf_cmd.h 00:05:57.747 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:05:57.747 TEST_HEADER include/spdk/nvmf.h 00:05:57.747 TEST_HEADER include/spdk/nvmf_spec.h 00:05:57.747 TEST_HEADER include/spdk/nvmf_transport.h 00:05:57.747 TEST_HEADER include/spdk/opal.h 00:05:57.747 TEST_HEADER include/spdk/opal_spec.h 00:05:57.747 TEST_HEADER include/spdk/pci_ids.h 00:05:57.747 TEST_HEADER include/spdk/pipe.h 00:05:57.747 TEST_HEADER include/spdk/queue.h 00:05:57.747 CC test/env/mem_callbacks/mem_callbacks.o 00:05:57.747 TEST_HEADER include/spdk/reduce.h 00:05:57.747 TEST_HEADER include/spdk/rpc.h 00:05:57.747 TEST_HEADER include/spdk/scheduler.h 00:05:57.747 TEST_HEADER include/spdk/scsi.h 00:05:57.747 TEST_HEADER include/spdk/scsi_spec.h 00:05:57.747 TEST_HEADER include/spdk/sock.h 00:05:57.747 LINK rpc_client_test 00:05:57.747 TEST_HEADER include/spdk/stdinc.h 00:05:57.747 TEST_HEADER include/spdk/string.h 00:05:57.747 TEST_HEADER include/spdk/thread.h 00:05:57.747 TEST_HEADER include/spdk/trace.h 00:05:57.747 TEST_HEADER include/spdk/trace_parser.h 00:05:57.747 TEST_HEADER include/spdk/tree.h 00:05:57.747 TEST_HEADER include/spdk/ublk.h 00:05:57.747 TEST_HEADER include/spdk/util.h 00:05:57.747 TEST_HEADER include/spdk/uuid.h 00:05:57.747 TEST_HEADER include/spdk/version.h 00:05:57.747 TEST_HEADER include/spdk/vfio_user_pci.h 00:05:57.747 TEST_HEADER include/spdk/vfio_user_spec.h 00:05:57.747 TEST_HEADER include/spdk/vhost.h 00:05:57.747 TEST_HEADER include/spdk/vmd.h 00:05:57.747 TEST_HEADER include/spdk/xor.h 00:05:57.747 TEST_HEADER include/spdk/zipf.h 00:05:57.747 LINK interrupt_tgt 00:05:57.747 CXX test/cpp_headers/accel.o 00:05:57.747 LINK poller_perf 00:05:58.004 LINK ioat_perf 00:05:58.004 LINK zipf 00:05:58.004 CXX test/cpp_headers/accel_module.o 00:05:58.004 LINK bdev_svc 00:05:58.262 CXX test/cpp_headers/assert.o 00:05:58.262 CC examples/ioat/verify/verify.o 00:05:58.262 CC app/trace_record/trace_record.o 00:05:58.262 LINK spdk_trace 00:05:58.262 CC app/nvmf_tgt/nvmf_main.o 00:05:58.262 LINK test_dma 00:05:58.521 CXX test/cpp_headers/barrier.o 00:05:58.521 CC app/iscsi_tgt/iscsi_tgt.o 00:05:58.521 CC test/event/event_perf/event_perf.o 00:05:58.521 LINK verify 00:05:58.521 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:05:58.521 LINK nvmf_tgt 00:05:58.779 CXX test/cpp_headers/base64.o 00:05:58.779 LINK spdk_trace_record 00:05:58.779 CC test/event/reactor/reactor.o 00:05:58.779 LINK event_perf 00:05:58.779 LINK mem_callbacks 00:05:58.779 CC test/event/reactor_perf/reactor_perf.o 00:05:58.779 CXX test/cpp_headers/bdev.o 00:05:59.037 LINK iscsi_tgt 00:05:59.037 LINK reactor 00:05:59.037 CC test/app/histogram_perf/histogram_perf.o 00:05:59.037 CC examples/thread/thread/thread_ex.o 00:05:59.037 CC test/app/jsoncat/jsoncat.o 00:05:59.295 LINK reactor_perf 00:05:59.295 CC test/env/vtophys/vtophys.o 00:05:59.295 LINK nvme_fuzz 00:05:59.295 CXX test/cpp_headers/bdev_module.o 00:05:59.295 CC examples/sock/hello_world/hello_sock.o 00:05:59.295 CC app/spdk_lspci/spdk_lspci.o 00:05:59.295 LINK vtophys 00:05:59.295 LINK histogram_perf 00:05:59.554 LINK jsoncat 00:05:59.554 CC app/spdk_tgt/spdk_tgt.o 00:05:59.554 LINK thread 00:05:59.554 LINK hello_sock 00:05:59.554 CXX test/cpp_headers/bdev_zone.o 00:05:59.554 CC test/event/app_repeat/app_repeat.o 00:05:59.554 CXX test/cpp_headers/bit_array.o 00:05:59.554 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:05:59.554 LINK spdk_lspci 00:05:59.554 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:05:59.554 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:05:59.812 LINK app_repeat 00:05:59.812 LINK env_dpdk_post_init 00:05:59.812 LINK spdk_tgt 00:05:59.812 CC app/spdk_nvme_perf/perf.o 00:05:59.812 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:06:00.070 CXX test/cpp_headers/bit_pool.o 00:06:00.070 CC test/event/scheduler/scheduler.o 00:06:00.070 CC examples/vmd/lsvmd/lsvmd.o 00:06:00.070 CC test/app/stub/stub.o 00:06:00.070 CC examples/vmd/led/led.o 00:06:00.070 CC test/env/memory/memory_ut.o 00:06:00.328 CC app/spdk_nvme_identify/identify.o 00:06:00.328 CXX test/cpp_headers/blob_bdev.o 00:06:00.328 LINK lsvmd 00:06:00.328 LINK stub 00:06:00.328 LINK led 00:06:00.328 LINK scheduler 00:06:00.587 CXX test/cpp_headers/blobfs_bdev.o 00:06:00.587 CC test/env/pci/pci_ut.o 00:06:00.587 LINK vhost_fuzz 00:06:00.587 CC app/spdk_nvme_discover/discovery_aer.o 00:06:00.846 CC examples/idxd/perf/perf.o 00:06:00.846 CC examples/fsdev/hello_world/hello_fsdev.o 00:06:00.846 CXX test/cpp_headers/blobfs.o 00:06:00.846 CC app/spdk_top/spdk_top.o 00:06:00.846 LINK spdk_nvme_discover 00:06:01.104 CXX test/cpp_headers/blob.o 00:06:01.104 LINK pci_ut 00:06:01.104 CXX test/cpp_headers/conf.o 00:06:01.104 LINK hello_fsdev 00:06:01.104 LINK spdk_nvme_identify 00:06:01.362 LINK idxd_perf 00:06:01.362 CXX test/cpp_headers/config.o 00:06:01.362 LINK spdk_nvme_perf 00:06:01.362 CXX test/cpp_headers/cpuset.o 00:06:01.362 CC examples/accel/perf/accel_perf.o 00:06:01.620 CC app/vhost/vhost.o 00:06:01.620 CC app/spdk_dd/spdk_dd.o 00:06:01.620 CXX test/cpp_headers/crc16.o 00:06:01.620 CC examples/blob/hello_world/hello_blob.o 00:06:01.879 CC app/fio/nvme/fio_plugin.o 00:06:01.879 LINK vhost 00:06:01.879 CC test/accel/dif/dif.o 00:06:01.879 CXX test/cpp_headers/crc32.o 00:06:01.879 LINK spdk_top 00:06:02.137 LINK hello_blob 00:06:02.137 CXX test/cpp_headers/crc64.o 00:06:02.137 CXX test/cpp_headers/dif.o 00:06:02.137 LINK memory_ut 00:06:02.395 LINK accel_perf 00:06:02.395 CXX test/cpp_headers/dma.o 00:06:02.395 LINK spdk_dd 00:06:02.395 CC test/blobfs/mkfs/mkfs.o 00:06:02.395 CC examples/blob/cli/blobcli.o 00:06:02.395 CXX test/cpp_headers/endian.o 00:06:02.395 CC app/fio/bdev/fio_plugin.o 00:06:02.653 LINK spdk_nvme 00:06:02.653 CXX test/cpp_headers/env_dpdk.o 00:06:02.653 LINK iscsi_fuzz 00:06:02.653 CXX test/cpp_headers/env.o 00:06:02.653 LINK mkfs 00:06:02.653 CC examples/nvme/hello_world/hello_world.o 00:06:02.653 LINK dif 00:06:02.911 CC examples/nvme/reconnect/reconnect.o 00:06:02.911 CC test/lvol/esnap/esnap.o 00:06:02.911 CXX test/cpp_headers/event.o 00:06:02.911 CXX test/cpp_headers/fd_group.o 00:06:02.911 CXX test/cpp_headers/fd.o 00:06:02.911 CXX test/cpp_headers/file.o 00:06:02.911 CXX test/cpp_headers/fsdev.o 00:06:02.911 LINK hello_world 00:06:03.169 CXX test/cpp_headers/fsdev_module.o 00:06:03.169 CXX test/cpp_headers/ftl.o 00:06:03.169 CXX test/cpp_headers/fuse_dispatcher.o 00:06:03.169 CXX test/cpp_headers/gpt_spec.o 00:06:03.169 CC examples/bdev/hello_world/hello_bdev.o 00:06:03.169 LINK spdk_bdev 00:06:03.169 LINK blobcli 00:06:03.427 CXX test/cpp_headers/hexlify.o 00:06:03.427 CXX test/cpp_headers/histogram_data.o 00:06:03.427 CXX test/cpp_headers/idxd.o 00:06:03.427 LINK reconnect 00:06:03.427 CC examples/bdev/bdevperf/bdevperf.o 00:06:03.686 CC test/nvme/aer/aer.o 00:06:03.686 LINK hello_bdev 00:06:03.686 CC test/nvme/reset/reset.o 00:06:03.686 CXX test/cpp_headers/idxd_spec.o 00:06:03.686 CC examples/nvme/nvme_manage/nvme_manage.o 00:06:03.686 CC test/bdev/bdevio/bdevio.o 00:06:03.686 CC examples/nvme/arbitration/arbitration.o 00:06:03.944 CC examples/nvme/hotplug/hotplug.o 00:06:03.944 CXX test/cpp_headers/init.o 00:06:03.944 LINK reset 00:06:03.944 CC examples/nvme/cmb_copy/cmb_copy.o 00:06:04.202 LINK hotplug 00:06:04.202 LINK aer 00:06:04.202 LINK bdevio 00:06:04.202 CXX test/cpp_headers/ioat.o 00:06:04.202 LINK cmb_copy 00:06:04.202 LINK arbitration 00:06:04.202 CXX test/cpp_headers/ioat_spec.o 00:06:04.460 LINK bdevperf 00:06:04.460 CC test/nvme/sgl/sgl.o 00:06:04.460 LINK nvme_manage 00:06:04.460 CC test/nvme/e2edp/nvme_dp.o 00:06:04.718 CC test/nvme/overhead/overhead.o 00:06:04.718 CC test/nvme/err_injection/err_injection.o 00:06:04.718 CXX test/cpp_headers/iscsi_spec.o 00:06:04.718 CC examples/nvme/abort/abort.o 00:06:04.718 CXX test/cpp_headers/json.o 00:06:04.718 LINK sgl 00:06:04.718 CC test/nvme/startup/startup.o 00:06:04.718 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:06:04.977 LINK err_injection 00:06:04.977 CXX test/cpp_headers/jsonrpc.o 00:06:04.977 LINK overhead 00:06:04.977 LINK startup 00:06:04.977 LINK nvme_dp 00:06:04.977 CC test/nvme/reserve/reserve.o 00:06:04.977 CC test/nvme/simple_copy/simple_copy.o 00:06:04.977 LINK pmr_persistence 00:06:05.235 CXX test/cpp_headers/keyring.o 00:06:05.235 CXX test/cpp_headers/keyring_module.o 00:06:05.235 CXX test/cpp_headers/likely.o 00:06:05.235 CXX test/cpp_headers/log.o 00:06:05.235 CC test/nvme/connect_stress/connect_stress.o 00:06:05.235 LINK reserve 00:06:05.235 LINK abort 00:06:05.235 LINK simple_copy 00:06:05.494 CXX test/cpp_headers/lvol.o 00:06:05.494 CXX test/cpp_headers/md5.o 00:06:05.494 CXX test/cpp_headers/memory.o 00:06:05.494 CXX test/cpp_headers/mmio.o 00:06:05.752 CXX test/cpp_headers/nbd.o 00:06:05.752 CC test/nvme/boot_partition/boot_partition.o 00:06:05.752 LINK connect_stress 00:06:05.752 CC test/nvme/compliance/nvme_compliance.o 00:06:05.752 CC test/nvme/fused_ordering/fused_ordering.o 00:06:05.752 CXX test/cpp_headers/net.o 00:06:05.752 CC test/nvme/doorbell_aers/doorbell_aers.o 00:06:06.010 CC examples/nvmf/nvmf/nvmf.o 00:06:06.010 CXX test/cpp_headers/notify.o 00:06:06.010 LINK boot_partition 00:06:06.010 CXX test/cpp_headers/nvme.o 00:06:06.010 CC test/nvme/fdp/fdp.o 00:06:06.010 LINK doorbell_aers 00:06:06.010 CC test/nvme/cuse/cuse.o 00:06:06.268 LINK fused_ordering 00:06:06.268 CXX test/cpp_headers/nvme_intel.o 00:06:06.268 CXX test/cpp_headers/nvme_ocssd.o 00:06:06.268 CXX test/cpp_headers/nvme_ocssd_spec.o 00:06:06.268 LINK nvme_compliance 00:06:06.268 LINK nvmf 00:06:06.268 CXX test/cpp_headers/nvme_spec.o 00:06:06.525 CXX test/cpp_headers/nvme_zns.o 00:06:06.525 CXX test/cpp_headers/nvmf_cmd.o 00:06:06.525 CXX test/cpp_headers/nvmf_fc_spec.o 00:06:06.525 CXX test/cpp_headers/nvmf.o 00:06:06.525 CXX test/cpp_headers/nvmf_spec.o 00:06:06.525 CXX test/cpp_headers/nvmf_transport.o 00:06:06.525 CXX test/cpp_headers/opal.o 00:06:06.786 CXX test/cpp_headers/opal_spec.o 00:06:06.786 LINK fdp 00:06:06.786 CXX test/cpp_headers/pci_ids.o 00:06:06.786 CXX test/cpp_headers/pipe.o 00:06:06.786 CXX test/cpp_headers/queue.o 00:06:06.786 CXX test/cpp_headers/reduce.o 00:06:06.786 CXX test/cpp_headers/rpc.o 00:06:06.786 CXX test/cpp_headers/scheduler.o 00:06:06.786 CXX test/cpp_headers/scsi.o 00:06:06.786 CXX test/cpp_headers/scsi_spec.o 00:06:07.047 CXX test/cpp_headers/sock.o 00:06:07.047 CXX test/cpp_headers/stdinc.o 00:06:07.047 CXX test/cpp_headers/string.o 00:06:07.047 CXX test/cpp_headers/thread.o 00:06:07.047 CXX test/cpp_headers/trace.o 00:06:07.047 CXX test/cpp_headers/trace_parser.o 00:06:07.047 CXX test/cpp_headers/tree.o 00:06:07.305 CXX test/cpp_headers/ublk.o 00:06:07.305 CXX test/cpp_headers/util.o 00:06:07.305 CXX test/cpp_headers/uuid.o 00:06:07.305 CXX test/cpp_headers/version.o 00:06:07.305 CXX test/cpp_headers/vfio_user_pci.o 00:06:07.305 CXX test/cpp_headers/vfio_user_spec.o 00:06:07.305 CXX test/cpp_headers/vhost.o 00:06:07.305 CXX test/cpp_headers/vmd.o 00:06:07.305 CXX test/cpp_headers/xor.o 00:06:07.305 CXX test/cpp_headers/zipf.o 00:06:07.563 LINK cuse 00:06:10.092 LINK esnap 00:06:10.092 00:06:10.092 real 1m39.678s 00:06:10.092 user 9m32.251s 00:06:10.092 sys 1m46.912s 00:06:10.092 11:16:51 make -- common/autotest_common.sh@1126 -- $ xtrace_disable 00:06:10.092 11:16:51 make -- common/autotest_common.sh@10 -- $ set +x 00:06:10.092 ************************************ 00:06:10.092 END TEST make 00:06:10.092 ************************************ 00:06:10.351 11:16:51 -- spdk/autobuild.sh@1 -- $ stop_monitor_resources 00:06:10.351 11:16:51 -- pm/common@29 -- $ signal_monitor_resources TERM 00:06:10.351 11:16:51 -- pm/common@40 -- $ local monitor pid pids signal=TERM 00:06:10.351 11:16:51 -- pm/common@42 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:06:10.351 11:16:51 -- pm/common@43 -- $ [[ -e /home/vagrant/spdk_repo/spdk/../output/power/collect-cpu-load.pid ]] 00:06:10.351 11:16:51 -- pm/common@44 -- $ pid=5302 00:06:10.351 11:16:51 -- pm/common@50 -- $ kill -TERM 5302 00:06:10.351 11:16:51 -- pm/common@42 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:06:10.351 11:16:51 -- pm/common@43 -- $ [[ -e /home/vagrant/spdk_repo/spdk/../output/power/collect-vmstat.pid ]] 00:06:10.351 11:16:51 -- pm/common@44 -- $ pid=5303 00:06:10.351 11:16:51 -- pm/common@50 -- $ kill -TERM 5303 00:06:10.351 11:16:51 -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:06:10.351 11:16:51 -- common/autotest_common.sh@1681 -- # lcov --version 00:06:10.352 11:16:51 -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:06:10.352 11:16:51 -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:06:10.352 11:16:51 -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:06:10.352 11:16:51 -- scripts/common.sh@333 -- # local ver1 ver1_l 00:06:10.352 11:16:51 -- scripts/common.sh@334 -- # local ver2 ver2_l 00:06:10.352 11:16:51 -- scripts/common.sh@336 -- # IFS=.-: 00:06:10.352 11:16:51 -- scripts/common.sh@336 -- # read -ra ver1 00:06:10.352 11:16:51 -- scripts/common.sh@337 -- # IFS=.-: 00:06:10.352 11:16:51 -- scripts/common.sh@337 -- # read -ra ver2 00:06:10.352 11:16:51 -- scripts/common.sh@338 -- # local 'op=<' 00:06:10.352 11:16:51 -- scripts/common.sh@340 -- # ver1_l=2 00:06:10.352 11:16:51 -- scripts/common.sh@341 -- # ver2_l=1 00:06:10.352 11:16:51 -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:06:10.352 11:16:51 -- scripts/common.sh@344 -- # case "$op" in 00:06:10.352 11:16:51 -- scripts/common.sh@345 -- # : 1 00:06:10.352 11:16:51 -- scripts/common.sh@364 -- # (( v = 0 )) 00:06:10.352 11:16:51 -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:10.352 11:16:51 -- scripts/common.sh@365 -- # decimal 1 00:06:10.352 11:16:51 -- scripts/common.sh@353 -- # local d=1 00:06:10.352 11:16:52 -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:10.352 11:16:52 -- scripts/common.sh@355 -- # echo 1 00:06:10.352 11:16:52 -- scripts/common.sh@365 -- # ver1[v]=1 00:06:10.352 11:16:52 -- scripts/common.sh@366 -- # decimal 2 00:06:10.352 11:16:52 -- scripts/common.sh@353 -- # local d=2 00:06:10.352 11:16:52 -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:10.352 11:16:52 -- scripts/common.sh@355 -- # echo 2 00:06:10.352 11:16:52 -- scripts/common.sh@366 -- # ver2[v]=2 00:06:10.352 11:16:52 -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:06:10.352 11:16:52 -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:06:10.352 11:16:52 -- scripts/common.sh@368 -- # return 0 00:06:10.352 11:16:52 -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:10.352 11:16:52 -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:06:10.352 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:10.352 --rc genhtml_branch_coverage=1 00:06:10.352 --rc genhtml_function_coverage=1 00:06:10.352 --rc genhtml_legend=1 00:06:10.352 --rc geninfo_all_blocks=1 00:06:10.352 --rc geninfo_unexecuted_blocks=1 00:06:10.352 00:06:10.352 ' 00:06:10.352 11:16:52 -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:06:10.352 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:10.352 --rc genhtml_branch_coverage=1 00:06:10.352 --rc genhtml_function_coverage=1 00:06:10.352 --rc genhtml_legend=1 00:06:10.352 --rc geninfo_all_blocks=1 00:06:10.352 --rc geninfo_unexecuted_blocks=1 00:06:10.352 00:06:10.352 ' 00:06:10.352 11:16:52 -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:06:10.352 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:10.352 --rc genhtml_branch_coverage=1 00:06:10.352 --rc genhtml_function_coverage=1 00:06:10.352 --rc genhtml_legend=1 00:06:10.352 --rc geninfo_all_blocks=1 00:06:10.352 --rc geninfo_unexecuted_blocks=1 00:06:10.352 00:06:10.352 ' 00:06:10.352 11:16:52 -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:06:10.352 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:10.352 --rc genhtml_branch_coverage=1 00:06:10.352 --rc genhtml_function_coverage=1 00:06:10.352 --rc genhtml_legend=1 00:06:10.352 --rc geninfo_all_blocks=1 00:06:10.352 --rc geninfo_unexecuted_blocks=1 00:06:10.352 00:06:10.352 ' 00:06:10.352 11:16:52 -- spdk/autotest.sh@25 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:06:10.352 11:16:52 -- nvmf/common.sh@7 -- # uname -s 00:06:10.352 11:16:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:10.352 11:16:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:10.352 11:16:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:10.352 11:16:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:10.352 11:16:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:10.352 11:16:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:10.352 11:16:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:10.352 11:16:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:10.352 11:16:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:10.352 11:16:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:10.352 11:16:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:06:10.352 11:16:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:06:10.352 11:16:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:10.352 11:16:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:10.352 11:16:52 -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:06:10.352 11:16:52 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:10.352 11:16:52 -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:06:10.352 11:16:52 -- scripts/common.sh@15 -- # shopt -s extglob 00:06:10.352 11:16:52 -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:10.352 11:16:52 -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:10.352 11:16:52 -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:10.352 11:16:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:10.352 11:16:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:10.352 11:16:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:10.352 11:16:52 -- paths/export.sh@5 -- # export PATH 00:06:10.352 11:16:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:10.352 11:16:52 -- nvmf/common.sh@51 -- # : 0 00:06:10.352 11:16:52 -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:06:10.352 11:16:52 -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:06:10.352 11:16:52 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:10.352 11:16:52 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:10.352 11:16:52 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:10.352 11:16:52 -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:06:10.352 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:06:10.352 11:16:52 -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:06:10.352 11:16:52 -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:06:10.352 11:16:52 -- nvmf/common.sh@55 -- # have_pci_nics=0 00:06:10.352 11:16:52 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:06:10.352 11:16:52 -- spdk/autotest.sh@32 -- # uname -s 00:06:10.352 11:16:52 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:06:10.352 11:16:52 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:06:10.352 11:16:52 -- spdk/autotest.sh@34 -- # mkdir -p /home/vagrant/spdk_repo/spdk/../output/coredumps 00:06:10.352 11:16:52 -- spdk/autotest.sh@39 -- # echo '|/home/vagrant/spdk_repo/spdk/scripts/core-collector.sh %P %s %t' 00:06:10.352 11:16:52 -- spdk/autotest.sh@40 -- # echo /home/vagrant/spdk_repo/spdk/../output/coredumps 00:06:10.352 11:16:52 -- spdk/autotest.sh@44 -- # modprobe nbd 00:06:10.611 11:16:52 -- spdk/autotest.sh@46 -- # type -P udevadm 00:06:10.611 11:16:52 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:06:10.611 11:16:52 -- spdk/autotest.sh@48 -- # udevadm_pid=54499 00:06:10.611 11:16:52 -- spdk/autotest.sh@53 -- # start_monitor_resources 00:06:10.611 11:16:52 -- pm/common@17 -- # local monitor 00:06:10.611 11:16:52 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:06:10.611 11:16:52 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:06:10.611 11:16:52 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:06:10.611 11:16:52 -- pm/common@25 -- # sleep 1 00:06:10.611 11:16:52 -- pm/common@21 -- # date +%s 00:06:10.611 11:16:52 -- pm/common@21 -- # date +%s 00:06:10.611 11:16:52 -- pm/common@21 -- # /home/vagrant/spdk_repo/spdk/scripts/perf/pm/collect-cpu-load -d /home/vagrant/spdk_repo/spdk/../output/power -l -p monitor.autotest.sh.1728299812 00:06:10.611 11:16:52 -- pm/common@21 -- # /home/vagrant/spdk_repo/spdk/scripts/perf/pm/collect-vmstat -d /home/vagrant/spdk_repo/spdk/../output/power -l -p monitor.autotest.sh.1728299812 00:06:10.611 Redirecting to /home/vagrant/spdk_repo/spdk/../output/power/monitor.autotest.sh.1728299812_collect-vmstat.pm.log 00:06:10.611 Redirecting to /home/vagrant/spdk_repo/spdk/../output/power/monitor.autotest.sh.1728299812_collect-cpu-load.pm.log 00:06:11.572 11:16:53 -- spdk/autotest.sh@55 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:06:11.572 11:16:53 -- spdk/autotest.sh@57 -- # timing_enter autotest 00:06:11.572 11:16:53 -- common/autotest_common.sh@724 -- # xtrace_disable 00:06:11.572 11:16:53 -- common/autotest_common.sh@10 -- # set +x 00:06:11.572 11:16:53 -- spdk/autotest.sh@59 -- # create_test_list 00:06:11.572 11:16:53 -- common/autotest_common.sh@748 -- # xtrace_disable 00:06:11.572 11:16:53 -- common/autotest_common.sh@10 -- # set +x 00:06:11.572 11:16:53 -- spdk/autotest.sh@61 -- # dirname /home/vagrant/spdk_repo/spdk/autotest.sh 00:06:11.572 11:16:53 -- spdk/autotest.sh@61 -- # readlink -f /home/vagrant/spdk_repo/spdk 00:06:11.572 11:16:53 -- spdk/autotest.sh@61 -- # src=/home/vagrant/spdk_repo/spdk 00:06:11.572 11:16:53 -- spdk/autotest.sh@62 -- # out=/home/vagrant/spdk_repo/spdk/../output 00:06:11.572 11:16:53 -- spdk/autotest.sh@63 -- # cd /home/vagrant/spdk_repo/spdk 00:06:11.572 11:16:53 -- spdk/autotest.sh@65 -- # freebsd_update_contigmem_mod 00:06:11.572 11:16:53 -- common/autotest_common.sh@1455 -- # uname 00:06:11.572 11:16:53 -- common/autotest_common.sh@1455 -- # '[' Linux = FreeBSD ']' 00:06:11.572 11:16:53 -- spdk/autotest.sh@66 -- # freebsd_set_maxsock_buf 00:06:11.572 11:16:53 -- common/autotest_common.sh@1475 -- # uname 00:06:11.572 11:16:53 -- common/autotest_common.sh@1475 -- # [[ Linux = FreeBSD ]] 00:06:11.572 11:16:53 -- spdk/autotest.sh@68 -- # [[ y == y ]] 00:06:11.572 11:16:53 -- spdk/autotest.sh@70 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:06:11.572 lcov: LCOV version 1.15 00:06:11.572 11:16:53 -- spdk/autotest.sh@72 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /home/vagrant/spdk_repo/spdk -o /home/vagrant/spdk_repo/spdk/../output/cov_base.info 00:06:33.498 /home/vagrant/spdk_repo/spdk/lib/nvme/nvme_stubs.gcno:no functions found 00:06:33.498 geninfo: WARNING: GCOV did not produce any data for /home/vagrant/spdk_repo/spdk/lib/nvme/nvme_stubs.gcno 00:06:55.419 11:17:35 -- spdk/autotest.sh@76 -- # timing_enter pre_cleanup 00:06:55.419 11:17:35 -- common/autotest_common.sh@724 -- # xtrace_disable 00:06:55.419 11:17:35 -- common/autotest_common.sh@10 -- # set +x 00:06:55.419 11:17:35 -- spdk/autotest.sh@78 -- # rm -f 00:06:55.419 11:17:35 -- spdk/autotest.sh@81 -- # /home/vagrant/spdk_repo/spdk/scripts/setup.sh reset 00:06:55.419 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:06:55.419 0000:00:11.0 (1b36 0010): Already using the nvme driver 00:06:55.419 0000:00:10.0 (1b36 0010): Already using the nvme driver 00:06:55.419 11:17:36 -- spdk/autotest.sh@83 -- # get_zoned_devs 00:06:55.419 11:17:36 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:06:55.419 11:17:36 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:06:55.419 11:17:36 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:06:55.419 11:17:36 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:06:55.419 11:17:36 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:06:55.419 11:17:36 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:06:55.419 11:17:36 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:06:55.419 11:17:36 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:06:55.419 11:17:36 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:06:55.419 11:17:36 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme1n1 00:06:55.419 11:17:36 -- common/autotest_common.sh@1648 -- # local device=nvme1n1 00:06:55.419 11:17:36 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme1n1/queue/zoned ]] 00:06:55.419 11:17:36 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:06:55.419 11:17:36 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:06:55.419 11:17:36 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme1n2 00:06:55.419 11:17:36 -- common/autotest_common.sh@1648 -- # local device=nvme1n2 00:06:55.419 11:17:36 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme1n2/queue/zoned ]] 00:06:55.419 11:17:36 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:06:55.419 11:17:36 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:06:55.419 11:17:36 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme1n3 00:06:55.419 11:17:36 -- common/autotest_common.sh@1648 -- # local device=nvme1n3 00:06:55.419 11:17:36 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme1n3/queue/zoned ]] 00:06:55.419 11:17:36 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:06:55.419 11:17:36 -- spdk/autotest.sh@85 -- # (( 0 > 0 )) 00:06:55.419 11:17:36 -- spdk/autotest.sh@97 -- # for dev in /dev/nvme*n!(*p*) 00:06:55.419 11:17:36 -- spdk/autotest.sh@99 -- # [[ -z '' ]] 00:06:55.419 11:17:36 -- spdk/autotest.sh@100 -- # block_in_use /dev/nvme0n1 00:06:55.419 11:17:36 -- scripts/common.sh@381 -- # local block=/dev/nvme0n1 pt 00:06:55.419 11:17:36 -- scripts/common.sh@390 -- # /home/vagrant/spdk_repo/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:06:55.419 No valid GPT data, bailing 00:06:55.419 11:17:36 -- scripts/common.sh@394 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:06:55.419 11:17:36 -- scripts/common.sh@394 -- # pt= 00:06:55.419 11:17:36 -- scripts/common.sh@395 -- # return 1 00:06:55.419 11:17:36 -- spdk/autotest.sh@101 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:06:55.419 1+0 records in 00:06:55.419 1+0 records out 00:06:55.419 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00369503 s, 284 MB/s 00:06:55.419 11:17:36 -- spdk/autotest.sh@97 -- # for dev in /dev/nvme*n!(*p*) 00:06:55.419 11:17:36 -- spdk/autotest.sh@99 -- # [[ -z '' ]] 00:06:55.419 11:17:36 -- spdk/autotest.sh@100 -- # block_in_use /dev/nvme1n1 00:06:55.419 11:17:36 -- scripts/common.sh@381 -- # local block=/dev/nvme1n1 pt 00:06:55.419 11:17:36 -- scripts/common.sh@390 -- # /home/vagrant/spdk_repo/spdk/scripts/spdk-gpt.py /dev/nvme1n1 00:06:55.419 No valid GPT data, bailing 00:06:55.419 11:17:36 -- scripts/common.sh@394 -- # blkid -s PTTYPE -o value /dev/nvme1n1 00:06:55.419 11:17:36 -- scripts/common.sh@394 -- # pt= 00:06:55.419 11:17:36 -- scripts/common.sh@395 -- # return 1 00:06:55.419 11:17:36 -- spdk/autotest.sh@101 -- # dd if=/dev/zero of=/dev/nvme1n1 bs=1M count=1 00:06:55.419 1+0 records in 00:06:55.419 1+0 records out 00:06:55.419 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00337749 s, 310 MB/s 00:06:55.419 11:17:36 -- spdk/autotest.sh@97 -- # for dev in /dev/nvme*n!(*p*) 00:06:55.419 11:17:36 -- spdk/autotest.sh@99 -- # [[ -z '' ]] 00:06:55.419 11:17:36 -- spdk/autotest.sh@100 -- # block_in_use /dev/nvme1n2 00:06:55.419 11:17:36 -- scripts/common.sh@381 -- # local block=/dev/nvme1n2 pt 00:06:55.419 11:17:36 -- scripts/common.sh@390 -- # /home/vagrant/spdk_repo/spdk/scripts/spdk-gpt.py /dev/nvme1n2 00:06:55.419 No valid GPT data, bailing 00:06:55.419 11:17:36 -- scripts/common.sh@394 -- # blkid -s PTTYPE -o value /dev/nvme1n2 00:06:55.419 11:17:36 -- scripts/common.sh@394 -- # pt= 00:06:55.419 11:17:36 -- scripts/common.sh@395 -- # return 1 00:06:55.419 11:17:36 -- spdk/autotest.sh@101 -- # dd if=/dev/zero of=/dev/nvme1n2 bs=1M count=1 00:06:55.419 1+0 records in 00:06:55.419 1+0 records out 00:06:55.419 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00395734 s, 265 MB/s 00:06:55.419 11:17:36 -- spdk/autotest.sh@97 -- # for dev in /dev/nvme*n!(*p*) 00:06:55.419 11:17:36 -- spdk/autotest.sh@99 -- # [[ -z '' ]] 00:06:55.419 11:17:36 -- spdk/autotest.sh@100 -- # block_in_use /dev/nvme1n3 00:06:55.419 11:17:36 -- scripts/common.sh@381 -- # local block=/dev/nvme1n3 pt 00:06:55.419 11:17:36 -- scripts/common.sh@390 -- # /home/vagrant/spdk_repo/spdk/scripts/spdk-gpt.py /dev/nvme1n3 00:06:55.419 No valid GPT data, bailing 00:06:55.419 11:17:37 -- scripts/common.sh@394 -- # blkid -s PTTYPE -o value /dev/nvme1n3 00:06:55.419 11:17:37 -- scripts/common.sh@394 -- # pt= 00:06:55.419 11:17:37 -- scripts/common.sh@395 -- # return 1 00:06:55.419 11:17:37 -- spdk/autotest.sh@101 -- # dd if=/dev/zero of=/dev/nvme1n3 bs=1M count=1 00:06:55.419 1+0 records in 00:06:55.419 1+0 records out 00:06:55.419 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00363133 s, 289 MB/s 00:06:55.419 11:17:37 -- spdk/autotest.sh@105 -- # sync 00:06:55.419 11:17:37 -- spdk/autotest.sh@107 -- # xtrace_disable_per_cmd reap_spdk_processes 00:06:55.419 11:17:37 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:06:55.419 11:17:37 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:06:57.322 11:17:38 -- spdk/autotest.sh@111 -- # uname -s 00:06:57.322 11:17:38 -- spdk/autotest.sh@111 -- # [[ Linux == Linux ]] 00:06:57.322 11:17:38 -- spdk/autotest.sh@111 -- # [[ 0 -eq 1 ]] 00:06:57.322 11:17:38 -- spdk/autotest.sh@115 -- # /home/vagrant/spdk_repo/spdk/scripts/setup.sh status 00:06:57.890 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:06:57.890 Hugepages 00:06:57.890 node hugesize free / total 00:06:57.890 node0 1048576kB 0 / 0 00:06:57.890 node0 2048kB 0 / 0 00:06:57.890 00:06:57.890 Type BDF Vendor Device NUMA Driver Device Block devices 00:06:58.149 virtio 0000:00:03.0 1af4 1001 unknown virtio-pci - vda 00:06:58.149 NVMe 0000:00:10.0 1b36 0010 unknown nvme nvme0 nvme0n1 00:06:58.149 NVMe 0000:00:11.0 1b36 0010 unknown nvme nvme1 nvme1n1 nvme1n2 nvme1n3 00:06:58.149 11:17:39 -- spdk/autotest.sh@117 -- # uname -s 00:06:58.149 11:17:39 -- spdk/autotest.sh@117 -- # [[ Linux == Linux ]] 00:06:58.149 11:17:39 -- spdk/autotest.sh@119 -- # nvme_namespace_revert 00:06:58.149 11:17:39 -- common/autotest_common.sh@1514 -- # /home/vagrant/spdk_repo/spdk/scripts/setup.sh 00:06:59.084 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:06:59.084 0000:00:10.0 (1b36 0010): nvme -> uio_pci_generic 00:06:59.084 0000:00:11.0 (1b36 0010): nvme -> uio_pci_generic 00:06:59.084 11:17:40 -- common/autotest_common.sh@1515 -- # sleep 1 00:07:00.018 11:17:41 -- common/autotest_common.sh@1516 -- # bdfs=() 00:07:00.018 11:17:41 -- common/autotest_common.sh@1516 -- # local bdfs 00:07:00.018 11:17:41 -- common/autotest_common.sh@1518 -- # bdfs=($(get_nvme_bdfs)) 00:07:00.018 11:17:41 -- common/autotest_common.sh@1518 -- # get_nvme_bdfs 00:07:00.018 11:17:41 -- common/autotest_common.sh@1496 -- # bdfs=() 00:07:00.018 11:17:41 -- common/autotest_common.sh@1496 -- # local bdfs 00:07:00.018 11:17:41 -- common/autotest_common.sh@1497 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:07:00.018 11:17:41 -- common/autotest_common.sh@1497 -- # /home/vagrant/spdk_repo/spdk/scripts/gen_nvme.sh 00:07:00.018 11:17:41 -- common/autotest_common.sh@1497 -- # jq -r '.config[].params.traddr' 00:07:00.018 11:17:41 -- common/autotest_common.sh@1498 -- # (( 2 == 0 )) 00:07:00.018 11:17:41 -- common/autotest_common.sh@1502 -- # printf '%s\n' 0000:00:10.0 0000:00:11.0 00:07:00.018 11:17:41 -- common/autotest_common.sh@1520 -- # /home/vagrant/spdk_repo/spdk/scripts/setup.sh reset 00:07:00.584 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:07:00.584 Waiting for block devices as requested 00:07:00.584 0000:00:11.0 (1b36 0010): uio_pci_generic -> nvme 00:07:00.584 0000:00:10.0 (1b36 0010): uio_pci_generic -> nvme 00:07:00.584 11:17:42 -- common/autotest_common.sh@1522 -- # for bdf in "${bdfs[@]}" 00:07:00.584 11:17:42 -- common/autotest_common.sh@1523 -- # get_nvme_ctrlr_from_bdf 0000:00:10.0 00:07:00.584 11:17:42 -- common/autotest_common.sh@1485 -- # grep 0000:00:10.0/nvme/nvme 00:07:00.584 11:17:42 -- common/autotest_common.sh@1485 -- # readlink -f /sys/class/nvme/nvme0 /sys/class/nvme/nvme1 00:07:00.842 11:17:42 -- common/autotest_common.sh@1485 -- # bdf_sysfs_path=/sys/devices/pci0000:00/0000:00:10.0/nvme/nvme1 00:07:00.842 11:17:42 -- common/autotest_common.sh@1486 -- # [[ -z /sys/devices/pci0000:00/0000:00:10.0/nvme/nvme1 ]] 00:07:00.842 11:17:42 -- common/autotest_common.sh@1490 -- # basename /sys/devices/pci0000:00/0000:00:10.0/nvme/nvme1 00:07:00.842 11:17:42 -- common/autotest_common.sh@1490 -- # printf '%s\n' nvme1 00:07:00.842 11:17:42 -- common/autotest_common.sh@1523 -- # nvme_ctrlr=/dev/nvme1 00:07:00.842 11:17:42 -- common/autotest_common.sh@1524 -- # [[ -z /dev/nvme1 ]] 00:07:00.842 11:17:42 -- common/autotest_common.sh@1529 -- # nvme id-ctrl /dev/nvme1 00:07:00.842 11:17:42 -- common/autotest_common.sh@1529 -- # grep oacs 00:07:00.842 11:17:42 -- common/autotest_common.sh@1529 -- # cut -d: -f2 00:07:00.842 11:17:42 -- common/autotest_common.sh@1529 -- # oacs=' 0x12a' 00:07:00.842 11:17:42 -- common/autotest_common.sh@1530 -- # oacs_ns_manage=8 00:07:00.842 11:17:42 -- common/autotest_common.sh@1532 -- # [[ 8 -ne 0 ]] 00:07:00.842 11:17:42 -- common/autotest_common.sh@1538 -- # nvme id-ctrl /dev/nvme1 00:07:00.842 11:17:42 -- common/autotest_common.sh@1538 -- # grep unvmcap 00:07:00.842 11:17:42 -- common/autotest_common.sh@1538 -- # cut -d: -f2 00:07:00.842 11:17:42 -- common/autotest_common.sh@1538 -- # unvmcap=' 0' 00:07:00.842 11:17:42 -- common/autotest_common.sh@1539 -- # [[ 0 -eq 0 ]] 00:07:00.842 11:17:42 -- common/autotest_common.sh@1541 -- # continue 00:07:00.842 11:17:42 -- common/autotest_common.sh@1522 -- # for bdf in "${bdfs[@]}" 00:07:00.842 11:17:42 -- common/autotest_common.sh@1523 -- # get_nvme_ctrlr_from_bdf 0000:00:11.0 00:07:00.842 11:17:42 -- common/autotest_common.sh@1485 -- # readlink -f /sys/class/nvme/nvme0 /sys/class/nvme/nvme1 00:07:00.843 11:17:42 -- common/autotest_common.sh@1485 -- # grep 0000:00:11.0/nvme/nvme 00:07:00.843 11:17:42 -- common/autotest_common.sh@1485 -- # bdf_sysfs_path=/sys/devices/pci0000:00/0000:00:11.0/nvme/nvme0 00:07:00.843 11:17:42 -- common/autotest_common.sh@1486 -- # [[ -z /sys/devices/pci0000:00/0000:00:11.0/nvme/nvme0 ]] 00:07:00.843 11:17:42 -- common/autotest_common.sh@1490 -- # basename /sys/devices/pci0000:00/0000:00:11.0/nvme/nvme0 00:07:00.843 11:17:42 -- common/autotest_common.sh@1490 -- # printf '%s\n' nvme0 00:07:00.843 11:17:42 -- common/autotest_common.sh@1523 -- # nvme_ctrlr=/dev/nvme0 00:07:00.843 11:17:42 -- common/autotest_common.sh@1524 -- # [[ -z /dev/nvme0 ]] 00:07:00.843 11:17:42 -- common/autotest_common.sh@1529 -- # nvme id-ctrl /dev/nvme0 00:07:00.843 11:17:42 -- common/autotest_common.sh@1529 -- # grep oacs 00:07:00.843 11:17:42 -- common/autotest_common.sh@1529 -- # cut -d: -f2 00:07:00.843 11:17:42 -- common/autotest_common.sh@1529 -- # oacs=' 0x12a' 00:07:00.843 11:17:42 -- common/autotest_common.sh@1530 -- # oacs_ns_manage=8 00:07:00.843 11:17:42 -- common/autotest_common.sh@1532 -- # [[ 8 -ne 0 ]] 00:07:00.843 11:17:42 -- common/autotest_common.sh@1538 -- # nvme id-ctrl /dev/nvme0 00:07:00.843 11:17:42 -- common/autotest_common.sh@1538 -- # grep unvmcap 00:07:00.843 11:17:42 -- common/autotest_common.sh@1538 -- # cut -d: -f2 00:07:00.843 11:17:42 -- common/autotest_common.sh@1538 -- # unvmcap=' 0' 00:07:00.843 11:17:42 -- common/autotest_common.sh@1539 -- # [[ 0 -eq 0 ]] 00:07:00.843 11:17:42 -- common/autotest_common.sh@1541 -- # continue 00:07:00.843 11:17:42 -- spdk/autotest.sh@122 -- # timing_exit pre_cleanup 00:07:00.843 11:17:42 -- common/autotest_common.sh@730 -- # xtrace_disable 00:07:00.843 11:17:42 -- common/autotest_common.sh@10 -- # set +x 00:07:00.843 11:17:42 -- spdk/autotest.sh@125 -- # timing_enter afterboot 00:07:00.843 11:17:42 -- common/autotest_common.sh@724 -- # xtrace_disable 00:07:00.843 11:17:42 -- common/autotest_common.sh@10 -- # set +x 00:07:00.843 11:17:42 -- spdk/autotest.sh@126 -- # /home/vagrant/spdk_repo/spdk/scripts/setup.sh 00:07:01.409 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:07:01.668 0000:00:10.0 (1b36 0010): nvme -> uio_pci_generic 00:07:01.668 0000:00:11.0 (1b36 0010): nvme -> uio_pci_generic 00:07:01.668 11:17:43 -- spdk/autotest.sh@127 -- # timing_exit afterboot 00:07:01.668 11:17:43 -- common/autotest_common.sh@730 -- # xtrace_disable 00:07:01.668 11:17:43 -- common/autotest_common.sh@10 -- # set +x 00:07:01.668 11:17:43 -- spdk/autotest.sh@131 -- # opal_revert_cleanup 00:07:01.668 11:17:43 -- common/autotest_common.sh@1576 -- # mapfile -t bdfs 00:07:01.668 11:17:43 -- common/autotest_common.sh@1576 -- # get_nvme_bdfs_by_id 0x0a54 00:07:01.668 11:17:43 -- common/autotest_common.sh@1561 -- # bdfs=() 00:07:01.668 11:17:43 -- common/autotest_common.sh@1561 -- # _bdfs=() 00:07:01.668 11:17:43 -- common/autotest_common.sh@1561 -- # local bdfs _bdfs 00:07:01.668 11:17:43 -- common/autotest_common.sh@1562 -- # _bdfs=($(get_nvme_bdfs)) 00:07:01.668 11:17:43 -- common/autotest_common.sh@1562 -- # get_nvme_bdfs 00:07:01.668 11:17:43 -- common/autotest_common.sh@1496 -- # bdfs=() 00:07:01.668 11:17:43 -- common/autotest_common.sh@1496 -- # local bdfs 00:07:01.668 11:17:43 -- common/autotest_common.sh@1497 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:07:01.668 11:17:43 -- common/autotest_common.sh@1497 -- # /home/vagrant/spdk_repo/spdk/scripts/gen_nvme.sh 00:07:01.668 11:17:43 -- common/autotest_common.sh@1497 -- # jq -r '.config[].params.traddr' 00:07:01.668 11:17:43 -- common/autotest_common.sh@1498 -- # (( 2 == 0 )) 00:07:01.668 11:17:43 -- common/autotest_common.sh@1502 -- # printf '%s\n' 0000:00:10.0 0000:00:11.0 00:07:01.668 11:17:43 -- common/autotest_common.sh@1563 -- # for bdf in "${_bdfs[@]}" 00:07:01.668 11:17:43 -- common/autotest_common.sh@1564 -- # cat /sys/bus/pci/devices/0000:00:10.0/device 00:07:01.668 11:17:43 -- common/autotest_common.sh@1564 -- # device=0x0010 00:07:01.668 11:17:43 -- common/autotest_common.sh@1565 -- # [[ 0x0010 == \0\x\0\a\5\4 ]] 00:07:01.668 11:17:43 -- common/autotest_common.sh@1563 -- # for bdf in "${_bdfs[@]}" 00:07:01.668 11:17:43 -- common/autotest_common.sh@1564 -- # cat /sys/bus/pci/devices/0000:00:11.0/device 00:07:01.668 11:17:43 -- common/autotest_common.sh@1564 -- # device=0x0010 00:07:01.668 11:17:43 -- common/autotest_common.sh@1565 -- # [[ 0x0010 == \0\x\0\a\5\4 ]] 00:07:01.668 11:17:43 -- common/autotest_common.sh@1570 -- # (( 0 > 0 )) 00:07:01.668 11:17:43 -- common/autotest_common.sh@1570 -- # return 0 00:07:01.668 11:17:43 -- common/autotest_common.sh@1577 -- # [[ -z '' ]] 00:07:01.668 11:17:43 -- common/autotest_common.sh@1578 -- # return 0 00:07:01.668 11:17:43 -- spdk/autotest.sh@137 -- # '[' 0 -eq 1 ']' 00:07:01.668 11:17:43 -- spdk/autotest.sh@141 -- # '[' 1 -eq 1 ']' 00:07:01.668 11:17:43 -- spdk/autotest.sh@142 -- # [[ 0 -eq 1 ]] 00:07:01.668 11:17:43 -- spdk/autotest.sh@142 -- # [[ 0 -eq 1 ]] 00:07:01.668 11:17:43 -- spdk/autotest.sh@149 -- # timing_enter lib 00:07:01.668 11:17:43 -- common/autotest_common.sh@724 -- # xtrace_disable 00:07:01.668 11:17:43 -- common/autotest_common.sh@10 -- # set +x 00:07:01.668 11:17:43 -- spdk/autotest.sh@151 -- # [[ 1 -eq 1 ]] 00:07:01.668 11:17:43 -- spdk/autotest.sh@152 -- # export SPDK_SOCK_IMPL_DEFAULT=uring 00:07:01.668 11:17:43 -- spdk/autotest.sh@152 -- # SPDK_SOCK_IMPL_DEFAULT=uring 00:07:01.668 11:17:43 -- spdk/autotest.sh@155 -- # run_test env /home/vagrant/spdk_repo/spdk/test/env/env.sh 00:07:01.668 11:17:43 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:01.668 11:17:43 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:01.668 11:17:43 -- common/autotest_common.sh@10 -- # set +x 00:07:01.668 ************************************ 00:07:01.668 START TEST env 00:07:01.668 ************************************ 00:07:01.668 11:17:43 env -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/env/env.sh 00:07:01.926 * Looking for test storage... 00:07:01.926 * Found test storage at /home/vagrant/spdk_repo/spdk/test/env 00:07:01.926 11:17:43 env -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:01.926 11:17:43 env -- common/autotest_common.sh@1681 -- # lcov --version 00:07:01.926 11:17:43 env -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:01.926 11:17:43 env -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:01.926 11:17:43 env -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:01.926 11:17:43 env -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:01.926 11:17:43 env -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:01.926 11:17:43 env -- scripts/common.sh@336 -- # IFS=.-: 00:07:01.927 11:17:43 env -- scripts/common.sh@336 -- # read -ra ver1 00:07:01.927 11:17:43 env -- scripts/common.sh@337 -- # IFS=.-: 00:07:01.927 11:17:43 env -- scripts/common.sh@337 -- # read -ra ver2 00:07:01.927 11:17:43 env -- scripts/common.sh@338 -- # local 'op=<' 00:07:01.927 11:17:43 env -- scripts/common.sh@340 -- # ver1_l=2 00:07:01.927 11:17:43 env -- scripts/common.sh@341 -- # ver2_l=1 00:07:01.927 11:17:43 env -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:01.927 11:17:43 env -- scripts/common.sh@344 -- # case "$op" in 00:07:01.927 11:17:43 env -- scripts/common.sh@345 -- # : 1 00:07:01.927 11:17:43 env -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:01.927 11:17:43 env -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:01.927 11:17:43 env -- scripts/common.sh@365 -- # decimal 1 00:07:01.927 11:17:43 env -- scripts/common.sh@353 -- # local d=1 00:07:01.927 11:17:43 env -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:01.927 11:17:43 env -- scripts/common.sh@355 -- # echo 1 00:07:01.927 11:17:43 env -- scripts/common.sh@365 -- # ver1[v]=1 00:07:01.927 11:17:43 env -- scripts/common.sh@366 -- # decimal 2 00:07:01.927 11:17:43 env -- scripts/common.sh@353 -- # local d=2 00:07:01.927 11:17:43 env -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:01.927 11:17:43 env -- scripts/common.sh@355 -- # echo 2 00:07:01.927 11:17:43 env -- scripts/common.sh@366 -- # ver2[v]=2 00:07:01.927 11:17:43 env -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:01.927 11:17:43 env -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:01.927 11:17:43 env -- scripts/common.sh@368 -- # return 0 00:07:01.927 11:17:43 env -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:01.927 11:17:43 env -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:01.927 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:01.927 --rc genhtml_branch_coverage=1 00:07:01.927 --rc genhtml_function_coverage=1 00:07:01.927 --rc genhtml_legend=1 00:07:01.927 --rc geninfo_all_blocks=1 00:07:01.927 --rc geninfo_unexecuted_blocks=1 00:07:01.927 00:07:01.927 ' 00:07:01.927 11:17:43 env -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:01.927 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:01.927 --rc genhtml_branch_coverage=1 00:07:01.927 --rc genhtml_function_coverage=1 00:07:01.927 --rc genhtml_legend=1 00:07:01.927 --rc geninfo_all_blocks=1 00:07:01.927 --rc geninfo_unexecuted_blocks=1 00:07:01.927 00:07:01.927 ' 00:07:01.927 11:17:43 env -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:01.927 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:01.927 --rc genhtml_branch_coverage=1 00:07:01.927 --rc genhtml_function_coverage=1 00:07:01.927 --rc genhtml_legend=1 00:07:01.927 --rc geninfo_all_blocks=1 00:07:01.927 --rc geninfo_unexecuted_blocks=1 00:07:01.927 00:07:01.927 ' 00:07:01.927 11:17:43 env -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:01.927 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:01.927 --rc genhtml_branch_coverage=1 00:07:01.927 --rc genhtml_function_coverage=1 00:07:01.927 --rc genhtml_legend=1 00:07:01.927 --rc geninfo_all_blocks=1 00:07:01.927 --rc geninfo_unexecuted_blocks=1 00:07:01.927 00:07:01.927 ' 00:07:01.927 11:17:43 env -- env/env.sh@10 -- # run_test env_memory /home/vagrant/spdk_repo/spdk/test/env/memory/memory_ut 00:07:01.927 11:17:43 env -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:01.927 11:17:43 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:01.927 11:17:43 env -- common/autotest_common.sh@10 -- # set +x 00:07:01.927 ************************************ 00:07:01.927 START TEST env_memory 00:07:01.927 ************************************ 00:07:01.927 11:17:43 env.env_memory -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/env/memory/memory_ut 00:07:01.927 00:07:01.927 00:07:01.927 CUnit - A unit testing framework for C - Version 2.1-3 00:07:01.927 http://cunit.sourceforge.net/ 00:07:01.927 00:07:01.927 00:07:01.927 Suite: memory 00:07:01.927 Test: alloc and free memory map ...[2024-10-07 11:17:43.623853] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:07:02.186 passed 00:07:02.186 Test: mem map translation ...[2024-10-07 11:17:43.654225] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 595:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:07:02.186 [2024-10-07 11:17:43.654345] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 595:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:07:02.186 [2024-10-07 11:17:43.654433] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 589:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:07:02.186 [2024-10-07 11:17:43.654453] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 605:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:07:02.186 passed 00:07:02.186 Test: mem map registration ...[2024-10-07 11:17:43.712919] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 347:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=200000 len=1234 00:07:02.186 [2024-10-07 11:17:43.713030] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 347:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=4d2 len=2097152 00:07:02.186 passed 00:07:02.186 Test: mem map adjacent registrations ...passed 00:07:02.186 00:07:02.186 Run Summary: Type Total Ran Passed Failed Inactive 00:07:02.186 suites 1 1 n/a 0 0 00:07:02.186 tests 4 4 4 0 0 00:07:02.186 asserts 152 152 152 0 n/a 00:07:02.186 00:07:02.186 Elapsed time = 0.199 seconds 00:07:02.186 00:07:02.186 real 0m0.217s 00:07:02.186 user 0m0.200s 00:07:02.186 sys 0m0.012s 00:07:02.186 11:17:43 env.env_memory -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:02.186 11:17:43 env.env_memory -- common/autotest_common.sh@10 -- # set +x 00:07:02.186 ************************************ 00:07:02.186 END TEST env_memory 00:07:02.186 ************************************ 00:07:02.186 11:17:43 env -- env/env.sh@11 -- # run_test env_vtophys /home/vagrant/spdk_repo/spdk/test/env/vtophys/vtophys 00:07:02.186 11:17:43 env -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:02.186 11:17:43 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:02.186 11:17:43 env -- common/autotest_common.sh@10 -- # set +x 00:07:02.186 ************************************ 00:07:02.186 START TEST env_vtophys 00:07:02.186 ************************************ 00:07:02.186 11:17:43 env.env_vtophys -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/env/vtophys/vtophys 00:07:02.186 EAL: lib.eal log level changed from notice to debug 00:07:02.186 EAL: Detected lcore 0 as core 0 on socket 0 00:07:02.186 EAL: Detected lcore 1 as core 0 on socket 0 00:07:02.186 EAL: Detected lcore 2 as core 0 on socket 0 00:07:02.186 EAL: Detected lcore 3 as core 0 on socket 0 00:07:02.186 EAL: Detected lcore 4 as core 0 on socket 0 00:07:02.186 EAL: Detected lcore 5 as core 0 on socket 0 00:07:02.186 EAL: Detected lcore 6 as core 0 on socket 0 00:07:02.186 EAL: Detected lcore 7 as core 0 on socket 0 00:07:02.186 EAL: Detected lcore 8 as core 0 on socket 0 00:07:02.186 EAL: Detected lcore 9 as core 0 on socket 0 00:07:02.186 EAL: Maximum logical cores by configuration: 128 00:07:02.186 EAL: Detected CPU lcores: 10 00:07:02.186 EAL: Detected NUMA nodes: 1 00:07:02.186 EAL: Checking presence of .so 'librte_eal.so.24.1' 00:07:02.186 EAL: Detected shared linkage of DPDK 00:07:02.187 EAL: No shared files mode enabled, IPC will be disabled 00:07:02.187 EAL: Selected IOVA mode 'PA' 00:07:02.187 EAL: Probing VFIO support... 00:07:02.187 EAL: Module /sys/module/vfio not found! error 2 (No such file or directory) 00:07:02.187 EAL: VFIO modules not loaded, skipping VFIO support... 00:07:02.187 EAL: Ask a virtual area of 0x2e000 bytes 00:07:02.187 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:07:02.187 EAL: Setting up physically contiguous memory... 00:07:02.187 EAL: Setting maximum number of open files to 524288 00:07:02.187 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:07:02.187 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:07:02.187 EAL: Ask a virtual area of 0x61000 bytes 00:07:02.187 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:07:02.187 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:07:02.187 EAL: Ask a virtual area of 0x400000000 bytes 00:07:02.187 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:07:02.187 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:07:02.187 EAL: Ask a virtual area of 0x61000 bytes 00:07:02.187 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:07:02.187 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:07:02.187 EAL: Ask a virtual area of 0x400000000 bytes 00:07:02.187 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:07:02.187 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:07:02.187 EAL: Ask a virtual area of 0x61000 bytes 00:07:02.187 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:07:02.187 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:07:02.187 EAL: Ask a virtual area of 0x400000000 bytes 00:07:02.187 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:07:02.187 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:07:02.187 EAL: Ask a virtual area of 0x61000 bytes 00:07:02.187 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:07:02.187 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:07:02.187 EAL: Ask a virtual area of 0x400000000 bytes 00:07:02.187 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:07:02.187 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:07:02.187 EAL: Hugepages will be freed exactly as allocated. 00:07:02.187 EAL: No shared files mode enabled, IPC is disabled 00:07:02.187 EAL: No shared files mode enabled, IPC is disabled 00:07:02.446 EAL: TSC frequency is ~2200000 KHz 00:07:02.446 EAL: Main lcore 0 is ready (tid=7f0cfc634a00;cpuset=[0]) 00:07:02.446 EAL: Trying to obtain current memory policy. 00:07:02.446 EAL: Setting policy MPOL_PREFERRED for socket 0 00:07:02.446 EAL: Restoring previous memory policy: 0 00:07:02.446 EAL: request: mp_malloc_sync 00:07:02.446 EAL: No shared files mode enabled, IPC is disabled 00:07:02.446 EAL: Heap on socket 0 was expanded by 2MB 00:07:02.446 EAL: Module /sys/module/vfio not found! error 2 (No such file or directory) 00:07:02.446 EAL: No PCI address specified using 'addr=' in: bus=pci 00:07:02.446 EAL: Mem event callback 'spdk:(nil)' registered 00:07:02.446 EAL: Module /sys/module/vfio_pci not found! error 2 (No such file or directory) 00:07:02.446 00:07:02.446 00:07:02.446 CUnit - A unit testing framework for C - Version 2.1-3 00:07:02.446 http://cunit.sourceforge.net/ 00:07:02.446 00:07:02.446 00:07:02.446 Suite: components_suite 00:07:02.446 Test: vtophys_malloc_test ...passed 00:07:02.446 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:07:02.446 EAL: Setting policy MPOL_PREFERRED for socket 0 00:07:02.446 EAL: Restoring previous memory policy: 4 00:07:02.446 EAL: Calling mem event callback 'spdk:(nil)' 00:07:02.446 EAL: request: mp_malloc_sync 00:07:02.446 EAL: No shared files mode enabled, IPC is disabled 00:07:02.446 EAL: Heap on socket 0 was expanded by 4MB 00:07:02.446 EAL: Calling mem event callback 'spdk:(nil)' 00:07:02.446 EAL: request: mp_malloc_sync 00:07:02.446 EAL: No shared files mode enabled, IPC is disabled 00:07:02.446 EAL: Heap on socket 0 was shrunk by 4MB 00:07:02.446 EAL: Trying to obtain current memory policy. 00:07:02.446 EAL: Setting policy MPOL_PREFERRED for socket 0 00:07:02.446 EAL: Restoring previous memory policy: 4 00:07:02.446 EAL: Calling mem event callback 'spdk:(nil)' 00:07:02.446 EAL: request: mp_malloc_sync 00:07:02.446 EAL: No shared files mode enabled, IPC is disabled 00:07:02.446 EAL: Heap on socket 0 was expanded by 6MB 00:07:02.446 EAL: Calling mem event callback 'spdk:(nil)' 00:07:02.446 EAL: request: mp_malloc_sync 00:07:02.446 EAL: No shared files mode enabled, IPC is disabled 00:07:02.446 EAL: Heap on socket 0 was shrunk by 6MB 00:07:02.446 EAL: Trying to obtain current memory policy. 00:07:02.446 EAL: Setting policy MPOL_PREFERRED for socket 0 00:07:02.446 EAL: Restoring previous memory policy: 4 00:07:02.446 EAL: Calling mem event callback 'spdk:(nil)' 00:07:02.446 EAL: request: mp_malloc_sync 00:07:02.446 EAL: No shared files mode enabled, IPC is disabled 00:07:02.446 EAL: Heap on socket 0 was expanded by 10MB 00:07:02.446 EAL: Calling mem event callback 'spdk:(nil)' 00:07:02.446 EAL: request: mp_malloc_sync 00:07:02.446 EAL: No shared files mode enabled, IPC is disabled 00:07:02.446 EAL: Heap on socket 0 was shrunk by 10MB 00:07:02.446 EAL: Trying to obtain current memory policy. 00:07:02.446 EAL: Setting policy MPOL_PREFERRED for socket 0 00:07:02.446 EAL: Restoring previous memory policy: 4 00:07:02.446 EAL: Calling mem event callback 'spdk:(nil)' 00:07:02.446 EAL: request: mp_malloc_sync 00:07:02.446 EAL: No shared files mode enabled, IPC is disabled 00:07:02.446 EAL: Heap on socket 0 was expanded by 18MB 00:07:02.446 EAL: Calling mem event callback 'spdk:(nil)' 00:07:02.446 EAL: request: mp_malloc_sync 00:07:02.446 EAL: No shared files mode enabled, IPC is disabled 00:07:02.446 EAL: Heap on socket 0 was shrunk by 18MB 00:07:02.446 EAL: Trying to obtain current memory policy. 00:07:02.446 EAL: Setting policy MPOL_PREFERRED for socket 0 00:07:02.446 EAL: Restoring previous memory policy: 4 00:07:02.446 EAL: Calling mem event callback 'spdk:(nil)' 00:07:02.446 EAL: request: mp_malloc_sync 00:07:02.446 EAL: No shared files mode enabled, IPC is disabled 00:07:02.446 EAL: Heap on socket 0 was expanded by 34MB 00:07:02.446 EAL: Calling mem event callback 'spdk:(nil)' 00:07:02.446 EAL: request: mp_malloc_sync 00:07:02.446 EAL: No shared files mode enabled, IPC is disabled 00:07:02.446 EAL: Heap on socket 0 was shrunk by 34MB 00:07:02.446 EAL: Trying to obtain current memory policy. 00:07:02.446 EAL: Setting policy MPOL_PREFERRED for socket 0 00:07:02.446 EAL: Restoring previous memory policy: 4 00:07:02.446 EAL: Calling mem event callback 'spdk:(nil)' 00:07:02.446 EAL: request: mp_malloc_sync 00:07:02.446 EAL: No shared files mode enabled, IPC is disabled 00:07:02.446 EAL: Heap on socket 0 was expanded by 66MB 00:07:02.446 EAL: Calling mem event callback 'spdk:(nil)' 00:07:02.446 EAL: request: mp_malloc_sync 00:07:02.446 EAL: No shared files mode enabled, IPC is disabled 00:07:02.446 EAL: Heap on socket 0 was shrunk by 66MB 00:07:02.446 EAL: Trying to obtain current memory policy. 00:07:02.446 EAL: Setting policy MPOL_PREFERRED for socket 0 00:07:02.446 EAL: Restoring previous memory policy: 4 00:07:02.446 EAL: Calling mem event callback 'spdk:(nil)' 00:07:02.446 EAL: request: mp_malloc_sync 00:07:02.446 EAL: No shared files mode enabled, IPC is disabled 00:07:02.446 EAL: Heap on socket 0 was expanded by 130MB 00:07:02.446 EAL: Calling mem event callback 'spdk:(nil)' 00:07:02.446 EAL: request: mp_malloc_sync 00:07:02.446 EAL: No shared files mode enabled, IPC is disabled 00:07:02.446 EAL: Heap on socket 0 was shrunk by 130MB 00:07:02.446 EAL: Trying to obtain current memory policy. 00:07:02.446 EAL: Setting policy MPOL_PREFERRED for socket 0 00:07:02.446 EAL: Restoring previous memory policy: 4 00:07:02.446 EAL: Calling mem event callback 'spdk:(nil)' 00:07:02.446 EAL: request: mp_malloc_sync 00:07:02.446 EAL: No shared files mode enabled, IPC is disabled 00:07:02.446 EAL: Heap on socket 0 was expanded by 258MB 00:07:02.446 EAL: Calling mem event callback 'spdk:(nil)' 00:07:02.704 EAL: request: mp_malloc_sync 00:07:02.704 EAL: No shared files mode enabled, IPC is disabled 00:07:02.704 EAL: Heap on socket 0 was shrunk by 258MB 00:07:02.704 EAL: Trying to obtain current memory policy. 00:07:02.704 EAL: Setting policy MPOL_PREFERRED for socket 0 00:07:02.704 EAL: Restoring previous memory policy: 4 00:07:02.704 EAL: Calling mem event callback 'spdk:(nil)' 00:07:02.704 EAL: request: mp_malloc_sync 00:07:02.704 EAL: No shared files mode enabled, IPC is disabled 00:07:02.704 EAL: Heap on socket 0 was expanded by 514MB 00:07:02.704 EAL: Calling mem event callback 'spdk:(nil)' 00:07:02.704 EAL: request: mp_malloc_sync 00:07:02.704 EAL: No shared files mode enabled, IPC is disabled 00:07:02.704 EAL: Heap on socket 0 was shrunk by 514MB 00:07:02.704 EAL: Trying to obtain current memory policy. 00:07:02.704 EAL: Setting policy MPOL_PREFERRED for socket 0 00:07:03.015 EAL: Restoring previous memory policy: 4 00:07:03.015 EAL: Calling mem event callback 'spdk:(nil)' 00:07:03.015 EAL: request: mp_malloc_sync 00:07:03.015 EAL: No shared files mode enabled, IPC is disabled 00:07:03.015 EAL: Heap on socket 0 was expanded by 1026MB 00:07:03.015 EAL: Calling mem event callback 'spdk:(nil)' 00:07:03.276 EAL: request: mp_malloc_sync 00:07:03.276 EAL: No shared files mode enabled, IPC is disabled 00:07:03.276 EAL: Heap on socket 0 was shrunk by 1026MB 00:07:03.276 passed 00:07:03.276 00:07:03.276 Run Summary: Type Total Ran Passed Failed Inactive 00:07:03.276 suites 1 1 n/a 0 0 00:07:03.276 tests 2 2 2 0 0 00:07:03.276 asserts 5505 5505 5505 0 n/a 00:07:03.276 00:07:03.276 Elapsed time = 0.690 seconds 00:07:03.276 EAL: Calling mem event callback 'spdk:(nil)' 00:07:03.276 EAL: request: mp_malloc_sync 00:07:03.276 EAL: No shared files mode enabled, IPC is disabled 00:07:03.276 EAL: Heap on socket 0 was shrunk by 2MB 00:07:03.276 EAL: No shared files mode enabled, IPC is disabled 00:07:03.276 EAL: No shared files mode enabled, IPC is disabled 00:07:03.276 EAL: No shared files mode enabled, IPC is disabled 00:07:03.276 00:07:03.276 real 0m0.901s 00:07:03.276 user 0m0.453s 00:07:03.276 sys 0m0.308s 00:07:03.276 11:17:44 env.env_vtophys -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:03.276 11:17:44 env.env_vtophys -- common/autotest_common.sh@10 -- # set +x 00:07:03.276 ************************************ 00:07:03.276 END TEST env_vtophys 00:07:03.276 ************************************ 00:07:03.276 11:17:44 env -- env/env.sh@12 -- # run_test env_pci /home/vagrant/spdk_repo/spdk/test/env/pci/pci_ut 00:07:03.276 11:17:44 env -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:03.276 11:17:44 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:03.276 11:17:44 env -- common/autotest_common.sh@10 -- # set +x 00:07:03.276 ************************************ 00:07:03.276 START TEST env_pci 00:07:03.276 ************************************ 00:07:03.276 11:17:44 env.env_pci -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/env/pci/pci_ut 00:07:03.276 00:07:03.276 00:07:03.276 CUnit - A unit testing framework for C - Version 2.1-3 00:07:03.276 http://cunit.sourceforge.net/ 00:07:03.276 00:07:03.276 00:07:03.276 Suite: pci 00:07:03.276 Test: pci_hook ...[2024-10-07 11:17:44.792477] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/pci.c:1049:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 56860 has claimed it 00:07:03.276 passed 00:07:03.276 00:07:03.276 Run Summary: Type Total Ran Passed Failed Inactive 00:07:03.276 suites 1 1 n/a 0 0 00:07:03.276 tests 1 1 1 0 0 00:07:03.276 asserts 25 25 25 0 n/a 00:07:03.276 00:07:03.276 Elapsed time = 0.003 seconds 00:07:03.276 EAL: Cannot find device (10000:00:01.0) 00:07:03.276 EAL: Failed to attach device on primary process 00:07:03.276 00:07:03.276 real 0m0.018s 00:07:03.276 user 0m0.007s 00:07:03.276 sys 0m0.011s 00:07:03.276 11:17:44 env.env_pci -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:03.276 11:17:44 env.env_pci -- common/autotest_common.sh@10 -- # set +x 00:07:03.276 ************************************ 00:07:03.276 END TEST env_pci 00:07:03.276 ************************************ 00:07:03.276 11:17:44 env -- env/env.sh@14 -- # argv='-c 0x1 ' 00:07:03.276 11:17:44 env -- env/env.sh@15 -- # uname 00:07:03.276 11:17:44 env -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:07:03.276 11:17:44 env -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:07:03.276 11:17:44 env -- env/env.sh@24 -- # run_test env_dpdk_post_init /home/vagrant/spdk_repo/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:07:03.276 11:17:44 env -- common/autotest_common.sh@1101 -- # '[' 5 -le 1 ']' 00:07:03.276 11:17:44 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:03.276 11:17:44 env -- common/autotest_common.sh@10 -- # set +x 00:07:03.276 ************************************ 00:07:03.276 START TEST env_dpdk_post_init 00:07:03.276 ************************************ 00:07:03.276 11:17:44 env.env_dpdk_post_init -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:07:03.276 EAL: Detected CPU lcores: 10 00:07:03.276 EAL: Detected NUMA nodes: 1 00:07:03.276 EAL: Detected shared linkage of DPDK 00:07:03.276 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:07:03.276 EAL: Selected IOVA mode 'PA' 00:07:03.534 TELEMETRY: No legacy callbacks, legacy socket not created 00:07:03.534 EAL: Probe PCI driver: spdk_nvme (1b36:0010) device: 0000:00:10.0 (socket -1) 00:07:03.534 EAL: Probe PCI driver: spdk_nvme (1b36:0010) device: 0000:00:11.0 (socket -1) 00:07:03.534 Starting DPDK initialization... 00:07:03.534 Starting SPDK post initialization... 00:07:03.534 SPDK NVMe probe 00:07:03.534 Attaching to 0000:00:10.0 00:07:03.534 Attaching to 0000:00:11.0 00:07:03.534 Attached to 0000:00:10.0 00:07:03.534 Attached to 0000:00:11.0 00:07:03.534 Cleaning up... 00:07:03.534 00:07:03.534 real 0m0.189s 00:07:03.534 user 0m0.055s 00:07:03.534 sys 0m0.034s 00:07:03.534 11:17:45 env.env_dpdk_post_init -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:03.534 11:17:45 env.env_dpdk_post_init -- common/autotest_common.sh@10 -- # set +x 00:07:03.534 ************************************ 00:07:03.534 END TEST env_dpdk_post_init 00:07:03.534 ************************************ 00:07:03.534 11:17:45 env -- env/env.sh@26 -- # uname 00:07:03.534 11:17:45 env -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:07:03.534 11:17:45 env -- env/env.sh@29 -- # run_test env_mem_callbacks /home/vagrant/spdk_repo/spdk/test/env/mem_callbacks/mem_callbacks 00:07:03.534 11:17:45 env -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:03.534 11:17:45 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:03.534 11:17:45 env -- common/autotest_common.sh@10 -- # set +x 00:07:03.534 ************************************ 00:07:03.534 START TEST env_mem_callbacks 00:07:03.534 ************************************ 00:07:03.534 11:17:45 env.env_mem_callbacks -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/env/mem_callbacks/mem_callbacks 00:07:03.534 EAL: Detected CPU lcores: 10 00:07:03.534 EAL: Detected NUMA nodes: 1 00:07:03.534 EAL: Detected shared linkage of DPDK 00:07:03.534 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:07:03.534 EAL: Selected IOVA mode 'PA' 00:07:03.534 TELEMETRY: No legacy callbacks, legacy socket not created 00:07:03.534 00:07:03.534 00:07:03.534 CUnit - A unit testing framework for C - Version 2.1-3 00:07:03.534 http://cunit.sourceforge.net/ 00:07:03.534 00:07:03.534 00:07:03.534 Suite: memory 00:07:03.534 Test: test ... 00:07:03.534 register 0x200000200000 2097152 00:07:03.534 malloc 3145728 00:07:03.534 register 0x200000400000 4194304 00:07:03.534 buf 0x200000500000 len 3145728 PASSED 00:07:03.534 malloc 64 00:07:03.534 buf 0x2000004fff40 len 64 PASSED 00:07:03.534 malloc 4194304 00:07:03.534 register 0x200000800000 6291456 00:07:03.534 buf 0x200000a00000 len 4194304 PASSED 00:07:03.534 free 0x200000500000 3145728 00:07:03.534 free 0x2000004fff40 64 00:07:03.534 unregister 0x200000400000 4194304 PASSED 00:07:03.534 free 0x200000a00000 4194304 00:07:03.534 unregister 0x200000800000 6291456 PASSED 00:07:03.534 malloc 8388608 00:07:03.534 register 0x200000400000 10485760 00:07:03.534 buf 0x200000600000 len 8388608 PASSED 00:07:03.534 free 0x200000600000 8388608 00:07:03.534 unregister 0x200000400000 10485760 PASSED 00:07:03.534 passed 00:07:03.534 00:07:03.534 Run Summary: Type Total Ran Passed Failed Inactive 00:07:03.534 suites 1 1 n/a 0 0 00:07:03.534 tests 1 1 1 0 0 00:07:03.534 asserts 15 15 15 0 n/a 00:07:03.534 00:07:03.534 Elapsed time = 0.006 seconds 00:07:03.534 00:07:03.534 real 0m0.144s 00:07:03.534 user 0m0.019s 00:07:03.534 sys 0m0.023s 00:07:03.534 11:17:45 env.env_mem_callbacks -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:03.534 11:17:45 env.env_mem_callbacks -- common/autotest_common.sh@10 -- # set +x 00:07:03.534 ************************************ 00:07:03.534 END TEST env_mem_callbacks 00:07:03.534 ************************************ 00:07:03.792 ************************************ 00:07:03.792 END TEST env 00:07:03.792 ************************************ 00:07:03.792 00:07:03.792 real 0m1.893s 00:07:03.792 user 0m0.949s 00:07:03.792 sys 0m0.591s 00:07:03.792 11:17:45 env -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:03.792 11:17:45 env -- common/autotest_common.sh@10 -- # set +x 00:07:03.792 11:17:45 -- spdk/autotest.sh@156 -- # run_test rpc /home/vagrant/spdk_repo/spdk/test/rpc/rpc.sh 00:07:03.792 11:17:45 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:03.792 11:17:45 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:03.792 11:17:45 -- common/autotest_common.sh@10 -- # set +x 00:07:03.792 ************************************ 00:07:03.792 START TEST rpc 00:07:03.792 ************************************ 00:07:03.792 11:17:45 rpc -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/rpc/rpc.sh 00:07:03.792 * Looking for test storage... 00:07:03.792 * Found test storage at /home/vagrant/spdk_repo/spdk/test/rpc 00:07:03.792 11:17:45 rpc -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:03.792 11:17:45 rpc -- common/autotest_common.sh@1681 -- # lcov --version 00:07:03.792 11:17:45 rpc -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:03.792 11:17:45 rpc -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:03.792 11:17:45 rpc -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:03.792 11:17:45 rpc -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:03.792 11:17:45 rpc -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:03.792 11:17:45 rpc -- scripts/common.sh@336 -- # IFS=.-: 00:07:03.792 11:17:45 rpc -- scripts/common.sh@336 -- # read -ra ver1 00:07:03.792 11:17:45 rpc -- scripts/common.sh@337 -- # IFS=.-: 00:07:03.793 11:17:45 rpc -- scripts/common.sh@337 -- # read -ra ver2 00:07:03.793 11:17:45 rpc -- scripts/common.sh@338 -- # local 'op=<' 00:07:03.793 11:17:45 rpc -- scripts/common.sh@340 -- # ver1_l=2 00:07:03.793 11:17:45 rpc -- scripts/common.sh@341 -- # ver2_l=1 00:07:03.793 11:17:45 rpc -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:03.793 11:17:45 rpc -- scripts/common.sh@344 -- # case "$op" in 00:07:03.793 11:17:45 rpc -- scripts/common.sh@345 -- # : 1 00:07:03.793 11:17:45 rpc -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:03.793 11:17:45 rpc -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:03.793 11:17:45 rpc -- scripts/common.sh@365 -- # decimal 1 00:07:03.793 11:17:45 rpc -- scripts/common.sh@353 -- # local d=1 00:07:03.793 11:17:45 rpc -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:03.793 11:17:45 rpc -- scripts/common.sh@355 -- # echo 1 00:07:03.793 11:17:45 rpc -- scripts/common.sh@365 -- # ver1[v]=1 00:07:03.793 11:17:45 rpc -- scripts/common.sh@366 -- # decimal 2 00:07:03.793 11:17:45 rpc -- scripts/common.sh@353 -- # local d=2 00:07:03.793 11:17:45 rpc -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:03.793 11:17:45 rpc -- scripts/common.sh@355 -- # echo 2 00:07:03.793 11:17:45 rpc -- scripts/common.sh@366 -- # ver2[v]=2 00:07:03.793 11:17:45 rpc -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:03.793 11:17:45 rpc -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:03.793 11:17:45 rpc -- scripts/common.sh@368 -- # return 0 00:07:03.793 11:17:45 rpc -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:03.793 11:17:45 rpc -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:03.793 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.793 --rc genhtml_branch_coverage=1 00:07:03.793 --rc genhtml_function_coverage=1 00:07:03.793 --rc genhtml_legend=1 00:07:03.793 --rc geninfo_all_blocks=1 00:07:03.793 --rc geninfo_unexecuted_blocks=1 00:07:03.793 00:07:03.793 ' 00:07:03.793 11:17:45 rpc -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:03.793 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.793 --rc genhtml_branch_coverage=1 00:07:03.793 --rc genhtml_function_coverage=1 00:07:03.793 --rc genhtml_legend=1 00:07:03.793 --rc geninfo_all_blocks=1 00:07:03.793 --rc geninfo_unexecuted_blocks=1 00:07:03.793 00:07:03.793 ' 00:07:03.793 11:17:45 rpc -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:03.793 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.793 --rc genhtml_branch_coverage=1 00:07:03.793 --rc genhtml_function_coverage=1 00:07:03.793 --rc genhtml_legend=1 00:07:03.793 --rc geninfo_all_blocks=1 00:07:03.793 --rc geninfo_unexecuted_blocks=1 00:07:03.793 00:07:03.793 ' 00:07:03.793 11:17:45 rpc -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:03.793 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.793 --rc genhtml_branch_coverage=1 00:07:03.793 --rc genhtml_function_coverage=1 00:07:03.793 --rc genhtml_legend=1 00:07:03.793 --rc geninfo_all_blocks=1 00:07:03.793 --rc geninfo_unexecuted_blocks=1 00:07:03.793 00:07:03.793 ' 00:07:03.793 11:17:45 rpc -- rpc/rpc.sh@65 -- # spdk_pid=56979 00:07:03.793 11:17:45 rpc -- rpc/rpc.sh@64 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -e bdev 00:07:03.793 11:17:45 rpc -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:07:03.793 11:17:45 rpc -- rpc/rpc.sh@67 -- # waitforlisten 56979 00:07:03.793 11:17:45 rpc -- common/autotest_common.sh@831 -- # '[' -z 56979 ']' 00:07:03.793 11:17:45 rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:03.793 11:17:45 rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:03.793 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:03.793 11:17:45 rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:03.793 11:17:45 rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:03.793 11:17:45 rpc -- common/autotest_common.sh@10 -- # set +x 00:07:04.051 [2024-10-07 11:17:45.545782] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:04.051 [2024-10-07 11:17:45.545882] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid56979 ] 00:07:04.051 [2024-10-07 11:17:45.680498] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:04.051 [2024-10-07 11:17:45.739804] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:07:04.051 [2024-10-07 11:17:45.739872] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 56979' to capture a snapshot of events at runtime. 00:07:04.051 [2024-10-07 11:17:45.739884] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:04.051 [2024-10-07 11:17:45.739894] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:04.051 [2024-10-07 11:17:45.739905] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid56979 for offline analysis/debug. 00:07:04.051 [2024-10-07 11:17:45.740306] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:04.309 [2024-10-07 11:17:45.779954] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:07:04.309 11:17:45 rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:04.309 11:17:45 rpc -- common/autotest_common.sh@864 -- # return 0 00:07:04.309 11:17:45 rpc -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/test/rpc 00:07:04.309 11:17:45 rpc -- rpc/rpc.sh@69 -- # PYTHONPATH=:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/test/rpc 00:07:04.309 11:17:45 rpc -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:07:04.309 11:17:45 rpc -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:07:04.309 11:17:45 rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:04.309 11:17:45 rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:04.309 11:17:45 rpc -- common/autotest_common.sh@10 -- # set +x 00:07:04.309 ************************************ 00:07:04.309 START TEST rpc_integrity 00:07:04.309 ************************************ 00:07:04.309 11:17:45 rpc.rpc_integrity -- common/autotest_common.sh@1125 -- # rpc_integrity 00:07:04.309 11:17:45 rpc.rpc_integrity -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:07:04.309 11:17:45 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.309 11:17:45 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:07:04.309 11:17:45 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.309 11:17:45 rpc.rpc_integrity -- rpc/rpc.sh@12 -- # bdevs='[]' 00:07:04.309 11:17:45 rpc.rpc_integrity -- rpc/rpc.sh@13 -- # jq length 00:07:04.309 11:17:45 rpc.rpc_integrity -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:07:04.309 11:17:46 rpc.rpc_integrity -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:07:04.309 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.310 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:07:04.310 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.310 11:17:46 rpc.rpc_integrity -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:07:04.310 11:17:46 rpc.rpc_integrity -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:07:04.310 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.310 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:07:04.568 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.568 11:17:46 rpc.rpc_integrity -- rpc/rpc.sh@16 -- # bdevs='[ 00:07:04.568 { 00:07:04.568 "name": "Malloc0", 00:07:04.568 "aliases": [ 00:07:04.568 "7f33dd65-e778-4965-8038-3781a65164c2" 00:07:04.568 ], 00:07:04.568 "product_name": "Malloc disk", 00:07:04.568 "block_size": 512, 00:07:04.568 "num_blocks": 16384, 00:07:04.568 "uuid": "7f33dd65-e778-4965-8038-3781a65164c2", 00:07:04.568 "assigned_rate_limits": { 00:07:04.568 "rw_ios_per_sec": 0, 00:07:04.568 "rw_mbytes_per_sec": 0, 00:07:04.568 "r_mbytes_per_sec": 0, 00:07:04.568 "w_mbytes_per_sec": 0 00:07:04.568 }, 00:07:04.568 "claimed": false, 00:07:04.568 "zoned": false, 00:07:04.568 "supported_io_types": { 00:07:04.568 "read": true, 00:07:04.568 "write": true, 00:07:04.568 "unmap": true, 00:07:04.568 "flush": true, 00:07:04.568 "reset": true, 00:07:04.568 "nvme_admin": false, 00:07:04.568 "nvme_io": false, 00:07:04.568 "nvme_io_md": false, 00:07:04.568 "write_zeroes": true, 00:07:04.568 "zcopy": true, 00:07:04.568 "get_zone_info": false, 00:07:04.568 "zone_management": false, 00:07:04.568 "zone_append": false, 00:07:04.568 "compare": false, 00:07:04.568 "compare_and_write": false, 00:07:04.568 "abort": true, 00:07:04.568 "seek_hole": false, 00:07:04.568 "seek_data": false, 00:07:04.568 "copy": true, 00:07:04.568 "nvme_iov_md": false 00:07:04.568 }, 00:07:04.568 "memory_domains": [ 00:07:04.568 { 00:07:04.568 "dma_device_id": "system", 00:07:04.568 "dma_device_type": 1 00:07:04.568 }, 00:07:04.568 { 00:07:04.568 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:04.568 "dma_device_type": 2 00:07:04.568 } 00:07:04.568 ], 00:07:04.568 "driver_specific": {} 00:07:04.568 } 00:07:04.568 ]' 00:07:04.568 11:17:46 rpc.rpc_integrity -- rpc/rpc.sh@17 -- # jq length 00:07:04.568 11:17:46 rpc.rpc_integrity -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:07:04.568 11:17:46 rpc.rpc_integrity -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:07:04.568 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.568 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:07:04.568 [2024-10-07 11:17:46.095864] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:07:04.568 [2024-10-07 11:17:46.095934] vbdev_passthru.c: 635:vbdev_passthru_register: *NOTICE*: base bdev opened 00:07:04.568 [2024-10-07 11:17:46.095968] vbdev_passthru.c: 681:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1f90120 00:07:04.568 [2024-10-07 11:17:46.095995] vbdev_passthru.c: 696:vbdev_passthru_register: *NOTICE*: bdev claimed 00:07:04.568 [2024-10-07 11:17:46.097713] vbdev_passthru.c: 709:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:07:04.568 [2024-10-07 11:17:46.097761] vbdev_passthru.c: 710:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:07:04.568 Passthru0 00:07:04.568 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.568 11:17:46 rpc.rpc_integrity -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:07:04.568 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.568 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:07:04.568 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.568 11:17:46 rpc.rpc_integrity -- rpc/rpc.sh@20 -- # bdevs='[ 00:07:04.568 { 00:07:04.568 "name": "Malloc0", 00:07:04.568 "aliases": [ 00:07:04.568 "7f33dd65-e778-4965-8038-3781a65164c2" 00:07:04.568 ], 00:07:04.568 "product_name": "Malloc disk", 00:07:04.568 "block_size": 512, 00:07:04.568 "num_blocks": 16384, 00:07:04.568 "uuid": "7f33dd65-e778-4965-8038-3781a65164c2", 00:07:04.568 "assigned_rate_limits": { 00:07:04.568 "rw_ios_per_sec": 0, 00:07:04.568 "rw_mbytes_per_sec": 0, 00:07:04.568 "r_mbytes_per_sec": 0, 00:07:04.568 "w_mbytes_per_sec": 0 00:07:04.568 }, 00:07:04.568 "claimed": true, 00:07:04.568 "claim_type": "exclusive_write", 00:07:04.568 "zoned": false, 00:07:04.568 "supported_io_types": { 00:07:04.568 "read": true, 00:07:04.568 "write": true, 00:07:04.568 "unmap": true, 00:07:04.568 "flush": true, 00:07:04.568 "reset": true, 00:07:04.568 "nvme_admin": false, 00:07:04.568 "nvme_io": false, 00:07:04.568 "nvme_io_md": false, 00:07:04.568 "write_zeroes": true, 00:07:04.568 "zcopy": true, 00:07:04.568 "get_zone_info": false, 00:07:04.568 "zone_management": false, 00:07:04.568 "zone_append": false, 00:07:04.568 "compare": false, 00:07:04.568 "compare_and_write": false, 00:07:04.568 "abort": true, 00:07:04.568 "seek_hole": false, 00:07:04.568 "seek_data": false, 00:07:04.568 "copy": true, 00:07:04.568 "nvme_iov_md": false 00:07:04.568 }, 00:07:04.568 "memory_domains": [ 00:07:04.568 { 00:07:04.568 "dma_device_id": "system", 00:07:04.568 "dma_device_type": 1 00:07:04.568 }, 00:07:04.568 { 00:07:04.568 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:04.568 "dma_device_type": 2 00:07:04.568 } 00:07:04.568 ], 00:07:04.568 "driver_specific": {} 00:07:04.568 }, 00:07:04.568 { 00:07:04.568 "name": "Passthru0", 00:07:04.568 "aliases": [ 00:07:04.568 "651753fd-1820-5001-adc1-f0aecc815032" 00:07:04.568 ], 00:07:04.568 "product_name": "passthru", 00:07:04.568 "block_size": 512, 00:07:04.568 "num_blocks": 16384, 00:07:04.568 "uuid": "651753fd-1820-5001-adc1-f0aecc815032", 00:07:04.568 "assigned_rate_limits": { 00:07:04.568 "rw_ios_per_sec": 0, 00:07:04.568 "rw_mbytes_per_sec": 0, 00:07:04.568 "r_mbytes_per_sec": 0, 00:07:04.568 "w_mbytes_per_sec": 0 00:07:04.568 }, 00:07:04.568 "claimed": false, 00:07:04.568 "zoned": false, 00:07:04.568 "supported_io_types": { 00:07:04.568 "read": true, 00:07:04.568 "write": true, 00:07:04.568 "unmap": true, 00:07:04.568 "flush": true, 00:07:04.568 "reset": true, 00:07:04.568 "nvme_admin": false, 00:07:04.568 "nvme_io": false, 00:07:04.568 "nvme_io_md": false, 00:07:04.568 "write_zeroes": true, 00:07:04.568 "zcopy": true, 00:07:04.568 "get_zone_info": false, 00:07:04.568 "zone_management": false, 00:07:04.568 "zone_append": false, 00:07:04.568 "compare": false, 00:07:04.568 "compare_and_write": false, 00:07:04.568 "abort": true, 00:07:04.568 "seek_hole": false, 00:07:04.568 "seek_data": false, 00:07:04.568 "copy": true, 00:07:04.568 "nvme_iov_md": false 00:07:04.568 }, 00:07:04.568 "memory_domains": [ 00:07:04.568 { 00:07:04.568 "dma_device_id": "system", 00:07:04.568 "dma_device_type": 1 00:07:04.568 }, 00:07:04.568 { 00:07:04.568 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:04.568 "dma_device_type": 2 00:07:04.568 } 00:07:04.568 ], 00:07:04.568 "driver_specific": { 00:07:04.568 "passthru": { 00:07:04.568 "name": "Passthru0", 00:07:04.568 "base_bdev_name": "Malloc0" 00:07:04.568 } 00:07:04.568 } 00:07:04.568 } 00:07:04.568 ]' 00:07:04.568 11:17:46 rpc.rpc_integrity -- rpc/rpc.sh@21 -- # jq length 00:07:04.568 11:17:46 rpc.rpc_integrity -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:07:04.568 11:17:46 rpc.rpc_integrity -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:07:04.568 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.568 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:07:04.568 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.568 11:17:46 rpc.rpc_integrity -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:07:04.569 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.569 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:07:04.569 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.569 11:17:46 rpc.rpc_integrity -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:07:04.569 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.569 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:07:04.569 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.569 11:17:46 rpc.rpc_integrity -- rpc/rpc.sh@25 -- # bdevs='[]' 00:07:04.569 11:17:46 rpc.rpc_integrity -- rpc/rpc.sh@26 -- # jq length 00:07:04.569 11:17:46 rpc.rpc_integrity -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:07:04.569 00:07:04.569 real 0m0.326s 00:07:04.569 user 0m0.233s 00:07:04.569 sys 0m0.033s 00:07:04.569 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:04.569 11:17:46 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:07:04.569 ************************************ 00:07:04.569 END TEST rpc_integrity 00:07:04.569 ************************************ 00:07:04.826 11:17:46 rpc -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:07:04.826 11:17:46 rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:04.826 11:17:46 rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:04.826 11:17:46 rpc -- common/autotest_common.sh@10 -- # set +x 00:07:04.826 ************************************ 00:07:04.826 START TEST rpc_plugins 00:07:04.826 ************************************ 00:07:04.826 11:17:46 rpc.rpc_plugins -- common/autotest_common.sh@1125 -- # rpc_plugins 00:07:04.826 11:17:46 rpc.rpc_plugins -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:07:04.826 11:17:46 rpc.rpc_plugins -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.826 11:17:46 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:07:04.826 11:17:46 rpc.rpc_plugins -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.826 11:17:46 rpc.rpc_plugins -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:07:04.826 11:17:46 rpc.rpc_plugins -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:07:04.826 11:17:46 rpc.rpc_plugins -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.826 11:17:46 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:07:04.826 11:17:46 rpc.rpc_plugins -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.826 11:17:46 rpc.rpc_plugins -- rpc/rpc.sh@31 -- # bdevs='[ 00:07:04.826 { 00:07:04.826 "name": "Malloc1", 00:07:04.826 "aliases": [ 00:07:04.826 "2108f05c-2adc-48c1-8550-f71339627e34" 00:07:04.826 ], 00:07:04.826 "product_name": "Malloc disk", 00:07:04.826 "block_size": 4096, 00:07:04.826 "num_blocks": 256, 00:07:04.826 "uuid": "2108f05c-2adc-48c1-8550-f71339627e34", 00:07:04.826 "assigned_rate_limits": { 00:07:04.826 "rw_ios_per_sec": 0, 00:07:04.826 "rw_mbytes_per_sec": 0, 00:07:04.826 "r_mbytes_per_sec": 0, 00:07:04.826 "w_mbytes_per_sec": 0 00:07:04.826 }, 00:07:04.826 "claimed": false, 00:07:04.826 "zoned": false, 00:07:04.826 "supported_io_types": { 00:07:04.826 "read": true, 00:07:04.826 "write": true, 00:07:04.826 "unmap": true, 00:07:04.826 "flush": true, 00:07:04.826 "reset": true, 00:07:04.826 "nvme_admin": false, 00:07:04.826 "nvme_io": false, 00:07:04.826 "nvme_io_md": false, 00:07:04.826 "write_zeroes": true, 00:07:04.826 "zcopy": true, 00:07:04.826 "get_zone_info": false, 00:07:04.826 "zone_management": false, 00:07:04.826 "zone_append": false, 00:07:04.826 "compare": false, 00:07:04.826 "compare_and_write": false, 00:07:04.826 "abort": true, 00:07:04.826 "seek_hole": false, 00:07:04.826 "seek_data": false, 00:07:04.826 "copy": true, 00:07:04.826 "nvme_iov_md": false 00:07:04.826 }, 00:07:04.826 "memory_domains": [ 00:07:04.826 { 00:07:04.826 "dma_device_id": "system", 00:07:04.826 "dma_device_type": 1 00:07:04.826 }, 00:07:04.826 { 00:07:04.826 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:04.826 "dma_device_type": 2 00:07:04.826 } 00:07:04.826 ], 00:07:04.826 "driver_specific": {} 00:07:04.826 } 00:07:04.826 ]' 00:07:04.826 11:17:46 rpc.rpc_plugins -- rpc/rpc.sh@32 -- # jq length 00:07:04.826 11:17:46 rpc.rpc_plugins -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:07:04.827 11:17:46 rpc.rpc_plugins -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:07:04.827 11:17:46 rpc.rpc_plugins -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.827 11:17:46 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:07:04.827 11:17:46 rpc.rpc_plugins -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.827 11:17:46 rpc.rpc_plugins -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:07:04.827 11:17:46 rpc.rpc_plugins -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.827 11:17:46 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:07:04.827 11:17:46 rpc.rpc_plugins -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.827 11:17:46 rpc.rpc_plugins -- rpc/rpc.sh@35 -- # bdevs='[]' 00:07:04.827 11:17:46 rpc.rpc_plugins -- rpc/rpc.sh@36 -- # jq length 00:07:04.827 11:17:46 rpc.rpc_plugins -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:07:04.827 00:07:04.827 real 0m0.176s 00:07:04.827 user 0m0.118s 00:07:04.827 sys 0m0.020s 00:07:04.827 11:17:46 rpc.rpc_plugins -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:04.827 11:17:46 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:07:04.827 ************************************ 00:07:04.827 END TEST rpc_plugins 00:07:04.827 ************************************ 00:07:04.827 11:17:46 rpc -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:07:04.827 11:17:46 rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:04.827 11:17:46 rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:04.827 11:17:46 rpc -- common/autotest_common.sh@10 -- # set +x 00:07:04.827 ************************************ 00:07:04.827 START TEST rpc_trace_cmd_test 00:07:04.827 ************************************ 00:07:04.827 11:17:46 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@1125 -- # rpc_trace_cmd_test 00:07:04.827 11:17:46 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@40 -- # local info 00:07:04.827 11:17:46 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:07:04.827 11:17:46 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.827 11:17:46 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@10 -- # set +x 00:07:04.827 11:17:46 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:05.084 11:17:46 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@42 -- # info='{ 00:07:05.084 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid56979", 00:07:05.084 "tpoint_group_mask": "0x8", 00:07:05.084 "iscsi_conn": { 00:07:05.084 "mask": "0x2", 00:07:05.084 "tpoint_mask": "0x0" 00:07:05.084 }, 00:07:05.084 "scsi": { 00:07:05.084 "mask": "0x4", 00:07:05.084 "tpoint_mask": "0x0" 00:07:05.084 }, 00:07:05.084 "bdev": { 00:07:05.084 "mask": "0x8", 00:07:05.084 "tpoint_mask": "0xffffffffffffffff" 00:07:05.084 }, 00:07:05.084 "nvmf_rdma": { 00:07:05.085 "mask": "0x10", 00:07:05.085 "tpoint_mask": "0x0" 00:07:05.085 }, 00:07:05.085 "nvmf_tcp": { 00:07:05.085 "mask": "0x20", 00:07:05.085 "tpoint_mask": "0x0" 00:07:05.085 }, 00:07:05.085 "ftl": { 00:07:05.085 "mask": "0x40", 00:07:05.085 "tpoint_mask": "0x0" 00:07:05.085 }, 00:07:05.085 "blobfs": { 00:07:05.085 "mask": "0x80", 00:07:05.085 "tpoint_mask": "0x0" 00:07:05.085 }, 00:07:05.085 "dsa": { 00:07:05.085 "mask": "0x200", 00:07:05.085 "tpoint_mask": "0x0" 00:07:05.085 }, 00:07:05.085 "thread": { 00:07:05.085 "mask": "0x400", 00:07:05.085 "tpoint_mask": "0x0" 00:07:05.085 }, 00:07:05.085 "nvme_pcie": { 00:07:05.085 "mask": "0x800", 00:07:05.085 "tpoint_mask": "0x0" 00:07:05.085 }, 00:07:05.085 "iaa": { 00:07:05.085 "mask": "0x1000", 00:07:05.085 "tpoint_mask": "0x0" 00:07:05.085 }, 00:07:05.085 "nvme_tcp": { 00:07:05.085 "mask": "0x2000", 00:07:05.085 "tpoint_mask": "0x0" 00:07:05.085 }, 00:07:05.085 "bdev_nvme": { 00:07:05.085 "mask": "0x4000", 00:07:05.085 "tpoint_mask": "0x0" 00:07:05.085 }, 00:07:05.085 "sock": { 00:07:05.085 "mask": "0x8000", 00:07:05.085 "tpoint_mask": "0x0" 00:07:05.085 }, 00:07:05.085 "blob": { 00:07:05.085 "mask": "0x10000", 00:07:05.085 "tpoint_mask": "0x0" 00:07:05.085 }, 00:07:05.085 "bdev_raid": { 00:07:05.085 "mask": "0x20000", 00:07:05.085 "tpoint_mask": "0x0" 00:07:05.085 }, 00:07:05.085 "scheduler": { 00:07:05.085 "mask": "0x40000", 00:07:05.085 "tpoint_mask": "0x0" 00:07:05.085 } 00:07:05.085 }' 00:07:05.085 11:17:46 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@43 -- # jq length 00:07:05.085 11:17:46 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@43 -- # '[' 19 -gt 2 ']' 00:07:05.085 11:17:46 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:07:05.085 11:17:46 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:07:05.085 11:17:46 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:07:05.085 11:17:46 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:07:05.085 11:17:46 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:07:05.085 11:17:46 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:07:05.085 11:17:46 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:07:05.344 11:17:46 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:07:05.344 00:07:05.344 real 0m0.315s 00:07:05.344 user 0m0.278s 00:07:05.344 sys 0m0.028s 00:07:05.344 11:17:46 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:05.344 11:17:46 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@10 -- # set +x 00:07:05.344 ************************************ 00:07:05.344 END TEST rpc_trace_cmd_test 00:07:05.344 ************************************ 00:07:05.344 11:17:46 rpc -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:07:05.344 11:17:46 rpc -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:07:05.344 11:17:46 rpc -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:07:05.344 11:17:46 rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:05.344 11:17:46 rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:05.344 11:17:46 rpc -- common/autotest_common.sh@10 -- # set +x 00:07:05.344 ************************************ 00:07:05.344 START TEST rpc_daemon_integrity 00:07:05.344 ************************************ 00:07:05.344 11:17:46 rpc.rpc_daemon_integrity -- common/autotest_common.sh@1125 -- # rpc_integrity 00:07:05.344 11:17:46 rpc.rpc_daemon_integrity -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:07:05.344 11:17:46 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:05.344 11:17:46 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:07:05.344 11:17:46 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:05.344 11:17:46 rpc.rpc_daemon_integrity -- rpc/rpc.sh@12 -- # bdevs='[]' 00:07:05.344 11:17:46 rpc.rpc_daemon_integrity -- rpc/rpc.sh@13 -- # jq length 00:07:05.344 11:17:46 rpc.rpc_daemon_integrity -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:07:05.344 11:17:46 rpc.rpc_daemon_integrity -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:07:05.344 11:17:46 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:05.344 11:17:46 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:07:05.344 11:17:46 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:05.344 11:17:46 rpc.rpc_daemon_integrity -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:07:05.344 11:17:46 rpc.rpc_daemon_integrity -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:07:05.344 11:17:46 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:05.344 11:17:46 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:07:05.344 11:17:46 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:05.344 11:17:46 rpc.rpc_daemon_integrity -- rpc/rpc.sh@16 -- # bdevs='[ 00:07:05.344 { 00:07:05.344 "name": "Malloc2", 00:07:05.344 "aliases": [ 00:07:05.344 "86ea2f0f-a81d-456a-9d7f-c41b73720979" 00:07:05.344 ], 00:07:05.344 "product_name": "Malloc disk", 00:07:05.344 "block_size": 512, 00:07:05.344 "num_blocks": 16384, 00:07:05.344 "uuid": "86ea2f0f-a81d-456a-9d7f-c41b73720979", 00:07:05.344 "assigned_rate_limits": { 00:07:05.344 "rw_ios_per_sec": 0, 00:07:05.344 "rw_mbytes_per_sec": 0, 00:07:05.344 "r_mbytes_per_sec": 0, 00:07:05.344 "w_mbytes_per_sec": 0 00:07:05.344 }, 00:07:05.344 "claimed": false, 00:07:05.344 "zoned": false, 00:07:05.344 "supported_io_types": { 00:07:05.344 "read": true, 00:07:05.344 "write": true, 00:07:05.344 "unmap": true, 00:07:05.344 "flush": true, 00:07:05.344 "reset": true, 00:07:05.344 "nvme_admin": false, 00:07:05.344 "nvme_io": false, 00:07:05.344 "nvme_io_md": false, 00:07:05.344 "write_zeroes": true, 00:07:05.344 "zcopy": true, 00:07:05.344 "get_zone_info": false, 00:07:05.344 "zone_management": false, 00:07:05.344 "zone_append": false, 00:07:05.344 "compare": false, 00:07:05.344 "compare_and_write": false, 00:07:05.344 "abort": true, 00:07:05.344 "seek_hole": false, 00:07:05.344 "seek_data": false, 00:07:05.344 "copy": true, 00:07:05.344 "nvme_iov_md": false 00:07:05.344 }, 00:07:05.344 "memory_domains": [ 00:07:05.344 { 00:07:05.344 "dma_device_id": "system", 00:07:05.344 "dma_device_type": 1 00:07:05.344 }, 00:07:05.344 { 00:07:05.344 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:05.344 "dma_device_type": 2 00:07:05.344 } 00:07:05.344 ], 00:07:05.344 "driver_specific": {} 00:07:05.344 } 00:07:05.344 ]' 00:07:05.344 11:17:46 rpc.rpc_daemon_integrity -- rpc/rpc.sh@17 -- # jq length 00:07:05.344 11:17:47 rpc.rpc_daemon_integrity -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:07:05.344 11:17:47 rpc.rpc_daemon_integrity -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:07:05.344 11:17:47 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:05.344 11:17:47 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:07:05.344 [2024-10-07 11:17:47.028220] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:07:05.344 [2024-10-07 11:17:47.028285] vbdev_passthru.c: 635:vbdev_passthru_register: *NOTICE*: base bdev opened 00:07:05.344 [2024-10-07 11:17:47.028315] vbdev_passthru.c: 681:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1f9ea80 00:07:05.344 [2024-10-07 11:17:47.028328] vbdev_passthru.c: 696:vbdev_passthru_register: *NOTICE*: bdev claimed 00:07:05.344 [2024-10-07 11:17:47.030380] vbdev_passthru.c: 709:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:07:05.344 [2024-10-07 11:17:47.030430] vbdev_passthru.c: 710:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:07:05.344 Passthru0 00:07:05.344 11:17:47 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:05.344 11:17:47 rpc.rpc_daemon_integrity -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:07:05.344 11:17:47 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:05.344 11:17:47 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- rpc/rpc.sh@20 -- # bdevs='[ 00:07:05.603 { 00:07:05.603 "name": "Malloc2", 00:07:05.603 "aliases": [ 00:07:05.603 "86ea2f0f-a81d-456a-9d7f-c41b73720979" 00:07:05.603 ], 00:07:05.603 "product_name": "Malloc disk", 00:07:05.603 "block_size": 512, 00:07:05.603 "num_blocks": 16384, 00:07:05.603 "uuid": "86ea2f0f-a81d-456a-9d7f-c41b73720979", 00:07:05.603 "assigned_rate_limits": { 00:07:05.603 "rw_ios_per_sec": 0, 00:07:05.603 "rw_mbytes_per_sec": 0, 00:07:05.603 "r_mbytes_per_sec": 0, 00:07:05.603 "w_mbytes_per_sec": 0 00:07:05.603 }, 00:07:05.603 "claimed": true, 00:07:05.603 "claim_type": "exclusive_write", 00:07:05.603 "zoned": false, 00:07:05.603 "supported_io_types": { 00:07:05.603 "read": true, 00:07:05.603 "write": true, 00:07:05.603 "unmap": true, 00:07:05.603 "flush": true, 00:07:05.603 "reset": true, 00:07:05.603 "nvme_admin": false, 00:07:05.603 "nvme_io": false, 00:07:05.603 "nvme_io_md": false, 00:07:05.603 "write_zeroes": true, 00:07:05.603 "zcopy": true, 00:07:05.603 "get_zone_info": false, 00:07:05.603 "zone_management": false, 00:07:05.603 "zone_append": false, 00:07:05.603 "compare": false, 00:07:05.603 "compare_and_write": false, 00:07:05.603 "abort": true, 00:07:05.603 "seek_hole": false, 00:07:05.603 "seek_data": false, 00:07:05.603 "copy": true, 00:07:05.603 "nvme_iov_md": false 00:07:05.603 }, 00:07:05.603 "memory_domains": [ 00:07:05.603 { 00:07:05.603 "dma_device_id": "system", 00:07:05.603 "dma_device_type": 1 00:07:05.603 }, 00:07:05.603 { 00:07:05.603 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:05.603 "dma_device_type": 2 00:07:05.603 } 00:07:05.603 ], 00:07:05.603 "driver_specific": {} 00:07:05.603 }, 00:07:05.603 { 00:07:05.603 "name": "Passthru0", 00:07:05.603 "aliases": [ 00:07:05.603 "ae13cd10-817d-5ad6-8652-9a7e84bec34a" 00:07:05.603 ], 00:07:05.603 "product_name": "passthru", 00:07:05.603 "block_size": 512, 00:07:05.603 "num_blocks": 16384, 00:07:05.603 "uuid": "ae13cd10-817d-5ad6-8652-9a7e84bec34a", 00:07:05.603 "assigned_rate_limits": { 00:07:05.603 "rw_ios_per_sec": 0, 00:07:05.603 "rw_mbytes_per_sec": 0, 00:07:05.603 "r_mbytes_per_sec": 0, 00:07:05.603 "w_mbytes_per_sec": 0 00:07:05.603 }, 00:07:05.603 "claimed": false, 00:07:05.603 "zoned": false, 00:07:05.603 "supported_io_types": { 00:07:05.603 "read": true, 00:07:05.603 "write": true, 00:07:05.603 "unmap": true, 00:07:05.603 "flush": true, 00:07:05.603 "reset": true, 00:07:05.603 "nvme_admin": false, 00:07:05.603 "nvme_io": false, 00:07:05.603 "nvme_io_md": false, 00:07:05.603 "write_zeroes": true, 00:07:05.603 "zcopy": true, 00:07:05.603 "get_zone_info": false, 00:07:05.603 "zone_management": false, 00:07:05.603 "zone_append": false, 00:07:05.603 "compare": false, 00:07:05.603 "compare_and_write": false, 00:07:05.603 "abort": true, 00:07:05.603 "seek_hole": false, 00:07:05.603 "seek_data": false, 00:07:05.603 "copy": true, 00:07:05.603 "nvme_iov_md": false 00:07:05.603 }, 00:07:05.603 "memory_domains": [ 00:07:05.603 { 00:07:05.603 "dma_device_id": "system", 00:07:05.603 "dma_device_type": 1 00:07:05.603 }, 00:07:05.603 { 00:07:05.603 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:05.603 "dma_device_type": 2 00:07:05.603 } 00:07:05.603 ], 00:07:05.603 "driver_specific": { 00:07:05.603 "passthru": { 00:07:05.603 "name": "Passthru0", 00:07:05.603 "base_bdev_name": "Malloc2" 00:07:05.603 } 00:07:05.603 } 00:07:05.603 } 00:07:05.603 ]' 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- rpc/rpc.sh@21 -- # jq length 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- rpc/rpc.sh@25 -- # bdevs='[]' 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- rpc/rpc.sh@26 -- # jq length 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:07:05.603 00:07:05.603 real 0m0.320s 00:07:05.603 user 0m0.204s 00:07:05.603 sys 0m0.048s 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:05.603 11:17:47 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:07:05.603 ************************************ 00:07:05.603 END TEST rpc_daemon_integrity 00:07:05.603 ************************************ 00:07:05.603 11:17:47 rpc -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:07:05.603 11:17:47 rpc -- rpc/rpc.sh@84 -- # killprocess 56979 00:07:05.603 11:17:47 rpc -- common/autotest_common.sh@950 -- # '[' -z 56979 ']' 00:07:05.603 11:17:47 rpc -- common/autotest_common.sh@954 -- # kill -0 56979 00:07:05.603 11:17:47 rpc -- common/autotest_common.sh@955 -- # uname 00:07:05.603 11:17:47 rpc -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:05.603 11:17:47 rpc -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 56979 00:07:05.603 11:17:47 rpc -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:05.603 killing process with pid 56979 00:07:05.603 11:17:47 rpc -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:05.603 11:17:47 rpc -- common/autotest_common.sh@968 -- # echo 'killing process with pid 56979' 00:07:05.603 11:17:47 rpc -- common/autotest_common.sh@969 -- # kill 56979 00:07:05.603 11:17:47 rpc -- common/autotest_common.sh@974 -- # wait 56979 00:07:05.861 00:07:05.861 real 0m2.234s 00:07:05.861 user 0m3.063s 00:07:05.861 sys 0m0.547s 00:07:05.861 11:17:47 rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:05.861 ************************************ 00:07:05.861 END TEST rpc 00:07:05.861 ************************************ 00:07:05.861 11:17:47 rpc -- common/autotest_common.sh@10 -- # set +x 00:07:06.119 11:17:47 -- spdk/autotest.sh@157 -- # run_test skip_rpc /home/vagrant/spdk_repo/spdk/test/rpc/skip_rpc.sh 00:07:06.119 11:17:47 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:06.119 11:17:47 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:06.119 11:17:47 -- common/autotest_common.sh@10 -- # set +x 00:07:06.119 ************************************ 00:07:06.120 START TEST skip_rpc 00:07:06.120 ************************************ 00:07:06.120 11:17:47 skip_rpc -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/rpc/skip_rpc.sh 00:07:06.120 * Looking for test storage... 00:07:06.120 * Found test storage at /home/vagrant/spdk_repo/spdk/test/rpc 00:07:06.120 11:17:47 skip_rpc -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:06.120 11:17:47 skip_rpc -- common/autotest_common.sh@1681 -- # lcov --version 00:07:06.120 11:17:47 skip_rpc -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:06.120 11:17:47 skip_rpc -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@336 -- # IFS=.-: 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@336 -- # read -ra ver1 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@337 -- # IFS=.-: 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@337 -- # read -ra ver2 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@338 -- # local 'op=<' 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@340 -- # ver1_l=2 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@341 -- # ver2_l=1 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@344 -- # case "$op" in 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@345 -- # : 1 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@365 -- # decimal 1 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@353 -- # local d=1 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@355 -- # echo 1 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@365 -- # ver1[v]=1 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@366 -- # decimal 2 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@353 -- # local d=2 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@355 -- # echo 2 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@366 -- # ver2[v]=2 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:06.120 11:17:47 skip_rpc -- scripts/common.sh@368 -- # return 0 00:07:06.120 11:17:47 skip_rpc -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:06.120 11:17:47 skip_rpc -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:06.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:06.120 --rc genhtml_branch_coverage=1 00:07:06.120 --rc genhtml_function_coverage=1 00:07:06.120 --rc genhtml_legend=1 00:07:06.120 --rc geninfo_all_blocks=1 00:07:06.120 --rc geninfo_unexecuted_blocks=1 00:07:06.120 00:07:06.120 ' 00:07:06.120 11:17:47 skip_rpc -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:06.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:06.120 --rc genhtml_branch_coverage=1 00:07:06.120 --rc genhtml_function_coverage=1 00:07:06.120 --rc genhtml_legend=1 00:07:06.120 --rc geninfo_all_blocks=1 00:07:06.120 --rc geninfo_unexecuted_blocks=1 00:07:06.120 00:07:06.120 ' 00:07:06.120 11:17:47 skip_rpc -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:06.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:06.120 --rc genhtml_branch_coverage=1 00:07:06.120 --rc genhtml_function_coverage=1 00:07:06.120 --rc genhtml_legend=1 00:07:06.120 --rc geninfo_all_blocks=1 00:07:06.120 --rc geninfo_unexecuted_blocks=1 00:07:06.120 00:07:06.120 ' 00:07:06.120 11:17:47 skip_rpc -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:06.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:06.120 --rc genhtml_branch_coverage=1 00:07:06.120 --rc genhtml_function_coverage=1 00:07:06.120 --rc genhtml_legend=1 00:07:06.120 --rc geninfo_all_blocks=1 00:07:06.120 --rc geninfo_unexecuted_blocks=1 00:07:06.120 00:07:06.120 ' 00:07:06.120 11:17:47 skip_rpc -- rpc/skip_rpc.sh@11 -- # CONFIG_PATH=/home/vagrant/spdk_repo/spdk/test/rpc/config.json 00:07:06.120 11:17:47 skip_rpc -- rpc/skip_rpc.sh@12 -- # LOG_PATH=/home/vagrant/spdk_repo/spdk/test/rpc/log.txt 00:07:06.120 11:17:47 skip_rpc -- rpc/skip_rpc.sh@73 -- # run_test skip_rpc test_skip_rpc 00:07:06.120 11:17:47 skip_rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:06.120 11:17:47 skip_rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:06.120 11:17:47 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:06.120 ************************************ 00:07:06.120 START TEST skip_rpc 00:07:06.120 ************************************ 00:07:06.120 11:17:47 skip_rpc.skip_rpc -- common/autotest_common.sh@1125 -- # test_skip_rpc 00:07:06.120 11:17:47 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@16 -- # local spdk_pid=57172 00:07:06.120 11:17:47 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@15 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 00:07:06.120 11:17:47 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@18 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:07:06.120 11:17:47 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@19 -- # sleep 5 00:07:06.379 [2024-10-07 11:17:47.868245] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:06.379 [2024-10-07 11:17:47.868590] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid57172 ] 00:07:06.379 [2024-10-07 11:17:48.002934] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:06.379 [2024-10-07 11:17:48.062289] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.639 [2024-10-07 11:17:48.101864] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@21 -- # NOT rpc_cmd spdk_get_version 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@650 -- # local es=0 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd spdk_get_version 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@653 -- # rpc_cmd spdk_get_version 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@653 -- # es=1 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@22 -- # trap - SIGINT SIGTERM EXIT 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@23 -- # killprocess 57172 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@950 -- # '[' -z 57172 ']' 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@954 -- # kill -0 57172 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@955 -- # uname 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 57172 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@968 -- # echo 'killing process with pid 57172' 00:07:11.907 killing process with pid 57172 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@969 -- # kill 57172 00:07:11.907 11:17:52 skip_rpc.skip_rpc -- common/autotest_common.sh@974 -- # wait 57172 00:07:11.907 00:07:11.907 real 0m5.303s 00:07:11.907 user 0m5.005s 00:07:11.907 sys 0m0.192s 00:07:11.907 11:17:53 skip_rpc.skip_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:11.907 11:17:53 skip_rpc.skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:11.907 ************************************ 00:07:11.907 END TEST skip_rpc 00:07:11.907 ************************************ 00:07:11.907 11:17:53 skip_rpc -- rpc/skip_rpc.sh@74 -- # run_test skip_rpc_with_json test_skip_rpc_with_json 00:07:11.907 11:17:53 skip_rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:11.907 11:17:53 skip_rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:11.907 11:17:53 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:11.907 ************************************ 00:07:11.907 START TEST skip_rpc_with_json 00:07:11.907 ************************************ 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@1125 -- # test_skip_rpc_with_json 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@44 -- # gen_json_config 00:07:11.907 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@28 -- # local spdk_pid=57258 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@30 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@31 -- # waitforlisten 57258 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@831 -- # '[' -z 57258 ']' 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:07:11.907 [2024-10-07 11:17:53.198766] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:11.907 [2024-10-07 11:17:53.199077] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid57258 ] 00:07:11.907 [2024-10-07 11:17:53.331025] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:11.907 [2024-10-07 11:17:53.389821] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:11.907 [2024-10-07 11:17:53.428938] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@864 -- # return 0 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_get_transports --trtype tcp 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:07:11.907 [2024-10-07 11:17:53.562047] nvmf_rpc.c:2703:rpc_nvmf_get_transports: *ERROR*: transport 'tcp' does not exist 00:07:11.907 request: 00:07:11.907 { 00:07:11.907 "trtype": "tcp", 00:07:11.907 "method": "nvmf_get_transports", 00:07:11.907 "req_id": 1 00:07:11.907 } 00:07:11.907 Got JSON-RPC error response 00:07:11.907 response: 00:07:11.907 { 00:07:11.907 "code": -19, 00:07:11.907 "message": "No such device" 00:07:11.907 } 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_create_transport -t tcp 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:11.907 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:07:11.907 [2024-10-07 11:17:53.574172] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:11.908 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:11.908 11:17:53 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@36 -- # rpc_cmd save_config 00:07:11.908 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:11.908 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:07:12.166 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:12.166 11:17:53 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@37 -- # cat /home/vagrant/spdk_repo/spdk/test/rpc/config.json 00:07:12.166 { 00:07:12.166 "subsystems": [ 00:07:12.166 { 00:07:12.166 "subsystem": "fsdev", 00:07:12.166 "config": [ 00:07:12.166 { 00:07:12.166 "method": "fsdev_set_opts", 00:07:12.166 "params": { 00:07:12.166 "fsdev_io_pool_size": 65535, 00:07:12.166 "fsdev_io_cache_size": 256 00:07:12.166 } 00:07:12.166 } 00:07:12.166 ] 00:07:12.166 }, 00:07:12.166 { 00:07:12.166 "subsystem": "keyring", 00:07:12.166 "config": [] 00:07:12.166 }, 00:07:12.166 { 00:07:12.166 "subsystem": "iobuf", 00:07:12.166 "config": [ 00:07:12.166 { 00:07:12.166 "method": "iobuf_set_options", 00:07:12.166 "params": { 00:07:12.166 "small_pool_count": 8192, 00:07:12.166 "large_pool_count": 1024, 00:07:12.166 "small_bufsize": 8192, 00:07:12.166 "large_bufsize": 135168 00:07:12.166 } 00:07:12.166 } 00:07:12.166 ] 00:07:12.166 }, 00:07:12.166 { 00:07:12.166 "subsystem": "sock", 00:07:12.166 "config": [ 00:07:12.166 { 00:07:12.167 "method": "sock_set_default_impl", 00:07:12.167 "params": { 00:07:12.167 "impl_name": "uring" 00:07:12.167 } 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "method": "sock_impl_set_options", 00:07:12.167 "params": { 00:07:12.167 "impl_name": "ssl", 00:07:12.167 "recv_buf_size": 4096, 00:07:12.167 "send_buf_size": 4096, 00:07:12.167 "enable_recv_pipe": true, 00:07:12.167 "enable_quickack": false, 00:07:12.167 "enable_placement_id": 0, 00:07:12.167 "enable_zerocopy_send_server": true, 00:07:12.167 "enable_zerocopy_send_client": false, 00:07:12.167 "zerocopy_threshold": 0, 00:07:12.167 "tls_version": 0, 00:07:12.167 "enable_ktls": false 00:07:12.167 } 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "method": "sock_impl_set_options", 00:07:12.167 "params": { 00:07:12.167 "impl_name": "posix", 00:07:12.167 "recv_buf_size": 2097152, 00:07:12.167 "send_buf_size": 2097152, 00:07:12.167 "enable_recv_pipe": true, 00:07:12.167 "enable_quickack": false, 00:07:12.167 "enable_placement_id": 0, 00:07:12.167 "enable_zerocopy_send_server": true, 00:07:12.167 "enable_zerocopy_send_client": false, 00:07:12.167 "zerocopy_threshold": 0, 00:07:12.167 "tls_version": 0, 00:07:12.167 "enable_ktls": false 00:07:12.167 } 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "method": "sock_impl_set_options", 00:07:12.167 "params": { 00:07:12.167 "impl_name": "uring", 00:07:12.167 "recv_buf_size": 2097152, 00:07:12.167 "send_buf_size": 2097152, 00:07:12.167 "enable_recv_pipe": true, 00:07:12.167 "enable_quickack": false, 00:07:12.167 "enable_placement_id": 0, 00:07:12.167 "enable_zerocopy_send_server": false, 00:07:12.167 "enable_zerocopy_send_client": false, 00:07:12.167 "zerocopy_threshold": 0, 00:07:12.167 "tls_version": 0, 00:07:12.167 "enable_ktls": false 00:07:12.167 } 00:07:12.167 } 00:07:12.167 ] 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "subsystem": "vmd", 00:07:12.167 "config": [] 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "subsystem": "accel", 00:07:12.167 "config": [ 00:07:12.167 { 00:07:12.167 "method": "accel_set_options", 00:07:12.167 "params": { 00:07:12.167 "small_cache_size": 128, 00:07:12.167 "large_cache_size": 16, 00:07:12.167 "task_count": 2048, 00:07:12.167 "sequence_count": 2048, 00:07:12.167 "buf_count": 2048 00:07:12.167 } 00:07:12.167 } 00:07:12.167 ] 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "subsystem": "bdev", 00:07:12.167 "config": [ 00:07:12.167 { 00:07:12.167 "method": "bdev_set_options", 00:07:12.167 "params": { 00:07:12.167 "bdev_io_pool_size": 65535, 00:07:12.167 "bdev_io_cache_size": 256, 00:07:12.167 "bdev_auto_examine": true, 00:07:12.167 "iobuf_small_cache_size": 128, 00:07:12.167 "iobuf_large_cache_size": 16 00:07:12.167 } 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "method": "bdev_raid_set_options", 00:07:12.167 "params": { 00:07:12.167 "process_window_size_kb": 1024, 00:07:12.167 "process_max_bandwidth_mb_sec": 0 00:07:12.167 } 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "method": "bdev_iscsi_set_options", 00:07:12.167 "params": { 00:07:12.167 "timeout_sec": 30 00:07:12.167 } 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "method": "bdev_nvme_set_options", 00:07:12.167 "params": { 00:07:12.167 "action_on_timeout": "none", 00:07:12.167 "timeout_us": 0, 00:07:12.167 "timeout_admin_us": 0, 00:07:12.167 "keep_alive_timeout_ms": 10000, 00:07:12.167 "arbitration_burst": 0, 00:07:12.167 "low_priority_weight": 0, 00:07:12.167 "medium_priority_weight": 0, 00:07:12.167 "high_priority_weight": 0, 00:07:12.167 "nvme_adminq_poll_period_us": 10000, 00:07:12.167 "nvme_ioq_poll_period_us": 0, 00:07:12.167 "io_queue_requests": 0, 00:07:12.167 "delay_cmd_submit": true, 00:07:12.167 "transport_retry_count": 4, 00:07:12.167 "bdev_retry_count": 3, 00:07:12.167 "transport_ack_timeout": 0, 00:07:12.167 "ctrlr_loss_timeout_sec": 0, 00:07:12.167 "reconnect_delay_sec": 0, 00:07:12.167 "fast_io_fail_timeout_sec": 0, 00:07:12.167 "disable_auto_failback": false, 00:07:12.167 "generate_uuids": false, 00:07:12.167 "transport_tos": 0, 00:07:12.167 "nvme_error_stat": false, 00:07:12.167 "rdma_srq_size": 0, 00:07:12.167 "io_path_stat": false, 00:07:12.167 "allow_accel_sequence": false, 00:07:12.167 "rdma_max_cq_size": 0, 00:07:12.167 "rdma_cm_event_timeout_ms": 0, 00:07:12.167 "dhchap_digests": [ 00:07:12.167 "sha256", 00:07:12.167 "sha384", 00:07:12.167 "sha512" 00:07:12.167 ], 00:07:12.167 "dhchap_dhgroups": [ 00:07:12.167 "null", 00:07:12.167 "ffdhe2048", 00:07:12.167 "ffdhe3072", 00:07:12.167 "ffdhe4096", 00:07:12.167 "ffdhe6144", 00:07:12.167 "ffdhe8192" 00:07:12.167 ] 00:07:12.167 } 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "method": "bdev_nvme_set_hotplug", 00:07:12.167 "params": { 00:07:12.167 "period_us": 100000, 00:07:12.167 "enable": false 00:07:12.167 } 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "method": "bdev_wait_for_examine" 00:07:12.167 } 00:07:12.167 ] 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "subsystem": "scsi", 00:07:12.167 "config": null 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "subsystem": "scheduler", 00:07:12.167 "config": [ 00:07:12.167 { 00:07:12.167 "method": "framework_set_scheduler", 00:07:12.167 "params": { 00:07:12.167 "name": "static" 00:07:12.167 } 00:07:12.167 } 00:07:12.167 ] 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "subsystem": "vhost_scsi", 00:07:12.167 "config": [] 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "subsystem": "vhost_blk", 00:07:12.167 "config": [] 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "subsystem": "ublk", 00:07:12.167 "config": [] 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "subsystem": "nbd", 00:07:12.167 "config": [] 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "subsystem": "nvmf", 00:07:12.167 "config": [ 00:07:12.167 { 00:07:12.167 "method": "nvmf_set_config", 00:07:12.167 "params": { 00:07:12.167 "discovery_filter": "match_any", 00:07:12.167 "admin_cmd_passthru": { 00:07:12.167 "identify_ctrlr": false 00:07:12.167 }, 00:07:12.167 "dhchap_digests": [ 00:07:12.167 "sha256", 00:07:12.167 "sha384", 00:07:12.167 "sha512" 00:07:12.167 ], 00:07:12.167 "dhchap_dhgroups": [ 00:07:12.167 "null", 00:07:12.167 "ffdhe2048", 00:07:12.167 "ffdhe3072", 00:07:12.167 "ffdhe4096", 00:07:12.167 "ffdhe6144", 00:07:12.167 "ffdhe8192" 00:07:12.167 ] 00:07:12.167 } 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "method": "nvmf_set_max_subsystems", 00:07:12.167 "params": { 00:07:12.167 "max_subsystems": 1024 00:07:12.167 } 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "method": "nvmf_set_crdt", 00:07:12.167 "params": { 00:07:12.167 "crdt1": 0, 00:07:12.167 "crdt2": 0, 00:07:12.167 "crdt3": 0 00:07:12.167 } 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "method": "nvmf_create_transport", 00:07:12.167 "params": { 00:07:12.167 "trtype": "TCP", 00:07:12.167 "max_queue_depth": 128, 00:07:12.167 "max_io_qpairs_per_ctrlr": 127, 00:07:12.167 "in_capsule_data_size": 4096, 00:07:12.167 "max_io_size": 131072, 00:07:12.167 "io_unit_size": 131072, 00:07:12.167 "max_aq_depth": 128, 00:07:12.167 "num_shared_buffers": 511, 00:07:12.167 "buf_cache_size": 4294967295, 00:07:12.167 "dif_insert_or_strip": false, 00:07:12.167 "zcopy": false, 00:07:12.167 "c2h_success": true, 00:07:12.167 "sock_priority": 0, 00:07:12.167 "abort_timeout_sec": 1, 00:07:12.167 "ack_timeout": 0, 00:07:12.167 "data_wr_pool_size": 0 00:07:12.167 } 00:07:12.167 } 00:07:12.167 ] 00:07:12.167 }, 00:07:12.167 { 00:07:12.167 "subsystem": "iscsi", 00:07:12.167 "config": [ 00:07:12.167 { 00:07:12.167 "method": "iscsi_set_options", 00:07:12.167 "params": { 00:07:12.167 "node_base": "iqn.2016-06.io.spdk", 00:07:12.167 "max_sessions": 128, 00:07:12.167 "max_connections_per_session": 2, 00:07:12.167 "max_queue_depth": 64, 00:07:12.167 "default_time2wait": 2, 00:07:12.167 "default_time2retain": 20, 00:07:12.167 "first_burst_length": 8192, 00:07:12.167 "immediate_data": true, 00:07:12.167 "allow_duplicated_isid": false, 00:07:12.167 "error_recovery_level": 0, 00:07:12.167 "nop_timeout": 60, 00:07:12.167 "nop_in_interval": 30, 00:07:12.167 "disable_chap": false, 00:07:12.167 "require_chap": false, 00:07:12.167 "mutual_chap": false, 00:07:12.167 "chap_group": 0, 00:07:12.167 "max_large_datain_per_connection": 64, 00:07:12.167 "max_r2t_per_connection": 4, 00:07:12.167 "pdu_pool_size": 36864, 00:07:12.167 "immediate_data_pool_size": 16384, 00:07:12.167 "data_out_pool_size": 2048 00:07:12.167 } 00:07:12.167 } 00:07:12.167 ] 00:07:12.167 } 00:07:12.167 ] 00:07:12.167 } 00:07:12.167 11:17:53 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:07:12.167 11:17:53 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@40 -- # killprocess 57258 00:07:12.167 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@950 -- # '[' -z 57258 ']' 00:07:12.168 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@954 -- # kill -0 57258 00:07:12.168 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@955 -- # uname 00:07:12.168 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:12.168 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 57258 00:07:12.168 killing process with pid 57258 00:07:12.168 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:12.168 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:12.168 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@968 -- # echo 'killing process with pid 57258' 00:07:12.168 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@969 -- # kill 57258 00:07:12.168 11:17:53 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@974 -- # wait 57258 00:07:12.426 11:17:54 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@47 -- # local spdk_pid=57273 00:07:12.426 11:17:54 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@48 -- # sleep 5 00:07:12.426 11:17:54 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@46 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --json /home/vagrant/spdk_repo/spdk/test/rpc/config.json 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@50 -- # killprocess 57273 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@950 -- # '[' -z 57273 ']' 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@954 -- # kill -0 57273 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@955 -- # uname 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 57273 00:07:17.692 killing process with pid 57273 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@968 -- # echo 'killing process with pid 57273' 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@969 -- # kill 57273 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@974 -- # wait 57273 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@51 -- # grep -q 'TCP Transport Init' /home/vagrant/spdk_repo/spdk/test/rpc/log.txt 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@52 -- # rm /home/vagrant/spdk_repo/spdk/test/rpc/log.txt 00:07:17.692 ************************************ 00:07:17.692 END TEST skip_rpc_with_json 00:07:17.692 ************************************ 00:07:17.692 00:07:17.692 real 0m6.215s 00:07:17.692 user 0m5.992s 00:07:17.692 sys 0m0.407s 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:07:17.692 11:17:59 skip_rpc -- rpc/skip_rpc.sh@75 -- # run_test skip_rpc_with_delay test_skip_rpc_with_delay 00:07:17.692 11:17:59 skip_rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:17.692 11:17:59 skip_rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:17.692 11:17:59 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:17.692 ************************************ 00:07:17.692 START TEST skip_rpc_with_delay 00:07:17.692 ************************************ 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@1125 -- # test_skip_rpc_with_delay 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_delay -- rpc/skip_rpc.sh@57 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@650 -- # local es=0 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:17.692 11:17:59 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:07:17.952 11:17:59 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:17.952 11:17:59 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:07:17.952 11:17:59 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt ]] 00:07:17.952 11:17:59 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:07:17.952 [2024-10-07 11:17:59.465686] app.c: 840:spdk_app_start: *ERROR*: Cannot use '--wait-for-rpc' if no RPC server is going to be started. 00:07:17.952 [2024-10-07 11:17:59.465815] app.c: 719:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 0, errno: 2 00:07:17.952 11:17:59 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@653 -- # es=1 00:07:17.952 11:17:59 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:17.952 11:17:59 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:17.952 11:17:59 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:17.952 00:07:17.952 real 0m0.085s 00:07:17.952 user 0m0.050s 00:07:17.952 sys 0m0.033s 00:07:17.952 11:17:59 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:17.952 ************************************ 00:07:17.952 END TEST skip_rpc_with_delay 00:07:17.952 ************************************ 00:07:17.952 11:17:59 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@10 -- # set +x 00:07:17.952 11:17:59 skip_rpc -- rpc/skip_rpc.sh@77 -- # uname 00:07:17.953 11:17:59 skip_rpc -- rpc/skip_rpc.sh@77 -- # '[' Linux '!=' FreeBSD ']' 00:07:17.953 11:17:59 skip_rpc -- rpc/skip_rpc.sh@78 -- # run_test exit_on_failed_rpc_init test_exit_on_failed_rpc_init 00:07:17.953 11:17:59 skip_rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:17.953 11:17:59 skip_rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:17.953 11:17:59 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:17.953 ************************************ 00:07:17.953 START TEST exit_on_failed_rpc_init 00:07:17.953 ************************************ 00:07:17.953 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@1125 -- # test_exit_on_failed_rpc_init 00:07:17.953 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:17.953 11:17:59 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@62 -- # local spdk_pid=57388 00:07:17.953 11:17:59 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@63 -- # waitforlisten 57388 00:07:17.953 11:17:59 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@61 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 00:07:17.953 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@831 -- # '[' -z 57388 ']' 00:07:17.953 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:17.953 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:17.953 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:17.953 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:17.953 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@10 -- # set +x 00:07:17.953 [2024-10-07 11:17:59.590711] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:17.953 [2024-10-07 11:17:59.590807] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid57388 ] 00:07:18.212 [2024-10-07 11:17:59.723110] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:18.212 [2024-10-07 11:17:59.783333] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:18.212 [2024-10-07 11:17:59.824593] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:07:18.471 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:18.471 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@864 -- # return 0 00:07:18.471 11:17:59 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@65 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:07:18.471 11:17:59 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@67 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x2 00:07:18.471 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@650 -- # local es=0 00:07:18.471 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x2 00:07:18.471 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:07:18.471 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:18.471 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:07:18.471 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:18.471 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:07:18.471 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:18.471 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:07:18.471 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt ]] 00:07:18.471 11:17:59 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x2 00:07:18.471 [2024-10-07 11:18:00.046298] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:18.471 [2024-10-07 11:18:00.046461] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid57393 ] 00:07:18.729 [2024-10-07 11:18:00.188826] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:18.729 [2024-10-07 11:18:00.263163] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:07:18.729 [2024-10-07 11:18:00.263290] rpc.c: 180:_spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:07:18.729 [2024-10-07 11:18:00.263315] rpc.c: 166:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:07:18.729 [2024-10-07 11:18:00.263331] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:07:18.729 11:18:00 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@653 -- # es=234 00:07:18.729 11:18:00 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:18.729 11:18:00 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@662 -- # es=106 00:07:18.729 11:18:00 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@663 -- # case "$es" in 00:07:18.729 11:18:00 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@670 -- # es=1 00:07:18.729 11:18:00 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:18.729 11:18:00 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:07:18.729 11:18:00 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@70 -- # killprocess 57388 00:07:18.729 11:18:00 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@950 -- # '[' -z 57388 ']' 00:07:18.729 11:18:00 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@954 -- # kill -0 57388 00:07:18.729 11:18:00 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@955 -- # uname 00:07:18.729 11:18:00 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:18.729 11:18:00 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 57388 00:07:18.729 killing process with pid 57388 00:07:18.729 11:18:00 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:18.729 11:18:00 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:18.729 11:18:00 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@968 -- # echo 'killing process with pid 57388' 00:07:18.729 11:18:00 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@969 -- # kill 57388 00:07:18.729 11:18:00 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@974 -- # wait 57388 00:07:18.987 00:07:18.987 real 0m1.143s 00:07:18.987 user 0m1.385s 00:07:18.987 sys 0m0.290s 00:07:18.987 11:18:00 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:18.987 11:18:00 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@10 -- # set +x 00:07:18.987 ************************************ 00:07:18.987 END TEST exit_on_failed_rpc_init 00:07:18.987 ************************************ 00:07:19.244 11:18:00 skip_rpc -- rpc/skip_rpc.sh@81 -- # rm /home/vagrant/spdk_repo/spdk/test/rpc/config.json 00:07:19.244 00:07:19.244 real 0m13.133s 00:07:19.244 user 0m12.642s 00:07:19.244 sys 0m1.092s 00:07:19.244 11:18:00 skip_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:19.244 11:18:00 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:19.244 ************************************ 00:07:19.244 END TEST skip_rpc 00:07:19.244 ************************************ 00:07:19.244 11:18:00 -- spdk/autotest.sh@158 -- # run_test rpc_client /home/vagrant/spdk_repo/spdk/test/rpc_client/rpc_client.sh 00:07:19.244 11:18:00 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:19.244 11:18:00 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:19.244 11:18:00 -- common/autotest_common.sh@10 -- # set +x 00:07:19.244 ************************************ 00:07:19.244 START TEST rpc_client 00:07:19.244 ************************************ 00:07:19.244 11:18:00 rpc_client -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/rpc_client/rpc_client.sh 00:07:19.244 * Looking for test storage... 00:07:19.244 * Found test storage at /home/vagrant/spdk_repo/spdk/test/rpc_client 00:07:19.244 11:18:00 rpc_client -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:19.244 11:18:00 rpc_client -- common/autotest_common.sh@1681 -- # lcov --version 00:07:19.244 11:18:00 rpc_client -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:19.244 11:18:00 rpc_client -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:19.244 11:18:00 rpc_client -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:19.244 11:18:00 rpc_client -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:19.244 11:18:00 rpc_client -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:19.244 11:18:00 rpc_client -- scripts/common.sh@336 -- # IFS=.-: 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@336 -- # read -ra ver1 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@337 -- # IFS=.-: 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@337 -- # read -ra ver2 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@338 -- # local 'op=<' 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@340 -- # ver1_l=2 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@341 -- # ver2_l=1 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@344 -- # case "$op" in 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@345 -- # : 1 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@365 -- # decimal 1 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@353 -- # local d=1 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@355 -- # echo 1 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@365 -- # ver1[v]=1 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@366 -- # decimal 2 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@353 -- # local d=2 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@355 -- # echo 2 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@366 -- # ver2[v]=2 00:07:19.245 11:18:00 rpc_client -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:19.502 11:18:00 rpc_client -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:19.502 11:18:00 rpc_client -- scripts/common.sh@368 -- # return 0 00:07:19.502 11:18:00 rpc_client -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:19.502 11:18:00 rpc_client -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:19.502 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:19.502 --rc genhtml_branch_coverage=1 00:07:19.502 --rc genhtml_function_coverage=1 00:07:19.502 --rc genhtml_legend=1 00:07:19.502 --rc geninfo_all_blocks=1 00:07:19.502 --rc geninfo_unexecuted_blocks=1 00:07:19.503 00:07:19.503 ' 00:07:19.503 11:18:00 rpc_client -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:19.503 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:19.503 --rc genhtml_branch_coverage=1 00:07:19.503 --rc genhtml_function_coverage=1 00:07:19.503 --rc genhtml_legend=1 00:07:19.503 --rc geninfo_all_blocks=1 00:07:19.503 --rc geninfo_unexecuted_blocks=1 00:07:19.503 00:07:19.503 ' 00:07:19.503 11:18:00 rpc_client -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:19.503 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:19.503 --rc genhtml_branch_coverage=1 00:07:19.503 --rc genhtml_function_coverage=1 00:07:19.503 --rc genhtml_legend=1 00:07:19.503 --rc geninfo_all_blocks=1 00:07:19.503 --rc geninfo_unexecuted_blocks=1 00:07:19.503 00:07:19.503 ' 00:07:19.503 11:18:00 rpc_client -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:19.503 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:19.503 --rc genhtml_branch_coverage=1 00:07:19.503 --rc genhtml_function_coverage=1 00:07:19.503 --rc genhtml_legend=1 00:07:19.503 --rc geninfo_all_blocks=1 00:07:19.503 --rc geninfo_unexecuted_blocks=1 00:07:19.503 00:07:19.503 ' 00:07:19.503 11:18:00 rpc_client -- rpc_client/rpc_client.sh@10 -- # /home/vagrant/spdk_repo/spdk/test/rpc_client/rpc_client_test 00:07:19.503 OK 00:07:19.503 11:18:00 rpc_client -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:07:19.503 ************************************ 00:07:19.503 END TEST rpc_client 00:07:19.503 ************************************ 00:07:19.503 00:07:19.503 real 0m0.220s 00:07:19.503 user 0m0.141s 00:07:19.503 sys 0m0.087s 00:07:19.503 11:18:00 rpc_client -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:19.503 11:18:00 rpc_client -- common/autotest_common.sh@10 -- # set +x 00:07:19.503 11:18:01 -- spdk/autotest.sh@159 -- # run_test json_config /home/vagrant/spdk_repo/spdk/test/json_config/json_config.sh 00:07:19.503 11:18:01 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:19.503 11:18:01 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:19.503 11:18:01 -- common/autotest_common.sh@10 -- # set +x 00:07:19.503 ************************************ 00:07:19.503 START TEST json_config 00:07:19.503 ************************************ 00:07:19.503 11:18:01 json_config -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/json_config/json_config.sh 00:07:19.503 11:18:01 json_config -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:19.503 11:18:01 json_config -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:19.503 11:18:01 json_config -- common/autotest_common.sh@1681 -- # lcov --version 00:07:19.503 11:18:01 json_config -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:19.503 11:18:01 json_config -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:19.503 11:18:01 json_config -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:19.503 11:18:01 json_config -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:19.503 11:18:01 json_config -- scripts/common.sh@336 -- # IFS=.-: 00:07:19.503 11:18:01 json_config -- scripts/common.sh@336 -- # read -ra ver1 00:07:19.503 11:18:01 json_config -- scripts/common.sh@337 -- # IFS=.-: 00:07:19.503 11:18:01 json_config -- scripts/common.sh@337 -- # read -ra ver2 00:07:19.503 11:18:01 json_config -- scripts/common.sh@338 -- # local 'op=<' 00:07:19.503 11:18:01 json_config -- scripts/common.sh@340 -- # ver1_l=2 00:07:19.503 11:18:01 json_config -- scripts/common.sh@341 -- # ver2_l=1 00:07:19.503 11:18:01 json_config -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:19.503 11:18:01 json_config -- scripts/common.sh@344 -- # case "$op" in 00:07:19.503 11:18:01 json_config -- scripts/common.sh@345 -- # : 1 00:07:19.503 11:18:01 json_config -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:19.503 11:18:01 json_config -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:19.503 11:18:01 json_config -- scripts/common.sh@365 -- # decimal 1 00:07:19.503 11:18:01 json_config -- scripts/common.sh@353 -- # local d=1 00:07:19.503 11:18:01 json_config -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:19.503 11:18:01 json_config -- scripts/common.sh@355 -- # echo 1 00:07:19.503 11:18:01 json_config -- scripts/common.sh@365 -- # ver1[v]=1 00:07:19.503 11:18:01 json_config -- scripts/common.sh@366 -- # decimal 2 00:07:19.503 11:18:01 json_config -- scripts/common.sh@353 -- # local d=2 00:07:19.503 11:18:01 json_config -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:19.503 11:18:01 json_config -- scripts/common.sh@355 -- # echo 2 00:07:19.503 11:18:01 json_config -- scripts/common.sh@366 -- # ver2[v]=2 00:07:19.503 11:18:01 json_config -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:19.503 11:18:01 json_config -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:19.503 11:18:01 json_config -- scripts/common.sh@368 -- # return 0 00:07:19.503 11:18:01 json_config -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:19.503 11:18:01 json_config -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:19.503 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:19.503 --rc genhtml_branch_coverage=1 00:07:19.503 --rc genhtml_function_coverage=1 00:07:19.503 --rc genhtml_legend=1 00:07:19.503 --rc geninfo_all_blocks=1 00:07:19.503 --rc geninfo_unexecuted_blocks=1 00:07:19.503 00:07:19.503 ' 00:07:19.503 11:18:01 json_config -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:19.503 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:19.503 --rc genhtml_branch_coverage=1 00:07:19.503 --rc genhtml_function_coverage=1 00:07:19.503 --rc genhtml_legend=1 00:07:19.503 --rc geninfo_all_blocks=1 00:07:19.503 --rc geninfo_unexecuted_blocks=1 00:07:19.503 00:07:19.503 ' 00:07:19.503 11:18:01 json_config -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:19.503 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:19.503 --rc genhtml_branch_coverage=1 00:07:19.503 --rc genhtml_function_coverage=1 00:07:19.503 --rc genhtml_legend=1 00:07:19.503 --rc geninfo_all_blocks=1 00:07:19.503 --rc geninfo_unexecuted_blocks=1 00:07:19.503 00:07:19.503 ' 00:07:19.503 11:18:01 json_config -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:19.503 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:19.503 --rc genhtml_branch_coverage=1 00:07:19.503 --rc genhtml_function_coverage=1 00:07:19.503 --rc genhtml_legend=1 00:07:19.503 --rc geninfo_all_blocks=1 00:07:19.503 --rc geninfo_unexecuted_blocks=1 00:07:19.503 00:07:19.503 ' 00:07:19.503 11:18:01 json_config -- json_config/json_config.sh@8 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@7 -- # uname -s 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:07:19.503 11:18:01 json_config -- scripts/common.sh@15 -- # shopt -s extglob 00:07:19.503 11:18:01 json_config -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:19.503 11:18:01 json_config -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:19.503 11:18:01 json_config -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:19.503 11:18:01 json_config -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:19.503 11:18:01 json_config -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:19.503 11:18:01 json_config -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:19.503 11:18:01 json_config -- paths/export.sh@5 -- # export PATH 00:07:19.503 11:18:01 json_config -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@51 -- # : 0 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:07:19.503 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:07:19.503 11:18:01 json_config -- nvmf/common.sh@55 -- # have_pci_nics=0 00:07:19.503 11:18:01 json_config -- json_config/json_config.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/json_config/common.sh 00:07:19.503 11:18:01 json_config -- json_config/json_config.sh@11 -- # [[ 0 -eq 1 ]] 00:07:19.503 11:18:01 json_config -- json_config/json_config.sh@15 -- # [[ 0 -ne 1 ]] 00:07:19.504 11:18:01 json_config -- json_config/json_config.sh@15 -- # [[ 0 -eq 1 ]] 00:07:19.504 11:18:01 json_config -- json_config/json_config.sh@26 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:07:19.504 11:18:01 json_config -- json_config/json_config.sh@31 -- # app_pid=(['target']='' ['initiator']='') 00:07:19.504 11:18:01 json_config -- json_config/json_config.sh@31 -- # declare -A app_pid 00:07:19.504 11:18:01 json_config -- json_config/json_config.sh@32 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:07:19.504 11:18:01 json_config -- json_config/json_config.sh@32 -- # declare -A app_socket 00:07:19.504 11:18:01 json_config -- json_config/json_config.sh@33 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:07:19.504 11:18:01 json_config -- json_config/json_config.sh@33 -- # declare -A app_params 00:07:19.504 11:18:01 json_config -- json_config/json_config.sh@34 -- # configs_path=(['target']='/home/vagrant/spdk_repo/spdk/spdk_tgt_config.json' ['initiator']='/home/vagrant/spdk_repo/spdk/spdk_initiator_config.json') 00:07:19.504 INFO: JSON configuration test init 00:07:19.504 11:18:01 json_config -- json_config/json_config.sh@34 -- # declare -A configs_path 00:07:19.504 11:18:01 json_config -- json_config/json_config.sh@40 -- # last_event_id=0 00:07:19.504 11:18:01 json_config -- json_config/json_config.sh@362 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:07:19.504 11:18:01 json_config -- json_config/json_config.sh@363 -- # echo 'INFO: JSON configuration test init' 00:07:19.504 11:18:01 json_config -- json_config/json_config.sh@364 -- # json_config_test_init 00:07:19.504 11:18:01 json_config -- json_config/json_config.sh@269 -- # timing_enter json_config_test_init 00:07:19.504 11:18:01 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:07:19.504 11:18:01 json_config -- common/autotest_common.sh@10 -- # set +x 00:07:19.504 11:18:01 json_config -- json_config/json_config.sh@270 -- # timing_enter json_config_setup_target 00:07:19.504 11:18:01 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:07:19.504 11:18:01 json_config -- common/autotest_common.sh@10 -- # set +x 00:07:19.504 11:18:01 json_config -- json_config/json_config.sh@272 -- # json_config_test_start_app target --wait-for-rpc 00:07:19.504 11:18:01 json_config -- json_config/common.sh@9 -- # local app=target 00:07:19.504 11:18:01 json_config -- json_config/common.sh@10 -- # shift 00:07:19.504 11:18:01 json_config -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:07:19.504 Waiting for target to run... 00:07:19.504 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:07:19.504 11:18:01 json_config -- json_config/common.sh@13 -- # [[ -z '' ]] 00:07:19.504 11:18:01 json_config -- json_config/common.sh@15 -- # local app_extra_params= 00:07:19.504 11:18:01 json_config -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:07:19.504 11:18:01 json_config -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:07:19.504 11:18:01 json_config -- json_config/common.sh@22 -- # app_pid["$app"]=57527 00:07:19.504 11:18:01 json_config -- json_config/common.sh@21 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:07:19.504 11:18:01 json_config -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:07:19.504 11:18:01 json_config -- json_config/common.sh@25 -- # waitforlisten 57527 /var/tmp/spdk_tgt.sock 00:07:19.504 11:18:01 json_config -- common/autotest_common.sh@831 -- # '[' -z 57527 ']' 00:07:19.504 11:18:01 json_config -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:07:19.504 11:18:01 json_config -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:19.504 11:18:01 json_config -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:07:19.504 11:18:01 json_config -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:19.504 11:18:01 json_config -- common/autotest_common.sh@10 -- # set +x 00:07:19.761 [2024-10-07 11:18:01.286742] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:19.761 [2024-10-07 11:18:01.287167] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid57527 ] 00:07:20.018 [2024-10-07 11:18:01.606521] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:20.018 [2024-10-07 11:18:01.654209] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.986 11:18:02 json_config -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:20.986 11:18:02 json_config -- common/autotest_common.sh@864 -- # return 0 00:07:20.986 11:18:02 json_config -- json_config/common.sh@26 -- # echo '' 00:07:20.986 00:07:20.986 11:18:02 json_config -- json_config/json_config.sh@276 -- # create_accel_config 00:07:20.986 11:18:02 json_config -- json_config/json_config.sh@100 -- # timing_enter create_accel_config 00:07:20.986 11:18:02 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:07:20.986 11:18:02 json_config -- common/autotest_common.sh@10 -- # set +x 00:07:20.986 11:18:02 json_config -- json_config/json_config.sh@102 -- # [[ 0 -eq 1 ]] 00:07:20.986 11:18:02 json_config -- json_config/json_config.sh@108 -- # timing_exit create_accel_config 00:07:20.986 11:18:02 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:07:20.986 11:18:02 json_config -- common/autotest_common.sh@10 -- # set +x 00:07:20.986 11:18:02 json_config -- json_config/json_config.sh@280 -- # /home/vagrant/spdk_repo/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:07:20.986 11:18:02 json_config -- json_config/json_config.sh@281 -- # tgt_rpc load_config 00:07:20.986 11:18:02 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:07:21.244 [2024-10-07 11:18:02.784951] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:07:21.502 11:18:02 json_config -- json_config/json_config.sh@283 -- # tgt_check_notification_types 00:07:21.502 11:18:02 json_config -- json_config/json_config.sh@43 -- # timing_enter tgt_check_notification_types 00:07:21.502 11:18:02 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:07:21.502 11:18:02 json_config -- common/autotest_common.sh@10 -- # set +x 00:07:21.502 11:18:02 json_config -- json_config/json_config.sh@45 -- # local ret=0 00:07:21.502 11:18:02 json_config -- json_config/json_config.sh@46 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:07:21.502 11:18:02 json_config -- json_config/json_config.sh@46 -- # local enabled_types 00:07:21.502 11:18:02 json_config -- json_config/json_config.sh@47 -- # [[ y == y ]] 00:07:21.502 11:18:02 json_config -- json_config/json_config.sh@48 -- # enabled_types+=("fsdev_register" "fsdev_unregister") 00:07:21.502 11:18:02 json_config -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:07:21.502 11:18:02 json_config -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:07:21.502 11:18:02 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@51 -- # get_types=('fsdev_register' 'fsdev_unregister' 'bdev_register' 'bdev_unregister') 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@51 -- # local get_types 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@53 -- # local type_diff 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@54 -- # echo bdev_register bdev_unregister fsdev_register fsdev_unregister fsdev_register fsdev_unregister bdev_register bdev_unregister 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@54 -- # tr ' ' '\n' 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@54 -- # sort 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@54 -- # uniq -u 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@54 -- # type_diff= 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@56 -- # [[ -n '' ]] 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@61 -- # timing_exit tgt_check_notification_types 00:07:21.762 11:18:03 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:07:21.762 11:18:03 json_config -- common/autotest_common.sh@10 -- # set +x 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@62 -- # return 0 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@285 -- # [[ 0 -eq 1 ]] 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@289 -- # [[ 0 -eq 1 ]] 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@293 -- # [[ 0 -eq 1 ]] 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@297 -- # [[ 1 -eq 1 ]] 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@298 -- # create_nvmf_subsystem_config 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@237 -- # timing_enter create_nvmf_subsystem_config 00:07:21.762 11:18:03 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:07:21.762 11:18:03 json_config -- common/autotest_common.sh@10 -- # set +x 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@239 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@240 -- # [[ tcp == \r\d\m\a ]] 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@244 -- # [[ -z 127.0.0.1 ]] 00:07:21.762 11:18:03 json_config -- json_config/json_config.sh@249 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:07:21.762 11:18:03 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:07:22.022 MallocForNvmf0 00:07:22.022 11:18:03 json_config -- json_config/json_config.sh@250 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:07:22.022 11:18:03 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:07:22.588 MallocForNvmf1 00:07:22.588 11:18:04 json_config -- json_config/json_config.sh@252 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:07:22.588 11:18:04 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:07:22.847 [2024-10-07 11:18:04.320185] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:22.847 11:18:04 json_config -- json_config/json_config.sh@253 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:22.847 11:18:04 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:23.105 11:18:04 json_config -- json_config/json_config.sh@254 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:07:23.105 11:18:04 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:07:23.363 11:18:04 json_config -- json_config/json_config.sh@255 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:07:23.363 11:18:04 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:07:23.622 11:18:05 json_config -- json_config/json_config.sh@256 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:07:23.622 11:18:05 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:07:24.189 [2024-10-07 11:18:05.605029] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:07:24.189 11:18:05 json_config -- json_config/json_config.sh@258 -- # timing_exit create_nvmf_subsystem_config 00:07:24.189 11:18:05 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:07:24.189 11:18:05 json_config -- common/autotest_common.sh@10 -- # set +x 00:07:24.189 11:18:05 json_config -- json_config/json_config.sh@300 -- # timing_exit json_config_setup_target 00:07:24.189 11:18:05 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:07:24.189 11:18:05 json_config -- common/autotest_common.sh@10 -- # set +x 00:07:24.189 11:18:05 json_config -- json_config/json_config.sh@302 -- # [[ 0 -eq 1 ]] 00:07:24.189 11:18:05 json_config -- json_config/json_config.sh@307 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:07:24.189 11:18:05 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:07:24.450 MallocBdevForConfigChangeCheck 00:07:24.450 11:18:05 json_config -- json_config/json_config.sh@309 -- # timing_exit json_config_test_init 00:07:24.450 11:18:05 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:07:24.450 11:18:05 json_config -- common/autotest_common.sh@10 -- # set +x 00:07:24.450 11:18:06 json_config -- json_config/json_config.sh@366 -- # tgt_rpc save_config 00:07:24.450 11:18:06 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:07:25.014 INFO: shutting down applications... 00:07:25.014 11:18:06 json_config -- json_config/json_config.sh@368 -- # echo 'INFO: shutting down applications...' 00:07:25.014 11:18:06 json_config -- json_config/json_config.sh@369 -- # [[ 0 -eq 1 ]] 00:07:25.014 11:18:06 json_config -- json_config/json_config.sh@375 -- # json_config_clear target 00:07:25.014 11:18:06 json_config -- json_config/json_config.sh@339 -- # [[ -n 22 ]] 00:07:25.014 11:18:06 json_config -- json_config/json_config.sh@340 -- # /home/vagrant/spdk_repo/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:07:25.271 Calling clear_iscsi_subsystem 00:07:25.271 Calling clear_nvmf_subsystem 00:07:25.271 Calling clear_nbd_subsystem 00:07:25.271 Calling clear_ublk_subsystem 00:07:25.271 Calling clear_vhost_blk_subsystem 00:07:25.271 Calling clear_vhost_scsi_subsystem 00:07:25.271 Calling clear_bdev_subsystem 00:07:25.271 11:18:06 json_config -- json_config/json_config.sh@344 -- # local config_filter=/home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py 00:07:25.271 11:18:06 json_config -- json_config/json_config.sh@350 -- # count=100 00:07:25.271 11:18:06 json_config -- json_config/json_config.sh@351 -- # '[' 100 -gt 0 ']' 00:07:25.271 11:18:06 json_config -- json_config/json_config.sh@352 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:07:25.271 11:18:06 json_config -- json_config/json_config.sh@352 -- # /home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:07:25.271 11:18:06 json_config -- json_config/json_config.sh@352 -- # /home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py -method check_empty 00:07:25.837 11:18:07 json_config -- json_config/json_config.sh@352 -- # break 00:07:25.837 11:18:07 json_config -- json_config/json_config.sh@357 -- # '[' 100 -eq 0 ']' 00:07:25.837 11:18:07 json_config -- json_config/json_config.sh@376 -- # json_config_test_shutdown_app target 00:07:25.837 11:18:07 json_config -- json_config/common.sh@31 -- # local app=target 00:07:25.837 11:18:07 json_config -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:07:25.837 11:18:07 json_config -- json_config/common.sh@35 -- # [[ -n 57527 ]] 00:07:25.837 11:18:07 json_config -- json_config/common.sh@38 -- # kill -SIGINT 57527 00:07:25.837 11:18:07 json_config -- json_config/common.sh@40 -- # (( i = 0 )) 00:07:25.837 11:18:07 json_config -- json_config/common.sh@40 -- # (( i < 30 )) 00:07:25.837 11:18:07 json_config -- json_config/common.sh@41 -- # kill -0 57527 00:07:25.837 11:18:07 json_config -- json_config/common.sh@45 -- # sleep 0.5 00:07:26.403 11:18:07 json_config -- json_config/common.sh@40 -- # (( i++ )) 00:07:26.403 11:18:07 json_config -- json_config/common.sh@40 -- # (( i < 30 )) 00:07:26.403 11:18:07 json_config -- json_config/common.sh@41 -- # kill -0 57527 00:07:26.403 11:18:07 json_config -- json_config/common.sh@42 -- # app_pid["$app"]= 00:07:26.403 11:18:07 json_config -- json_config/common.sh@43 -- # break 00:07:26.403 11:18:07 json_config -- json_config/common.sh@48 -- # [[ -n '' ]] 00:07:26.403 SPDK target shutdown done 00:07:26.403 INFO: relaunching applications... 00:07:26.403 11:18:07 json_config -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:07:26.403 11:18:07 json_config -- json_config/json_config.sh@378 -- # echo 'INFO: relaunching applications...' 00:07:26.403 11:18:07 json_config -- json_config/json_config.sh@379 -- # json_config_test_start_app target --json /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:07:26.403 11:18:07 json_config -- json_config/common.sh@9 -- # local app=target 00:07:26.403 11:18:07 json_config -- json_config/common.sh@10 -- # shift 00:07:26.403 11:18:07 json_config -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:07:26.403 11:18:07 json_config -- json_config/common.sh@13 -- # [[ -z '' ]] 00:07:26.403 11:18:07 json_config -- json_config/common.sh@15 -- # local app_extra_params= 00:07:26.403 11:18:07 json_config -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:07:26.403 11:18:07 json_config -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:07:26.403 11:18:07 json_config -- json_config/common.sh@22 -- # app_pid["$app"]=57739 00:07:26.403 11:18:07 json_config -- json_config/common.sh@21 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:07:26.403 Waiting for target to run... 00:07:26.403 11:18:07 json_config -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:07:26.403 11:18:07 json_config -- json_config/common.sh@25 -- # waitforlisten 57739 /var/tmp/spdk_tgt.sock 00:07:26.403 11:18:07 json_config -- common/autotest_common.sh@831 -- # '[' -z 57739 ']' 00:07:26.403 11:18:07 json_config -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:07:26.403 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:07:26.403 11:18:07 json_config -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:26.403 11:18:07 json_config -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:07:26.403 11:18:07 json_config -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:26.403 11:18:07 json_config -- common/autotest_common.sh@10 -- # set +x 00:07:26.403 [2024-10-07 11:18:07.923007] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:26.403 [2024-10-07 11:18:07.923391] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid57739 ] 00:07:26.661 [2024-10-07 11:18:08.228195] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:26.661 [2024-10-07 11:18:08.274121] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.921 [2024-10-07 11:18:08.406497] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:07:26.921 [2024-10-07 11:18:08.608654] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:27.181 [2024-10-07 11:18:08.640752] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:07:27.439 00:07:27.439 INFO: Checking if target configuration is the same... 00:07:27.439 11:18:08 json_config -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:27.439 11:18:08 json_config -- common/autotest_common.sh@864 -- # return 0 00:07:27.439 11:18:08 json_config -- json_config/common.sh@26 -- # echo '' 00:07:27.439 11:18:08 json_config -- json_config/json_config.sh@380 -- # [[ 0 -eq 1 ]] 00:07:27.439 11:18:08 json_config -- json_config/json_config.sh@384 -- # echo 'INFO: Checking if target configuration is the same...' 00:07:27.439 11:18:08 json_config -- json_config/json_config.sh@385 -- # /home/vagrant/spdk_repo/spdk/test/json_config/json_diff.sh /dev/fd/62 /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:07:27.439 11:18:08 json_config -- json_config/json_config.sh@385 -- # tgt_rpc save_config 00:07:27.439 11:18:08 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:07:27.439 + '[' 2 -ne 2 ']' 00:07:27.439 +++ dirname /home/vagrant/spdk_repo/spdk/test/json_config/json_diff.sh 00:07:27.439 ++ readlink -f /home/vagrant/spdk_repo/spdk/test/json_config/../.. 00:07:27.439 + rootdir=/home/vagrant/spdk_repo/spdk 00:07:27.439 +++ basename /dev/fd/62 00:07:27.439 ++ mktemp /tmp/62.XXX 00:07:27.439 + tmp_file_1=/tmp/62.DDC 00:07:27.439 +++ basename /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:07:27.439 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:07:27.439 + tmp_file_2=/tmp/spdk_tgt_config.json.nCF 00:07:27.439 + ret=0 00:07:27.439 + /home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py -method sort 00:07:27.697 + /home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py -method sort 00:07:27.955 + diff -u /tmp/62.DDC /tmp/spdk_tgt_config.json.nCF 00:07:27.955 INFO: JSON config files are the same 00:07:27.955 + echo 'INFO: JSON config files are the same' 00:07:27.955 + rm /tmp/62.DDC /tmp/spdk_tgt_config.json.nCF 00:07:27.955 + exit 0 00:07:27.955 INFO: changing configuration and checking if this can be detected... 00:07:27.955 11:18:09 json_config -- json_config/json_config.sh@386 -- # [[ 0 -eq 1 ]] 00:07:27.955 11:18:09 json_config -- json_config/json_config.sh@391 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:07:27.955 11:18:09 json_config -- json_config/json_config.sh@393 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:07:27.955 11:18:09 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:07:28.213 11:18:09 json_config -- json_config/json_config.sh@394 -- # tgt_rpc save_config 00:07:28.213 11:18:09 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:07:28.213 11:18:09 json_config -- json_config/json_config.sh@394 -- # /home/vagrant/spdk_repo/spdk/test/json_config/json_diff.sh /dev/fd/62 /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:07:28.213 + '[' 2 -ne 2 ']' 00:07:28.213 +++ dirname /home/vagrant/spdk_repo/spdk/test/json_config/json_diff.sh 00:07:28.213 ++ readlink -f /home/vagrant/spdk_repo/spdk/test/json_config/../.. 00:07:28.213 + rootdir=/home/vagrant/spdk_repo/spdk 00:07:28.213 +++ basename /dev/fd/62 00:07:28.213 ++ mktemp /tmp/62.XXX 00:07:28.213 + tmp_file_1=/tmp/62.swL 00:07:28.213 +++ basename /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:07:28.213 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:07:28.213 + tmp_file_2=/tmp/spdk_tgt_config.json.0d8 00:07:28.213 + ret=0 00:07:28.213 + /home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py -method sort 00:07:28.780 + /home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py -method sort 00:07:28.780 + diff -u /tmp/62.swL /tmp/spdk_tgt_config.json.0d8 00:07:28.780 + ret=1 00:07:28.780 + echo '=== Start of file: /tmp/62.swL ===' 00:07:28.780 + cat /tmp/62.swL 00:07:28.780 + echo '=== End of file: /tmp/62.swL ===' 00:07:28.780 + echo '' 00:07:28.780 + echo '=== Start of file: /tmp/spdk_tgt_config.json.0d8 ===' 00:07:28.780 + cat /tmp/spdk_tgt_config.json.0d8 00:07:28.780 + echo '=== End of file: /tmp/spdk_tgt_config.json.0d8 ===' 00:07:28.780 + echo '' 00:07:28.780 + rm /tmp/62.swL /tmp/spdk_tgt_config.json.0d8 00:07:28.780 + exit 1 00:07:28.780 INFO: configuration change detected. 00:07:28.780 11:18:10 json_config -- json_config/json_config.sh@398 -- # echo 'INFO: configuration change detected.' 00:07:28.780 11:18:10 json_config -- json_config/json_config.sh@401 -- # json_config_test_fini 00:07:28.780 11:18:10 json_config -- json_config/json_config.sh@313 -- # timing_enter json_config_test_fini 00:07:28.780 11:18:10 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:07:28.780 11:18:10 json_config -- common/autotest_common.sh@10 -- # set +x 00:07:28.780 11:18:10 json_config -- json_config/json_config.sh@314 -- # local ret=0 00:07:28.780 11:18:10 json_config -- json_config/json_config.sh@316 -- # [[ -n '' ]] 00:07:28.780 11:18:10 json_config -- json_config/json_config.sh@324 -- # [[ -n 57739 ]] 00:07:28.780 11:18:10 json_config -- json_config/json_config.sh@327 -- # cleanup_bdev_subsystem_config 00:07:28.780 11:18:10 json_config -- json_config/json_config.sh@191 -- # timing_enter cleanup_bdev_subsystem_config 00:07:28.780 11:18:10 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:07:28.780 11:18:10 json_config -- common/autotest_common.sh@10 -- # set +x 00:07:28.780 11:18:10 json_config -- json_config/json_config.sh@193 -- # [[ 0 -eq 1 ]] 00:07:28.780 11:18:10 json_config -- json_config/json_config.sh@200 -- # uname -s 00:07:28.780 11:18:10 json_config -- json_config/json_config.sh@200 -- # [[ Linux = Linux ]] 00:07:28.780 11:18:10 json_config -- json_config/json_config.sh@201 -- # rm -f /sample_aio 00:07:28.780 11:18:10 json_config -- json_config/json_config.sh@204 -- # [[ 0 -eq 1 ]] 00:07:28.780 11:18:10 json_config -- json_config/json_config.sh@208 -- # timing_exit cleanup_bdev_subsystem_config 00:07:28.780 11:18:10 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:07:28.780 11:18:10 json_config -- common/autotest_common.sh@10 -- # set +x 00:07:28.780 11:18:10 json_config -- json_config/json_config.sh@330 -- # killprocess 57739 00:07:28.780 11:18:10 json_config -- common/autotest_common.sh@950 -- # '[' -z 57739 ']' 00:07:28.780 11:18:10 json_config -- common/autotest_common.sh@954 -- # kill -0 57739 00:07:28.780 11:18:10 json_config -- common/autotest_common.sh@955 -- # uname 00:07:28.780 11:18:10 json_config -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:28.780 11:18:10 json_config -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 57739 00:07:28.780 killing process with pid 57739 00:07:28.780 11:18:10 json_config -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:28.780 11:18:10 json_config -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:28.780 11:18:10 json_config -- common/autotest_common.sh@968 -- # echo 'killing process with pid 57739' 00:07:28.780 11:18:10 json_config -- common/autotest_common.sh@969 -- # kill 57739 00:07:28.780 11:18:10 json_config -- common/autotest_common.sh@974 -- # wait 57739 00:07:29.038 11:18:10 json_config -- json_config/json_config.sh@333 -- # rm -f /home/vagrant/spdk_repo/spdk/spdk_initiator_config.json /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:07:29.038 11:18:10 json_config -- json_config/json_config.sh@334 -- # timing_exit json_config_test_fini 00:07:29.038 11:18:10 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:07:29.038 11:18:10 json_config -- common/autotest_common.sh@10 -- # set +x 00:07:29.038 INFO: Success 00:07:29.038 11:18:10 json_config -- json_config/json_config.sh@335 -- # return 0 00:07:29.038 11:18:10 json_config -- json_config/json_config.sh@403 -- # echo 'INFO: Success' 00:07:29.039 00:07:29.039 real 0m9.617s 00:07:29.039 user 0m14.542s 00:07:29.039 sys 0m1.511s 00:07:29.039 ************************************ 00:07:29.039 END TEST json_config 00:07:29.039 ************************************ 00:07:29.039 11:18:10 json_config -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:29.039 11:18:10 json_config -- common/autotest_common.sh@10 -- # set +x 00:07:29.039 11:18:10 -- spdk/autotest.sh@160 -- # run_test json_config_extra_key /home/vagrant/spdk_repo/spdk/test/json_config/json_config_extra_key.sh 00:07:29.039 11:18:10 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:29.039 11:18:10 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:29.039 11:18:10 -- common/autotest_common.sh@10 -- # set +x 00:07:29.039 ************************************ 00:07:29.039 START TEST json_config_extra_key 00:07:29.039 ************************************ 00:07:29.039 11:18:10 json_config_extra_key -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/json_config/json_config_extra_key.sh 00:07:29.039 11:18:10 json_config_extra_key -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:29.297 11:18:10 json_config_extra_key -- common/autotest_common.sh@1681 -- # lcov --version 00:07:29.297 11:18:10 json_config_extra_key -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:29.297 11:18:10 json_config_extra_key -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@336 -- # IFS=.-: 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@336 -- # read -ra ver1 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@337 -- # IFS=.-: 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@337 -- # read -ra ver2 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@338 -- # local 'op=<' 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@340 -- # ver1_l=2 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@341 -- # ver2_l=1 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@344 -- # case "$op" in 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@345 -- # : 1 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@365 -- # decimal 1 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@353 -- # local d=1 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@355 -- # echo 1 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@365 -- # ver1[v]=1 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@366 -- # decimal 2 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@353 -- # local d=2 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@355 -- # echo 2 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@366 -- # ver2[v]=2 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:29.297 11:18:10 json_config_extra_key -- scripts/common.sh@368 -- # return 0 00:07:29.297 11:18:10 json_config_extra_key -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:29.297 11:18:10 json_config_extra_key -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:29.297 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.297 --rc genhtml_branch_coverage=1 00:07:29.297 --rc genhtml_function_coverage=1 00:07:29.297 --rc genhtml_legend=1 00:07:29.297 --rc geninfo_all_blocks=1 00:07:29.297 --rc geninfo_unexecuted_blocks=1 00:07:29.297 00:07:29.297 ' 00:07:29.297 11:18:10 json_config_extra_key -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:29.297 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.297 --rc genhtml_branch_coverage=1 00:07:29.297 --rc genhtml_function_coverage=1 00:07:29.297 --rc genhtml_legend=1 00:07:29.297 --rc geninfo_all_blocks=1 00:07:29.297 --rc geninfo_unexecuted_blocks=1 00:07:29.297 00:07:29.297 ' 00:07:29.297 11:18:10 json_config_extra_key -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:29.297 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.297 --rc genhtml_branch_coverage=1 00:07:29.297 --rc genhtml_function_coverage=1 00:07:29.297 --rc genhtml_legend=1 00:07:29.297 --rc geninfo_all_blocks=1 00:07:29.297 --rc geninfo_unexecuted_blocks=1 00:07:29.297 00:07:29.297 ' 00:07:29.297 11:18:10 json_config_extra_key -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:29.297 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.297 --rc genhtml_branch_coverage=1 00:07:29.298 --rc genhtml_function_coverage=1 00:07:29.298 --rc genhtml_legend=1 00:07:29.298 --rc geninfo_all_blocks=1 00:07:29.298 --rc geninfo_unexecuted_blocks=1 00:07:29.298 00:07:29.298 ' 00:07:29.298 11:18:10 json_config_extra_key -- json_config/json_config_extra_key.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@7 -- # uname -s 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:07:29.298 11:18:10 json_config_extra_key -- scripts/common.sh@15 -- # shopt -s extglob 00:07:29.298 11:18:10 json_config_extra_key -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:29.298 11:18:10 json_config_extra_key -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:29.298 11:18:10 json_config_extra_key -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:29.298 11:18:10 json_config_extra_key -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.298 11:18:10 json_config_extra_key -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.298 11:18:10 json_config_extra_key -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.298 11:18:10 json_config_extra_key -- paths/export.sh@5 -- # export PATH 00:07:29.298 11:18:10 json_config_extra_key -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@51 -- # : 0 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:07:29.298 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:07:29.298 11:18:10 json_config_extra_key -- nvmf/common.sh@55 -- # have_pci_nics=0 00:07:29.298 11:18:10 json_config_extra_key -- json_config/json_config_extra_key.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/json_config/common.sh 00:07:29.298 11:18:10 json_config_extra_key -- json_config/json_config_extra_key.sh@17 -- # app_pid=(['target']='') 00:07:29.298 11:18:10 json_config_extra_key -- json_config/json_config_extra_key.sh@17 -- # declare -A app_pid 00:07:29.298 11:18:10 json_config_extra_key -- json_config/json_config_extra_key.sh@18 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:07:29.298 11:18:10 json_config_extra_key -- json_config/json_config_extra_key.sh@18 -- # declare -A app_socket 00:07:29.298 11:18:10 json_config_extra_key -- json_config/json_config_extra_key.sh@19 -- # app_params=(['target']='-m 0x1 -s 1024') 00:07:29.298 11:18:10 json_config_extra_key -- json_config/json_config_extra_key.sh@19 -- # declare -A app_params 00:07:29.298 11:18:10 json_config_extra_key -- json_config/json_config_extra_key.sh@20 -- # configs_path=(['target']='/home/vagrant/spdk_repo/spdk/test/json_config/extra_key.json') 00:07:29.298 11:18:10 json_config_extra_key -- json_config/json_config_extra_key.sh@20 -- # declare -A configs_path 00:07:29.298 11:18:10 json_config_extra_key -- json_config/json_config_extra_key.sh@22 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:07:29.298 11:18:10 json_config_extra_key -- json_config/json_config_extra_key.sh@24 -- # echo 'INFO: launching applications...' 00:07:29.298 INFO: launching applications... 00:07:29.298 11:18:10 json_config_extra_key -- json_config/json_config_extra_key.sh@25 -- # json_config_test_start_app target --json /home/vagrant/spdk_repo/spdk/test/json_config/extra_key.json 00:07:29.298 11:18:10 json_config_extra_key -- json_config/common.sh@9 -- # local app=target 00:07:29.298 11:18:10 json_config_extra_key -- json_config/common.sh@10 -- # shift 00:07:29.298 11:18:10 json_config_extra_key -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:07:29.298 11:18:10 json_config_extra_key -- json_config/common.sh@13 -- # [[ -z '' ]] 00:07:29.298 11:18:10 json_config_extra_key -- json_config/common.sh@15 -- # local app_extra_params= 00:07:29.298 11:18:10 json_config_extra_key -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:07:29.298 11:18:10 json_config_extra_key -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:07:29.298 11:18:10 json_config_extra_key -- json_config/common.sh@22 -- # app_pid["$app"]=57893 00:07:29.298 11:18:10 json_config_extra_key -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:07:29.298 Waiting for target to run... 00:07:29.298 11:18:10 json_config_extra_key -- json_config/common.sh@25 -- # waitforlisten 57893 /var/tmp/spdk_tgt.sock 00:07:29.298 11:18:10 json_config_extra_key -- json_config/common.sh@21 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /home/vagrant/spdk_repo/spdk/test/json_config/extra_key.json 00:07:29.298 11:18:10 json_config_extra_key -- common/autotest_common.sh@831 -- # '[' -z 57893 ']' 00:07:29.298 11:18:10 json_config_extra_key -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:07:29.298 11:18:10 json_config_extra_key -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:29.298 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:07:29.298 11:18:10 json_config_extra_key -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:07:29.298 11:18:10 json_config_extra_key -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:29.298 11:18:10 json_config_extra_key -- common/autotest_common.sh@10 -- # set +x 00:07:29.298 [2024-10-07 11:18:10.914099] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:29.298 [2024-10-07 11:18:10.914204] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid57893 ] 00:07:29.557 [2024-10-07 11:18:11.189599] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:29.557 [2024-10-07 11:18:11.245146] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.815 [2024-10-07 11:18:11.273999] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:07:30.381 00:07:30.381 INFO: shutting down applications... 00:07:30.382 11:18:11 json_config_extra_key -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:30.382 11:18:11 json_config_extra_key -- common/autotest_common.sh@864 -- # return 0 00:07:30.382 11:18:11 json_config_extra_key -- json_config/common.sh@26 -- # echo '' 00:07:30.382 11:18:11 json_config_extra_key -- json_config/json_config_extra_key.sh@27 -- # echo 'INFO: shutting down applications...' 00:07:30.382 11:18:11 json_config_extra_key -- json_config/json_config_extra_key.sh@28 -- # json_config_test_shutdown_app target 00:07:30.382 11:18:11 json_config_extra_key -- json_config/common.sh@31 -- # local app=target 00:07:30.382 11:18:11 json_config_extra_key -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:07:30.382 11:18:11 json_config_extra_key -- json_config/common.sh@35 -- # [[ -n 57893 ]] 00:07:30.382 11:18:11 json_config_extra_key -- json_config/common.sh@38 -- # kill -SIGINT 57893 00:07:30.382 11:18:11 json_config_extra_key -- json_config/common.sh@40 -- # (( i = 0 )) 00:07:30.382 11:18:11 json_config_extra_key -- json_config/common.sh@40 -- # (( i < 30 )) 00:07:30.382 11:18:11 json_config_extra_key -- json_config/common.sh@41 -- # kill -0 57893 00:07:30.382 11:18:11 json_config_extra_key -- json_config/common.sh@45 -- # sleep 0.5 00:07:30.949 11:18:12 json_config_extra_key -- json_config/common.sh@40 -- # (( i++ )) 00:07:30.949 11:18:12 json_config_extra_key -- json_config/common.sh@40 -- # (( i < 30 )) 00:07:30.949 11:18:12 json_config_extra_key -- json_config/common.sh@41 -- # kill -0 57893 00:07:30.949 11:18:12 json_config_extra_key -- json_config/common.sh@42 -- # app_pid["$app"]= 00:07:30.949 11:18:12 json_config_extra_key -- json_config/common.sh@43 -- # break 00:07:30.949 11:18:12 json_config_extra_key -- json_config/common.sh@48 -- # [[ -n '' ]] 00:07:30.949 11:18:12 json_config_extra_key -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:07:30.949 SPDK target shutdown done 00:07:30.949 11:18:12 json_config_extra_key -- json_config/json_config_extra_key.sh@30 -- # echo Success 00:07:30.949 Success 00:07:30.949 00:07:30.949 real 0m1.700s 00:07:30.949 user 0m1.595s 00:07:30.949 sys 0m0.285s 00:07:30.949 ************************************ 00:07:30.949 END TEST json_config_extra_key 00:07:30.949 ************************************ 00:07:30.949 11:18:12 json_config_extra_key -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:30.949 11:18:12 json_config_extra_key -- common/autotest_common.sh@10 -- # set +x 00:07:30.949 11:18:12 -- spdk/autotest.sh@161 -- # run_test alias_rpc /home/vagrant/spdk_repo/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:07:30.949 11:18:12 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:30.949 11:18:12 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:30.949 11:18:12 -- common/autotest_common.sh@10 -- # set +x 00:07:30.949 ************************************ 00:07:30.949 START TEST alias_rpc 00:07:30.949 ************************************ 00:07:30.949 11:18:12 alias_rpc -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:07:30.949 * Looking for test storage... 00:07:30.949 * Found test storage at /home/vagrant/spdk_repo/spdk/test/json_config/alias_rpc 00:07:30.949 11:18:12 alias_rpc -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:30.950 11:18:12 alias_rpc -- common/autotest_common.sh@1681 -- # lcov --version 00:07:30.950 11:18:12 alias_rpc -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:30.950 11:18:12 alias_rpc -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@336 -- # IFS=.-: 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@336 -- # read -ra ver1 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@337 -- # IFS=.-: 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@337 -- # read -ra ver2 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@338 -- # local 'op=<' 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@340 -- # ver1_l=2 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@341 -- # ver2_l=1 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@344 -- # case "$op" in 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@345 -- # : 1 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@365 -- # decimal 1 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@353 -- # local d=1 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@355 -- # echo 1 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@365 -- # ver1[v]=1 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@366 -- # decimal 2 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@353 -- # local d=2 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@355 -- # echo 2 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@366 -- # ver2[v]=2 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:30.950 11:18:12 alias_rpc -- scripts/common.sh@368 -- # return 0 00:07:30.950 11:18:12 alias_rpc -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:30.950 11:18:12 alias_rpc -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:30.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.950 --rc genhtml_branch_coverage=1 00:07:30.950 --rc genhtml_function_coverage=1 00:07:30.950 --rc genhtml_legend=1 00:07:30.950 --rc geninfo_all_blocks=1 00:07:30.950 --rc geninfo_unexecuted_blocks=1 00:07:30.950 00:07:30.950 ' 00:07:30.950 11:18:12 alias_rpc -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:30.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.950 --rc genhtml_branch_coverage=1 00:07:30.950 --rc genhtml_function_coverage=1 00:07:30.950 --rc genhtml_legend=1 00:07:30.950 --rc geninfo_all_blocks=1 00:07:30.950 --rc geninfo_unexecuted_blocks=1 00:07:30.950 00:07:30.950 ' 00:07:30.950 11:18:12 alias_rpc -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:30.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.950 --rc genhtml_branch_coverage=1 00:07:30.950 --rc genhtml_function_coverage=1 00:07:30.950 --rc genhtml_legend=1 00:07:30.950 --rc geninfo_all_blocks=1 00:07:30.950 --rc geninfo_unexecuted_blocks=1 00:07:30.950 00:07:30.950 ' 00:07:30.950 11:18:12 alias_rpc -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:30.950 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.950 --rc genhtml_branch_coverage=1 00:07:30.950 --rc genhtml_function_coverage=1 00:07:30.950 --rc genhtml_legend=1 00:07:30.950 --rc geninfo_all_blocks=1 00:07:30.950 --rc geninfo_unexecuted_blocks=1 00:07:30.950 00:07:30.950 ' 00:07:30.950 11:18:12 alias_rpc -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:30.950 11:18:12 alias_rpc -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=57961 00:07:30.950 11:18:12 alias_rpc -- alias_rpc/alias_rpc.sh@12 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:07:30.950 11:18:12 alias_rpc -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 57961 00:07:30.950 11:18:12 alias_rpc -- common/autotest_common.sh@831 -- # '[' -z 57961 ']' 00:07:30.950 11:18:12 alias_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:30.950 11:18:12 alias_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:30.950 11:18:12 alias_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:30.950 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:30.950 11:18:12 alias_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:30.950 11:18:12 alias_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:31.208 [2024-10-07 11:18:12.679213] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:31.209 [2024-10-07 11:18:12.679866] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid57961 ] 00:07:31.209 [2024-10-07 11:18:12.810612] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:31.209 [2024-10-07 11:18:12.870919] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.209 [2024-10-07 11:18:12.911488] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:07:31.466 11:18:13 alias_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:31.466 11:18:13 alias_rpc -- common/autotest_common.sh@864 -- # return 0 00:07:31.466 11:18:13 alias_rpc -- alias_rpc/alias_rpc.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py load_config -i 00:07:31.725 11:18:13 alias_rpc -- alias_rpc/alias_rpc.sh@19 -- # killprocess 57961 00:07:31.725 11:18:13 alias_rpc -- common/autotest_common.sh@950 -- # '[' -z 57961 ']' 00:07:31.725 11:18:13 alias_rpc -- common/autotest_common.sh@954 -- # kill -0 57961 00:07:31.725 11:18:13 alias_rpc -- common/autotest_common.sh@955 -- # uname 00:07:31.725 11:18:13 alias_rpc -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:31.725 11:18:13 alias_rpc -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 57961 00:07:31.984 killing process with pid 57961 00:07:31.984 11:18:13 alias_rpc -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:31.984 11:18:13 alias_rpc -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:31.984 11:18:13 alias_rpc -- common/autotest_common.sh@968 -- # echo 'killing process with pid 57961' 00:07:31.984 11:18:13 alias_rpc -- common/autotest_common.sh@969 -- # kill 57961 00:07:31.984 11:18:13 alias_rpc -- common/autotest_common.sh@974 -- # wait 57961 00:07:32.279 ************************************ 00:07:32.279 END TEST alias_rpc 00:07:32.279 ************************************ 00:07:32.279 00:07:32.279 real 0m1.277s 00:07:32.279 user 0m1.534s 00:07:32.279 sys 0m0.345s 00:07:32.279 11:18:13 alias_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:32.279 11:18:13 alias_rpc -- common/autotest_common.sh@10 -- # set +x 00:07:32.279 11:18:13 -- spdk/autotest.sh@163 -- # [[ 0 -eq 0 ]] 00:07:32.279 11:18:13 -- spdk/autotest.sh@164 -- # run_test spdkcli_tcp /home/vagrant/spdk_repo/spdk/test/spdkcli/tcp.sh 00:07:32.279 11:18:13 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:32.279 11:18:13 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:32.279 11:18:13 -- common/autotest_common.sh@10 -- # set +x 00:07:32.279 ************************************ 00:07:32.279 START TEST spdkcli_tcp 00:07:32.279 ************************************ 00:07:32.279 11:18:13 spdkcli_tcp -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/spdkcli/tcp.sh 00:07:32.279 * Looking for test storage... 00:07:32.279 * Found test storage at /home/vagrant/spdk_repo/spdk/test/spdkcli 00:07:32.279 11:18:13 spdkcli_tcp -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:32.279 11:18:13 spdkcli_tcp -- common/autotest_common.sh@1681 -- # lcov --version 00:07:32.279 11:18:13 spdkcli_tcp -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:32.279 11:18:13 spdkcli_tcp -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:32.279 11:18:13 spdkcli_tcp -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:32.279 11:18:13 spdkcli_tcp -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:32.279 11:18:13 spdkcli_tcp -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:32.279 11:18:13 spdkcli_tcp -- scripts/common.sh@336 -- # IFS=.-: 00:07:32.279 11:18:13 spdkcli_tcp -- scripts/common.sh@336 -- # read -ra ver1 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@337 -- # IFS=.-: 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@337 -- # read -ra ver2 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@338 -- # local 'op=<' 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@340 -- # ver1_l=2 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@341 -- # ver2_l=1 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@344 -- # case "$op" in 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@345 -- # : 1 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@365 -- # decimal 1 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@353 -- # local d=1 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@355 -- # echo 1 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@365 -- # ver1[v]=1 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@366 -- # decimal 2 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@353 -- # local d=2 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@355 -- # echo 2 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@366 -- # ver2[v]=2 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:32.280 11:18:13 spdkcli_tcp -- scripts/common.sh@368 -- # return 0 00:07:32.280 11:18:13 spdkcli_tcp -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:32.280 11:18:13 spdkcli_tcp -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:32.280 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:32.280 --rc genhtml_branch_coverage=1 00:07:32.280 --rc genhtml_function_coverage=1 00:07:32.280 --rc genhtml_legend=1 00:07:32.280 --rc geninfo_all_blocks=1 00:07:32.280 --rc geninfo_unexecuted_blocks=1 00:07:32.280 00:07:32.280 ' 00:07:32.280 11:18:13 spdkcli_tcp -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:32.280 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:32.280 --rc genhtml_branch_coverage=1 00:07:32.280 --rc genhtml_function_coverage=1 00:07:32.280 --rc genhtml_legend=1 00:07:32.280 --rc geninfo_all_blocks=1 00:07:32.280 --rc geninfo_unexecuted_blocks=1 00:07:32.280 00:07:32.280 ' 00:07:32.280 11:18:13 spdkcli_tcp -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:32.280 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:32.280 --rc genhtml_branch_coverage=1 00:07:32.280 --rc genhtml_function_coverage=1 00:07:32.280 --rc genhtml_legend=1 00:07:32.280 --rc geninfo_all_blocks=1 00:07:32.280 --rc geninfo_unexecuted_blocks=1 00:07:32.280 00:07:32.280 ' 00:07:32.280 11:18:13 spdkcli_tcp -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:32.280 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:32.280 --rc genhtml_branch_coverage=1 00:07:32.280 --rc genhtml_function_coverage=1 00:07:32.280 --rc genhtml_legend=1 00:07:32.280 --rc geninfo_all_blocks=1 00:07:32.280 --rc geninfo_unexecuted_blocks=1 00:07:32.280 00:07:32.280 ' 00:07:32.280 11:18:13 spdkcli_tcp -- spdkcli/tcp.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/spdkcli/common.sh 00:07:32.280 11:18:13 spdkcli_tcp -- spdkcli/common.sh@6 -- # spdkcli_job=/home/vagrant/spdk_repo/spdk/test/spdkcli/spdkcli_job.py 00:07:32.280 11:18:13 spdkcli_tcp -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/home/vagrant/spdk_repo/spdk/test/json_config/clear_config.py 00:07:32.280 11:18:13 spdkcli_tcp -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:07:32.280 11:18:13 spdkcli_tcp -- spdkcli/tcp.sh@19 -- # PORT=9998 00:07:32.280 11:18:13 spdkcli_tcp -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:07:32.280 11:18:13 spdkcli_tcp -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:07:32.280 11:18:13 spdkcli_tcp -- common/autotest_common.sh@724 -- # xtrace_disable 00:07:32.280 11:18:13 spdkcli_tcp -- common/autotest_common.sh@10 -- # set +x 00:07:32.280 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:32.280 11:18:13 spdkcli_tcp -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=58042 00:07:32.280 11:18:13 spdkcli_tcp -- spdkcli/tcp.sh@27 -- # waitforlisten 58042 00:07:32.280 11:18:13 spdkcli_tcp -- common/autotest_common.sh@831 -- # '[' -z 58042 ']' 00:07:32.280 11:18:13 spdkcli_tcp -- spdkcli/tcp.sh@24 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:07:32.280 11:18:13 spdkcli_tcp -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:32.280 11:18:13 spdkcli_tcp -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:32.280 11:18:13 spdkcli_tcp -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:32.280 11:18:13 spdkcli_tcp -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:32.280 11:18:13 spdkcli_tcp -- common/autotest_common.sh@10 -- # set +x 00:07:32.540 [2024-10-07 11:18:14.015492] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:32.540 [2024-10-07 11:18:14.015613] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid58042 ] 00:07:32.540 [2024-10-07 11:18:14.156585] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:07:32.540 [2024-10-07 11:18:14.222748] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:07:32.540 [2024-10-07 11:18:14.222760] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:32.799 [2024-10-07 11:18:14.265105] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:07:32.799 11:18:14 spdkcli_tcp -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:32.799 11:18:14 spdkcli_tcp -- common/autotest_common.sh@864 -- # return 0 00:07:32.799 11:18:14 spdkcli_tcp -- spdkcli/tcp.sh@31 -- # socat_pid=58046 00:07:32.799 11:18:14 spdkcli_tcp -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:07:32.799 11:18:14 spdkcli_tcp -- spdkcli/tcp.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:07:33.058 [ 00:07:33.058 "bdev_malloc_delete", 00:07:33.058 "bdev_malloc_create", 00:07:33.058 "bdev_null_resize", 00:07:33.058 "bdev_null_delete", 00:07:33.058 "bdev_null_create", 00:07:33.058 "bdev_nvme_cuse_unregister", 00:07:33.058 "bdev_nvme_cuse_register", 00:07:33.058 "bdev_opal_new_user", 00:07:33.058 "bdev_opal_set_lock_state", 00:07:33.058 "bdev_opal_delete", 00:07:33.058 "bdev_opal_get_info", 00:07:33.058 "bdev_opal_create", 00:07:33.058 "bdev_nvme_opal_revert", 00:07:33.058 "bdev_nvme_opal_init", 00:07:33.058 "bdev_nvme_send_cmd", 00:07:33.058 "bdev_nvme_set_keys", 00:07:33.058 "bdev_nvme_get_path_iostat", 00:07:33.058 "bdev_nvme_get_mdns_discovery_info", 00:07:33.058 "bdev_nvme_stop_mdns_discovery", 00:07:33.058 "bdev_nvme_start_mdns_discovery", 00:07:33.058 "bdev_nvme_set_multipath_policy", 00:07:33.058 "bdev_nvme_set_preferred_path", 00:07:33.058 "bdev_nvme_get_io_paths", 00:07:33.058 "bdev_nvme_remove_error_injection", 00:07:33.058 "bdev_nvme_add_error_injection", 00:07:33.058 "bdev_nvme_get_discovery_info", 00:07:33.058 "bdev_nvme_stop_discovery", 00:07:33.059 "bdev_nvme_start_discovery", 00:07:33.059 "bdev_nvme_get_controller_health_info", 00:07:33.059 "bdev_nvme_disable_controller", 00:07:33.059 "bdev_nvme_enable_controller", 00:07:33.059 "bdev_nvme_reset_controller", 00:07:33.059 "bdev_nvme_get_transport_statistics", 00:07:33.059 "bdev_nvme_apply_firmware", 00:07:33.059 "bdev_nvme_detach_controller", 00:07:33.059 "bdev_nvme_get_controllers", 00:07:33.059 "bdev_nvme_attach_controller", 00:07:33.059 "bdev_nvme_set_hotplug", 00:07:33.059 "bdev_nvme_set_options", 00:07:33.059 "bdev_passthru_delete", 00:07:33.059 "bdev_passthru_create", 00:07:33.059 "bdev_lvol_set_parent_bdev", 00:07:33.059 "bdev_lvol_set_parent", 00:07:33.059 "bdev_lvol_check_shallow_copy", 00:07:33.059 "bdev_lvol_start_shallow_copy", 00:07:33.059 "bdev_lvol_grow_lvstore", 00:07:33.059 "bdev_lvol_get_lvols", 00:07:33.059 "bdev_lvol_get_lvstores", 00:07:33.059 "bdev_lvol_delete", 00:07:33.059 "bdev_lvol_set_read_only", 00:07:33.059 "bdev_lvol_resize", 00:07:33.059 "bdev_lvol_decouple_parent", 00:07:33.059 "bdev_lvol_inflate", 00:07:33.059 "bdev_lvol_rename", 00:07:33.059 "bdev_lvol_clone_bdev", 00:07:33.059 "bdev_lvol_clone", 00:07:33.059 "bdev_lvol_snapshot", 00:07:33.059 "bdev_lvol_create", 00:07:33.059 "bdev_lvol_delete_lvstore", 00:07:33.059 "bdev_lvol_rename_lvstore", 00:07:33.059 "bdev_lvol_create_lvstore", 00:07:33.059 "bdev_raid_set_options", 00:07:33.059 "bdev_raid_remove_base_bdev", 00:07:33.059 "bdev_raid_add_base_bdev", 00:07:33.059 "bdev_raid_delete", 00:07:33.059 "bdev_raid_create", 00:07:33.059 "bdev_raid_get_bdevs", 00:07:33.059 "bdev_error_inject_error", 00:07:33.059 "bdev_error_delete", 00:07:33.059 "bdev_error_create", 00:07:33.059 "bdev_split_delete", 00:07:33.059 "bdev_split_create", 00:07:33.059 "bdev_delay_delete", 00:07:33.059 "bdev_delay_create", 00:07:33.059 "bdev_delay_update_latency", 00:07:33.059 "bdev_zone_block_delete", 00:07:33.059 "bdev_zone_block_create", 00:07:33.059 "blobfs_create", 00:07:33.059 "blobfs_detect", 00:07:33.059 "blobfs_set_cache_size", 00:07:33.059 "bdev_aio_delete", 00:07:33.059 "bdev_aio_rescan", 00:07:33.059 "bdev_aio_create", 00:07:33.059 "bdev_ftl_set_property", 00:07:33.059 "bdev_ftl_get_properties", 00:07:33.059 "bdev_ftl_get_stats", 00:07:33.059 "bdev_ftl_unmap", 00:07:33.059 "bdev_ftl_unload", 00:07:33.059 "bdev_ftl_delete", 00:07:33.059 "bdev_ftl_load", 00:07:33.059 "bdev_ftl_create", 00:07:33.059 "bdev_virtio_attach_controller", 00:07:33.059 "bdev_virtio_scsi_get_devices", 00:07:33.059 "bdev_virtio_detach_controller", 00:07:33.059 "bdev_virtio_blk_set_hotplug", 00:07:33.059 "bdev_iscsi_delete", 00:07:33.059 "bdev_iscsi_create", 00:07:33.059 "bdev_iscsi_set_options", 00:07:33.059 "bdev_uring_delete", 00:07:33.059 "bdev_uring_rescan", 00:07:33.059 "bdev_uring_create", 00:07:33.059 "accel_error_inject_error", 00:07:33.059 "ioat_scan_accel_module", 00:07:33.059 "dsa_scan_accel_module", 00:07:33.059 "iaa_scan_accel_module", 00:07:33.059 "keyring_file_remove_key", 00:07:33.059 "keyring_file_add_key", 00:07:33.059 "keyring_linux_set_options", 00:07:33.059 "fsdev_aio_delete", 00:07:33.059 "fsdev_aio_create", 00:07:33.059 "iscsi_get_histogram", 00:07:33.059 "iscsi_enable_histogram", 00:07:33.059 "iscsi_set_options", 00:07:33.059 "iscsi_get_auth_groups", 00:07:33.059 "iscsi_auth_group_remove_secret", 00:07:33.059 "iscsi_auth_group_add_secret", 00:07:33.059 "iscsi_delete_auth_group", 00:07:33.059 "iscsi_create_auth_group", 00:07:33.059 "iscsi_set_discovery_auth", 00:07:33.059 "iscsi_get_options", 00:07:33.059 "iscsi_target_node_request_logout", 00:07:33.059 "iscsi_target_node_set_redirect", 00:07:33.059 "iscsi_target_node_set_auth", 00:07:33.059 "iscsi_target_node_add_lun", 00:07:33.059 "iscsi_get_stats", 00:07:33.059 "iscsi_get_connections", 00:07:33.059 "iscsi_portal_group_set_auth", 00:07:33.059 "iscsi_start_portal_group", 00:07:33.059 "iscsi_delete_portal_group", 00:07:33.059 "iscsi_create_portal_group", 00:07:33.059 "iscsi_get_portal_groups", 00:07:33.059 "iscsi_delete_target_node", 00:07:33.059 "iscsi_target_node_remove_pg_ig_maps", 00:07:33.059 "iscsi_target_node_add_pg_ig_maps", 00:07:33.059 "iscsi_create_target_node", 00:07:33.059 "iscsi_get_target_nodes", 00:07:33.059 "iscsi_delete_initiator_group", 00:07:33.059 "iscsi_initiator_group_remove_initiators", 00:07:33.059 "iscsi_initiator_group_add_initiators", 00:07:33.059 "iscsi_create_initiator_group", 00:07:33.059 "iscsi_get_initiator_groups", 00:07:33.059 "nvmf_set_crdt", 00:07:33.059 "nvmf_set_config", 00:07:33.059 "nvmf_set_max_subsystems", 00:07:33.059 "nvmf_stop_mdns_prr", 00:07:33.059 "nvmf_publish_mdns_prr", 00:07:33.059 "nvmf_subsystem_get_listeners", 00:07:33.059 "nvmf_subsystem_get_qpairs", 00:07:33.059 "nvmf_subsystem_get_controllers", 00:07:33.059 "nvmf_get_stats", 00:07:33.059 "nvmf_get_transports", 00:07:33.059 "nvmf_create_transport", 00:07:33.059 "nvmf_get_targets", 00:07:33.059 "nvmf_delete_target", 00:07:33.059 "nvmf_create_target", 00:07:33.059 "nvmf_subsystem_allow_any_host", 00:07:33.059 "nvmf_subsystem_set_keys", 00:07:33.059 "nvmf_subsystem_remove_host", 00:07:33.059 "nvmf_subsystem_add_host", 00:07:33.059 "nvmf_ns_remove_host", 00:07:33.059 "nvmf_ns_add_host", 00:07:33.059 "nvmf_subsystem_remove_ns", 00:07:33.059 "nvmf_subsystem_set_ns_ana_group", 00:07:33.059 "nvmf_subsystem_add_ns", 00:07:33.059 "nvmf_subsystem_listener_set_ana_state", 00:07:33.059 "nvmf_discovery_get_referrals", 00:07:33.059 "nvmf_discovery_remove_referral", 00:07:33.059 "nvmf_discovery_add_referral", 00:07:33.059 "nvmf_subsystem_remove_listener", 00:07:33.059 "nvmf_subsystem_add_listener", 00:07:33.059 "nvmf_delete_subsystem", 00:07:33.059 "nvmf_create_subsystem", 00:07:33.059 "nvmf_get_subsystems", 00:07:33.059 "env_dpdk_get_mem_stats", 00:07:33.059 "nbd_get_disks", 00:07:33.059 "nbd_stop_disk", 00:07:33.059 "nbd_start_disk", 00:07:33.059 "ublk_recover_disk", 00:07:33.059 "ublk_get_disks", 00:07:33.059 "ublk_stop_disk", 00:07:33.059 "ublk_start_disk", 00:07:33.059 "ublk_destroy_target", 00:07:33.059 "ublk_create_target", 00:07:33.059 "virtio_blk_create_transport", 00:07:33.059 "virtio_blk_get_transports", 00:07:33.059 "vhost_controller_set_coalescing", 00:07:33.059 "vhost_get_controllers", 00:07:33.059 "vhost_delete_controller", 00:07:33.059 "vhost_create_blk_controller", 00:07:33.059 "vhost_scsi_controller_remove_target", 00:07:33.059 "vhost_scsi_controller_add_target", 00:07:33.059 "vhost_start_scsi_controller", 00:07:33.059 "vhost_create_scsi_controller", 00:07:33.059 "thread_set_cpumask", 00:07:33.059 "scheduler_set_options", 00:07:33.059 "framework_get_governor", 00:07:33.059 "framework_get_scheduler", 00:07:33.059 "framework_set_scheduler", 00:07:33.059 "framework_get_reactors", 00:07:33.059 "thread_get_io_channels", 00:07:33.059 "thread_get_pollers", 00:07:33.059 "thread_get_stats", 00:07:33.059 "framework_monitor_context_switch", 00:07:33.059 "spdk_kill_instance", 00:07:33.059 "log_enable_timestamps", 00:07:33.059 "log_get_flags", 00:07:33.059 "log_clear_flag", 00:07:33.059 "log_set_flag", 00:07:33.059 "log_get_level", 00:07:33.059 "log_set_level", 00:07:33.059 "log_get_print_level", 00:07:33.059 "log_set_print_level", 00:07:33.059 "framework_enable_cpumask_locks", 00:07:33.059 "framework_disable_cpumask_locks", 00:07:33.059 "framework_wait_init", 00:07:33.059 "framework_start_init", 00:07:33.059 "scsi_get_devices", 00:07:33.059 "bdev_get_histogram", 00:07:33.059 "bdev_enable_histogram", 00:07:33.059 "bdev_set_qos_limit", 00:07:33.059 "bdev_set_qd_sampling_period", 00:07:33.059 "bdev_get_bdevs", 00:07:33.059 "bdev_reset_iostat", 00:07:33.059 "bdev_get_iostat", 00:07:33.059 "bdev_examine", 00:07:33.059 "bdev_wait_for_examine", 00:07:33.059 "bdev_set_options", 00:07:33.059 "accel_get_stats", 00:07:33.059 "accel_set_options", 00:07:33.059 "accel_set_driver", 00:07:33.059 "accel_crypto_key_destroy", 00:07:33.059 "accel_crypto_keys_get", 00:07:33.059 "accel_crypto_key_create", 00:07:33.059 "accel_assign_opc", 00:07:33.059 "accel_get_module_info", 00:07:33.059 "accel_get_opc_assignments", 00:07:33.059 "vmd_rescan", 00:07:33.059 "vmd_remove_device", 00:07:33.059 "vmd_enable", 00:07:33.059 "sock_get_default_impl", 00:07:33.059 "sock_set_default_impl", 00:07:33.059 "sock_impl_set_options", 00:07:33.059 "sock_impl_get_options", 00:07:33.059 "iobuf_get_stats", 00:07:33.059 "iobuf_set_options", 00:07:33.059 "keyring_get_keys", 00:07:33.059 "framework_get_pci_devices", 00:07:33.059 "framework_get_config", 00:07:33.059 "framework_get_subsystems", 00:07:33.059 "fsdev_set_opts", 00:07:33.059 "fsdev_get_opts", 00:07:33.059 "trace_get_info", 00:07:33.060 "trace_get_tpoint_group_mask", 00:07:33.060 "trace_disable_tpoint_group", 00:07:33.060 "trace_enable_tpoint_group", 00:07:33.060 "trace_clear_tpoint_mask", 00:07:33.060 "trace_set_tpoint_mask", 00:07:33.060 "notify_get_notifications", 00:07:33.060 "notify_get_types", 00:07:33.060 "spdk_get_version", 00:07:33.060 "rpc_get_methods" 00:07:33.060 ] 00:07:33.060 11:18:14 spdkcli_tcp -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:07:33.060 11:18:14 spdkcli_tcp -- common/autotest_common.sh@730 -- # xtrace_disable 00:07:33.060 11:18:14 spdkcli_tcp -- common/autotest_common.sh@10 -- # set +x 00:07:33.060 11:18:14 spdkcli_tcp -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:07:33.060 11:18:14 spdkcli_tcp -- spdkcli/tcp.sh@38 -- # killprocess 58042 00:07:33.060 11:18:14 spdkcli_tcp -- common/autotest_common.sh@950 -- # '[' -z 58042 ']' 00:07:33.060 11:18:14 spdkcli_tcp -- common/autotest_common.sh@954 -- # kill -0 58042 00:07:33.060 11:18:14 spdkcli_tcp -- common/autotest_common.sh@955 -- # uname 00:07:33.060 11:18:14 spdkcli_tcp -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:33.060 11:18:14 spdkcli_tcp -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 58042 00:07:33.060 killing process with pid 58042 00:07:33.060 11:18:14 spdkcli_tcp -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:33.060 11:18:14 spdkcli_tcp -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:33.060 11:18:14 spdkcli_tcp -- common/autotest_common.sh@968 -- # echo 'killing process with pid 58042' 00:07:33.060 11:18:14 spdkcli_tcp -- common/autotest_common.sh@969 -- # kill 58042 00:07:33.060 11:18:14 spdkcli_tcp -- common/autotest_common.sh@974 -- # wait 58042 00:07:33.319 ************************************ 00:07:33.319 END TEST spdkcli_tcp 00:07:33.320 ************************************ 00:07:33.320 00:07:33.320 real 0m1.239s 00:07:33.320 user 0m2.118s 00:07:33.320 sys 0m0.362s 00:07:33.320 11:18:15 spdkcli_tcp -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:33.320 11:18:15 spdkcli_tcp -- common/autotest_common.sh@10 -- # set +x 00:07:33.579 11:18:15 -- spdk/autotest.sh@167 -- # run_test dpdk_mem_utility /home/vagrant/spdk_repo/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:07:33.579 11:18:15 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:33.579 11:18:15 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:33.579 11:18:15 -- common/autotest_common.sh@10 -- # set +x 00:07:33.579 ************************************ 00:07:33.579 START TEST dpdk_mem_utility 00:07:33.579 ************************************ 00:07:33.579 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:07:33.579 * Looking for test storage... 00:07:33.579 * Found test storage at /home/vagrant/spdk_repo/spdk/test/dpdk_memory_utility 00:07:33.579 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:33.579 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@1681 -- # lcov --version 00:07:33.579 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:33.579 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@336 -- # IFS=.-: 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@336 -- # read -ra ver1 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@337 -- # IFS=.-: 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@337 -- # read -ra ver2 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@338 -- # local 'op=<' 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@340 -- # ver1_l=2 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@341 -- # ver2_l=1 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@344 -- # case "$op" in 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@345 -- # : 1 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@365 -- # decimal 1 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@353 -- # local d=1 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@355 -- # echo 1 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@365 -- # ver1[v]=1 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@366 -- # decimal 2 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@353 -- # local d=2 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@355 -- # echo 2 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@366 -- # ver2[v]=2 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:33.579 11:18:15 dpdk_mem_utility -- scripts/common.sh@368 -- # return 0 00:07:33.580 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:33.580 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:33.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:33.580 --rc genhtml_branch_coverage=1 00:07:33.580 --rc genhtml_function_coverage=1 00:07:33.580 --rc genhtml_legend=1 00:07:33.580 --rc geninfo_all_blocks=1 00:07:33.580 --rc geninfo_unexecuted_blocks=1 00:07:33.580 00:07:33.580 ' 00:07:33.580 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:33.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:33.580 --rc genhtml_branch_coverage=1 00:07:33.580 --rc genhtml_function_coverage=1 00:07:33.580 --rc genhtml_legend=1 00:07:33.580 --rc geninfo_all_blocks=1 00:07:33.580 --rc geninfo_unexecuted_blocks=1 00:07:33.580 00:07:33.580 ' 00:07:33.580 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:33.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:33.580 --rc genhtml_branch_coverage=1 00:07:33.580 --rc genhtml_function_coverage=1 00:07:33.580 --rc genhtml_legend=1 00:07:33.580 --rc geninfo_all_blocks=1 00:07:33.580 --rc geninfo_unexecuted_blocks=1 00:07:33.580 00:07:33.580 ' 00:07:33.580 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:33.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:33.580 --rc genhtml_branch_coverage=1 00:07:33.580 --rc genhtml_function_coverage=1 00:07:33.580 --rc genhtml_legend=1 00:07:33.580 --rc geninfo_all_blocks=1 00:07:33.580 --rc geninfo_unexecuted_blocks=1 00:07:33.580 00:07:33.580 ' 00:07:33.580 11:18:15 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/home/vagrant/spdk_repo/spdk/scripts/dpdk_mem_info.py 00:07:33.580 11:18:15 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=58128 00:07:33.580 11:18:15 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:07:33.580 11:18:15 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 58128 00:07:33.580 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@831 -- # '[' -z 58128 ']' 00:07:33.580 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:33.580 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:33.580 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:33.580 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:33.580 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:33.580 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@10 -- # set +x 00:07:33.580 [2024-10-07 11:18:15.263824] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:33.580 [2024-10-07 11:18:15.264132] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid58128 ] 00:07:33.838 [2024-10-07 11:18:15.402900] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:33.838 [2024-10-07 11:18:15.477788] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:33.838 [2024-10-07 11:18:15.522773] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:07:34.098 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:34.098 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@864 -- # return 0 00:07:34.098 11:18:15 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:07:34.098 11:18:15 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:07:34.098 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.098 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@10 -- # set +x 00:07:34.098 { 00:07:34.098 "filename": "/tmp/spdk_mem_dump.txt" 00:07:34.098 } 00:07:34.098 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.098 11:18:15 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /home/vagrant/spdk_repo/spdk/scripts/dpdk_mem_info.py 00:07:34.098 DPDK memory size 860.000000 MiB in 1 heap(s) 00:07:34.098 1 heaps totaling size 860.000000 MiB 00:07:34.098 size: 860.000000 MiB heap id: 0 00:07:34.098 end heaps---------- 00:07:34.098 9 mempools totaling size 642.649841 MiB 00:07:34.098 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:07:34.098 size: 158.602051 MiB name: PDU_data_out_Pool 00:07:34.098 size: 92.545471 MiB name: bdev_io_58128 00:07:34.098 size: 51.011292 MiB name: evtpool_58128 00:07:34.098 size: 50.003479 MiB name: msgpool_58128 00:07:34.098 size: 36.509338 MiB name: fsdev_io_58128 00:07:34.098 size: 21.763794 MiB name: PDU_Pool 00:07:34.098 size: 19.513306 MiB name: SCSI_TASK_Pool 00:07:34.098 size: 0.026123 MiB name: Session_Pool 00:07:34.098 end mempools------- 00:07:34.098 6 memzones totaling size 4.142822 MiB 00:07:34.098 size: 1.000366 MiB name: RG_ring_0_58128 00:07:34.098 size: 1.000366 MiB name: RG_ring_1_58128 00:07:34.098 size: 1.000366 MiB name: RG_ring_4_58128 00:07:34.098 size: 1.000366 MiB name: RG_ring_5_58128 00:07:34.098 size: 0.125366 MiB name: RG_ring_2_58128 00:07:34.098 size: 0.015991 MiB name: RG_ring_3_58128 00:07:34.098 end memzones------- 00:07:34.098 11:18:15 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /home/vagrant/spdk_repo/spdk/scripts/dpdk_mem_info.py -m 0 00:07:34.098 heap id: 0 total size: 860.000000 MiB number of busy elements: 316 number of free elements: 16 00:07:34.098 list of free elements. size: 13.934875 MiB 00:07:34.098 element at address: 0x200000400000 with size: 1.999512 MiB 00:07:34.098 element at address: 0x200000800000 with size: 1.996948 MiB 00:07:34.098 element at address: 0x20001bc00000 with size: 0.999878 MiB 00:07:34.098 element at address: 0x20001be00000 with size: 0.999878 MiB 00:07:34.098 element at address: 0x200034a00000 with size: 0.994446 MiB 00:07:34.098 element at address: 0x200009600000 with size: 0.959839 MiB 00:07:34.098 element at address: 0x200015e00000 with size: 0.954285 MiB 00:07:34.098 element at address: 0x20001c000000 with size: 0.936584 MiB 00:07:34.098 element at address: 0x200000200000 with size: 0.835022 MiB 00:07:34.098 element at address: 0x20001d800000 with size: 0.566956 MiB 00:07:34.098 element at address: 0x20000d800000 with size: 0.489258 MiB 00:07:34.098 element at address: 0x200003e00000 with size: 0.487549 MiB 00:07:34.098 element at address: 0x20001c200000 with size: 0.485657 MiB 00:07:34.098 element at address: 0x200007000000 with size: 0.480286 MiB 00:07:34.098 element at address: 0x20002ac00000 with size: 0.395752 MiB 00:07:34.098 element at address: 0x200003a00000 with size: 0.353027 MiB 00:07:34.098 list of standard malloc elements. size: 199.268433 MiB 00:07:34.098 element at address: 0x20000d9fff80 with size: 132.000122 MiB 00:07:34.098 element at address: 0x2000097fff80 with size: 64.000122 MiB 00:07:34.098 element at address: 0x20001bcfff80 with size: 1.000122 MiB 00:07:34.098 element at address: 0x20001befff80 with size: 1.000122 MiB 00:07:34.098 element at address: 0x20001c0fff80 with size: 1.000122 MiB 00:07:34.098 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:07:34.098 element at address: 0x20001c0eff00 with size: 0.062622 MiB 00:07:34.098 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:07:34.098 element at address: 0x20001c0efdc0 with size: 0.000305 MiB 00:07:34.098 element at address: 0x2000002d5c40 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d5d00 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d5dc0 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d5e80 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d5f40 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d6000 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d60c0 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d6180 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d6240 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d6300 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d63c0 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d6480 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d6540 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d6600 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d66c0 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d68c0 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d6980 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d6a40 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d6b00 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d6bc0 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d6c80 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d6d40 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d6e00 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d6ec0 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d6f80 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d7040 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d7100 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d71c0 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d7280 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d7340 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d7400 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d74c0 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d7580 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d7640 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d7700 with size: 0.000183 MiB 00:07:34.098 element at address: 0x2000002d77c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x2000002d7880 with size: 0.000183 MiB 00:07:34.099 element at address: 0x2000002d7940 with size: 0.000183 MiB 00:07:34.099 element at address: 0x2000002d7a00 with size: 0.000183 MiB 00:07:34.099 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:07:34.099 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:07:34.099 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003a5a600 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003a5a800 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003a5eac0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003a7ed80 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003a7ee40 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003a7ef00 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003a7efc0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003a7f080 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003a7f140 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003a7f200 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003a7f2c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003a7f380 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003a7f440 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003a7f500 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003a7f5c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003a7f680 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003aff940 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003affb40 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7cd00 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7cdc0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7ce80 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7cf40 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7d000 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7d0c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7d180 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7d240 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7d300 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7d3c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7d480 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7d540 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7d600 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7d6c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7d780 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7d840 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7d900 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7d9c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7da80 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7db40 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7dc00 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7dcc0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7dd80 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7de40 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7df00 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7dfc0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7e080 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7e140 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7e200 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7e2c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7e380 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7e440 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7e500 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7e5c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7e680 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7e740 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7e800 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7e8c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7e980 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7ea40 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7eb00 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7ebc0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7ec80 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003e7ed40 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003eff000 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000707af40 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000707b000 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000707b0c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000707b180 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000707b240 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000707b300 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000707b3c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000707b480 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000707b540 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000707b600 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000707b6c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x2000070fb980 with size: 0.000183 MiB 00:07:34.099 element at address: 0x2000096fdd80 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000d87d400 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000d87d4c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000d87d580 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000d87d640 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000d87d700 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000d87d7c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000d87d880 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000d87d940 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000d87da00 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000d87dac0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20000d8fdd80 with size: 0.000183 MiB 00:07:34.099 element at address: 0x200015ef44c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001c0efc40 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001c0efd00 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001c2bc740 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d891240 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d891300 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d8913c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d891480 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d891540 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d891600 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d8916c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d891780 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d891840 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d891900 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d8919c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d891a80 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d891b40 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d891c00 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d891cc0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d891d80 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d891e40 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d891f00 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d891fc0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d892080 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d892140 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d892200 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d8922c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d892380 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d892440 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d892500 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d8925c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d892680 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d892740 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d892800 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d8928c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d892980 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d892a40 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d892b00 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d892bc0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d892c80 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d892d40 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d892e00 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d892ec0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d892f80 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d893040 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d893100 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d8931c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d893280 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d893340 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d893400 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d8934c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d893580 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d893640 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d893700 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d8937c0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d893880 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d893940 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d893a00 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d893ac0 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d893b80 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d893c40 with size: 0.000183 MiB 00:07:34.099 element at address: 0x20001d893d00 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d893dc0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d893e80 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d893f40 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d894000 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d8940c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d894180 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d894240 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d894300 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d8943c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d894480 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d894540 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d894600 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d8946c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d894780 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d894840 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d894900 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d8949c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d894a80 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d894b40 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d894c00 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d894cc0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d894d80 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d894e40 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d894f00 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d894fc0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d895080 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d895140 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d895200 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d8952c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d895380 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20001d895440 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac65500 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac655c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6c1c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6c3c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6c480 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6c540 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6c600 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6c6c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6c780 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6c840 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6c900 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6c9c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6ca80 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6cb40 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6cc00 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6ccc0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6cd80 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6ce40 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6cf00 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6cfc0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6d080 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6d140 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6d200 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6d2c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6d380 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6d440 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6d500 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6d5c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6d680 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6d740 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6d800 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6d8c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6d980 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6da40 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6db00 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6dbc0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6dc80 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6dd40 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6de00 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6dec0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6df80 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6e040 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6e100 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6e1c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6e280 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6e340 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6e400 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6e4c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6e580 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6e640 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6e700 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6e7c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6e880 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6e940 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6ea00 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6eac0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6eb80 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6ec40 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6ed00 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6edc0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6ee80 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6ef40 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6f000 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6f0c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6f180 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6f240 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6f300 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6f3c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6f480 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6f540 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6f600 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6f6c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6f780 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6f840 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6f900 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6f9c0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6fa80 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6fb40 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6fc00 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6fcc0 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6fd80 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6fe40 with size: 0.000183 MiB 00:07:34.100 element at address: 0x20002ac6ff00 with size: 0.000183 MiB 00:07:34.100 list of memzone associated elements. size: 646.796692 MiB 00:07:34.100 element at address: 0x20001d895500 with size: 211.416748 MiB 00:07:34.100 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:07:34.100 element at address: 0x20002ac6ffc0 with size: 157.562561 MiB 00:07:34.100 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:07:34.100 element at address: 0x200015ff4780 with size: 92.045044 MiB 00:07:34.100 associated memzone info: size: 92.044922 MiB name: MP_bdev_io_58128_0 00:07:34.100 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:07:34.100 associated memzone info: size: 48.002930 MiB name: MP_evtpool_58128_0 00:07:34.100 element at address: 0x200003fff380 with size: 48.003052 MiB 00:07:34.100 associated memzone info: size: 48.002930 MiB name: MP_msgpool_58128_0 00:07:34.100 element at address: 0x2000071fdb80 with size: 36.008911 MiB 00:07:34.100 associated memzone info: size: 36.008789 MiB name: MP_fsdev_io_58128_0 00:07:34.100 element at address: 0x20001c3be940 with size: 20.255554 MiB 00:07:34.100 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:07:34.100 element at address: 0x200034bfeb40 with size: 18.005066 MiB 00:07:34.100 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:07:34.100 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:07:34.100 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_58128 00:07:34.100 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:07:34.100 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_58128 00:07:34.100 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:07:34.100 associated memzone info: size: 1.007996 MiB name: MP_evtpool_58128 00:07:34.100 element at address: 0x20000d8fde40 with size: 1.008118 MiB 00:07:34.100 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:07:34.100 element at address: 0x20001c2bc800 with size: 1.008118 MiB 00:07:34.100 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:07:34.100 element at address: 0x2000096fde40 with size: 1.008118 MiB 00:07:34.100 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:07:34.100 element at address: 0x2000070fba40 with size: 1.008118 MiB 00:07:34.100 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:07:34.100 element at address: 0x200003eff180 with size: 1.000488 MiB 00:07:34.101 associated memzone info: size: 1.000366 MiB name: RG_ring_0_58128 00:07:34.101 element at address: 0x200003affc00 with size: 1.000488 MiB 00:07:34.101 associated memzone info: size: 1.000366 MiB name: RG_ring_1_58128 00:07:34.101 element at address: 0x200015ef4580 with size: 1.000488 MiB 00:07:34.101 associated memzone info: size: 1.000366 MiB name: RG_ring_4_58128 00:07:34.101 element at address: 0x200034afe940 with size: 1.000488 MiB 00:07:34.101 associated memzone info: size: 1.000366 MiB name: RG_ring_5_58128 00:07:34.101 element at address: 0x200003a7f740 with size: 0.500488 MiB 00:07:34.101 associated memzone info: size: 0.500366 MiB name: RG_MP_fsdev_io_58128 00:07:34.101 element at address: 0x200003e7ee00 with size: 0.500488 MiB 00:07:34.101 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_58128 00:07:34.101 element at address: 0x20000d87db80 with size: 0.500488 MiB 00:07:34.101 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:07:34.101 element at address: 0x20000707b780 with size: 0.500488 MiB 00:07:34.101 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:07:34.101 element at address: 0x20001c27c540 with size: 0.250488 MiB 00:07:34.101 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:07:34.101 element at address: 0x200003a5eb80 with size: 0.125488 MiB 00:07:34.101 associated memzone info: size: 0.125366 MiB name: RG_ring_2_58128 00:07:34.101 element at address: 0x2000096f5b80 with size: 0.031738 MiB 00:07:34.101 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:07:34.101 element at address: 0x20002ac65680 with size: 0.023743 MiB 00:07:34.101 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:07:34.101 element at address: 0x200003a5a8c0 with size: 0.016113 MiB 00:07:34.101 associated memzone info: size: 0.015991 MiB name: RG_ring_3_58128 00:07:34.101 element at address: 0x20002ac6b7c0 with size: 0.002441 MiB 00:07:34.101 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:07:34.101 element at address: 0x2000002d6780 with size: 0.000305 MiB 00:07:34.101 associated memzone info: size: 0.000183 MiB name: MP_msgpool_58128 00:07:34.101 element at address: 0x200003affa00 with size: 0.000305 MiB 00:07:34.101 associated memzone info: size: 0.000183 MiB name: MP_fsdev_io_58128 00:07:34.101 element at address: 0x200003a5a6c0 with size: 0.000305 MiB 00:07:34.101 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_58128 00:07:34.101 element at address: 0x20002ac6c280 with size: 0.000305 MiB 00:07:34.101 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:07:34.101 11:18:15 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:07:34.101 11:18:15 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 58128 00:07:34.101 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@950 -- # '[' -z 58128 ']' 00:07:34.101 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@954 -- # kill -0 58128 00:07:34.101 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@955 -- # uname 00:07:34.359 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:34.359 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 58128 00:07:34.359 killing process with pid 58128 00:07:34.359 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:34.359 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:34.359 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@968 -- # echo 'killing process with pid 58128' 00:07:34.359 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@969 -- # kill 58128 00:07:34.359 11:18:15 dpdk_mem_utility -- common/autotest_common.sh@974 -- # wait 58128 00:07:34.618 ************************************ 00:07:34.618 END TEST dpdk_mem_utility 00:07:34.618 ************************************ 00:07:34.618 00:07:34.618 real 0m1.051s 00:07:34.618 user 0m1.084s 00:07:34.618 sys 0m0.323s 00:07:34.618 11:18:16 dpdk_mem_utility -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:34.618 11:18:16 dpdk_mem_utility -- common/autotest_common.sh@10 -- # set +x 00:07:34.618 11:18:16 -- spdk/autotest.sh@168 -- # run_test event /home/vagrant/spdk_repo/spdk/test/event/event.sh 00:07:34.618 11:18:16 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:34.618 11:18:16 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:34.618 11:18:16 -- common/autotest_common.sh@10 -- # set +x 00:07:34.618 ************************************ 00:07:34.618 START TEST event 00:07:34.618 ************************************ 00:07:34.618 11:18:16 event -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/event/event.sh 00:07:34.618 * Looking for test storage... 00:07:34.618 * Found test storage at /home/vagrant/spdk_repo/spdk/test/event 00:07:34.618 11:18:16 event -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:34.618 11:18:16 event -- common/autotest_common.sh@1681 -- # lcov --version 00:07:34.618 11:18:16 event -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:34.877 11:18:16 event -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:34.877 11:18:16 event -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:34.877 11:18:16 event -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:34.877 11:18:16 event -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:34.877 11:18:16 event -- scripts/common.sh@336 -- # IFS=.-: 00:07:34.877 11:18:16 event -- scripts/common.sh@336 -- # read -ra ver1 00:07:34.877 11:18:16 event -- scripts/common.sh@337 -- # IFS=.-: 00:07:34.877 11:18:16 event -- scripts/common.sh@337 -- # read -ra ver2 00:07:34.877 11:18:16 event -- scripts/common.sh@338 -- # local 'op=<' 00:07:34.877 11:18:16 event -- scripts/common.sh@340 -- # ver1_l=2 00:07:34.877 11:18:16 event -- scripts/common.sh@341 -- # ver2_l=1 00:07:34.877 11:18:16 event -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:34.877 11:18:16 event -- scripts/common.sh@344 -- # case "$op" in 00:07:34.877 11:18:16 event -- scripts/common.sh@345 -- # : 1 00:07:34.877 11:18:16 event -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:34.877 11:18:16 event -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:34.877 11:18:16 event -- scripts/common.sh@365 -- # decimal 1 00:07:34.877 11:18:16 event -- scripts/common.sh@353 -- # local d=1 00:07:34.877 11:18:16 event -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:34.877 11:18:16 event -- scripts/common.sh@355 -- # echo 1 00:07:34.877 11:18:16 event -- scripts/common.sh@365 -- # ver1[v]=1 00:07:34.877 11:18:16 event -- scripts/common.sh@366 -- # decimal 2 00:07:34.877 11:18:16 event -- scripts/common.sh@353 -- # local d=2 00:07:34.877 11:18:16 event -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:34.877 11:18:16 event -- scripts/common.sh@355 -- # echo 2 00:07:34.877 11:18:16 event -- scripts/common.sh@366 -- # ver2[v]=2 00:07:34.877 11:18:16 event -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:34.877 11:18:16 event -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:34.877 11:18:16 event -- scripts/common.sh@368 -- # return 0 00:07:34.877 11:18:16 event -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:34.877 11:18:16 event -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:34.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:34.877 --rc genhtml_branch_coverage=1 00:07:34.877 --rc genhtml_function_coverage=1 00:07:34.877 --rc genhtml_legend=1 00:07:34.877 --rc geninfo_all_blocks=1 00:07:34.877 --rc geninfo_unexecuted_blocks=1 00:07:34.877 00:07:34.877 ' 00:07:34.877 11:18:16 event -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:34.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:34.877 --rc genhtml_branch_coverage=1 00:07:34.877 --rc genhtml_function_coverage=1 00:07:34.877 --rc genhtml_legend=1 00:07:34.877 --rc geninfo_all_blocks=1 00:07:34.877 --rc geninfo_unexecuted_blocks=1 00:07:34.877 00:07:34.877 ' 00:07:34.877 11:18:16 event -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:34.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:34.877 --rc genhtml_branch_coverage=1 00:07:34.877 --rc genhtml_function_coverage=1 00:07:34.877 --rc genhtml_legend=1 00:07:34.877 --rc geninfo_all_blocks=1 00:07:34.877 --rc geninfo_unexecuted_blocks=1 00:07:34.877 00:07:34.877 ' 00:07:34.877 11:18:16 event -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:34.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:34.877 --rc genhtml_branch_coverage=1 00:07:34.877 --rc genhtml_function_coverage=1 00:07:34.877 --rc genhtml_legend=1 00:07:34.877 --rc geninfo_all_blocks=1 00:07:34.877 --rc geninfo_unexecuted_blocks=1 00:07:34.877 00:07:34.877 ' 00:07:34.877 11:18:16 event -- event/event.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/bdev/nbd_common.sh 00:07:34.877 11:18:16 event -- bdev/nbd_common.sh@6 -- # set -e 00:07:34.877 11:18:16 event -- event/event.sh@45 -- # run_test event_perf /home/vagrant/spdk_repo/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:07:34.877 11:18:16 event -- common/autotest_common.sh@1101 -- # '[' 6 -le 1 ']' 00:07:34.877 11:18:16 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:34.877 11:18:16 event -- common/autotest_common.sh@10 -- # set +x 00:07:34.877 ************************************ 00:07:34.877 START TEST event_perf 00:07:34.877 ************************************ 00:07:34.877 11:18:16 event.event_perf -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:07:34.877 Running I/O for 1 seconds...[2024-10-07 11:18:16.375560] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:34.877 [2024-10-07 11:18:16.376462] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid58200 ] 00:07:34.877 [2024-10-07 11:18:16.510095] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:34.877 [2024-10-07 11:18:16.575766] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:07:34.877 [2024-10-07 11:18:16.575902] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:07:34.877 [2024-10-07 11:18:16.575985] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:07:34.877 [2024-10-07 11:18:16.575988] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:36.251 Running I/O for 1 seconds... 00:07:36.251 lcore 0: 175043 00:07:36.251 lcore 1: 175046 00:07:36.251 lcore 2: 175043 00:07:36.251 lcore 3: 175042 00:07:36.251 done. 00:07:36.251 00:07:36.251 real 0m1.299s 00:07:36.251 user 0m4.107s 00:07:36.251 sys 0m0.048s 00:07:36.251 11:18:17 event.event_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:36.251 11:18:17 event.event_perf -- common/autotest_common.sh@10 -- # set +x 00:07:36.251 ************************************ 00:07:36.251 END TEST event_perf 00:07:36.251 ************************************ 00:07:36.251 11:18:17 event -- event/event.sh@46 -- # run_test event_reactor /home/vagrant/spdk_repo/spdk/test/event/reactor/reactor -t 1 00:07:36.251 11:18:17 event -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:07:36.251 11:18:17 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:36.251 11:18:17 event -- common/autotest_common.sh@10 -- # set +x 00:07:36.251 ************************************ 00:07:36.251 START TEST event_reactor 00:07:36.251 ************************************ 00:07:36.251 11:18:17 event.event_reactor -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/event/reactor/reactor -t 1 00:07:36.251 [2024-10-07 11:18:17.718799] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:36.251 [2024-10-07 11:18:17.719535] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid58233 ] 00:07:36.251 [2024-10-07 11:18:17.852302] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:36.251 [2024-10-07 11:18:17.943257] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.632 test_start 00:07:37.632 oneshot 00:07:37.632 tick 100 00:07:37.632 tick 100 00:07:37.632 tick 250 00:07:37.632 tick 100 00:07:37.632 tick 100 00:07:37.632 tick 100 00:07:37.632 tick 250 00:07:37.632 tick 500 00:07:37.632 tick 100 00:07:37.632 tick 100 00:07:37.632 tick 250 00:07:37.632 tick 100 00:07:37.632 tick 100 00:07:37.632 test_end 00:07:37.632 00:07:37.632 real 0m1.318s 00:07:37.632 user 0m1.160s 00:07:37.632 sys 0m0.047s 00:07:37.632 11:18:19 event.event_reactor -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:37.632 ************************************ 00:07:37.632 END TEST event_reactor 00:07:37.632 ************************************ 00:07:37.632 11:18:19 event.event_reactor -- common/autotest_common.sh@10 -- # set +x 00:07:37.632 11:18:19 event -- event/event.sh@47 -- # run_test event_reactor_perf /home/vagrant/spdk_repo/spdk/test/event/reactor_perf/reactor_perf -t 1 00:07:37.632 11:18:19 event -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:07:37.632 11:18:19 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:37.632 11:18:19 event -- common/autotest_common.sh@10 -- # set +x 00:07:37.632 ************************************ 00:07:37.632 START TEST event_reactor_perf 00:07:37.632 ************************************ 00:07:37.632 11:18:19 event.event_reactor_perf -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/event/reactor_perf/reactor_perf -t 1 00:07:37.632 [2024-10-07 11:18:19.081192] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:37.633 [2024-10-07 11:18:19.081659] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid58274 ] 00:07:37.633 [2024-10-07 11:18:19.220767] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:37.633 [2024-10-07 11:18:19.301026] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:39.008 test_start 00:07:39.008 test_end 00:07:39.008 Performance: 343621 events per second 00:07:39.008 00:07:39.008 real 0m1.314s 00:07:39.008 user 0m1.156s 00:07:39.008 sys 0m0.046s 00:07:39.008 11:18:20 event.event_reactor_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:39.008 ************************************ 00:07:39.008 END TEST event_reactor_perf 00:07:39.008 ************************************ 00:07:39.008 11:18:20 event.event_reactor_perf -- common/autotest_common.sh@10 -- # set +x 00:07:39.008 11:18:20 event -- event/event.sh@49 -- # uname -s 00:07:39.008 11:18:20 event -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:07:39.008 11:18:20 event -- event/event.sh@50 -- # run_test event_scheduler /home/vagrant/spdk_repo/spdk/test/event/scheduler/scheduler.sh 00:07:39.008 11:18:20 event -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:39.008 11:18:20 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:39.008 11:18:20 event -- common/autotest_common.sh@10 -- # set +x 00:07:39.008 ************************************ 00:07:39.008 START TEST event_scheduler 00:07:39.008 ************************************ 00:07:39.008 11:18:20 event.event_scheduler -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/event/scheduler/scheduler.sh 00:07:39.008 * Looking for test storage... 00:07:39.008 * Found test storage at /home/vagrant/spdk_repo/spdk/test/event/scheduler 00:07:39.008 11:18:20 event.event_scheduler -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:39.008 11:18:20 event.event_scheduler -- common/autotest_common.sh@1681 -- # lcov --version 00:07:39.008 11:18:20 event.event_scheduler -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:39.008 11:18:20 event.event_scheduler -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@336 -- # IFS=.-: 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@336 -- # read -ra ver1 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@337 -- # IFS=.-: 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@337 -- # read -ra ver2 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@338 -- # local 'op=<' 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@340 -- # ver1_l=2 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@341 -- # ver2_l=1 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@344 -- # case "$op" in 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@345 -- # : 1 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@365 -- # decimal 1 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@353 -- # local d=1 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@355 -- # echo 1 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@365 -- # ver1[v]=1 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@366 -- # decimal 2 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@353 -- # local d=2 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@355 -- # echo 2 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@366 -- # ver2[v]=2 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:39.008 11:18:20 event.event_scheduler -- scripts/common.sh@368 -- # return 0 00:07:39.008 11:18:20 event.event_scheduler -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:39.008 11:18:20 event.event_scheduler -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:39.008 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:39.008 --rc genhtml_branch_coverage=1 00:07:39.008 --rc genhtml_function_coverage=1 00:07:39.008 --rc genhtml_legend=1 00:07:39.008 --rc geninfo_all_blocks=1 00:07:39.008 --rc geninfo_unexecuted_blocks=1 00:07:39.008 00:07:39.008 ' 00:07:39.008 11:18:20 event.event_scheduler -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:39.008 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:39.008 --rc genhtml_branch_coverage=1 00:07:39.008 --rc genhtml_function_coverage=1 00:07:39.008 --rc genhtml_legend=1 00:07:39.008 --rc geninfo_all_blocks=1 00:07:39.008 --rc geninfo_unexecuted_blocks=1 00:07:39.008 00:07:39.008 ' 00:07:39.008 11:18:20 event.event_scheduler -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:39.008 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:39.008 --rc genhtml_branch_coverage=1 00:07:39.008 --rc genhtml_function_coverage=1 00:07:39.008 --rc genhtml_legend=1 00:07:39.008 --rc geninfo_all_blocks=1 00:07:39.008 --rc geninfo_unexecuted_blocks=1 00:07:39.008 00:07:39.008 ' 00:07:39.008 11:18:20 event.event_scheduler -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:39.008 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:39.008 --rc genhtml_branch_coverage=1 00:07:39.008 --rc genhtml_function_coverage=1 00:07:39.008 --rc genhtml_legend=1 00:07:39.008 --rc geninfo_all_blocks=1 00:07:39.008 --rc geninfo_unexecuted_blocks=1 00:07:39.008 00:07:39.008 ' 00:07:39.008 11:18:20 event.event_scheduler -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:07:39.008 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:39.008 11:18:20 event.event_scheduler -- scheduler/scheduler.sh@35 -- # scheduler_pid=58338 00:07:39.008 11:18:20 event.event_scheduler -- scheduler/scheduler.sh@34 -- # /home/vagrant/spdk_repo/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:07:39.008 11:18:20 event.event_scheduler -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:07:39.008 11:18:20 event.event_scheduler -- scheduler/scheduler.sh@37 -- # waitforlisten 58338 00:07:39.008 11:18:20 event.event_scheduler -- common/autotest_common.sh@831 -- # '[' -z 58338 ']' 00:07:39.008 11:18:20 event.event_scheduler -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:39.008 11:18:20 event.event_scheduler -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:39.008 11:18:20 event.event_scheduler -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:39.008 11:18:20 event.event_scheduler -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:39.008 11:18:20 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:07:39.008 [2024-10-07 11:18:20.671094] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:39.008 [2024-10-07 11:18:20.671713] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid58338 ] 00:07:39.268 [2024-10-07 11:18:20.807691] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:39.268 [2024-10-07 11:18:20.869422] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:39.268 [2024-10-07 11:18:20.869477] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:07:39.268 [2024-10-07 11:18:20.869576] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:07:39.268 [2024-10-07 11:18:20.869562] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:07:39.527 11:18:21 event.event_scheduler -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:39.527 11:18:21 event.event_scheduler -- common/autotest_common.sh@864 -- # return 0 00:07:39.527 11:18:21 event.event_scheduler -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:07:39.527 11:18:21 event.event_scheduler -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.527 11:18:21 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:07:39.527 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:07:39.527 POWER: Cannot set governor of lcore 0 to userspace 00:07:39.527 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:07:39.527 POWER: Cannot set governor of lcore 0 to performance 00:07:39.527 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:07:39.527 POWER: Cannot set governor of lcore 0 to userspace 00:07:39.527 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:07:39.527 POWER: Cannot set governor of lcore 0 to userspace 00:07:39.527 GUEST_CHANNEL: Opening channel '/dev/virtio-ports/virtio.serial.port.poweragent.0' for lcore 0 00:07:39.527 GUEST_CHANNEL: Unable to connect to '/dev/virtio-ports/virtio.serial.port.poweragent.0' with error No such file or directory 00:07:39.527 POWER: Unable to set Power Management Environment for lcore 0 00:07:39.527 [2024-10-07 11:18:21.136639] dpdk_governor.c: 130:_init_core: *ERROR*: Failed to initialize on core0 00:07:39.527 [2024-10-07 11:18:21.136672] dpdk_governor.c: 191:_init: *ERROR*: Failed to initialize on core0 00:07:39.527 [2024-10-07 11:18:21.136700] scheduler_dynamic.c: 280:init: *NOTICE*: Unable to initialize dpdk governor 00:07:39.527 [2024-10-07 11:18:21.136728] scheduler_dynamic.c: 427:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:07:39.527 [2024-10-07 11:18:21.136740] scheduler_dynamic.c: 429:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:07:39.527 [2024-10-07 11:18:21.136751] scheduler_dynamic.c: 431:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:07:39.527 11:18:21 event.event_scheduler -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.527 11:18:21 event.event_scheduler -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:07:39.527 11:18:21 event.event_scheduler -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.527 11:18:21 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:07:39.527 [2024-10-07 11:18:21.180670] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:07:39.527 [2024-10-07 11:18:21.202038] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:07:39.527 11:18:21 event.event_scheduler -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.527 11:18:21 event.event_scheduler -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:07:39.527 11:18:21 event.event_scheduler -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:39.527 11:18:21 event.event_scheduler -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:39.527 11:18:21 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:07:39.527 ************************************ 00:07:39.527 START TEST scheduler_create_thread 00:07:39.527 ************************************ 00:07:39.527 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@1125 -- # scheduler_create_thread 00:07:39.527 11:18:21 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:07:39.527 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.527 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:07:39.527 2 00:07:39.527 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.527 11:18:21 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:07:39.527 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.527 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:07:39.788 3 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:07:39.788 4 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:07:39.788 5 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:07:39.788 6 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:07:39.788 7 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:07:39.788 8 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:07:39.788 9 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:07:39.788 10 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.788 11:18:21 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:07:40.723 11:18:22 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.723 11:18:22 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@22 -- # thread_id=11 00:07:40.723 11:18:22 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:07:40.723 11:18:22 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.723 11:18:22 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:07:41.670 11:18:23 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:41.670 11:18:23 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:07:41.670 11:18:23 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:41.670 11:18:23 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:07:42.604 11:18:24 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.604 11:18:24 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@25 -- # thread_id=12 00:07:42.604 11:18:24 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:07:42.604 11:18:24 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.604 11:18:24 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:07:43.171 11:18:24 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.171 00:07:43.171 real 0m3.553s 00:07:43.171 user 0m0.017s 00:07:43.171 sys 0m0.007s 00:07:43.171 11:18:24 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:43.171 11:18:24 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:07:43.171 ************************************ 00:07:43.171 END TEST scheduler_create_thread 00:07:43.171 ************************************ 00:07:43.171 11:18:24 event.event_scheduler -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:07:43.171 11:18:24 event.event_scheduler -- scheduler/scheduler.sh@46 -- # killprocess 58338 00:07:43.171 11:18:24 event.event_scheduler -- common/autotest_common.sh@950 -- # '[' -z 58338 ']' 00:07:43.171 11:18:24 event.event_scheduler -- common/autotest_common.sh@954 -- # kill -0 58338 00:07:43.171 11:18:24 event.event_scheduler -- common/autotest_common.sh@955 -- # uname 00:07:43.171 11:18:24 event.event_scheduler -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:43.171 11:18:24 event.event_scheduler -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 58338 00:07:43.171 11:18:24 event.event_scheduler -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:07:43.171 killing process with pid 58338 00:07:43.171 11:18:24 event.event_scheduler -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:07:43.171 11:18:24 event.event_scheduler -- common/autotest_common.sh@968 -- # echo 'killing process with pid 58338' 00:07:43.171 11:18:24 event.event_scheduler -- common/autotest_common.sh@969 -- # kill 58338 00:07:43.171 11:18:24 event.event_scheduler -- common/autotest_common.sh@974 -- # wait 58338 00:07:43.738 [2024-10-07 11:18:25.147081] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:07:43.738 00:07:43.738 real 0m4.968s 00:07:43.738 user 0m9.601s 00:07:43.738 sys 0m0.321s 00:07:43.738 11:18:25 event.event_scheduler -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:43.738 11:18:25 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:07:43.738 ************************************ 00:07:43.738 END TEST event_scheduler 00:07:43.738 ************************************ 00:07:43.738 11:18:25 event -- event/event.sh@51 -- # modprobe -n nbd 00:07:43.738 11:18:25 event -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:07:43.738 11:18:25 event -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:43.738 11:18:25 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:43.738 11:18:25 event -- common/autotest_common.sh@10 -- # set +x 00:07:43.738 ************************************ 00:07:43.738 START TEST app_repeat 00:07:43.738 ************************************ 00:07:43.738 11:18:25 event.app_repeat -- common/autotest_common.sh@1125 -- # app_repeat_test 00:07:43.738 11:18:25 event.app_repeat -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:43.738 11:18:25 event.app_repeat -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:43.738 11:18:25 event.app_repeat -- event/event.sh@13 -- # local nbd_list 00:07:43.738 11:18:25 event.app_repeat -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:43.738 11:18:25 event.app_repeat -- event/event.sh@14 -- # local bdev_list 00:07:43.738 11:18:25 event.app_repeat -- event/event.sh@15 -- # local repeat_times=4 00:07:43.738 11:18:25 event.app_repeat -- event/event.sh@17 -- # modprobe nbd 00:07:43.738 11:18:25 event.app_repeat -- event/event.sh@19 -- # repeat_pid=58441 00:07:43.738 11:18:25 event.app_repeat -- event/event.sh@18 -- # /home/vagrant/spdk_repo/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:07:43.738 11:18:25 event.app_repeat -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:07:43.738 Process app_repeat pid: 58441 00:07:43.738 11:18:25 event.app_repeat -- event/event.sh@21 -- # echo 'Process app_repeat pid: 58441' 00:07:43.738 11:18:25 event.app_repeat -- event/event.sh@23 -- # for i in {0..2} 00:07:43.738 spdk_app_start Round 0 00:07:43.738 11:18:25 event.app_repeat -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:07:43.738 11:18:25 event.app_repeat -- event/event.sh@25 -- # waitforlisten 58441 /var/tmp/spdk-nbd.sock 00:07:43.738 11:18:25 event.app_repeat -- common/autotest_common.sh@831 -- # '[' -z 58441 ']' 00:07:43.738 11:18:25 event.app_repeat -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:07:43.997 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:07:43.997 11:18:25 event.app_repeat -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:43.997 11:18:25 event.app_repeat -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:07:43.997 11:18:25 event.app_repeat -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:43.997 11:18:25 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:07:43.997 [2024-10-07 11:18:25.469334] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:43.997 [2024-10-07 11:18:25.469496] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid58441 ] 00:07:43.997 [2024-10-07 11:18:25.606960] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:07:43.997 [2024-10-07 11:18:25.687287] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:07:43.997 [2024-10-07 11:18:25.687324] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:44.280 [2024-10-07 11:18:25.724526] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:07:44.280 11:18:25 event.app_repeat -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:44.280 11:18:25 event.app_repeat -- common/autotest_common.sh@864 -- # return 0 00:07:44.280 11:18:25 event.app_repeat -- event/event.sh@27 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:44.539 Malloc0 00:07:44.539 11:18:26 event.app_repeat -- event/event.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:45.176 Malloc1 00:07:45.176 11:18:26 event.app_repeat -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:45.176 11:18:26 event.app_repeat -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:45.176 11:18:26 event.app_repeat -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:45.176 11:18:26 event.app_repeat -- bdev/nbd_common.sh@91 -- # local bdev_list 00:07:45.176 11:18:26 event.app_repeat -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:45.176 11:18:26 event.app_repeat -- bdev/nbd_common.sh@92 -- # local nbd_list 00:07:45.176 11:18:26 event.app_repeat -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:45.176 11:18:26 event.app_repeat -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:45.176 11:18:26 event.app_repeat -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:45.176 11:18:26 event.app_repeat -- bdev/nbd_common.sh@10 -- # local bdev_list 00:07:45.176 11:18:26 event.app_repeat -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:45.176 11:18:26 event.app_repeat -- bdev/nbd_common.sh@11 -- # local nbd_list 00:07:45.176 11:18:26 event.app_repeat -- bdev/nbd_common.sh@12 -- # local i 00:07:45.176 11:18:26 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:07:45.176 11:18:26 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:45.176 11:18:26 event.app_repeat -- bdev/nbd_common.sh@15 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:07:45.434 /dev/nbd0 00:07:45.434 11:18:26 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:07:45.434 11:18:26 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:07:45.434 11:18:26 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd0 00:07:45.434 11:18:26 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:07:45.434 11:18:26 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:07:45.434 11:18:26 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:07:45.434 11:18:26 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd0 /proc/partitions 00:07:45.434 11:18:26 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:07:45.434 11:18:26 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:07:45.434 11:18:26 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:07:45.434 11:18:26 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd0 of=/home/vagrant/spdk_repo/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:45.434 1+0 records in 00:07:45.434 1+0 records out 00:07:45.434 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000321119 s, 12.8 MB/s 00:07:45.434 11:18:26 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:07:45.434 11:18:26 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:07:45.434 11:18:26 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:07:45.434 11:18:26 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:07:45.434 11:18:26 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:07:45.434 11:18:26 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:45.434 11:18:26 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:45.434 11:18:26 event.app_repeat -- bdev/nbd_common.sh@15 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:07:45.998 /dev/nbd1 00:07:45.998 11:18:27 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:07:45.998 11:18:27 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:07:45.998 11:18:27 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd1 00:07:45.998 11:18:27 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:07:45.998 11:18:27 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:07:45.998 11:18:27 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:07:45.998 11:18:27 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd1 /proc/partitions 00:07:45.998 11:18:27 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:07:45.998 11:18:27 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:07:45.998 11:18:27 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:07:45.998 11:18:27 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd1 of=/home/vagrant/spdk_repo/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:45.998 1+0 records in 00:07:45.998 1+0 records out 00:07:45.998 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000396521 s, 10.3 MB/s 00:07:45.998 11:18:27 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:07:45.998 11:18:27 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:07:45.998 11:18:27 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:07:45.998 11:18:27 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:07:45.998 11:18:27 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:07:45.998 11:18:27 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:45.998 11:18:27 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:45.998 11:18:27 event.app_repeat -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:07:45.998 11:18:27 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:45.998 11:18:27 event.app_repeat -- bdev/nbd_common.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:07:46.256 11:18:27 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:07:46.256 { 00:07:46.256 "nbd_device": "/dev/nbd0", 00:07:46.256 "bdev_name": "Malloc0" 00:07:46.256 }, 00:07:46.256 { 00:07:46.256 "nbd_device": "/dev/nbd1", 00:07:46.256 "bdev_name": "Malloc1" 00:07:46.256 } 00:07:46.257 ]' 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[ 00:07:46.257 { 00:07:46.257 "nbd_device": "/dev/nbd0", 00:07:46.257 "bdev_name": "Malloc0" 00:07:46.257 }, 00:07:46.257 { 00:07:46.257 "nbd_device": "/dev/nbd1", 00:07:46.257 "bdev_name": "Malloc1" 00:07:46.257 } 00:07:46.257 ]' 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:07:46.257 /dev/nbd1' 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:07:46.257 /dev/nbd1' 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=2 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 2 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@95 -- # count=2 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=write 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest bs=4096 count=256 00:07:46.257 256+0 records in 00:07:46.257 256+0 records out 00:07:46.257 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587787 s, 178 MB/s 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:07:46.257 256+0 records in 00:07:46.257 256+0 records out 00:07:46.257 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0417106 s, 25.1 MB/s 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:07:46.257 256+0 records in 00:07:46.257 256+0 records out 00:07:46.257 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.039131 s, 26.8 MB/s 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=verify 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest /dev/nbd0 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest /dev/nbd1 00:07:46.257 11:18:27 event.app_repeat -- bdev/nbd_common.sh@85 -- # rm /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:07:46.515 11:18:27 event.app_repeat -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:07:46.515 11:18:27 event.app_repeat -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:46.515 11:18:27 event.app_repeat -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:46.515 11:18:27 event.app_repeat -- bdev/nbd_common.sh@50 -- # local nbd_list 00:07:46.515 11:18:27 event.app_repeat -- bdev/nbd_common.sh@51 -- # local i 00:07:46.515 11:18:27 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:07:46.515 11:18:27 event.app_repeat -- bdev/nbd_common.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:07:46.772 11:18:28 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:07:46.772 11:18:28 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:07:46.772 11:18:28 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:07:46.772 11:18:28 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:07:46.772 11:18:28 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:07:46.772 11:18:28 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:07:46.772 11:18:28 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:07:46.772 11:18:28 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:07:46.772 11:18:28 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:07:46.772 11:18:28 event.app_repeat -- bdev/nbd_common.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:07:47.029 11:18:28 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:07:47.029 11:18:28 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:07:47.029 11:18:28 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:07:47.029 11:18:28 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:07:47.029 11:18:28 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:07:47.029 11:18:28 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:07:47.029 11:18:28 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:07:47.029 11:18:28 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:07:47.029 11:18:28 event.app_repeat -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:07:47.029 11:18:28 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:47.029 11:18:28 event.app_repeat -- bdev/nbd_common.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:07:47.595 11:18:29 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:07:47.595 11:18:29 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[]' 00:07:47.595 11:18:29 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:07:47.595 11:18:29 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:07:47.595 11:18:29 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '' 00:07:47.595 11:18:29 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:07:47.595 11:18:29 event.app_repeat -- bdev/nbd_common.sh@65 -- # true 00:07:47.595 11:18:29 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=0 00:07:47.595 11:18:29 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 0 00:07:47.595 11:18:29 event.app_repeat -- bdev/nbd_common.sh@104 -- # count=0 00:07:47.595 11:18:29 event.app_repeat -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:07:47.595 11:18:29 event.app_repeat -- bdev/nbd_common.sh@109 -- # return 0 00:07:47.595 11:18:29 event.app_repeat -- event/event.sh@34 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:07:47.854 11:18:29 event.app_repeat -- event/event.sh@35 -- # sleep 3 00:07:48.111 [2024-10-07 11:18:29.573787] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:07:48.112 [2024-10-07 11:18:29.634553] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:07:48.112 [2024-10-07 11:18:29.634564] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:48.112 [2024-10-07 11:18:29.665085] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:07:48.112 [2024-10-07 11:18:29.665208] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:07:48.112 [2024-10-07 11:18:29.665226] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:07:51.397 11:18:32 event.app_repeat -- event/event.sh@23 -- # for i in {0..2} 00:07:51.398 spdk_app_start Round 1 00:07:51.398 11:18:32 event.app_repeat -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:07:51.398 11:18:32 event.app_repeat -- event/event.sh@25 -- # waitforlisten 58441 /var/tmp/spdk-nbd.sock 00:07:51.398 11:18:32 event.app_repeat -- common/autotest_common.sh@831 -- # '[' -z 58441 ']' 00:07:51.398 11:18:32 event.app_repeat -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:07:51.398 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:07:51.398 11:18:32 event.app_repeat -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:51.398 11:18:32 event.app_repeat -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:07:51.398 11:18:32 event.app_repeat -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:51.398 11:18:32 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:07:51.398 11:18:32 event.app_repeat -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:51.398 11:18:32 event.app_repeat -- common/autotest_common.sh@864 -- # return 0 00:07:51.398 11:18:32 event.app_repeat -- event/event.sh@27 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:51.398 Malloc0 00:07:51.398 11:18:33 event.app_repeat -- event/event.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:51.656 Malloc1 00:07:51.656 11:18:33 event.app_repeat -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:51.656 11:18:33 event.app_repeat -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:51.656 11:18:33 event.app_repeat -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:51.656 11:18:33 event.app_repeat -- bdev/nbd_common.sh@91 -- # local bdev_list 00:07:51.656 11:18:33 event.app_repeat -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:51.656 11:18:33 event.app_repeat -- bdev/nbd_common.sh@92 -- # local nbd_list 00:07:51.656 11:18:33 event.app_repeat -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:51.656 11:18:33 event.app_repeat -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:51.656 11:18:33 event.app_repeat -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:51.656 11:18:33 event.app_repeat -- bdev/nbd_common.sh@10 -- # local bdev_list 00:07:51.656 11:18:33 event.app_repeat -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:51.656 11:18:33 event.app_repeat -- bdev/nbd_common.sh@11 -- # local nbd_list 00:07:51.656 11:18:33 event.app_repeat -- bdev/nbd_common.sh@12 -- # local i 00:07:51.656 11:18:33 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:07:51.656 11:18:33 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:51.656 11:18:33 event.app_repeat -- bdev/nbd_common.sh@15 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:07:52.223 /dev/nbd0 00:07:52.223 11:18:33 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:07:52.223 11:18:33 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:07:52.223 11:18:33 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd0 00:07:52.223 11:18:33 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:07:52.223 11:18:33 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:07:52.223 11:18:33 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:07:52.223 11:18:33 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd0 /proc/partitions 00:07:52.223 11:18:33 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:07:52.223 11:18:33 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:07:52.223 11:18:33 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:07:52.223 11:18:33 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd0 of=/home/vagrant/spdk_repo/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:52.223 1+0 records in 00:07:52.223 1+0 records out 00:07:52.223 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000330246 s, 12.4 MB/s 00:07:52.223 11:18:33 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:07:52.223 11:18:33 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:07:52.223 11:18:33 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:07:52.223 11:18:33 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:07:52.223 11:18:33 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:07:52.223 11:18:33 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:52.223 11:18:33 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:52.223 11:18:33 event.app_repeat -- bdev/nbd_common.sh@15 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:07:52.480 /dev/nbd1 00:07:52.480 11:18:33 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:07:52.480 11:18:33 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:07:52.480 11:18:33 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd1 00:07:52.480 11:18:33 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:07:52.480 11:18:33 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:07:52.480 11:18:33 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:07:52.480 11:18:33 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd1 /proc/partitions 00:07:52.480 11:18:33 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:07:52.480 11:18:33 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:07:52.480 11:18:33 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:07:52.480 11:18:33 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd1 of=/home/vagrant/spdk_repo/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:52.480 1+0 records in 00:07:52.481 1+0 records out 00:07:52.481 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000252102 s, 16.2 MB/s 00:07:52.481 11:18:33 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:07:52.481 11:18:33 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:07:52.481 11:18:33 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:07:52.481 11:18:33 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:07:52.481 11:18:33 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:07:52.481 11:18:34 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:52.481 11:18:34 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:52.481 11:18:34 event.app_repeat -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:07:52.481 11:18:34 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:52.481 11:18:34 event.app_repeat -- bdev/nbd_common.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:07:52.738 11:18:34 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:07:52.738 { 00:07:52.738 "nbd_device": "/dev/nbd0", 00:07:52.738 "bdev_name": "Malloc0" 00:07:52.738 }, 00:07:52.738 { 00:07:52.738 "nbd_device": "/dev/nbd1", 00:07:52.738 "bdev_name": "Malloc1" 00:07:52.738 } 00:07:52.738 ]' 00:07:52.738 11:18:34 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:07:52.738 11:18:34 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[ 00:07:52.738 { 00:07:52.738 "nbd_device": "/dev/nbd0", 00:07:52.738 "bdev_name": "Malloc0" 00:07:52.738 }, 00:07:52.738 { 00:07:52.738 "nbd_device": "/dev/nbd1", 00:07:52.738 "bdev_name": "Malloc1" 00:07:52.738 } 00:07:52.738 ]' 00:07:52.738 11:18:34 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:07:52.738 /dev/nbd1' 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:07:52.996 /dev/nbd1' 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=2 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 2 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@95 -- # count=2 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=write 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest bs=4096 count=256 00:07:52.996 256+0 records in 00:07:52.996 256+0 records out 00:07:52.996 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852749 s, 123 MB/s 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:07:52.996 256+0 records in 00:07:52.996 256+0 records out 00:07:52.996 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292009 s, 35.9 MB/s 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:07:52.996 256+0 records in 00:07:52.996 256+0 records out 00:07:52.996 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0421925 s, 24.9 MB/s 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=verify 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest /dev/nbd0 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest /dev/nbd1 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@85 -- # rm /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@50 -- # local nbd_list 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@51 -- # local i 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:07:52.996 11:18:34 event.app_repeat -- bdev/nbd_common.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:07:53.254 11:18:34 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:07:53.254 11:18:34 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:07:53.254 11:18:34 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:07:53.254 11:18:34 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:07:53.254 11:18:34 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:07:53.254 11:18:34 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:07:53.254 11:18:34 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:07:53.254 11:18:34 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:07:53.254 11:18:34 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:07:53.254 11:18:34 event.app_repeat -- bdev/nbd_common.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:07:53.821 11:18:35 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:07:53.821 11:18:35 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:07:53.821 11:18:35 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:07:53.821 11:18:35 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:07:53.821 11:18:35 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:07:53.821 11:18:35 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:07:53.821 11:18:35 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:07:53.821 11:18:35 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:07:53.821 11:18:35 event.app_repeat -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:07:53.821 11:18:35 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:53.821 11:18:35 event.app_repeat -- bdev/nbd_common.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:07:54.080 11:18:35 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:07:54.080 11:18:35 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[]' 00:07:54.080 11:18:35 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:07:54.080 11:18:35 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:07:54.080 11:18:35 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '' 00:07:54.080 11:18:35 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:07:54.080 11:18:35 event.app_repeat -- bdev/nbd_common.sh@65 -- # true 00:07:54.080 11:18:35 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=0 00:07:54.080 11:18:35 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 0 00:07:54.080 11:18:35 event.app_repeat -- bdev/nbd_common.sh@104 -- # count=0 00:07:54.080 11:18:35 event.app_repeat -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:07:54.080 11:18:35 event.app_repeat -- bdev/nbd_common.sh@109 -- # return 0 00:07:54.080 11:18:35 event.app_repeat -- event/event.sh@34 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:07:54.662 11:18:36 event.app_repeat -- event/event.sh@35 -- # sleep 3 00:07:54.662 [2024-10-07 11:18:36.291817] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:07:54.662 [2024-10-07 11:18:36.352507] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:07:54.662 [2024-10-07 11:18:36.352519] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:54.920 [2024-10-07 11:18:36.383735] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:07:54.920 [2024-10-07 11:18:36.383831] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:07:54.920 [2024-10-07 11:18:36.383848] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:07:58.203 spdk_app_start Round 2 00:07:58.203 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:07:58.203 11:18:39 event.app_repeat -- event/event.sh@23 -- # for i in {0..2} 00:07:58.203 11:18:39 event.app_repeat -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:07:58.203 11:18:39 event.app_repeat -- event/event.sh@25 -- # waitforlisten 58441 /var/tmp/spdk-nbd.sock 00:07:58.203 11:18:39 event.app_repeat -- common/autotest_common.sh@831 -- # '[' -z 58441 ']' 00:07:58.203 11:18:39 event.app_repeat -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:07:58.203 11:18:39 event.app_repeat -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:58.203 11:18:39 event.app_repeat -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:07:58.203 11:18:39 event.app_repeat -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:58.203 11:18:39 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:07:58.203 11:18:39 event.app_repeat -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:58.203 11:18:39 event.app_repeat -- common/autotest_common.sh@864 -- # return 0 00:07:58.203 11:18:39 event.app_repeat -- event/event.sh@27 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:58.461 Malloc0 00:07:58.461 11:18:40 event.app_repeat -- event/event.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:59.027 Malloc1 00:07:59.027 11:18:40 event.app_repeat -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:59.027 11:18:40 event.app_repeat -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:59.027 11:18:40 event.app_repeat -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:59.027 11:18:40 event.app_repeat -- bdev/nbd_common.sh@91 -- # local bdev_list 00:07:59.027 11:18:40 event.app_repeat -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:59.027 11:18:40 event.app_repeat -- bdev/nbd_common.sh@92 -- # local nbd_list 00:07:59.027 11:18:40 event.app_repeat -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:59.027 11:18:40 event.app_repeat -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:59.027 11:18:40 event.app_repeat -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:59.027 11:18:40 event.app_repeat -- bdev/nbd_common.sh@10 -- # local bdev_list 00:07:59.027 11:18:40 event.app_repeat -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:59.027 11:18:40 event.app_repeat -- bdev/nbd_common.sh@11 -- # local nbd_list 00:07:59.027 11:18:40 event.app_repeat -- bdev/nbd_common.sh@12 -- # local i 00:07:59.027 11:18:40 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:07:59.027 11:18:40 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:59.027 11:18:40 event.app_repeat -- bdev/nbd_common.sh@15 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:07:59.286 /dev/nbd0 00:07:59.286 11:18:40 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:07:59.286 11:18:40 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:07:59.286 11:18:40 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd0 00:07:59.286 11:18:40 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:07:59.286 11:18:40 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:07:59.286 11:18:40 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:07:59.286 11:18:40 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd0 /proc/partitions 00:07:59.286 11:18:40 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:07:59.286 11:18:40 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:07:59.286 11:18:40 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:07:59.286 11:18:40 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd0 of=/home/vagrant/spdk_repo/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:59.286 1+0 records in 00:07:59.286 1+0 records out 00:07:59.286 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000362093 s, 11.3 MB/s 00:07:59.286 11:18:40 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:07:59.286 11:18:40 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:07:59.286 11:18:40 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:07:59.286 11:18:40 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:07:59.286 11:18:40 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:07:59.286 11:18:40 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:59.286 11:18:40 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:59.286 11:18:40 event.app_repeat -- bdev/nbd_common.sh@15 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:07:59.852 /dev/nbd1 00:07:59.852 11:18:41 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:07:59.852 11:18:41 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:07:59.852 11:18:41 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd1 00:07:59.852 11:18:41 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:07:59.852 11:18:41 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:07:59.852 11:18:41 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:07:59.852 11:18:41 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd1 /proc/partitions 00:07:59.852 11:18:41 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:07:59.852 11:18:41 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:07:59.852 11:18:41 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:07:59.852 11:18:41 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd1 of=/home/vagrant/spdk_repo/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:59.852 1+0 records in 00:07:59.852 1+0 records out 00:07:59.852 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000262011 s, 15.6 MB/s 00:07:59.852 11:18:41 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:07:59.852 11:18:41 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:07:59.852 11:18:41 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:07:59.852 11:18:41 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:07:59.852 11:18:41 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:07:59.852 11:18:41 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:59.852 11:18:41 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:59.852 11:18:41 event.app_repeat -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:07:59.852 11:18:41 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:59.852 11:18:41 event.app_repeat -- bdev/nbd_common.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:08:00.111 { 00:08:00.111 "nbd_device": "/dev/nbd0", 00:08:00.111 "bdev_name": "Malloc0" 00:08:00.111 }, 00:08:00.111 { 00:08:00.111 "nbd_device": "/dev/nbd1", 00:08:00.111 "bdev_name": "Malloc1" 00:08:00.111 } 00:08:00.111 ]' 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[ 00:08:00.111 { 00:08:00.111 "nbd_device": "/dev/nbd0", 00:08:00.111 "bdev_name": "Malloc0" 00:08:00.111 }, 00:08:00.111 { 00:08:00.111 "nbd_device": "/dev/nbd1", 00:08:00.111 "bdev_name": "Malloc1" 00:08:00.111 } 00:08:00.111 ]' 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:08:00.111 /dev/nbd1' 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:08:00.111 /dev/nbd1' 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=2 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 2 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@95 -- # count=2 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=write 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest bs=4096 count=256 00:08:00.111 256+0 records in 00:08:00.111 256+0 records out 00:08:00.111 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766158 s, 137 MB/s 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:08:00.111 256+0 records in 00:08:00.111 256+0 records out 00:08:00.111 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247407 s, 42.4 MB/s 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:08:00.111 11:18:41 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:08:00.369 256+0 records in 00:08:00.369 256+0 records out 00:08:00.369 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322491 s, 32.5 MB/s 00:08:00.369 11:18:41 event.app_repeat -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:08:00.369 11:18:41 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:08:00.369 11:18:41 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:08:00.369 11:18:41 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=verify 00:08:00.369 11:18:41 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:08:00.369 11:18:41 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:08:00.369 11:18:41 event.app_repeat -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:08:00.369 11:18:41 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:08:00.369 11:18:41 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest /dev/nbd0 00:08:00.369 11:18:41 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:08:00.369 11:18:41 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest /dev/nbd1 00:08:00.369 11:18:41 event.app_repeat -- bdev/nbd_common.sh@85 -- # rm /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:08:00.369 11:18:41 event.app_repeat -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:08:00.369 11:18:41 event.app_repeat -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:08:00.369 11:18:41 event.app_repeat -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:08:00.369 11:18:41 event.app_repeat -- bdev/nbd_common.sh@50 -- # local nbd_list 00:08:00.369 11:18:41 event.app_repeat -- bdev/nbd_common.sh@51 -- # local i 00:08:00.369 11:18:41 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:08:00.369 11:18:41 event.app_repeat -- bdev/nbd_common.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:08:00.627 11:18:42 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:08:00.627 11:18:42 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:08:00.627 11:18:42 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:08:00.627 11:18:42 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:08:00.627 11:18:42 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:08:00.627 11:18:42 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:08:00.627 11:18:42 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:08:00.627 11:18:42 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:08:00.627 11:18:42 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:08:00.627 11:18:42 event.app_repeat -- bdev/nbd_common.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:08:00.884 11:18:42 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:08:00.884 11:18:42 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:08:00.884 11:18:42 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:08:00.884 11:18:42 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:08:00.884 11:18:42 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:08:00.884 11:18:42 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:08:00.884 11:18:42 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:08:00.884 11:18:42 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:08:00.884 11:18:42 event.app_repeat -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:08:00.884 11:18:42 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:08:00.885 11:18:42 event.app_repeat -- bdev/nbd_common.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:08:01.143 11:18:42 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:08:01.143 11:18:42 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[]' 00:08:01.143 11:18:42 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:08:01.143 11:18:42 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:08:01.143 11:18:42 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '' 00:08:01.143 11:18:42 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:08:01.143 11:18:42 event.app_repeat -- bdev/nbd_common.sh@65 -- # true 00:08:01.143 11:18:42 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=0 00:08:01.143 11:18:42 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 0 00:08:01.143 11:18:42 event.app_repeat -- bdev/nbd_common.sh@104 -- # count=0 00:08:01.143 11:18:42 event.app_repeat -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:08:01.143 11:18:42 event.app_repeat -- bdev/nbd_common.sh@109 -- # return 0 00:08:01.143 11:18:42 event.app_repeat -- event/event.sh@34 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:08:01.401 11:18:43 event.app_repeat -- event/event.sh@35 -- # sleep 3 00:08:01.659 [2024-10-07 11:18:43.179170] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:08:01.659 [2024-10-07 11:18:43.239255] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:08:01.659 [2024-10-07 11:18:43.239268] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:01.659 [2024-10-07 11:18:43.268952] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:01.659 [2024-10-07 11:18:43.269037] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:08:01.659 [2024-10-07 11:18:43.269061] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:08:04.940 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:08:04.940 11:18:46 event.app_repeat -- event/event.sh@38 -- # waitforlisten 58441 /var/tmp/spdk-nbd.sock 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@831 -- # '[' -z 58441 ']' 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@864 -- # return 0 00:08:04.940 11:18:46 event.app_repeat -- event/event.sh@39 -- # killprocess 58441 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@950 -- # '[' -z 58441 ']' 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@954 -- # kill -0 58441 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@955 -- # uname 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 58441 00:08:04.940 killing process with pid 58441 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@968 -- # echo 'killing process with pid 58441' 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@969 -- # kill 58441 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@974 -- # wait 58441 00:08:04.940 spdk_app_start is called in Round 0. 00:08:04.940 Shutdown signal received, stop current app iteration 00:08:04.940 Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 reinitialization... 00:08:04.940 spdk_app_start is called in Round 1. 00:08:04.940 Shutdown signal received, stop current app iteration 00:08:04.940 Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 reinitialization... 00:08:04.940 spdk_app_start is called in Round 2. 00:08:04.940 Shutdown signal received, stop current app iteration 00:08:04.940 Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 reinitialization... 00:08:04.940 spdk_app_start is called in Round 3. 00:08:04.940 Shutdown signal received, stop current app iteration 00:08:04.940 11:18:46 event.app_repeat -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:08:04.940 11:18:46 event.app_repeat -- event/event.sh@42 -- # return 0 00:08:04.940 00:08:04.940 real 0m21.143s 00:08:04.940 user 0m49.144s 00:08:04.940 sys 0m3.208s 00:08:04.940 ************************************ 00:08:04.940 END TEST app_repeat 00:08:04.940 ************************************ 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:04.940 11:18:46 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:08:04.940 11:18:46 event -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:08:04.940 11:18:46 event -- event/event.sh@55 -- # run_test cpu_locks /home/vagrant/spdk_repo/spdk/test/event/cpu_locks.sh 00:08:04.940 11:18:46 event -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:04.940 11:18:46 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:04.940 11:18:46 event -- common/autotest_common.sh@10 -- # set +x 00:08:04.940 ************************************ 00:08:04.940 START TEST cpu_locks 00:08:04.940 ************************************ 00:08:04.940 11:18:46 event.cpu_locks -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/event/cpu_locks.sh 00:08:05.199 * Looking for test storage... 00:08:05.199 * Found test storage at /home/vagrant/spdk_repo/spdk/test/event 00:08:05.199 11:18:46 event.cpu_locks -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:08:05.199 11:18:46 event.cpu_locks -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:08:05.199 11:18:46 event.cpu_locks -- common/autotest_common.sh@1681 -- # lcov --version 00:08:05.199 11:18:46 event.cpu_locks -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@333 -- # local ver1 ver1_l 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@334 -- # local ver2 ver2_l 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@336 -- # IFS=.-: 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@336 -- # read -ra ver1 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@337 -- # IFS=.-: 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@337 -- # read -ra ver2 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@338 -- # local 'op=<' 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@340 -- # ver1_l=2 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@341 -- # ver2_l=1 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@344 -- # case "$op" in 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@345 -- # : 1 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@364 -- # (( v = 0 )) 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@365 -- # decimal 1 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@353 -- # local d=1 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@355 -- # echo 1 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@365 -- # ver1[v]=1 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@366 -- # decimal 2 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@353 -- # local d=2 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@355 -- # echo 2 00:08:05.199 11:18:46 event.cpu_locks -- scripts/common.sh@366 -- # ver2[v]=2 00:08:05.200 11:18:46 event.cpu_locks -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:08:05.200 11:18:46 event.cpu_locks -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:08:05.200 11:18:46 event.cpu_locks -- scripts/common.sh@368 -- # return 0 00:08:05.200 11:18:46 event.cpu_locks -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:05.200 11:18:46 event.cpu_locks -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:08:05.200 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:05.200 --rc genhtml_branch_coverage=1 00:08:05.200 --rc genhtml_function_coverage=1 00:08:05.200 --rc genhtml_legend=1 00:08:05.200 --rc geninfo_all_blocks=1 00:08:05.200 --rc geninfo_unexecuted_blocks=1 00:08:05.200 00:08:05.200 ' 00:08:05.200 11:18:46 event.cpu_locks -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:08:05.200 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:05.200 --rc genhtml_branch_coverage=1 00:08:05.200 --rc genhtml_function_coverage=1 00:08:05.200 --rc genhtml_legend=1 00:08:05.200 --rc geninfo_all_blocks=1 00:08:05.200 --rc geninfo_unexecuted_blocks=1 00:08:05.200 00:08:05.200 ' 00:08:05.200 11:18:46 event.cpu_locks -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:08:05.200 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:05.200 --rc genhtml_branch_coverage=1 00:08:05.200 --rc genhtml_function_coverage=1 00:08:05.200 --rc genhtml_legend=1 00:08:05.200 --rc geninfo_all_blocks=1 00:08:05.200 --rc geninfo_unexecuted_blocks=1 00:08:05.200 00:08:05.200 ' 00:08:05.200 11:18:46 event.cpu_locks -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:08:05.200 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:05.200 --rc genhtml_branch_coverage=1 00:08:05.200 --rc genhtml_function_coverage=1 00:08:05.200 --rc genhtml_legend=1 00:08:05.200 --rc geninfo_all_blocks=1 00:08:05.200 --rc geninfo_unexecuted_blocks=1 00:08:05.200 00:08:05.200 ' 00:08:05.200 11:18:46 event.cpu_locks -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:08:05.200 11:18:46 event.cpu_locks -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:08:05.200 11:18:46 event.cpu_locks -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:08:05.200 11:18:46 event.cpu_locks -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:08:05.200 11:18:46 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:05.200 11:18:46 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:05.200 11:18:46 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:08:05.200 ************************************ 00:08:05.200 START TEST default_locks 00:08:05.200 ************************************ 00:08:05.200 11:18:46 event.cpu_locks.default_locks -- common/autotest_common.sh@1125 -- # default_locks 00:08:05.200 11:18:46 event.cpu_locks.default_locks -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=58902 00:08:05.200 11:18:46 event.cpu_locks.default_locks -- event/cpu_locks.sh@47 -- # waitforlisten 58902 00:08:05.200 11:18:46 event.cpu_locks.default_locks -- event/cpu_locks.sh@45 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 00:08:05.200 11:18:46 event.cpu_locks.default_locks -- common/autotest_common.sh@831 -- # '[' -z 58902 ']' 00:08:05.200 11:18:46 event.cpu_locks.default_locks -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:05.200 11:18:46 event.cpu_locks.default_locks -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:05.200 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:05.200 11:18:46 event.cpu_locks.default_locks -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:05.200 11:18:46 event.cpu_locks.default_locks -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:05.200 11:18:46 event.cpu_locks.default_locks -- common/autotest_common.sh@10 -- # set +x 00:08:05.200 [2024-10-07 11:18:46.905365] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:05.200 [2024-10-07 11:18:46.906486] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid58902 ] 00:08:05.458 [2024-10-07 11:18:47.054432] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:05.458 [2024-10-07 11:18:47.124318] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:05.458 [2024-10-07 11:18:47.169257] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:05.717 11:18:47 event.cpu_locks.default_locks -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:05.717 11:18:47 event.cpu_locks.default_locks -- common/autotest_common.sh@864 -- # return 0 00:08:05.717 11:18:47 event.cpu_locks.default_locks -- event/cpu_locks.sh@49 -- # locks_exist 58902 00:08:05.717 11:18:47 event.cpu_locks.default_locks -- event/cpu_locks.sh@22 -- # lslocks -p 58902 00:08:05.717 11:18:47 event.cpu_locks.default_locks -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:08:06.283 11:18:47 event.cpu_locks.default_locks -- event/cpu_locks.sh@50 -- # killprocess 58902 00:08:06.283 11:18:47 event.cpu_locks.default_locks -- common/autotest_common.sh@950 -- # '[' -z 58902 ']' 00:08:06.283 11:18:47 event.cpu_locks.default_locks -- common/autotest_common.sh@954 -- # kill -0 58902 00:08:06.283 11:18:47 event.cpu_locks.default_locks -- common/autotest_common.sh@955 -- # uname 00:08:06.283 11:18:47 event.cpu_locks.default_locks -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:06.283 11:18:47 event.cpu_locks.default_locks -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 58902 00:08:06.283 11:18:47 event.cpu_locks.default_locks -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:06.283 11:18:47 event.cpu_locks.default_locks -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:06.283 killing process with pid 58902 00:08:06.283 11:18:47 event.cpu_locks.default_locks -- common/autotest_common.sh@968 -- # echo 'killing process with pid 58902' 00:08:06.283 11:18:47 event.cpu_locks.default_locks -- common/autotest_common.sh@969 -- # kill 58902 00:08:06.283 11:18:47 event.cpu_locks.default_locks -- common/autotest_common.sh@974 -- # wait 58902 00:08:06.541 11:18:48 event.cpu_locks.default_locks -- event/cpu_locks.sh@52 -- # NOT waitforlisten 58902 00:08:06.541 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@650 -- # local es=0 00:08:06.541 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 58902 00:08:06.541 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:08:06.541 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:06.541 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:08:06.541 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:06.541 ERROR: process (pid: 58902) is no longer running 00:08:06.541 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:06.541 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@653 -- # waitforlisten 58902 00:08:06.541 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@831 -- # '[' -z 58902 ']' 00:08:06.541 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:06.541 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:06.541 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:06.541 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:06.541 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@10 -- # set +x 00:08:06.541 /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh: line 846: kill: (58902) - No such process 00:08:06.541 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:06.541 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@864 -- # return 1 00:08:06.542 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@653 -- # es=1 00:08:06.542 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:06.542 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:08:06.542 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:06.542 11:18:48 event.cpu_locks.default_locks -- event/cpu_locks.sh@54 -- # no_locks 00:08:06.542 11:18:48 event.cpu_locks.default_locks -- event/cpu_locks.sh@26 -- # lock_files=() 00:08:06.542 11:18:48 event.cpu_locks.default_locks -- event/cpu_locks.sh@26 -- # local lock_files 00:08:06.542 11:18:48 event.cpu_locks.default_locks -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:08:06.542 00:08:06.542 real 0m1.282s 00:08:06.542 user 0m1.366s 00:08:06.542 sys 0m0.480s 00:08:06.542 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:06.542 11:18:48 event.cpu_locks.default_locks -- common/autotest_common.sh@10 -- # set +x 00:08:06.542 ************************************ 00:08:06.542 END TEST default_locks 00:08:06.542 ************************************ 00:08:06.542 11:18:48 event.cpu_locks -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:08:06.542 11:18:48 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:06.542 11:18:48 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:06.542 11:18:48 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:08:06.542 ************************************ 00:08:06.542 START TEST default_locks_via_rpc 00:08:06.542 ************************************ 00:08:06.542 11:18:48 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@1125 -- # default_locks_via_rpc 00:08:06.542 11:18:48 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=58941 00:08:06.542 11:18:48 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@61 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 00:08:06.542 11:18:48 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@63 -- # waitforlisten 58941 00:08:06.542 11:18:48 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 58941 ']' 00:08:06.542 11:18:48 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:06.542 11:18:48 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:06.542 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:06.542 11:18:48 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:06.542 11:18:48 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:06.542 11:18:48 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:06.542 [2024-10-07 11:18:48.195890] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:06.542 [2024-10-07 11:18:48.195993] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid58941 ] 00:08:06.799 [2024-10-07 11:18:48.326699] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:06.799 [2024-10-07 11:18:48.386830] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:06.799 [2024-10-07 11:18:48.427758] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:07.057 11:18:48 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:07.057 11:18:48 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:08:07.057 11:18:48 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:08:07.057 11:18:48 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:07.057 11:18:48 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:07.057 11:18:48 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:07.057 11:18:48 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@67 -- # no_locks 00:08:07.057 11:18:48 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@26 -- # lock_files=() 00:08:07.057 11:18:48 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@26 -- # local lock_files 00:08:07.057 11:18:48 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:08:07.057 11:18:48 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:08:07.057 11:18:48 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:07.057 11:18:48 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:07.057 11:18:48 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:07.057 11:18:48 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@71 -- # locks_exist 58941 00:08:07.057 11:18:48 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@22 -- # lslocks -p 58941 00:08:07.057 11:18:48 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:08:07.621 11:18:49 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@73 -- # killprocess 58941 00:08:07.621 11:18:49 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@950 -- # '[' -z 58941 ']' 00:08:07.621 11:18:49 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@954 -- # kill -0 58941 00:08:07.621 11:18:49 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@955 -- # uname 00:08:07.621 11:18:49 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:07.621 11:18:49 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 58941 00:08:07.621 11:18:49 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:07.621 killing process with pid 58941 00:08:07.621 11:18:49 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:07.621 11:18:49 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@968 -- # echo 'killing process with pid 58941' 00:08:07.621 11:18:49 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@969 -- # kill 58941 00:08:07.621 11:18:49 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@974 -- # wait 58941 00:08:07.879 00:08:07.879 real 0m1.225s 00:08:07.879 user 0m1.240s 00:08:07.879 sys 0m0.487s 00:08:07.879 11:18:49 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:07.879 ************************************ 00:08:07.879 END TEST default_locks_via_rpc 00:08:07.879 ************************************ 00:08:07.879 11:18:49 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:07.879 11:18:49 event.cpu_locks -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:08:07.879 11:18:49 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:07.879 11:18:49 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:07.879 11:18:49 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:08:07.879 ************************************ 00:08:07.879 START TEST non_locking_app_on_locked_coremask 00:08:07.879 ************************************ 00:08:07.879 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@1125 -- # non_locking_app_on_locked_coremask 00:08:07.879 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=58990 00:08:07.879 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@81 -- # waitforlisten 58990 /var/tmp/spdk.sock 00:08:07.879 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@79 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 00:08:07.879 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@831 -- # '[' -z 58990 ']' 00:08:07.879 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:07.879 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:07.879 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:07.879 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:07.879 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:07.879 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:08:07.879 [2024-10-07 11:18:49.467874] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:07.879 [2024-10-07 11:18:49.467983] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid58990 ] 00:08:08.137 [2024-10-07 11:18:49.599327] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:08.137 [2024-10-07 11:18:49.660615] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:08.137 [2024-10-07 11:18:49.704084] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:08.137 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:08.137 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@864 -- # return 0 00:08:08.137 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=58993 00:08:08.137 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@83 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:08:08.137 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@85 -- # waitforlisten 58993 /var/tmp/spdk2.sock 00:08:08.137 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@831 -- # '[' -z 58993 ']' 00:08:08.137 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:08:08.137 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:08.137 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:08:08.137 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:08:08.137 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:08.137 11:18:49 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:08:08.394 [2024-10-07 11:18:49.885572] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:08.395 [2024-10-07 11:18:49.885665] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid58993 ] 00:08:08.395 [2024-10-07 11:18:50.025540] app.c: 914:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:08:08.395 [2024-10-07 11:18:50.025639] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:08.652 [2024-10-07 11:18:50.155052] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:08.652 [2024-10-07 11:18:50.243679] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:08.910 11:18:50 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:08.910 11:18:50 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@864 -- # return 0 00:08:08.910 11:18:50 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@87 -- # locks_exist 58990 00:08:08.910 11:18:50 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@22 -- # lslocks -p 58990 00:08:08.910 11:18:50 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:08:09.842 11:18:51 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@89 -- # killprocess 58990 00:08:09.842 11:18:51 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@950 -- # '[' -z 58990 ']' 00:08:09.842 11:18:51 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@954 -- # kill -0 58990 00:08:09.842 11:18:51 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # uname 00:08:09.842 11:18:51 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:09.842 11:18:51 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 58990 00:08:09.842 11:18:51 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:09.842 11:18:51 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:09.842 killing process with pid 58990 00:08:09.842 11:18:51 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 58990' 00:08:09.842 11:18:51 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@969 -- # kill 58990 00:08:09.842 11:18:51 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@974 -- # wait 58990 00:08:10.408 11:18:52 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@90 -- # killprocess 58993 00:08:10.408 11:18:52 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@950 -- # '[' -z 58993 ']' 00:08:10.408 11:18:52 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@954 -- # kill -0 58993 00:08:10.408 11:18:52 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # uname 00:08:10.408 11:18:52 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:10.408 11:18:52 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 58993 00:08:10.408 11:18:52 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:10.408 11:18:52 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:10.408 11:18:52 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 58993' 00:08:10.408 killing process with pid 58993 00:08:10.408 11:18:52 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@969 -- # kill 58993 00:08:10.408 11:18:52 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@974 -- # wait 58993 00:08:10.667 00:08:10.667 real 0m2.931s 00:08:10.667 user 0m3.325s 00:08:10.667 sys 0m0.938s 00:08:10.667 11:18:52 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:10.667 11:18:52 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:08:10.667 ************************************ 00:08:10.667 END TEST non_locking_app_on_locked_coremask 00:08:10.667 ************************************ 00:08:10.667 11:18:52 event.cpu_locks -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:08:10.667 11:18:52 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:10.667 11:18:52 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:10.667 11:18:52 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:08:10.924 ************************************ 00:08:10.924 START TEST locking_app_on_unlocked_coremask 00:08:10.924 ************************************ 00:08:10.924 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@1125 -- # locking_app_on_unlocked_coremask 00:08:10.924 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=59053 00:08:10.924 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@97 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:08:10.924 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@99 -- # waitforlisten 59053 /var/tmp/spdk.sock 00:08:10.924 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@831 -- # '[' -z 59053 ']' 00:08:10.924 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:10.924 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:10.924 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:10.924 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:10.924 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:10.924 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@10 -- # set +x 00:08:10.924 [2024-10-07 11:18:52.438533] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:10.924 [2024-10-07 11:18:52.439253] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59053 ] 00:08:10.924 [2024-10-07 11:18:52.573605] app.c: 914:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:08:10.924 [2024-10-07 11:18:52.573721] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:11.182 [2024-10-07 11:18:52.639131] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:11.182 [2024-10-07 11:18:52.683778] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:11.182 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:11.182 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@864 -- # return 0 00:08:11.182 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=59061 00:08:11.182 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@101 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:08:11.182 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@103 -- # waitforlisten 59061 /var/tmp/spdk2.sock 00:08:11.182 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@831 -- # '[' -z 59061 ']' 00:08:11.182 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:08:11.182 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:11.182 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:08:11.182 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:08:11.182 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:11.182 11:18:52 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@10 -- # set +x 00:08:11.439 [2024-10-07 11:18:52.909284] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:11.439 [2024-10-07 11:18:52.909447] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59061 ] 00:08:11.440 [2024-10-07 11:18:53.058630] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:11.697 [2024-10-07 11:18:53.181377] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:11.697 [2024-10-07 11:18:53.292073] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:11.954 11:18:53 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:11.954 11:18:53 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@864 -- # return 0 00:08:11.954 11:18:53 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@105 -- # locks_exist 59061 00:08:11.954 11:18:53 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@22 -- # lslocks -p 59061 00:08:11.954 11:18:53 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:08:12.887 11:18:54 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@107 -- # killprocess 59053 00:08:12.887 11:18:54 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@950 -- # '[' -z 59053 ']' 00:08:12.887 11:18:54 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@954 -- # kill -0 59053 00:08:12.887 11:18:54 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@955 -- # uname 00:08:12.888 11:18:54 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:12.888 11:18:54 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 59053 00:08:12.888 11:18:54 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:12.888 11:18:54 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:12.888 killing process with pid 59053 00:08:12.888 11:18:54 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 59053' 00:08:12.888 11:18:54 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@969 -- # kill 59053 00:08:12.888 11:18:54 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@974 -- # wait 59053 00:08:13.454 11:18:55 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@108 -- # killprocess 59061 00:08:13.454 11:18:55 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@950 -- # '[' -z 59061 ']' 00:08:13.454 11:18:55 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@954 -- # kill -0 59061 00:08:13.454 11:18:55 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@955 -- # uname 00:08:13.454 11:18:55 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:13.454 11:18:55 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 59061 00:08:13.712 11:18:55 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:13.712 11:18:55 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:13.712 killing process with pid 59061 00:08:13.712 11:18:55 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 59061' 00:08:13.712 11:18:55 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@969 -- # kill 59061 00:08:13.712 11:18:55 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@974 -- # wait 59061 00:08:14.009 00:08:14.009 real 0m3.065s 00:08:14.009 user 0m3.560s 00:08:14.009 sys 0m1.028s 00:08:14.009 11:18:55 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:14.009 11:18:55 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@10 -- # set +x 00:08:14.009 ************************************ 00:08:14.009 END TEST locking_app_on_unlocked_coremask 00:08:14.009 ************************************ 00:08:14.009 11:18:55 event.cpu_locks -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:08:14.009 11:18:55 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:14.009 11:18:55 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:14.009 11:18:55 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:08:14.009 ************************************ 00:08:14.009 START TEST locking_app_on_locked_coremask 00:08:14.009 ************************************ 00:08:14.009 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@1125 -- # locking_app_on_locked_coremask 00:08:14.009 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=59121 00:08:14.009 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@114 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 00:08:14.009 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@116 -- # waitforlisten 59121 /var/tmp/spdk.sock 00:08:14.009 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@831 -- # '[' -z 59121 ']' 00:08:14.009 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:14.009 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:14.009 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:14.009 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:14.009 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:14.009 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:08:14.009 [2024-10-07 11:18:55.574795] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:14.009 [2024-10-07 11:18:55.574936] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59121 ] 00:08:14.009 [2024-10-07 11:18:55.712507] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:14.267 [2024-10-07 11:18:55.776021] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:14.267 [2024-10-07 11:18:55.816562] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:14.267 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:14.267 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@864 -- # return 0 00:08:14.267 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=59129 00:08:14.267 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@120 -- # NOT waitforlisten 59129 /var/tmp/spdk2.sock 00:08:14.267 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@118 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:08:14.267 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@650 -- # local es=0 00:08:14.267 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 59129 /var/tmp/spdk2.sock 00:08:14.267 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:08:14.267 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:14.267 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:08:14.267 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:14.267 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@653 -- # waitforlisten 59129 /var/tmp/spdk2.sock 00:08:14.267 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@831 -- # '[' -z 59129 ']' 00:08:14.267 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:08:14.267 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:14.268 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:08:14.268 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:08:14.268 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:14.268 11:18:55 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:08:14.526 [2024-10-07 11:18:56.032301] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:14.526 [2024-10-07 11:18:56.032390] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59129 ] 00:08:14.526 [2024-10-07 11:18:56.176057] app.c: 779:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 59121 has claimed it. 00:08:14.526 [2024-10-07 11:18:56.176133] app.c: 910:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:08:15.093 /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh: line 846: kill: (59129) - No such process 00:08:15.093 ERROR: process (pid: 59129) is no longer running 00:08:15.093 11:18:56 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:15.093 11:18:56 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@864 -- # return 1 00:08:15.093 11:18:56 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@653 -- # es=1 00:08:15.093 11:18:56 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:15.093 11:18:56 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:08:15.093 11:18:56 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:15.093 11:18:56 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@122 -- # locks_exist 59121 00:08:15.093 11:18:56 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@22 -- # lslocks -p 59121 00:08:15.093 11:18:56 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:08:15.660 11:18:57 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@124 -- # killprocess 59121 00:08:15.660 11:18:57 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@950 -- # '[' -z 59121 ']' 00:08:15.660 11:18:57 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@954 -- # kill -0 59121 00:08:15.660 11:18:57 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # uname 00:08:15.660 11:18:57 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:15.660 11:18:57 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 59121 00:08:15.660 11:18:57 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:15.660 11:18:57 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:15.660 killing process with pid 59121 00:08:15.660 11:18:57 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 59121' 00:08:15.660 11:18:57 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@969 -- # kill 59121 00:08:15.660 11:18:57 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@974 -- # wait 59121 00:08:15.917 00:08:15.917 real 0m2.115s 00:08:15.917 user 0m2.581s 00:08:15.917 sys 0m0.588s 00:08:15.917 11:18:57 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:15.917 ************************************ 00:08:15.917 END TEST locking_app_on_locked_coremask 00:08:15.917 ************************************ 00:08:15.917 11:18:57 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:08:16.174 11:18:57 event.cpu_locks -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:08:16.174 11:18:57 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:16.174 11:18:57 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:16.174 11:18:57 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:08:16.174 ************************************ 00:08:16.174 START TEST locking_overlapped_coremask 00:08:16.174 ************************************ 00:08:16.174 11:18:57 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@1125 -- # locking_overlapped_coremask 00:08:16.174 11:18:57 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=59175 00:08:16.174 11:18:57 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@133 -- # waitforlisten 59175 /var/tmp/spdk.sock 00:08:16.174 11:18:57 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@131 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x7 00:08:16.174 11:18:57 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@831 -- # '[' -z 59175 ']' 00:08:16.174 11:18:57 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:16.174 11:18:57 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:16.174 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:16.174 11:18:57 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:16.174 11:18:57 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:16.174 11:18:57 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@10 -- # set +x 00:08:16.174 [2024-10-07 11:18:57.714115] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:16.174 [2024-10-07 11:18:57.714212] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59175 ] 00:08:16.174 [2024-10-07 11:18:57.850885] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:08:16.432 [2024-10-07 11:18:57.929146] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:08:16.432 [2024-10-07 11:18:57.929233] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:08:16.432 [2024-10-07 11:18:57.929242] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:16.432 [2024-10-07 11:18:57.975698] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:17.365 11:18:58 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:17.365 11:18:58 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@864 -- # return 0 00:08:17.365 11:18:58 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=59197 00:08:17.365 11:18:58 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@135 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:08:17.365 11:18:58 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@137 -- # NOT waitforlisten 59197 /var/tmp/spdk2.sock 00:08:17.365 11:18:58 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@650 -- # local es=0 00:08:17.365 11:18:58 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 59197 /var/tmp/spdk2.sock 00:08:17.365 11:18:58 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:08:17.365 11:18:58 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:17.365 11:18:58 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:08:17.365 11:18:58 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:17.365 11:18:58 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@653 -- # waitforlisten 59197 /var/tmp/spdk2.sock 00:08:17.365 11:18:58 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@831 -- # '[' -z 59197 ']' 00:08:17.365 11:18:58 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:08:17.365 11:18:58 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:17.365 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:08:17.365 11:18:58 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:08:17.365 11:18:58 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:17.365 11:18:58 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@10 -- # set +x 00:08:17.365 [2024-10-07 11:18:58.789863] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:17.365 [2024-10-07 11:18:58.789958] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59197 ] 00:08:17.365 [2024-10-07 11:18:58.935754] app.c: 779:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 59175 has claimed it. 00:08:17.365 [2024-10-07 11:18:58.939445] app.c: 910:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:08:17.930 ERROR: process (pid: 59197) is no longer running 00:08:17.930 /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh: line 846: kill: (59197) - No such process 00:08:17.930 11:18:59 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:17.930 11:18:59 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@864 -- # return 1 00:08:17.930 11:18:59 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@653 -- # es=1 00:08:17.930 11:18:59 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:17.930 11:18:59 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:08:17.930 11:18:59 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:17.930 11:18:59 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:08:17.930 11:18:59 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:08:17.930 11:18:59 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:08:17.930 11:18:59 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:08:17.930 11:18:59 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@141 -- # killprocess 59175 00:08:17.930 11:18:59 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@950 -- # '[' -z 59175 ']' 00:08:17.930 11:18:59 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@954 -- # kill -0 59175 00:08:17.930 11:18:59 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@955 -- # uname 00:08:17.930 11:18:59 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:17.930 11:18:59 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 59175 00:08:17.930 killing process with pid 59175 00:08:17.930 11:18:59 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:17.930 11:18:59 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:17.931 11:18:59 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 59175' 00:08:17.931 11:18:59 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@969 -- # kill 59175 00:08:17.931 11:18:59 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@974 -- # wait 59175 00:08:18.188 ************************************ 00:08:18.188 END TEST locking_overlapped_coremask 00:08:18.188 ************************************ 00:08:18.188 00:08:18.188 real 0m2.158s 00:08:18.188 user 0m6.199s 00:08:18.188 sys 0m0.331s 00:08:18.188 11:18:59 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:18.188 11:18:59 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@10 -- # set +x 00:08:18.188 11:18:59 event.cpu_locks -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:08:18.188 11:18:59 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:18.188 11:18:59 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:18.188 11:18:59 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:08:18.188 ************************************ 00:08:18.188 START TEST locking_overlapped_coremask_via_rpc 00:08:18.188 ************************************ 00:08:18.188 11:18:59 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@1125 -- # locking_overlapped_coremask_via_rpc 00:08:18.188 11:18:59 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=59238 00:08:18.188 11:18:59 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@147 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:08:18.188 11:18:59 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@149 -- # waitforlisten 59238 /var/tmp/spdk.sock 00:08:18.188 11:18:59 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 59238 ']' 00:08:18.188 11:18:59 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:18.188 11:18:59 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:18.188 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:18.188 11:18:59 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:18.188 11:18:59 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:18.188 11:18:59 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:18.188 [2024-10-07 11:18:59.897508] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:18.188 [2024-10-07 11:18:59.897601] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59238 ] 00:08:18.445 [2024-10-07 11:19:00.030884] app.c: 914:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:08:18.445 [2024-10-07 11:19:00.030948] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:08:18.445 [2024-10-07 11:19:00.091415] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:08:18.445 [2024-10-07 11:19:00.091449] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:08:18.445 [2024-10-07 11:19:00.091452] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:18.445 [2024-10-07 11:19:00.131704] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:18.702 11:19:00 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:18.702 11:19:00 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:08:18.702 11:19:00 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=59243 00:08:18.702 11:19:00 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@153 -- # waitforlisten 59243 /var/tmp/spdk2.sock 00:08:18.702 11:19:00 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@151 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:08:18.702 11:19:00 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 59243 ']' 00:08:18.702 11:19:00 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:08:18.702 11:19:00 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:18.702 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:08:18.702 11:19:00 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:08:18.702 11:19:00 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:18.702 11:19:00 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:18.702 [2024-10-07 11:19:00.336394] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:18.702 [2024-10-07 11:19:00.336544] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59243 ] 00:08:18.960 [2024-10-07 11:19:00.486239] app.c: 914:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:08:18.960 [2024-10-07 11:19:00.486490] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:08:18.960 [2024-10-07 11:19:00.608583] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:08:18.960 [2024-10-07 11:19:00.612486] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:08:18.960 [2024-10-07 11:19:00.612486] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:08:19.217 [2024-10-07 11:19:00.691970] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@650 -- # local es=0 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:19.782 [2024-10-07 11:19:01.355586] app.c: 779:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 59238 has claimed it. 00:08:19.782 request: 00:08:19.782 { 00:08:19.782 "method": "framework_enable_cpumask_locks", 00:08:19.782 "req_id": 1 00:08:19.782 } 00:08:19.782 Got JSON-RPC error response 00:08:19.782 response: 00:08:19.782 { 00:08:19.782 "code": -32603, 00:08:19.782 "message": "Failed to claim CPU core: 2" 00:08:19.782 } 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@653 -- # es=1 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@158 -- # waitforlisten 59238 /var/tmp/spdk.sock 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 59238 ']' 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:19.782 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:19.782 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:20.040 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:20.040 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:08:20.040 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@159 -- # waitforlisten 59243 /var/tmp/spdk2.sock 00:08:20.040 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 59243 ']' 00:08:20.040 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:08:20.040 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:20.040 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:08:20.041 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:08:20.041 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:20.041 11:19:01 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:20.606 11:19:02 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:20.606 11:19:02 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:08:20.606 11:19:02 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:08:20.606 11:19:02 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:08:20.606 11:19:02 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:08:20.606 11:19:02 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:08:20.606 00:08:20.606 real 0m2.188s 00:08:20.606 user 0m1.324s 00:08:20.606 sys 0m0.157s 00:08:20.606 11:19:02 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:20.606 11:19:02 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:20.606 ************************************ 00:08:20.606 END TEST locking_overlapped_coremask_via_rpc 00:08:20.606 ************************************ 00:08:20.606 11:19:02 event.cpu_locks -- event/cpu_locks.sh@174 -- # cleanup 00:08:20.606 11:19:02 event.cpu_locks -- event/cpu_locks.sh@15 -- # [[ -z 59238 ]] 00:08:20.606 11:19:02 event.cpu_locks -- event/cpu_locks.sh@15 -- # killprocess 59238 00:08:20.606 11:19:02 event.cpu_locks -- common/autotest_common.sh@950 -- # '[' -z 59238 ']' 00:08:20.606 11:19:02 event.cpu_locks -- common/autotest_common.sh@954 -- # kill -0 59238 00:08:20.606 11:19:02 event.cpu_locks -- common/autotest_common.sh@955 -- # uname 00:08:20.606 11:19:02 event.cpu_locks -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:20.606 11:19:02 event.cpu_locks -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 59238 00:08:20.606 11:19:02 event.cpu_locks -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:20.606 11:19:02 event.cpu_locks -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:20.606 killing process with pid 59238 00:08:20.606 11:19:02 event.cpu_locks -- common/autotest_common.sh@968 -- # echo 'killing process with pid 59238' 00:08:20.606 11:19:02 event.cpu_locks -- common/autotest_common.sh@969 -- # kill 59238 00:08:20.606 11:19:02 event.cpu_locks -- common/autotest_common.sh@974 -- # wait 59238 00:08:20.864 11:19:02 event.cpu_locks -- event/cpu_locks.sh@16 -- # [[ -z 59243 ]] 00:08:20.864 11:19:02 event.cpu_locks -- event/cpu_locks.sh@16 -- # killprocess 59243 00:08:20.864 11:19:02 event.cpu_locks -- common/autotest_common.sh@950 -- # '[' -z 59243 ']' 00:08:20.864 11:19:02 event.cpu_locks -- common/autotest_common.sh@954 -- # kill -0 59243 00:08:20.864 11:19:02 event.cpu_locks -- common/autotest_common.sh@955 -- # uname 00:08:20.864 11:19:02 event.cpu_locks -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:20.864 11:19:02 event.cpu_locks -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 59243 00:08:20.864 11:19:02 event.cpu_locks -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:08:20.864 11:19:02 event.cpu_locks -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:08:20.864 killing process with pid 59243 00:08:20.864 11:19:02 event.cpu_locks -- common/autotest_common.sh@968 -- # echo 'killing process with pid 59243' 00:08:20.864 11:19:02 event.cpu_locks -- common/autotest_common.sh@969 -- # kill 59243 00:08:20.864 11:19:02 event.cpu_locks -- common/autotest_common.sh@974 -- # wait 59243 00:08:21.122 11:19:02 event.cpu_locks -- event/cpu_locks.sh@18 -- # rm -f 00:08:21.122 11:19:02 event.cpu_locks -- event/cpu_locks.sh@1 -- # cleanup 00:08:21.122 11:19:02 event.cpu_locks -- event/cpu_locks.sh@15 -- # [[ -z 59238 ]] 00:08:21.122 11:19:02 event.cpu_locks -- event/cpu_locks.sh@15 -- # killprocess 59238 00:08:21.122 11:19:02 event.cpu_locks -- common/autotest_common.sh@950 -- # '[' -z 59238 ']' 00:08:21.122 11:19:02 event.cpu_locks -- common/autotest_common.sh@954 -- # kill -0 59238 00:08:21.122 /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh: line 954: kill: (59238) - No such process 00:08:21.122 11:19:02 event.cpu_locks -- common/autotest_common.sh@977 -- # echo 'Process with pid 59238 is not found' 00:08:21.122 Process with pid 59238 is not found 00:08:21.122 11:19:02 event.cpu_locks -- event/cpu_locks.sh@16 -- # [[ -z 59243 ]] 00:08:21.122 11:19:02 event.cpu_locks -- event/cpu_locks.sh@16 -- # killprocess 59243 00:08:21.122 11:19:02 event.cpu_locks -- common/autotest_common.sh@950 -- # '[' -z 59243 ']' 00:08:21.122 11:19:02 event.cpu_locks -- common/autotest_common.sh@954 -- # kill -0 59243 00:08:21.122 /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh: line 954: kill: (59243) - No such process 00:08:21.122 Process with pid 59243 is not found 00:08:21.122 11:19:02 event.cpu_locks -- common/autotest_common.sh@977 -- # echo 'Process with pid 59243 is not found' 00:08:21.122 11:19:02 event.cpu_locks -- event/cpu_locks.sh@18 -- # rm -f 00:08:21.122 00:08:21.122 real 0m16.042s 00:08:21.122 user 0m30.560s 00:08:21.122 sys 0m4.666s 00:08:21.122 11:19:02 event.cpu_locks -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:21.122 11:19:02 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:08:21.122 ************************************ 00:08:21.122 END TEST cpu_locks 00:08:21.122 ************************************ 00:08:21.122 00:08:21.122 real 0m46.562s 00:08:21.122 user 1m35.950s 00:08:21.122 sys 0m8.570s 00:08:21.122 11:19:02 event -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:21.122 11:19:02 event -- common/autotest_common.sh@10 -- # set +x 00:08:21.122 ************************************ 00:08:21.122 END TEST event 00:08:21.122 ************************************ 00:08:21.122 11:19:02 -- spdk/autotest.sh@169 -- # run_test thread /home/vagrant/spdk_repo/spdk/test/thread/thread.sh 00:08:21.122 11:19:02 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:21.122 11:19:02 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:21.122 11:19:02 -- common/autotest_common.sh@10 -- # set +x 00:08:21.122 ************************************ 00:08:21.122 START TEST thread 00:08:21.122 ************************************ 00:08:21.122 11:19:02 thread -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/thread/thread.sh 00:08:21.122 * Looking for test storage... 00:08:21.381 * Found test storage at /home/vagrant/spdk_repo/spdk/test/thread 00:08:21.381 11:19:02 thread -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:08:21.381 11:19:02 thread -- common/autotest_common.sh@1681 -- # lcov --version 00:08:21.381 11:19:02 thread -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:08:21.381 11:19:02 thread -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:08:21.381 11:19:02 thread -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:08:21.381 11:19:02 thread -- scripts/common.sh@333 -- # local ver1 ver1_l 00:08:21.381 11:19:02 thread -- scripts/common.sh@334 -- # local ver2 ver2_l 00:08:21.381 11:19:02 thread -- scripts/common.sh@336 -- # IFS=.-: 00:08:21.381 11:19:02 thread -- scripts/common.sh@336 -- # read -ra ver1 00:08:21.381 11:19:02 thread -- scripts/common.sh@337 -- # IFS=.-: 00:08:21.381 11:19:02 thread -- scripts/common.sh@337 -- # read -ra ver2 00:08:21.381 11:19:02 thread -- scripts/common.sh@338 -- # local 'op=<' 00:08:21.381 11:19:02 thread -- scripts/common.sh@340 -- # ver1_l=2 00:08:21.381 11:19:02 thread -- scripts/common.sh@341 -- # ver2_l=1 00:08:21.381 11:19:02 thread -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:08:21.381 11:19:02 thread -- scripts/common.sh@344 -- # case "$op" in 00:08:21.381 11:19:02 thread -- scripts/common.sh@345 -- # : 1 00:08:21.381 11:19:02 thread -- scripts/common.sh@364 -- # (( v = 0 )) 00:08:21.381 11:19:02 thread -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:21.381 11:19:02 thread -- scripts/common.sh@365 -- # decimal 1 00:08:21.381 11:19:02 thread -- scripts/common.sh@353 -- # local d=1 00:08:21.381 11:19:02 thread -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:21.381 11:19:02 thread -- scripts/common.sh@355 -- # echo 1 00:08:21.381 11:19:02 thread -- scripts/common.sh@365 -- # ver1[v]=1 00:08:21.381 11:19:02 thread -- scripts/common.sh@366 -- # decimal 2 00:08:21.381 11:19:02 thread -- scripts/common.sh@353 -- # local d=2 00:08:21.381 11:19:02 thread -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:21.381 11:19:02 thread -- scripts/common.sh@355 -- # echo 2 00:08:21.381 11:19:02 thread -- scripts/common.sh@366 -- # ver2[v]=2 00:08:21.381 11:19:02 thread -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:08:21.381 11:19:02 thread -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:08:21.381 11:19:02 thread -- scripts/common.sh@368 -- # return 0 00:08:21.381 11:19:02 thread -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:21.381 11:19:02 thread -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:08:21.381 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:21.381 --rc genhtml_branch_coverage=1 00:08:21.381 --rc genhtml_function_coverage=1 00:08:21.381 --rc genhtml_legend=1 00:08:21.381 --rc geninfo_all_blocks=1 00:08:21.381 --rc geninfo_unexecuted_blocks=1 00:08:21.381 00:08:21.381 ' 00:08:21.381 11:19:02 thread -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:08:21.381 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:21.381 --rc genhtml_branch_coverage=1 00:08:21.381 --rc genhtml_function_coverage=1 00:08:21.381 --rc genhtml_legend=1 00:08:21.381 --rc geninfo_all_blocks=1 00:08:21.381 --rc geninfo_unexecuted_blocks=1 00:08:21.381 00:08:21.381 ' 00:08:21.381 11:19:02 thread -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:08:21.381 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:21.381 --rc genhtml_branch_coverage=1 00:08:21.381 --rc genhtml_function_coverage=1 00:08:21.381 --rc genhtml_legend=1 00:08:21.381 --rc geninfo_all_blocks=1 00:08:21.381 --rc geninfo_unexecuted_blocks=1 00:08:21.381 00:08:21.381 ' 00:08:21.381 11:19:02 thread -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:08:21.381 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:21.381 --rc genhtml_branch_coverage=1 00:08:21.381 --rc genhtml_function_coverage=1 00:08:21.381 --rc genhtml_legend=1 00:08:21.381 --rc geninfo_all_blocks=1 00:08:21.381 --rc geninfo_unexecuted_blocks=1 00:08:21.381 00:08:21.381 ' 00:08:21.381 11:19:02 thread -- thread/thread.sh@11 -- # run_test thread_poller_perf /home/vagrant/spdk_repo/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:08:21.381 11:19:02 thread -- common/autotest_common.sh@1101 -- # '[' 8 -le 1 ']' 00:08:21.381 11:19:02 thread -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:21.381 11:19:02 thread -- common/autotest_common.sh@10 -- # set +x 00:08:21.381 ************************************ 00:08:21.381 START TEST thread_poller_perf 00:08:21.381 ************************************ 00:08:21.381 11:19:02 thread.thread_poller_perf -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:08:21.381 [2024-10-07 11:19:02.946975] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:21.381 [2024-10-07 11:19:02.947064] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59378 ] 00:08:21.381 [2024-10-07 11:19:03.084100] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:21.638 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:08:21.638 [2024-10-07 11:19:03.156972] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:22.570 [2024-10-07T11:19:04.281Z] ====================================== 00:08:22.570 [2024-10-07T11:19:04.281Z] busy:2208622277 (cyc) 00:08:22.570 [2024-10-07T11:19:04.281Z] total_run_count: 284000 00:08:22.570 [2024-10-07T11:19:04.281Z] tsc_hz: 2200000000 (cyc) 00:08:22.570 [2024-10-07T11:19:04.281Z] ====================================== 00:08:22.570 [2024-10-07T11:19:04.281Z] poller_cost: 7776 (cyc), 3534 (nsec) 00:08:22.570 00:08:22.570 real 0m1.307s 00:08:22.570 user 0m1.156s 00:08:22.570 sys 0m0.044s 00:08:22.570 11:19:04 thread.thread_poller_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:22.570 ************************************ 00:08:22.570 END TEST thread_poller_perf 00:08:22.570 11:19:04 thread.thread_poller_perf -- common/autotest_common.sh@10 -- # set +x 00:08:22.570 ************************************ 00:08:22.570 11:19:04 thread -- thread/thread.sh@12 -- # run_test thread_poller_perf /home/vagrant/spdk_repo/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:08:22.570 11:19:04 thread -- common/autotest_common.sh@1101 -- # '[' 8 -le 1 ']' 00:08:22.570 11:19:04 thread -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:22.570 11:19:04 thread -- common/autotest_common.sh@10 -- # set +x 00:08:22.828 ************************************ 00:08:22.828 START TEST thread_poller_perf 00:08:22.828 ************************************ 00:08:22.828 11:19:04 thread.thread_poller_perf -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:08:22.828 [2024-10-07 11:19:04.310655] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:22.828 [2024-10-07 11:19:04.310750] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59409 ] 00:08:22.828 [2024-10-07 11:19:04.451786] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:22.828 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:08:22.828 [2024-10-07 11:19:04.522025] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:24.224 [2024-10-07T11:19:05.935Z] ====================================== 00:08:24.224 [2024-10-07T11:19:05.935Z] busy:2202351825 (cyc) 00:08:24.224 [2024-10-07T11:19:05.935Z] total_run_count: 3659000 00:08:24.224 [2024-10-07T11:19:05.935Z] tsc_hz: 2200000000 (cyc) 00:08:24.224 [2024-10-07T11:19:05.935Z] ====================================== 00:08:24.224 [2024-10-07T11:19:05.935Z] poller_cost: 601 (cyc), 273 (nsec) 00:08:24.224 00:08:24.224 real 0m1.305s 00:08:24.224 user 0m1.154s 00:08:24.224 sys 0m0.041s 00:08:24.224 11:19:05 thread.thread_poller_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:24.224 11:19:05 thread.thread_poller_perf -- common/autotest_common.sh@10 -- # set +x 00:08:24.224 ************************************ 00:08:24.224 END TEST thread_poller_perf 00:08:24.224 ************************************ 00:08:24.224 11:19:05 thread -- thread/thread.sh@17 -- # [[ y != \y ]] 00:08:24.224 ************************************ 00:08:24.224 END TEST thread 00:08:24.224 ************************************ 00:08:24.224 00:08:24.224 real 0m2.878s 00:08:24.224 user 0m2.442s 00:08:24.224 sys 0m0.219s 00:08:24.224 11:19:05 thread -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:24.224 11:19:05 thread -- common/autotest_common.sh@10 -- # set +x 00:08:24.224 11:19:05 -- spdk/autotest.sh@171 -- # [[ 0 -eq 1 ]] 00:08:24.224 11:19:05 -- spdk/autotest.sh@176 -- # run_test app_cmdline /home/vagrant/spdk_repo/spdk/test/app/cmdline.sh 00:08:24.224 11:19:05 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:24.224 11:19:05 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:24.224 11:19:05 -- common/autotest_common.sh@10 -- # set +x 00:08:24.224 ************************************ 00:08:24.224 START TEST app_cmdline 00:08:24.224 ************************************ 00:08:24.224 11:19:05 app_cmdline -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/app/cmdline.sh 00:08:24.224 * Looking for test storage... 00:08:24.224 * Found test storage at /home/vagrant/spdk_repo/spdk/test/app 00:08:24.224 11:19:05 app_cmdline -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:08:24.224 11:19:05 app_cmdline -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:08:24.224 11:19:05 app_cmdline -- common/autotest_common.sh@1681 -- # lcov --version 00:08:24.224 11:19:05 app_cmdline -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@333 -- # local ver1 ver1_l 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@334 -- # local ver2 ver2_l 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@336 -- # IFS=.-: 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@336 -- # read -ra ver1 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@337 -- # IFS=.-: 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@337 -- # read -ra ver2 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@338 -- # local 'op=<' 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@340 -- # ver1_l=2 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@341 -- # ver2_l=1 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@344 -- # case "$op" in 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@345 -- # : 1 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@364 -- # (( v = 0 )) 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@365 -- # decimal 1 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@353 -- # local d=1 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@355 -- # echo 1 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@365 -- # ver1[v]=1 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@366 -- # decimal 2 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@353 -- # local d=2 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@355 -- # echo 2 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@366 -- # ver2[v]=2 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:08:24.224 11:19:05 app_cmdline -- scripts/common.sh@368 -- # return 0 00:08:24.224 11:19:05 app_cmdline -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:24.224 11:19:05 app_cmdline -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:08:24.224 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:24.224 --rc genhtml_branch_coverage=1 00:08:24.224 --rc genhtml_function_coverage=1 00:08:24.224 --rc genhtml_legend=1 00:08:24.224 --rc geninfo_all_blocks=1 00:08:24.224 --rc geninfo_unexecuted_blocks=1 00:08:24.224 00:08:24.224 ' 00:08:24.224 11:19:05 app_cmdline -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:08:24.224 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:24.224 --rc genhtml_branch_coverage=1 00:08:24.224 --rc genhtml_function_coverage=1 00:08:24.224 --rc genhtml_legend=1 00:08:24.224 --rc geninfo_all_blocks=1 00:08:24.224 --rc geninfo_unexecuted_blocks=1 00:08:24.224 00:08:24.224 ' 00:08:24.224 11:19:05 app_cmdline -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:08:24.224 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:24.224 --rc genhtml_branch_coverage=1 00:08:24.224 --rc genhtml_function_coverage=1 00:08:24.224 --rc genhtml_legend=1 00:08:24.224 --rc geninfo_all_blocks=1 00:08:24.224 --rc geninfo_unexecuted_blocks=1 00:08:24.224 00:08:24.224 ' 00:08:24.224 11:19:05 app_cmdline -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:08:24.224 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:24.224 --rc genhtml_branch_coverage=1 00:08:24.224 --rc genhtml_function_coverage=1 00:08:24.224 --rc genhtml_legend=1 00:08:24.224 --rc geninfo_all_blocks=1 00:08:24.224 --rc geninfo_unexecuted_blocks=1 00:08:24.224 00:08:24.224 ' 00:08:24.224 11:19:05 app_cmdline -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:08:24.224 11:19:05 app_cmdline -- app/cmdline.sh@17 -- # spdk_tgt_pid=59492 00:08:24.224 11:19:05 app_cmdline -- app/cmdline.sh@18 -- # waitforlisten 59492 00:08:24.224 11:19:05 app_cmdline -- app/cmdline.sh@16 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:08:24.224 11:19:05 app_cmdline -- common/autotest_common.sh@831 -- # '[' -z 59492 ']' 00:08:24.224 11:19:05 app_cmdline -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:24.224 11:19:05 app_cmdline -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:24.224 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:24.224 11:19:05 app_cmdline -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:24.224 11:19:05 app_cmdline -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:24.224 11:19:05 app_cmdline -- common/autotest_common.sh@10 -- # set +x 00:08:24.224 [2024-10-07 11:19:05.935250] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:24.484 [2024-10-07 11:19:05.935359] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59492 ] 00:08:24.484 [2024-10-07 11:19:06.074065] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:24.484 [2024-10-07 11:19:06.147457] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:24.484 [2024-10-07 11:19:06.193642] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:24.741 11:19:06 app_cmdline -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:24.741 11:19:06 app_cmdline -- common/autotest_common.sh@864 -- # return 0 00:08:24.741 11:19:06 app_cmdline -- app/cmdline.sh@20 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py spdk_get_version 00:08:24.999 { 00:08:24.999 "version": "SPDK v25.01-pre git sha1 d16db39ee", 00:08:24.999 "fields": { 00:08:24.999 "major": 25, 00:08:24.999 "minor": 1, 00:08:24.999 "patch": 0, 00:08:24.999 "suffix": "-pre", 00:08:24.999 "commit": "d16db39ee" 00:08:24.999 } 00:08:24.999 } 00:08:24.999 11:19:06 app_cmdline -- app/cmdline.sh@22 -- # expected_methods=() 00:08:24.999 11:19:06 app_cmdline -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:08:24.999 11:19:06 app_cmdline -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:08:24.999 11:19:06 app_cmdline -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:08:24.999 11:19:06 app_cmdline -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:08:24.999 11:19:06 app_cmdline -- app/cmdline.sh@26 -- # jq -r '.[]' 00:08:24.999 11:19:06 app_cmdline -- app/cmdline.sh@26 -- # sort 00:08:24.999 11:19:06 app_cmdline -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:24.999 11:19:06 app_cmdline -- common/autotest_common.sh@10 -- # set +x 00:08:24.999 11:19:06 app_cmdline -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:24.999 11:19:06 app_cmdline -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:08:24.999 11:19:06 app_cmdline -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:08:24.999 11:19:06 app_cmdline -- app/cmdline.sh@30 -- # NOT /home/vagrant/spdk_repo/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:24.999 11:19:06 app_cmdline -- common/autotest_common.sh@650 -- # local es=0 00:08:24.999 11:19:06 app_cmdline -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:24.999 11:19:06 app_cmdline -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:08:25.256 11:19:06 app_cmdline -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:25.256 11:19:06 app_cmdline -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:08:25.256 11:19:06 app_cmdline -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:25.256 11:19:06 app_cmdline -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:08:25.256 11:19:06 app_cmdline -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:25.256 11:19:06 app_cmdline -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:08:25.256 11:19:06 app_cmdline -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/scripts/rpc.py ]] 00:08:25.256 11:19:06 app_cmdline -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:25.513 request: 00:08:25.514 { 00:08:25.514 "method": "env_dpdk_get_mem_stats", 00:08:25.514 "req_id": 1 00:08:25.514 } 00:08:25.514 Got JSON-RPC error response 00:08:25.514 response: 00:08:25.514 { 00:08:25.514 "code": -32601, 00:08:25.514 "message": "Method not found" 00:08:25.514 } 00:08:25.514 11:19:07 app_cmdline -- common/autotest_common.sh@653 -- # es=1 00:08:25.514 11:19:07 app_cmdline -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:25.514 11:19:07 app_cmdline -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:08:25.514 11:19:07 app_cmdline -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:25.514 11:19:07 app_cmdline -- app/cmdline.sh@1 -- # killprocess 59492 00:08:25.514 11:19:07 app_cmdline -- common/autotest_common.sh@950 -- # '[' -z 59492 ']' 00:08:25.514 11:19:07 app_cmdline -- common/autotest_common.sh@954 -- # kill -0 59492 00:08:25.514 11:19:07 app_cmdline -- common/autotest_common.sh@955 -- # uname 00:08:25.514 11:19:07 app_cmdline -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:25.514 11:19:07 app_cmdline -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 59492 00:08:25.514 11:19:07 app_cmdline -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:25.514 11:19:07 app_cmdline -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:25.514 killing process with pid 59492 00:08:25.514 11:19:07 app_cmdline -- common/autotest_common.sh@968 -- # echo 'killing process with pid 59492' 00:08:25.514 11:19:07 app_cmdline -- common/autotest_common.sh@969 -- # kill 59492 00:08:25.514 11:19:07 app_cmdline -- common/autotest_common.sh@974 -- # wait 59492 00:08:25.772 00:08:25.772 real 0m1.654s 00:08:25.772 user 0m2.201s 00:08:25.772 sys 0m0.381s 00:08:25.772 11:19:07 app_cmdline -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:25.772 11:19:07 app_cmdline -- common/autotest_common.sh@10 -- # set +x 00:08:25.772 ************************************ 00:08:25.772 END TEST app_cmdline 00:08:25.772 ************************************ 00:08:25.772 11:19:07 -- spdk/autotest.sh@177 -- # run_test version /home/vagrant/spdk_repo/spdk/test/app/version.sh 00:08:25.772 11:19:07 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:25.772 11:19:07 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:25.772 11:19:07 -- common/autotest_common.sh@10 -- # set +x 00:08:25.772 ************************************ 00:08:25.772 START TEST version 00:08:25.772 ************************************ 00:08:25.772 11:19:07 version -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/app/version.sh 00:08:25.772 * Looking for test storage... 00:08:25.772 * Found test storage at /home/vagrant/spdk_repo/spdk/test/app 00:08:25.772 11:19:07 version -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:08:25.772 11:19:07 version -- common/autotest_common.sh@1681 -- # lcov --version 00:08:25.772 11:19:07 version -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:08:26.030 11:19:07 version -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:08:26.030 11:19:07 version -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:08:26.030 11:19:07 version -- scripts/common.sh@333 -- # local ver1 ver1_l 00:08:26.031 11:19:07 version -- scripts/common.sh@334 -- # local ver2 ver2_l 00:08:26.031 11:19:07 version -- scripts/common.sh@336 -- # IFS=.-: 00:08:26.031 11:19:07 version -- scripts/common.sh@336 -- # read -ra ver1 00:08:26.031 11:19:07 version -- scripts/common.sh@337 -- # IFS=.-: 00:08:26.031 11:19:07 version -- scripts/common.sh@337 -- # read -ra ver2 00:08:26.031 11:19:07 version -- scripts/common.sh@338 -- # local 'op=<' 00:08:26.031 11:19:07 version -- scripts/common.sh@340 -- # ver1_l=2 00:08:26.031 11:19:07 version -- scripts/common.sh@341 -- # ver2_l=1 00:08:26.031 11:19:07 version -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:08:26.031 11:19:07 version -- scripts/common.sh@344 -- # case "$op" in 00:08:26.031 11:19:07 version -- scripts/common.sh@345 -- # : 1 00:08:26.031 11:19:07 version -- scripts/common.sh@364 -- # (( v = 0 )) 00:08:26.031 11:19:07 version -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:26.031 11:19:07 version -- scripts/common.sh@365 -- # decimal 1 00:08:26.031 11:19:07 version -- scripts/common.sh@353 -- # local d=1 00:08:26.031 11:19:07 version -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:26.031 11:19:07 version -- scripts/common.sh@355 -- # echo 1 00:08:26.031 11:19:07 version -- scripts/common.sh@365 -- # ver1[v]=1 00:08:26.031 11:19:07 version -- scripts/common.sh@366 -- # decimal 2 00:08:26.031 11:19:07 version -- scripts/common.sh@353 -- # local d=2 00:08:26.031 11:19:07 version -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:26.031 11:19:07 version -- scripts/common.sh@355 -- # echo 2 00:08:26.031 11:19:07 version -- scripts/common.sh@366 -- # ver2[v]=2 00:08:26.031 11:19:07 version -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:08:26.031 11:19:07 version -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:08:26.031 11:19:07 version -- scripts/common.sh@368 -- # return 0 00:08:26.031 11:19:07 version -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:26.031 11:19:07 version -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:08:26.031 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:26.031 --rc genhtml_branch_coverage=1 00:08:26.031 --rc genhtml_function_coverage=1 00:08:26.031 --rc genhtml_legend=1 00:08:26.031 --rc geninfo_all_blocks=1 00:08:26.031 --rc geninfo_unexecuted_blocks=1 00:08:26.031 00:08:26.031 ' 00:08:26.031 11:19:07 version -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:08:26.031 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:26.031 --rc genhtml_branch_coverage=1 00:08:26.031 --rc genhtml_function_coverage=1 00:08:26.031 --rc genhtml_legend=1 00:08:26.031 --rc geninfo_all_blocks=1 00:08:26.031 --rc geninfo_unexecuted_blocks=1 00:08:26.031 00:08:26.031 ' 00:08:26.031 11:19:07 version -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:08:26.031 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:26.031 --rc genhtml_branch_coverage=1 00:08:26.031 --rc genhtml_function_coverage=1 00:08:26.031 --rc genhtml_legend=1 00:08:26.031 --rc geninfo_all_blocks=1 00:08:26.031 --rc geninfo_unexecuted_blocks=1 00:08:26.031 00:08:26.031 ' 00:08:26.031 11:19:07 version -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:08:26.031 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:26.031 --rc genhtml_branch_coverage=1 00:08:26.031 --rc genhtml_function_coverage=1 00:08:26.031 --rc genhtml_legend=1 00:08:26.031 --rc geninfo_all_blocks=1 00:08:26.031 --rc geninfo_unexecuted_blocks=1 00:08:26.031 00:08:26.031 ' 00:08:26.031 11:19:07 version -- app/version.sh@17 -- # get_header_version major 00:08:26.031 11:19:07 version -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /home/vagrant/spdk_repo/spdk/include/spdk/version.h 00:08:26.031 11:19:07 version -- app/version.sh@14 -- # cut -f2 00:08:26.031 11:19:07 version -- app/version.sh@14 -- # tr -d '"' 00:08:26.031 11:19:07 version -- app/version.sh@17 -- # major=25 00:08:26.031 11:19:07 version -- app/version.sh@18 -- # get_header_version minor 00:08:26.031 11:19:07 version -- app/version.sh@14 -- # cut -f2 00:08:26.031 11:19:07 version -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /home/vagrant/spdk_repo/spdk/include/spdk/version.h 00:08:26.031 11:19:07 version -- app/version.sh@14 -- # tr -d '"' 00:08:26.031 11:19:07 version -- app/version.sh@18 -- # minor=1 00:08:26.031 11:19:07 version -- app/version.sh@19 -- # get_header_version patch 00:08:26.031 11:19:07 version -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /home/vagrant/spdk_repo/spdk/include/spdk/version.h 00:08:26.031 11:19:07 version -- app/version.sh@14 -- # cut -f2 00:08:26.031 11:19:07 version -- app/version.sh@14 -- # tr -d '"' 00:08:26.031 11:19:07 version -- app/version.sh@19 -- # patch=0 00:08:26.031 11:19:07 version -- app/version.sh@20 -- # get_header_version suffix 00:08:26.031 11:19:07 version -- app/version.sh@14 -- # cut -f2 00:08:26.031 11:19:07 version -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /home/vagrant/spdk_repo/spdk/include/spdk/version.h 00:08:26.031 11:19:07 version -- app/version.sh@14 -- # tr -d '"' 00:08:26.031 11:19:07 version -- app/version.sh@20 -- # suffix=-pre 00:08:26.031 11:19:07 version -- app/version.sh@22 -- # version=25.1 00:08:26.031 11:19:07 version -- app/version.sh@25 -- # (( patch != 0 )) 00:08:26.031 11:19:07 version -- app/version.sh@28 -- # version=25.1rc0 00:08:26.031 11:19:07 version -- app/version.sh@30 -- # PYTHONPATH=:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python 00:08:26.031 11:19:07 version -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:08:26.031 11:19:07 version -- app/version.sh@30 -- # py_version=25.1rc0 00:08:26.031 11:19:07 version -- app/version.sh@31 -- # [[ 25.1rc0 == \2\5\.\1\r\c\0 ]] 00:08:26.031 00:08:26.031 real 0m0.252s 00:08:26.031 user 0m0.180s 00:08:26.031 sys 0m0.104s 00:08:26.031 ************************************ 00:08:26.031 END TEST version 00:08:26.031 ************************************ 00:08:26.031 11:19:07 version -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:26.031 11:19:07 version -- common/autotest_common.sh@10 -- # set +x 00:08:26.031 11:19:07 -- spdk/autotest.sh@179 -- # '[' 0 -eq 1 ']' 00:08:26.031 11:19:07 -- spdk/autotest.sh@188 -- # [[ 0 -eq 1 ]] 00:08:26.031 11:19:07 -- spdk/autotest.sh@194 -- # uname -s 00:08:26.031 11:19:07 -- spdk/autotest.sh@194 -- # [[ Linux == Linux ]] 00:08:26.031 11:19:07 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:08:26.031 11:19:07 -- spdk/autotest.sh@195 -- # [[ 1 -eq 1 ]] 00:08:26.031 11:19:07 -- spdk/autotest.sh@201 -- # [[ 0 -eq 0 ]] 00:08:26.031 11:19:07 -- spdk/autotest.sh@202 -- # run_test spdk_dd /home/vagrant/spdk_repo/spdk/test/dd/dd.sh 00:08:26.031 11:19:07 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:26.031 11:19:07 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:26.031 11:19:07 -- common/autotest_common.sh@10 -- # set +x 00:08:26.031 ************************************ 00:08:26.031 START TEST spdk_dd 00:08:26.031 ************************************ 00:08:26.031 11:19:07 spdk_dd -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/dd/dd.sh 00:08:26.290 * Looking for test storage... 00:08:26.290 * Found test storage at /home/vagrant/spdk_repo/spdk/test/dd 00:08:26.290 11:19:07 spdk_dd -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:08:26.290 11:19:07 spdk_dd -- common/autotest_common.sh@1681 -- # lcov --version 00:08:26.290 11:19:07 spdk_dd -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:08:26.290 11:19:07 spdk_dd -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@333 -- # local ver1 ver1_l 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@334 -- # local ver2 ver2_l 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@336 -- # IFS=.-: 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@336 -- # read -ra ver1 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@337 -- # IFS=.-: 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@337 -- # read -ra ver2 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@338 -- # local 'op=<' 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@340 -- # ver1_l=2 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@341 -- # ver2_l=1 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@344 -- # case "$op" in 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@345 -- # : 1 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@364 -- # (( v = 0 )) 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@365 -- # decimal 1 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@353 -- # local d=1 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@355 -- # echo 1 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@365 -- # ver1[v]=1 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@366 -- # decimal 2 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@353 -- # local d=2 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@355 -- # echo 2 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@366 -- # ver2[v]=2 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@368 -- # return 0 00:08:26.290 11:19:07 spdk_dd -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:26.290 11:19:07 spdk_dd -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:08:26.290 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:26.290 --rc genhtml_branch_coverage=1 00:08:26.290 --rc genhtml_function_coverage=1 00:08:26.290 --rc genhtml_legend=1 00:08:26.290 --rc geninfo_all_blocks=1 00:08:26.290 --rc geninfo_unexecuted_blocks=1 00:08:26.290 00:08:26.290 ' 00:08:26.290 11:19:07 spdk_dd -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:08:26.290 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:26.290 --rc genhtml_branch_coverage=1 00:08:26.290 --rc genhtml_function_coverage=1 00:08:26.290 --rc genhtml_legend=1 00:08:26.290 --rc geninfo_all_blocks=1 00:08:26.290 --rc geninfo_unexecuted_blocks=1 00:08:26.290 00:08:26.290 ' 00:08:26.290 11:19:07 spdk_dd -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:08:26.290 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:26.290 --rc genhtml_branch_coverage=1 00:08:26.290 --rc genhtml_function_coverage=1 00:08:26.290 --rc genhtml_legend=1 00:08:26.290 --rc geninfo_all_blocks=1 00:08:26.290 --rc geninfo_unexecuted_blocks=1 00:08:26.290 00:08:26.290 ' 00:08:26.290 11:19:07 spdk_dd -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:08:26.290 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:26.290 --rc genhtml_branch_coverage=1 00:08:26.290 --rc genhtml_function_coverage=1 00:08:26.290 --rc genhtml_legend=1 00:08:26.290 --rc geninfo_all_blocks=1 00:08:26.290 --rc geninfo_unexecuted_blocks=1 00:08:26.290 00:08:26.290 ' 00:08:26.290 11:19:07 spdk_dd -- dd/common.sh@7 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@15 -- # shopt -s extglob 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:26.290 11:19:07 spdk_dd -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:26.290 11:19:07 spdk_dd -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:26.290 11:19:07 spdk_dd -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:26.290 11:19:07 spdk_dd -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:26.290 11:19:07 spdk_dd -- paths/export.sh@5 -- # export PATH 00:08:26.290 11:19:07 spdk_dd -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:26.290 11:19:07 spdk_dd -- dd/dd.sh@10 -- # /home/vagrant/spdk_repo/spdk/scripts/setup.sh 00:08:26.548 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:08:26.806 0000:00:11.0 (1b36 0010): Already using the uio_pci_generic driver 00:08:26.806 0000:00:10.0 (1b36 0010): Already using the uio_pci_generic driver 00:08:26.806 11:19:08 spdk_dd -- dd/dd.sh@11 -- # nvmes=($(nvme_in_userspace)) 00:08:26.806 11:19:08 spdk_dd -- dd/dd.sh@11 -- # nvme_in_userspace 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@312 -- # local bdf bdfs 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@313 -- # local nvmes 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@315 -- # [[ -n '' ]] 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@318 -- # nvmes=($(iter_pci_class_code 01 08 02)) 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@318 -- # iter_pci_class_code 01 08 02 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@298 -- # local bdf= 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@300 -- # iter_all_pci_class_code 01 08 02 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@233 -- # local class 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@234 -- # local subclass 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@235 -- # local progif 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@236 -- # printf %02x 1 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@236 -- # class=01 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@237 -- # printf %02x 8 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@237 -- # subclass=08 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@238 -- # printf %02x 2 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@238 -- # progif=02 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@240 -- # hash lspci 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@241 -- # '[' 02 '!=' 00 ']' 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@242 -- # lspci -mm -n -D 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@243 -- # grep -i -- -p02 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@244 -- # awk -v 'cc="0108"' -F ' ' '{if (cc ~ $2) print $1}' 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@245 -- # tr -d '"' 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@300 -- # for bdf in $(iter_all_pci_class_code "$@") 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@301 -- # pci_can_use 0000:00:10.0 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@18 -- # local i 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@21 -- # [[ =~ 0000:00:10.0 ]] 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@25 -- # [[ -z '' ]] 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@27 -- # return 0 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@302 -- # echo 0000:00:10.0 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@300 -- # for bdf in $(iter_all_pci_class_code "$@") 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@301 -- # pci_can_use 0000:00:11.0 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@18 -- # local i 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@21 -- # [[ =~ 0000:00:11.0 ]] 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@25 -- # [[ -z '' ]] 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@27 -- # return 0 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@302 -- # echo 0000:00:11.0 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@321 -- # for bdf in "${nvmes[@]}" 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@322 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:00:10.0 ]] 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@323 -- # uname -s 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@323 -- # [[ Linux == FreeBSD ]] 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@326 -- # bdfs+=("$bdf") 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@321 -- # for bdf in "${nvmes[@]}" 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@322 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:00:11.0 ]] 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@323 -- # uname -s 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@323 -- # [[ Linux == FreeBSD ]] 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@326 -- # bdfs+=("$bdf") 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@328 -- # (( 2 )) 00:08:26.806 11:19:08 spdk_dd -- scripts/common.sh@329 -- # printf '%s\n' 0000:00:10.0 0000:00:11.0 00:08:26.806 11:19:08 spdk_dd -- dd/dd.sh@13 -- # check_liburing 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@139 -- # local lib 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@140 -- # local -g liburing_in_use=0 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@137 -- # objdump -p /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@137 -- # grep NEEDED 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_bdev_malloc.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_bdev_null.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_bdev_nvme.so.7.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_bdev_passthru.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_bdev_lvol.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_bdev_raid.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_bdev_error.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_bdev_gpt.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_bdev_split.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_bdev_delay.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_bdev_zone_block.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_blobfs_bdev.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_blobfs.so.10.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_blob_bdev.so.11.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_lvol.so.10.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_blob.so.11.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_nvme.so.14.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_rdma_provider.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_rdma_utils.so.1.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_bdev_aio.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_bdev_ftl.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_ftl.so.9.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_bdev_virtio.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_virtio.so.7.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_vfio_user.so.5.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_bdev_iscsi.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_bdev_uring.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_accel_error.so.2.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_accel_ioat.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_ioat.so.7.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_accel_dsa.so.5.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_accel_iaa.so.3.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_idxd.so.12.1 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_scheduler_dynamic.so.4.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_env_dpdk.so.15.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_scheduler_dpdk_governor.so.4.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_scheduler_gscheduler.so.4.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_sock_posix.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_sock_uring.so.5.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_keyring_file.so.2.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_keyring_linux.so.1.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_fsdev_aio.so.1.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_fsdev.so.1.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_event.so.15.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_event_bdev.so.6.0 == liburing.so.* ]] 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.806 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_bdev.so.17.0 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_notify.so.6.0 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_event_accel.so.6.0 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_accel.so.16.0 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_dma.so.5.0 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_event_vmd.so.6.0 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_vmd.so.6.0 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_event_sock.so.5.0 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_sock.so.10.0 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_event_iobuf.so.3.0 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_event_keyring.so.1.0 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_init.so.6.0 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_thread.so.10.2 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_trace.so.11.0 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_keyring.so.2.0 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_rpc.so.6.0 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_jsonrpc.so.6.0 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_json.so.6.0 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_util.so.10.0 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ libspdk_log.so.7.0 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ librte_bus_pci.so.24 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ librte_cryptodev.so.24 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ librte_dmadev.so.24 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ librte_eal.so.24 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ librte_ethdev.so.24 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ librte_hash.so.24 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ librte_kvargs.so.24 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ librte_log.so.24 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ librte_mbuf.so.24 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ librte_mempool.so.24 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ librte_mempool_ring.so.24 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ librte_net.so.24 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ librte_pci.so.24 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ librte_power.so.24 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ librte_rcu.so.24 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ librte_ring.so.24 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ librte_telemetry.so.24 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ librte_vhost.so.24 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@142 -- # read -r _ lib _ 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@143 -- # [[ liburing.so.2 == liburing.so.* ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@144 -- # printf '* spdk_dd linked to liburing\n' 00:08:26.807 * spdk_dd linked to liburing 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@146 -- # [[ -e /home/vagrant/spdk_repo/spdk/test/common/build_config.sh ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@147 -- # source /home/vagrant/spdk_repo/spdk/test/common/build_config.sh 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@5 -- # CONFIG_USDT=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@19 -- # CONFIG_ENV=/home/vagrant/spdk_repo/spdk/lib/env_dpdk 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@22 -- # CONFIG_CET=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@26 -- # CONFIG_AIO_FSDEV=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@27 -- # CONFIG_HAVE_ARC4RANDOM=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@28 -- # CONFIG_HAVE_LIBARCHIVE=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@29 -- # CONFIG_UBLK=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@30 -- # CONFIG_ISAL_CRYPTO=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@31 -- # CONFIG_OPENSSL_PATH= 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@32 -- # CONFIG_OCF=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@33 -- # CONFIG_FUSE=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@34 -- # CONFIG_VTUNE_DIR= 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@35 -- # CONFIG_FUZZER_LIB= 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@36 -- # CONFIG_FUZZER=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@37 -- # CONFIG_FSDEV=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@38 -- # CONFIG_DPDK_DIR=/home/vagrant/spdk_repo/spdk/dpdk/build 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@39 -- # CONFIG_CRYPTO=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@40 -- # CONFIG_PGO_USE=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@41 -- # CONFIG_VHOST=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@42 -- # CONFIG_DAOS=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@43 -- # CONFIG_DPDK_INC_DIR= 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@44 -- # CONFIG_DAOS_DIR= 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@45 -- # CONFIG_UNIT_TESTS=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@46 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@47 -- # CONFIG_VIRTIO=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@48 -- # CONFIG_DPDK_UADK=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@49 -- # CONFIG_COVERAGE=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@50 -- # CONFIG_RDMA=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@51 -- # CONFIG_HAVE_STRUCT_STAT_ST_ATIM=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@52 -- # CONFIG_HAVE_LZ4=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@53 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@54 -- # CONFIG_URING_PATH= 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@55 -- # CONFIG_XNVME=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@56 -- # CONFIG_VFIO_USER=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@57 -- # CONFIG_ARCH=native 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@58 -- # CONFIG_HAVE_EVP_MAC=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@59 -- # CONFIG_URING_ZNS=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@60 -- # CONFIG_WERROR=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@61 -- # CONFIG_HAVE_LIBBSD=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@62 -- # CONFIG_UBSAN=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@63 -- # CONFIG_HAVE_STRUCT_STAT_ST_ATIMESPEC=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@64 -- # CONFIG_IPSEC_MB_DIR= 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@65 -- # CONFIG_GOLANG=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@66 -- # CONFIG_ISAL=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@67 -- # CONFIG_IDXD_KERNEL=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@68 -- # CONFIG_DPDK_LIB_DIR= 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@69 -- # CONFIG_RDMA_PROV=verbs 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@70 -- # CONFIG_APPS=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@71 -- # CONFIG_SHARED=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@72 -- # CONFIG_HAVE_KEYUTILS=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@73 -- # CONFIG_FC_PATH= 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@74 -- # CONFIG_DPDK_PKG_CONFIG=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@75 -- # CONFIG_FC=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@76 -- # CONFIG_AVAHI=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@77 -- # CONFIG_FIO_PLUGIN=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@78 -- # CONFIG_RAID5F=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@79 -- # CONFIG_EXAMPLES=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@80 -- # CONFIG_TESTS=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@81 -- # CONFIG_CRYPTO_MLX5=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@82 -- # CONFIG_MAX_LCORES=128 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@83 -- # CONFIG_IPSEC_MB=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@84 -- # CONFIG_PGO_DIR= 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@85 -- # CONFIG_DEBUG=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@86 -- # CONFIG_DPDK_COMPRESSDEV=n 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@87 -- # CONFIG_CROSS_PREFIX= 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@88 -- # CONFIG_COPY_FILE_RANGE=y 00:08:26.807 11:19:08 spdk_dd -- common/build_config.sh@89 -- # CONFIG_URING=y 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@149 -- # [[ y != y ]] 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@152 -- # export liburing_in_use=1 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@152 -- # liburing_in_use=1 00:08:26.807 11:19:08 spdk_dd -- dd/common.sh@153 -- # return 0 00:08:26.807 11:19:08 spdk_dd -- dd/dd.sh@15 -- # (( liburing_in_use == 0 && SPDK_TEST_URING == 1 )) 00:08:26.807 11:19:08 spdk_dd -- dd/dd.sh@20 -- # run_test spdk_dd_basic_rw /home/vagrant/spdk_repo/spdk/test/dd/basic_rw.sh 0000:00:10.0 0000:00:11.0 00:08:26.807 11:19:08 spdk_dd -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:08:26.807 11:19:08 spdk_dd -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:26.807 11:19:08 spdk_dd -- common/autotest_common.sh@10 -- # set +x 00:08:26.807 ************************************ 00:08:26.807 START TEST spdk_dd_basic_rw 00:08:26.807 ************************************ 00:08:26.807 11:19:08 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/dd/basic_rw.sh 0000:00:10.0 0000:00:11.0 00:08:26.807 * Looking for test storage... 00:08:26.807 * Found test storage at /home/vagrant/spdk_repo/spdk/test/dd 00:08:26.807 11:19:08 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:08:26.807 11:19:08 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@1681 -- # lcov --version 00:08:26.807 11:19:08 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@333 -- # local ver1 ver1_l 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@334 -- # local ver2 ver2_l 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@336 -- # IFS=.-: 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@336 -- # read -ra ver1 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@337 -- # IFS=.-: 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@337 -- # read -ra ver2 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@338 -- # local 'op=<' 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@340 -- # ver1_l=2 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@341 -- # ver2_l=1 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@344 -- # case "$op" in 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@345 -- # : 1 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@364 -- # (( v = 0 )) 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@365 -- # decimal 1 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@353 -- # local d=1 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@355 -- # echo 1 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@365 -- # ver1[v]=1 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@366 -- # decimal 2 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@353 -- # local d=2 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@355 -- # echo 2 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@366 -- # ver2[v]=2 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@368 -- # return 0 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:08:27.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:27.067 --rc genhtml_branch_coverage=1 00:08:27.067 --rc genhtml_function_coverage=1 00:08:27.067 --rc genhtml_legend=1 00:08:27.067 --rc geninfo_all_blocks=1 00:08:27.067 --rc geninfo_unexecuted_blocks=1 00:08:27.067 00:08:27.067 ' 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:08:27.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:27.067 --rc genhtml_branch_coverage=1 00:08:27.067 --rc genhtml_function_coverage=1 00:08:27.067 --rc genhtml_legend=1 00:08:27.067 --rc geninfo_all_blocks=1 00:08:27.067 --rc geninfo_unexecuted_blocks=1 00:08:27.067 00:08:27.067 ' 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:08:27.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:27.067 --rc genhtml_branch_coverage=1 00:08:27.067 --rc genhtml_function_coverage=1 00:08:27.067 --rc genhtml_legend=1 00:08:27.067 --rc geninfo_all_blocks=1 00:08:27.067 --rc geninfo_unexecuted_blocks=1 00:08:27.067 00:08:27.067 ' 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:08:27.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:27.067 --rc genhtml_branch_coverage=1 00:08:27.067 --rc genhtml_function_coverage=1 00:08:27.067 --rc genhtml_legend=1 00:08:27.067 --rc geninfo_all_blocks=1 00:08:27.067 --rc geninfo_unexecuted_blocks=1 00:08:27.067 00:08:27.067 ' 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/common.sh@7 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@15 -- # shopt -s extglob 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- paths/export.sh@5 -- # export PATH 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/basic_rw.sh@80 -- # trap cleanup EXIT 00:08:27.067 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/basic_rw.sh@82 -- # nvmes=("$@") 00:08:27.068 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/basic_rw.sh@83 -- # nvme0=Nvme0 00:08:27.068 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/basic_rw.sh@83 -- # nvme0_pci=0000:00:10.0 00:08:27.068 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/basic_rw.sh@83 -- # bdev0=Nvme0n1 00:08:27.068 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/basic_rw.sh@85 -- # method_bdev_nvme_attach_controller_0=(['name']='Nvme0' ['traddr']='0000:00:10.0' ['trtype']='pcie') 00:08:27.068 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/basic_rw.sh@85 -- # declare -A method_bdev_nvme_attach_controller_0 00:08:27.068 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/basic_rw.sh@91 -- # test_file0=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:08:27.068 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/basic_rw.sh@92 -- # test_file1=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:27.068 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/basic_rw.sh@93 -- # get_native_nvme_bs 0000:00:10.0 00:08:27.068 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/common.sh@124 -- # local pci=0000:00:10.0 lbaf id 00:08:27.068 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/common.sh@126 -- # mapfile -t id 00:08:27.068 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/common.sh@126 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_identify -r 'trtype:pcie traddr:0000:00:10.0' 00:08:27.068 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/common.sh@129 -- # [[ ===================================================== NVMe Controller at 0000:00:10.0 [1b36:0010] ===================================================== Controller Capabilities/Features ================================ Vendor ID: 1b36 Subsystem Vendor ID: 1af4 Serial Number: 12340 Model Number: QEMU NVMe Ctrl Firmware Version: 8.0.0 Recommended Arb Burst: 6 IEEE OUI Identifier: 00 54 52 Multi-path I/O May have multiple subsystem ports: No May have multiple controllers: No Associated with SR-IOV VF: No Max Data Transfer Size: 524288 Max Number of Namespaces: 256 Max Number of I/O Queues: 64 NVMe Specification Version (VS): 1.4 NVMe Specification Version (Identify): 1.4 Maximum Queue Entries: 2048 Contiguous Queues Required: Yes Arbitration Mechanisms Supported Weighted Round Robin: Not Supported Vendor Specific: Not Supported Reset Timeout: 7500 ms Doorbell Stride: 4 bytes NVM Subsystem Reset: Not Supported Command Sets Supported NVM Command Set: Supported Boot Partition: Not Supported Memory Page Size Minimum: 4096 bytes Memory Page Size Maximum: 65536 bytes Persistent Memory Region: Not Supported Optional Asynchronous Events Supported Namespace Attribute Notices: Supported Firmware Activation Notices: Not Supported ANA Change Notices: Not Supported PLE Aggregate Log Change Notices: Not Supported LBA Status Info Alert Notices: Not Supported EGE Aggregate Log Change Notices: Not Supported Normal NVM Subsystem Shutdown event: Not Supported Zone Descriptor Change Notices: Not Supported Discovery Log Change Notices: Not Supported Controller Attributes 128-bit Host Identifier: Not Supported Non-Operational Permissive Mode: Not Supported NVM Sets: Not Supported Read Recovery Levels: Not Supported Endurance Groups: Not Supported Predictable Latency Mode: Not Supported Traffic Based Keep ALive: Not Supported Namespace Granularity: Not Supported SQ Associations: Not Supported UUID List: Not Supported Multi-Domain Subsystem: Not Supported Fixed Capacity Management: Not Supported Variable Capacity Management: Not Supported Delete Endurance Group: Not Supported Delete NVM Set: Not Supported Extended LBA Formats Supported: Supported Flexible Data Placement Supported: Not Supported Controller Memory Buffer Support ================================ Supported: No Persistent Memory Region Support ================================ Supported: No Admin Command Set Attributes ============================ Security Send/Receive: Not Supported Format NVM: Supported Firmware Activate/Download: Not Supported Namespace Management: Supported Device Self-Test: Not Supported Directives: Supported NVMe-MI: Not Supported Virtualization Management: Not Supported Doorbell Buffer Config: Supported Get LBA Status Capability: Not Supported Command & Feature Lockdown Capability: Not Supported Abort Command Limit: 4 Async Event Request Limit: 4 Number of Firmware Slots: N/A Firmware Slot 1 Read-Only: N/A Firmware Activation Without Reset: N/A Multiple Update Detection Support: N/A Firmware Update Granularity: No Information Provided Per-Namespace SMART Log: Yes Asymmetric Namespace Access Log Page: Not Supported Subsystem NQN: nqn.2019-08.org.qemu:12340 Command Effects Log Page: Supported Get Log Page Extended Data: Supported Telemetry Log Pages: Not Supported Persistent Event Log Pages: Not Supported Supported Log Pages Log Page: May Support Commands Supported & Effects Log Page: Not Supported Feature Identifiers & Effects Log Page:May Support NVMe-MI Commands & Effects Log Page: May Support Data Area 4 for Telemetry Log: Not Supported Error Log Page Entries Supported: 1 Keep Alive: Not Supported NVM Command Set Attributes ========================== Submission Queue Entry Size Max: 64 Min: 64 Completion Queue Entry Size Max: 16 Min: 16 Number of Namespaces: 256 Compare Command: Supported Write Uncorrectable Command: Not Supported Dataset Management Command: Supported Write Zeroes Command: Supported Set Features Save Field: Supported Reservations: Not Supported Timestamp: Supported Copy: Supported Volatile Write Cache: Present Atomic Write Unit (Normal): 1 Atomic Write Unit (PFail): 1 Atomic Compare & Write Unit: 1 Fused Compare & Write: Not Supported Scatter-Gather List SGL Command Set: Supported SGL Keyed: Not Supported SGL Bit Bucket Descriptor: Not Supported SGL Metadata Pointer: Not Supported Oversized SGL: Not Supported SGL Metadata Address: Not Supported SGL Offset: Not Supported Transport SGL Data Block: Not Supported Replay Protected Memory Block: Not Supported Firmware Slot Information ========================= Active slot: 1 Slot 1 Firmware Revision: 1.0 Commands Supported and Effects ============================== Admin Commands -------------- Delete I/O Submission Queue (00h): Supported Create I/O Submission Queue (01h): Supported Get Log Page (02h): Supported Delete I/O Completion Queue (04h): Supported Create I/O Completion Queue (05h): Supported Identify (06h): Supported Abort (08h): Supported Set Features (09h): Supported Get Features (0Ah): Supported Asynchronous Event Request (0Ch): Supported Namespace Attachment (15h): Supported NS-Inventory-Change Directive Send (19h): Supported Directive Receive (1Ah): Supported Virtualization Management (1Ch): Supported Doorbell Buffer Config (7Ch): Supported Format NVM (80h): Supported LBA-Change I/O Commands ------------ Flush (00h): Supported LBA-Change Write (01h): Supported LBA-Change Read (02h): Supported Compare (05h): Supported Write Zeroes (08h): Supported LBA-Change Dataset Management (09h): Supported LBA-Change Unknown (0Ch): Supported Unknown (12h): Supported Copy (19h): Supported LBA-Change Unknown (1Dh): Supported LBA-Change Error Log ========= Arbitration =========== Arbitration Burst: no limit Power Management ================ Number of Power States: 1 Current Power State: Power State #0 Power State #0: Max Power: 25.00 W Non-Operational State: Operational Entry Latency: 16 microseconds Exit Latency: 4 microseconds Relative Read Throughput: 0 Relative Read Latency: 0 Relative Write Throughput: 0 Relative Write Latency: 0 Idle Power: Not Reported Active Power: Not Reported Non-Operational Permissive Mode: Not Supported Health Information ================== Critical Warnings: Available Spare Space: OK Temperature: OK Device Reliability: OK Read Only: No Volatile Memory Backup: OK Current Temperature: 323 Kelvin (50 Celsius) Temperature Threshold: 343 Kelvin (70 Celsius) Available Spare: 0% Available Spare Threshold: 0% Life Percentage Used: 0% Data Units Read: 22 Data Units Written: 3 Host Read Commands: 496 Host Write Commands: 2 Controller Busy Time: 0 minutes Power Cycles: 0 Power On Hours: 0 hours Unsafe Shutdowns: 0 Unrecoverable Media Errors: 0 Lifetime Error Log Entries: 0 Warning Temperature Time: 0 minutes Critical Temperature Time: 0 minutes Number of Queues ================ Number of I/O Submission Queues: 64 Number of I/O Completion Queues: 64 ZNS Specific Controller Data ============================ Zone Append Size Limit: 0 Active Namespaces ================= Namespace ID:1 Error Recovery Timeout: Unlimited Command Set Identifier: NVM (00h) Deallocate: Supported Deallocated/Unwritten Error: Supported Deallocated Read Value: All 0x00 Deallocate in Write Zeroes: Not Supported Deallocated Guard Field: 0xFFFF Flush: Supported Reservation: Not Supported Namespace Sharing Capabilities: Private Size (in LBAs): 1310720 (5GiB) Capacity (in LBAs): 1310720 (5GiB) Utilization (in LBAs): 1310720 (5GiB) Thin Provisioning: Not Supported Per-NS Atomic Units: No Maximum Single Source Range Length: 128 Maximum Copy Length: 128 Maximum Source Range Count: 128 NGUID/EUI64 Never Reused: No Namespace Write Protected: No Number of LBA Formats: 8 Current LBA Format: LBA Format #04 LBA Format #00: Data Size: 512 Metadata Size: 0 LBA Format #01: Data Size: 512 Metadata Size: 8 LBA Format #02: Data Size: 512 Metadata Size: 16 LBA Format #03: Data Size: 512 Metadata Size: 64 LBA Format #04: Data Size: 4096 Metadata Size: 0 LBA Format #05: Data Size: 4096 Metadata Size: 8 LBA Format #06: Data Size: 4096 Metadata Size: 16 LBA Format #07: Data Size: 4096 Metadata Size: 64 NVM Specific Namespace Data =========================== Logical Block Storage Tag Mask: 0 Protection Information Capabilities: 16b Guard Protection Information Storage Tag Support: No 16b Guard Protection Information Storage Tag Mask: Any bit in LBSTM can be 0 Storage Tag Check Read Support: No Extended LBA Format #00: Storage Tag Size: 0 , Protection Information Format: 16b Guard PI Extended LBA Format #01: Storage Tag Size: 0 , Protection Information Format: 16b Guard PI Extended LBA Format #02: Storage Tag Size: 0 , Protection Information Format: 16b Guard PI Extended LBA Format #03: Storage Tag Size: 0 , Protection Information Format: 16b Guard PI Extended LBA Format #04: Storage Tag Size: 0 , Protection Information Format: 16b Guard PI Extended LBA Format #05: Storage Tag Size: 0 , Protection Information Format: 16b Guard PI Extended LBA Format #06: Storage Tag Size: 0 , Protection Information Format: 16b Guard PI Extended LBA Format #07: Storage Tag Size: 0 , Protection Information Format: 16b Guard PI =~ Current LBA Format: *LBA Format #([0-9]+) ]] 00:08:27.068 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/common.sh@130 -- # lbaf=04 00:08:27.069 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/common.sh@131 -- # [[ ===================================================== NVMe Controller at 0000:00:10.0 [1b36:0010] ===================================================== Controller Capabilities/Features ================================ Vendor ID: 1b36 Subsystem Vendor ID: 1af4 Serial Number: 12340 Model Number: QEMU NVMe Ctrl Firmware Version: 8.0.0 Recommended Arb Burst: 6 IEEE OUI Identifier: 00 54 52 Multi-path I/O May have multiple subsystem ports: No May have multiple controllers: No Associated with SR-IOV VF: No Max Data Transfer Size: 524288 Max Number of Namespaces: 256 Max Number of I/O Queues: 64 NVMe Specification Version (VS): 1.4 NVMe Specification Version (Identify): 1.4 Maximum Queue Entries: 2048 Contiguous Queues Required: Yes Arbitration Mechanisms Supported Weighted Round Robin: Not Supported Vendor Specific: Not Supported Reset Timeout: 7500 ms Doorbell Stride: 4 bytes NVM Subsystem Reset: Not Supported Command Sets Supported NVM Command Set: Supported Boot Partition: Not Supported Memory Page Size Minimum: 4096 bytes Memory Page Size Maximum: 65536 bytes Persistent Memory Region: Not Supported Optional Asynchronous Events Supported Namespace Attribute Notices: Supported Firmware Activation Notices: Not Supported ANA Change Notices: Not Supported PLE Aggregate Log Change Notices: Not Supported LBA Status Info Alert Notices: Not Supported EGE Aggregate Log Change Notices: Not Supported Normal NVM Subsystem Shutdown event: Not Supported Zone Descriptor Change Notices: Not Supported Discovery Log Change Notices: Not Supported Controller Attributes 128-bit Host Identifier: Not Supported Non-Operational Permissive Mode: Not Supported NVM Sets: Not Supported Read Recovery Levels: Not Supported Endurance Groups: Not Supported Predictable Latency Mode: Not Supported Traffic Based Keep ALive: Not Supported Namespace Granularity: Not Supported SQ Associations: Not Supported UUID List: Not Supported Multi-Domain Subsystem: Not Supported Fixed Capacity Management: Not Supported Variable Capacity Management: Not Supported Delete Endurance Group: Not Supported Delete NVM Set: Not Supported Extended LBA Formats Supported: Supported Flexible Data Placement Supported: Not Supported Controller Memory Buffer Support ================================ Supported: No Persistent Memory Region Support ================================ Supported: No Admin Command Set Attributes ============================ Security Send/Receive: Not Supported Format NVM: Supported Firmware Activate/Download: Not Supported Namespace Management: Supported Device Self-Test: Not Supported Directives: Supported NVMe-MI: Not Supported Virtualization Management: Not Supported Doorbell Buffer Config: Supported Get LBA Status Capability: Not Supported Command & Feature Lockdown Capability: Not Supported Abort Command Limit: 4 Async Event Request Limit: 4 Number of Firmware Slots: N/A Firmware Slot 1 Read-Only: N/A Firmware Activation Without Reset: N/A Multiple Update Detection Support: N/A Firmware Update Granularity: No Information Provided Per-Namespace SMART Log: Yes Asymmetric Namespace Access Log Page: Not Supported Subsystem NQN: nqn.2019-08.org.qemu:12340 Command Effects Log Page: Supported Get Log Page Extended Data: Supported Telemetry Log Pages: Not Supported Persistent Event Log Pages: Not Supported Supported Log Pages Log Page: May Support Commands Supported & Effects Log Page: Not Supported Feature Identifiers & Effects Log Page:May Support NVMe-MI Commands & Effects Log Page: May Support Data Area 4 for Telemetry Log: Not Supported Error Log Page Entries Supported: 1 Keep Alive: Not Supported NVM Command Set Attributes ========================== Submission Queue Entry Size Max: 64 Min: 64 Completion Queue Entry Size Max: 16 Min: 16 Number of Namespaces: 256 Compare Command: Supported Write Uncorrectable Command: Not Supported Dataset Management Command: Supported Write Zeroes Command: Supported Set Features Save Field: Supported Reservations: Not Supported Timestamp: Supported Copy: Supported Volatile Write Cache: Present Atomic Write Unit (Normal): 1 Atomic Write Unit (PFail): 1 Atomic Compare & Write Unit: 1 Fused Compare & Write: Not Supported Scatter-Gather List SGL Command Set: Supported SGL Keyed: Not Supported SGL Bit Bucket Descriptor: Not Supported SGL Metadata Pointer: Not Supported Oversized SGL: Not Supported SGL Metadata Address: Not Supported SGL Offset: Not Supported Transport SGL Data Block: Not Supported Replay Protected Memory Block: Not Supported Firmware Slot Information ========================= Active slot: 1 Slot 1 Firmware Revision: 1.0 Commands Supported and Effects ============================== Admin Commands -------------- Delete I/O Submission Queue (00h): Supported Create I/O Submission Queue (01h): Supported Get Log Page (02h): Supported Delete I/O Completion Queue (04h): Supported Create I/O Completion Queue (05h): Supported Identify (06h): Supported Abort (08h): Supported Set Features (09h): Supported Get Features (0Ah): Supported Asynchronous Event Request (0Ch): Supported Namespace Attachment (15h): Supported NS-Inventory-Change Directive Send (19h): Supported Directive Receive (1Ah): Supported Virtualization Management (1Ch): Supported Doorbell Buffer Config (7Ch): Supported Format NVM (80h): Supported LBA-Change I/O Commands ------------ Flush (00h): Supported LBA-Change Write (01h): Supported LBA-Change Read (02h): Supported Compare (05h): Supported Write Zeroes (08h): Supported LBA-Change Dataset Management (09h): Supported LBA-Change Unknown (0Ch): Supported Unknown (12h): Supported Copy (19h): Supported LBA-Change Unknown (1Dh): Supported LBA-Change Error Log ========= Arbitration =========== Arbitration Burst: no limit Power Management ================ Number of Power States: 1 Current Power State: Power State #0 Power State #0: Max Power: 25.00 W Non-Operational State: Operational Entry Latency: 16 microseconds Exit Latency: 4 microseconds Relative Read Throughput: 0 Relative Read Latency: 0 Relative Write Throughput: 0 Relative Write Latency: 0 Idle Power: Not Reported Active Power: Not Reported Non-Operational Permissive Mode: Not Supported Health Information ================== Critical Warnings: Available Spare Space: OK Temperature: OK Device Reliability: OK Read Only: No Volatile Memory Backup: OK Current Temperature: 323 Kelvin (50 Celsius) Temperature Threshold: 343 Kelvin (70 Celsius) Available Spare: 0% Available Spare Threshold: 0% Life Percentage Used: 0% Data Units Read: 22 Data Units Written: 3 Host Read Commands: 496 Host Write Commands: 2 Controller Busy Time: 0 minutes Power Cycles: 0 Power On Hours: 0 hours Unsafe Shutdowns: 0 Unrecoverable Media Errors: 0 Lifetime Error Log Entries: 0 Warning Temperature Time: 0 minutes Critical Temperature Time: 0 minutes Number of Queues ================ Number of I/O Submission Queues: 64 Number of I/O Completion Queues: 64 ZNS Specific Controller Data ============================ Zone Append Size Limit: 0 Active Namespaces ================= Namespace ID:1 Error Recovery Timeout: Unlimited Command Set Identifier: NVM (00h) Deallocate: Supported Deallocated/Unwritten Error: Supported Deallocated Read Value: All 0x00 Deallocate in Write Zeroes: Not Supported Deallocated Guard Field: 0xFFFF Flush: Supported Reservation: Not Supported Namespace Sharing Capabilities: Private Size (in LBAs): 1310720 (5GiB) Capacity (in LBAs): 1310720 (5GiB) Utilization (in LBAs): 1310720 (5GiB) Thin Provisioning: Not Supported Per-NS Atomic Units: No Maximum Single Source Range Length: 128 Maximum Copy Length: 128 Maximum Source Range Count: 128 NGUID/EUI64 Never Reused: No Namespace Write Protected: No Number of LBA Formats: 8 Current LBA Format: LBA Format #04 LBA Format #00: Data Size: 512 Metadata Size: 0 LBA Format #01: Data Size: 512 Metadata Size: 8 LBA Format #02: Data Size: 512 Metadata Size: 16 LBA Format #03: Data Size: 512 Metadata Size: 64 LBA Format #04: Data Size: 4096 Metadata Size: 0 LBA Format #05: Data Size: 4096 Metadata Size: 8 LBA Format #06: Data Size: 4096 Metadata Size: 16 LBA Format #07: Data Size: 4096 Metadata Size: 64 NVM Specific Namespace Data =========================== Logical Block Storage Tag Mask: 0 Protection Information Capabilities: 16b Guard Protection Information Storage Tag Support: No 16b Guard Protection Information Storage Tag Mask: Any bit in LBSTM can be 0 Storage Tag Check Read Support: No Extended LBA Format #00: Storage Tag Size: 0 , Protection Information Format: 16b Guard PI Extended LBA Format #01: Storage Tag Size: 0 , Protection Information Format: 16b Guard PI Extended LBA Format #02: Storage Tag Size: 0 , Protection Information Format: 16b Guard PI Extended LBA Format #03: Storage Tag Size: 0 , Protection Information Format: 16b Guard PI Extended LBA Format #04: Storage Tag Size: 0 , Protection Information Format: 16b Guard PI Extended LBA Format #05: Storage Tag Size: 0 , Protection Information Format: 16b Guard PI Extended LBA Format #06: Storage Tag Size: 0 , Protection Information Format: 16b Guard PI Extended LBA Format #07: Storage Tag Size: 0 , Protection Information Format: 16b Guard PI =~ LBA Format #04: Data Size: *([0-9]+) ]] 00:08:27.069 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/common.sh@132 -- # lbaf=4096 00:08:27.069 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/common.sh@134 -- # echo 4096 00:08:27.069 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/basic_rw.sh@93 -- # native_bs=4096 00:08:27.069 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/basic_rw.sh@96 -- # run_test dd_bs_lt_native_bs NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/dev/fd/62 --ob=Nvme0n1 --bs=2048 --json /dev/fd/61 00:08:27.069 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/basic_rw.sh@96 -- # gen_conf 00:08:27.069 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/basic_rw.sh@96 -- # : 00:08:27.069 11:19:08 spdk_dd.spdk_dd_basic_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:27.069 11:19:08 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@1101 -- # '[' 8 -le 1 ']' 00:08:27.069 11:19:08 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@10 -- # set +x 00:08:27.069 11:19:08 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:27.069 11:19:08 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@10 -- # set +x 00:08:27.328 ************************************ 00:08:27.328 START TEST dd_bs_lt_native_bs 00:08:27.328 ************************************ 00:08:27.328 11:19:08 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@1125 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/dev/fd/62 --ob=Nvme0n1 --bs=2048 --json /dev/fd/61 00:08:27.328 11:19:08 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@650 -- # local es=0 00:08:27.328 11:19:08 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/dev/fd/62 --ob=Nvme0n1 --bs=2048 --json /dev/fd/61 00:08:27.328 11:19:08 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:27.328 11:19:08 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:27.328 11:19:08 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:27.328 11:19:08 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:27.328 11:19:08 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:27.328 11:19:08 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:27.328 11:19:08 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:27.328 11:19:08 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:08:27.328 11:19:08 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/dev/fd/62 --ob=Nvme0n1 --bs=2048 --json /dev/fd/61 00:08:27.328 { 00:08:27.328 "subsystems": [ 00:08:27.328 { 00:08:27.328 "subsystem": "bdev", 00:08:27.328 "config": [ 00:08:27.328 { 00:08:27.328 "params": { 00:08:27.328 "trtype": "pcie", 00:08:27.328 "traddr": "0000:00:10.0", 00:08:27.328 "name": "Nvme0" 00:08:27.328 }, 00:08:27.328 "method": "bdev_nvme_attach_controller" 00:08:27.328 }, 00:08:27.328 { 00:08:27.328 "method": "bdev_wait_for_examine" 00:08:27.328 } 00:08:27.328 ] 00:08:27.328 } 00:08:27.328 ] 00:08:27.328 } 00:08:27.328 [2024-10-07 11:19:08.846359] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:27.328 [2024-10-07 11:19:08.846490] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59836 ] 00:08:27.328 [2024-10-07 11:19:08.987215] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:27.586 [2024-10-07 11:19:09.058721] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:27.586 [2024-10-07 11:19:09.092887] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:27.586 [2024-10-07 11:19:09.192192] spdk_dd.c:1161:dd_run: *ERROR*: --bs value cannot be less than input (1) neither output (4096) native block size 00:08:27.586 [2024-10-07 11:19:09.192254] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:08:27.586 [2024-10-07 11:19:09.272815] spdk_dd.c:1536:main: *ERROR*: Error occurred while performing copy 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@653 -- # es=234 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@662 -- # es=106 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@663 -- # case "$es" in 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@670 -- # es=1 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:27.845 00:08:27.845 real 0m0.581s 00:08:27.845 user 0m0.408s 00:08:27.845 sys 0m0.126s 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:27.845 ************************************ 00:08:27.845 END TEST dd_bs_lt_native_bs 00:08:27.845 ************************************ 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_bs_lt_native_bs -- common/autotest_common.sh@10 -- # set +x 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw -- dd/basic_rw.sh@103 -- # run_test dd_rw basic_rw 4096 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@10 -- # set +x 00:08:27.845 ************************************ 00:08:27.845 START TEST dd_rw 00:08:27.845 ************************************ 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@1125 -- # basic_rw 4096 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@11 -- # local native_bs=4096 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@12 -- # local count size 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@13 -- # local qds bss 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@15 -- # qds=(1 64) 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@17 -- # for bs in {0..2} 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@18 -- # bss+=($((native_bs << bs))) 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@17 -- # for bs in {0..2} 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@18 -- # bss+=($((native_bs << bs))) 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@17 -- # for bs in {0..2} 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@18 -- # bss+=($((native_bs << bs))) 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@21 -- # for bs in "${bss[@]}" 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@22 -- # for qd in "${qds[@]}" 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@23 -- # count=15 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@24 -- # count=15 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@25 -- # size=61440 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@27 -- # gen_bytes 61440 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@98 -- # xtrace_disable 00:08:27.845 11:19:09 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:28.776 11:19:10 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@30 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --ob=Nvme0n1 --bs=4096 --qd=1 --json /dev/fd/62 00:08:28.776 11:19:10 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@30 -- # gen_conf 00:08:28.776 11:19:10 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:28.776 11:19:10 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:28.776 { 00:08:28.776 "subsystems": [ 00:08:28.776 { 00:08:28.776 "subsystem": "bdev", 00:08:28.776 "config": [ 00:08:28.776 { 00:08:28.776 "params": { 00:08:28.776 "trtype": "pcie", 00:08:28.776 "traddr": "0000:00:10.0", 00:08:28.776 "name": "Nvme0" 00:08:28.776 }, 00:08:28.776 "method": "bdev_nvme_attach_controller" 00:08:28.776 }, 00:08:28.776 { 00:08:28.776 "method": "bdev_wait_for_examine" 00:08:28.776 } 00:08:28.776 ] 00:08:28.776 } 00:08:28.776 ] 00:08:28.776 } 00:08:28.776 [2024-10-07 11:19:10.191976] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:28.776 [2024-10-07 11:19:10.192098] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59867 ] 00:08:28.776 [2024-10-07 11:19:10.326955] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:28.776 [2024-10-07 11:19:10.397087] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:28.776 [2024-10-07 11:19:10.431067] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:29.034  [2024-10-07T11:19:10.745Z] Copying: 60/60 [kB] (average 29 MBps) 00:08:29.034 00:08:29.034 11:19:10 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@37 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=Nvme0n1 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --bs=4096 --qd=1 --count=15 --json /dev/fd/62 00:08:29.034 11:19:10 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@37 -- # gen_conf 00:08:29.034 11:19:10 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:29.034 11:19:10 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:29.294 { 00:08:29.294 "subsystems": [ 00:08:29.294 { 00:08:29.294 "subsystem": "bdev", 00:08:29.294 "config": [ 00:08:29.294 { 00:08:29.294 "params": { 00:08:29.294 "trtype": "pcie", 00:08:29.294 "traddr": "0000:00:10.0", 00:08:29.294 "name": "Nvme0" 00:08:29.294 }, 00:08:29.294 "method": "bdev_nvme_attach_controller" 00:08:29.294 }, 00:08:29.294 { 00:08:29.294 "method": "bdev_wait_for_examine" 00:08:29.294 } 00:08:29.294 ] 00:08:29.294 } 00:08:29.294 ] 00:08:29.294 } 00:08:29.294 [2024-10-07 11:19:10.759314] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:29.294 [2024-10-07 11:19:10.759440] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59882 ] 00:08:29.294 [2024-10-07 11:19:10.900671] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:29.294 [2024-10-07 11:19:10.970865] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:29.294 [2024-10-07 11:19:11.004551] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:29.552  [2024-10-07T11:19:11.263Z] Copying: 60/60 [kB] (average 19 MBps) 00:08:29.552 00:08:29.552 11:19:11 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@44 -- # diff -q /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:29.811 11:19:11 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@45 -- # clear_nvme Nvme0n1 '' 61440 00:08:29.811 11:19:11 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@10 -- # local bdev=Nvme0n1 00:08:29.811 11:19:11 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@11 -- # local nvme_ref= 00:08:29.811 11:19:11 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@12 -- # local size=61440 00:08:29.811 11:19:11 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@14 -- # local bs=1048576 00:08:29.811 11:19:11 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@15 -- # local count=1 00:08:29.811 11:19:11 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@18 -- # gen_conf 00:08:29.811 11:19:11 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@18 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/dev/zero --bs=1048576 --ob=Nvme0n1 --count=1 --json /dev/fd/62 00:08:29.811 11:19:11 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:29.811 11:19:11 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:29.811 [2024-10-07 11:19:11.319891] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:29.811 [2024-10-07 11:19:11.319997] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59898 ] 00:08:29.811 { 00:08:29.811 "subsystems": [ 00:08:29.811 { 00:08:29.811 "subsystem": "bdev", 00:08:29.811 "config": [ 00:08:29.811 { 00:08:29.811 "params": { 00:08:29.811 "trtype": "pcie", 00:08:29.811 "traddr": "0000:00:10.0", 00:08:29.811 "name": "Nvme0" 00:08:29.811 }, 00:08:29.811 "method": "bdev_nvme_attach_controller" 00:08:29.811 }, 00:08:29.811 { 00:08:29.811 "method": "bdev_wait_for_examine" 00:08:29.811 } 00:08:29.811 ] 00:08:29.811 } 00:08:29.811 ] 00:08:29.811 } 00:08:29.811 [2024-10-07 11:19:11.459563] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:29.811 [2024-10-07 11:19:11.514801] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:30.069 [2024-10-07 11:19:11.544184] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:30.069  [2024-10-07T11:19:12.039Z] Copying: 1024/1024 [kB] (average 1000 MBps) 00:08:30.328 00:08:30.328 11:19:11 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@22 -- # for qd in "${qds[@]}" 00:08:30.328 11:19:11 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@23 -- # count=15 00:08:30.328 11:19:11 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@24 -- # count=15 00:08:30.328 11:19:11 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@25 -- # size=61440 00:08:30.328 11:19:11 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@27 -- # gen_bytes 61440 00:08:30.328 11:19:11 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@98 -- # xtrace_disable 00:08:30.328 11:19:11 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:30.917 11:19:12 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@30 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --ob=Nvme0n1 --bs=4096 --qd=64 --json /dev/fd/62 00:08:30.917 11:19:12 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@30 -- # gen_conf 00:08:30.917 11:19:12 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:30.917 11:19:12 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:30.917 { 00:08:30.917 "subsystems": [ 00:08:30.917 { 00:08:30.917 "subsystem": "bdev", 00:08:30.917 "config": [ 00:08:30.917 { 00:08:30.917 "params": { 00:08:30.917 "trtype": "pcie", 00:08:30.917 "traddr": "0000:00:10.0", 00:08:30.917 "name": "Nvme0" 00:08:30.917 }, 00:08:30.917 "method": "bdev_nvme_attach_controller" 00:08:30.917 }, 00:08:30.917 { 00:08:30.917 "method": "bdev_wait_for_examine" 00:08:30.917 } 00:08:30.917 ] 00:08:30.917 } 00:08:30.917 ] 00:08:30.917 } 00:08:30.917 [2024-10-07 11:19:12.546941] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:30.917 [2024-10-07 11:19:12.547040] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59922 ] 00:08:31.174 [2024-10-07 11:19:12.685321] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:31.174 [2024-10-07 11:19:12.755624] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:31.174 [2024-10-07 11:19:12.788769] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:31.174  [2024-10-07T11:19:13.143Z] Copying: 60/60 [kB] (average 58 MBps) 00:08:31.432 00:08:31.432 11:19:13 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@37 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=Nvme0n1 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --bs=4096 --qd=64 --count=15 --json /dev/fd/62 00:08:31.432 11:19:13 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@37 -- # gen_conf 00:08:31.432 11:19:13 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:31.432 11:19:13 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:31.432 { 00:08:31.432 "subsystems": [ 00:08:31.432 { 00:08:31.432 "subsystem": "bdev", 00:08:31.432 "config": [ 00:08:31.432 { 00:08:31.432 "params": { 00:08:31.432 "trtype": "pcie", 00:08:31.432 "traddr": "0000:00:10.0", 00:08:31.432 "name": "Nvme0" 00:08:31.432 }, 00:08:31.432 "method": "bdev_nvme_attach_controller" 00:08:31.432 }, 00:08:31.432 { 00:08:31.432 "method": "bdev_wait_for_examine" 00:08:31.432 } 00:08:31.432 ] 00:08:31.432 } 00:08:31.432 ] 00:08:31.432 } 00:08:31.432 [2024-10-07 11:19:13.103369] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:31.432 [2024-10-07 11:19:13.103490] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59936 ] 00:08:31.690 [2024-10-07 11:19:13.238549] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:31.690 [2024-10-07 11:19:13.299699] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:31.690 [2024-10-07 11:19:13.330332] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:31.947  [2024-10-07T11:19:13.658Z] Copying: 60/60 [kB] (average 58 MBps) 00:08:31.947 00:08:31.947 11:19:13 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@44 -- # diff -q /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:31.947 11:19:13 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@45 -- # clear_nvme Nvme0n1 '' 61440 00:08:31.947 11:19:13 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@10 -- # local bdev=Nvme0n1 00:08:31.947 11:19:13 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@11 -- # local nvme_ref= 00:08:31.947 11:19:13 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@12 -- # local size=61440 00:08:31.947 11:19:13 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@14 -- # local bs=1048576 00:08:31.947 11:19:13 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@15 -- # local count=1 00:08:31.947 11:19:13 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@18 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/dev/zero --bs=1048576 --ob=Nvme0n1 --count=1 --json /dev/fd/62 00:08:31.947 11:19:13 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@18 -- # gen_conf 00:08:31.947 11:19:13 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:31.947 11:19:13 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:31.947 { 00:08:31.947 "subsystems": [ 00:08:31.947 { 00:08:31.947 "subsystem": "bdev", 00:08:31.947 "config": [ 00:08:31.947 { 00:08:31.947 "params": { 00:08:31.947 "trtype": "pcie", 00:08:31.947 "traddr": "0000:00:10.0", 00:08:31.947 "name": "Nvme0" 00:08:31.947 }, 00:08:31.947 "method": "bdev_nvme_attach_controller" 00:08:31.947 }, 00:08:31.947 { 00:08:31.947 "method": "bdev_wait_for_examine" 00:08:31.947 } 00:08:31.947 ] 00:08:31.947 } 00:08:31.947 ] 00:08:31.947 } 00:08:31.947 [2024-10-07 11:19:13.643506] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:31.947 [2024-10-07 11:19:13.643610] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59951 ] 00:08:32.205 [2024-10-07 11:19:13.780689] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:32.205 [2024-10-07 11:19:13.843218] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:32.205 [2024-10-07 11:19:13.874823] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:32.463  [2024-10-07T11:19:14.174Z] Copying: 1024/1024 [kB] (average 1000 MBps) 00:08:32.463 00:08:32.463 11:19:14 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@21 -- # for bs in "${bss[@]}" 00:08:32.463 11:19:14 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@22 -- # for qd in "${qds[@]}" 00:08:32.463 11:19:14 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@23 -- # count=7 00:08:32.463 11:19:14 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@24 -- # count=7 00:08:32.463 11:19:14 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@25 -- # size=57344 00:08:32.463 11:19:14 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@27 -- # gen_bytes 57344 00:08:32.463 11:19:14 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@98 -- # xtrace_disable 00:08:32.463 11:19:14 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:33.398 11:19:14 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@30 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --ob=Nvme0n1 --bs=8192 --qd=1 --json /dev/fd/62 00:08:33.398 11:19:14 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@30 -- # gen_conf 00:08:33.398 11:19:14 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:33.398 11:19:14 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:33.398 [2024-10-07 11:19:14.926984] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:33.398 [2024-10-07 11:19:14.927084] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59976 ] 00:08:33.398 { 00:08:33.398 "subsystems": [ 00:08:33.398 { 00:08:33.398 "subsystem": "bdev", 00:08:33.398 "config": [ 00:08:33.398 { 00:08:33.398 "params": { 00:08:33.398 "trtype": "pcie", 00:08:33.398 "traddr": "0000:00:10.0", 00:08:33.398 "name": "Nvme0" 00:08:33.398 }, 00:08:33.398 "method": "bdev_nvme_attach_controller" 00:08:33.398 }, 00:08:33.398 { 00:08:33.398 "method": "bdev_wait_for_examine" 00:08:33.398 } 00:08:33.398 ] 00:08:33.398 } 00:08:33.398 ] 00:08:33.398 } 00:08:33.398 [2024-10-07 11:19:15.060890] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:33.656 [2024-10-07 11:19:15.122521] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:33.656 [2024-10-07 11:19:15.154382] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:33.656  [2024-10-07T11:19:15.625Z] Copying: 56/56 [kB] (average 54 MBps) 00:08:33.914 00:08:33.914 11:19:15 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@37 -- # gen_conf 00:08:33.914 11:19:15 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@37 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=Nvme0n1 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --bs=8192 --qd=1 --count=7 --json /dev/fd/62 00:08:33.914 11:19:15 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:33.914 11:19:15 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:33.914 [2024-10-07 11:19:15.462447] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:33.914 [2024-10-07 11:19:15.462559] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59984 ] 00:08:33.914 { 00:08:33.914 "subsystems": [ 00:08:33.914 { 00:08:33.914 "subsystem": "bdev", 00:08:33.914 "config": [ 00:08:33.914 { 00:08:33.914 "params": { 00:08:33.914 "trtype": "pcie", 00:08:33.914 "traddr": "0000:00:10.0", 00:08:33.914 "name": "Nvme0" 00:08:33.914 }, 00:08:33.914 "method": "bdev_nvme_attach_controller" 00:08:33.914 }, 00:08:33.914 { 00:08:33.914 "method": "bdev_wait_for_examine" 00:08:33.914 } 00:08:33.914 ] 00:08:33.914 } 00:08:33.914 ] 00:08:33.914 } 00:08:33.914 [2024-10-07 11:19:15.594881] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:34.173 [2024-10-07 11:19:15.660992] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:34.173 [2024-10-07 11:19:15.694515] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:34.173  [2024-10-07T11:19:16.142Z] Copying: 56/56 [kB] (average 27 MBps) 00:08:34.431 00:08:34.431 11:19:15 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@44 -- # diff -q /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:34.431 11:19:15 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@45 -- # clear_nvme Nvme0n1 '' 57344 00:08:34.431 11:19:15 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@10 -- # local bdev=Nvme0n1 00:08:34.431 11:19:15 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@11 -- # local nvme_ref= 00:08:34.431 11:19:15 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@12 -- # local size=57344 00:08:34.431 11:19:15 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@14 -- # local bs=1048576 00:08:34.431 11:19:15 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@15 -- # local count=1 00:08:34.431 11:19:15 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@18 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/dev/zero --bs=1048576 --ob=Nvme0n1 --count=1 --json /dev/fd/62 00:08:34.431 11:19:15 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@18 -- # gen_conf 00:08:34.431 11:19:15 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:34.431 11:19:15 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:34.431 { 00:08:34.431 "subsystems": [ 00:08:34.431 { 00:08:34.431 "subsystem": "bdev", 00:08:34.431 "config": [ 00:08:34.431 { 00:08:34.431 "params": { 00:08:34.431 "trtype": "pcie", 00:08:34.431 "traddr": "0000:00:10.0", 00:08:34.431 "name": "Nvme0" 00:08:34.431 }, 00:08:34.431 "method": "bdev_nvme_attach_controller" 00:08:34.431 }, 00:08:34.431 { 00:08:34.431 "method": "bdev_wait_for_examine" 00:08:34.431 } 00:08:34.431 ] 00:08:34.431 } 00:08:34.431 ] 00:08:34.431 } 00:08:34.431 [2024-10-07 11:19:16.020372] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:34.431 [2024-10-07 11:19:16.020525] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60005 ] 00:08:34.690 [2024-10-07 11:19:16.161541] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:34.690 [2024-10-07 11:19:16.221820] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:34.690 [2024-10-07 11:19:16.252724] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:34.690  [2024-10-07T11:19:16.660Z] Copying: 1024/1024 [kB] (average 1000 MBps) 00:08:34.949 00:08:34.949 11:19:16 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@22 -- # for qd in "${qds[@]}" 00:08:34.949 11:19:16 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@23 -- # count=7 00:08:34.949 11:19:16 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@24 -- # count=7 00:08:34.949 11:19:16 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@25 -- # size=57344 00:08:34.949 11:19:16 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@27 -- # gen_bytes 57344 00:08:34.949 11:19:16 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@98 -- # xtrace_disable 00:08:34.949 11:19:16 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:35.517 11:19:17 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@30 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --ob=Nvme0n1 --bs=8192 --qd=64 --json /dev/fd/62 00:08:35.517 11:19:17 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@30 -- # gen_conf 00:08:35.517 11:19:17 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:35.517 11:19:17 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:35.808 [2024-10-07 11:19:17.242231] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:35.808 [2024-10-07 11:19:17.242344] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60024 ] 00:08:35.808 { 00:08:35.808 "subsystems": [ 00:08:35.808 { 00:08:35.808 "subsystem": "bdev", 00:08:35.808 "config": [ 00:08:35.808 { 00:08:35.808 "params": { 00:08:35.808 "trtype": "pcie", 00:08:35.808 "traddr": "0000:00:10.0", 00:08:35.808 "name": "Nvme0" 00:08:35.808 }, 00:08:35.808 "method": "bdev_nvme_attach_controller" 00:08:35.808 }, 00:08:35.808 { 00:08:35.808 "method": "bdev_wait_for_examine" 00:08:35.808 } 00:08:35.808 ] 00:08:35.808 } 00:08:35.808 ] 00:08:35.808 } 00:08:35.808 [2024-10-07 11:19:17.381464] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:35.808 [2024-10-07 11:19:17.471102] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:36.090 [2024-10-07 11:19:17.504421] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:36.090  [2024-10-07T11:19:17.801Z] Copying: 56/56 [kB] (average 54 MBps) 00:08:36.090 00:08:36.090 11:19:17 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@37 -- # gen_conf 00:08:36.090 11:19:17 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@37 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=Nvme0n1 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --bs=8192 --qd=64 --count=7 --json /dev/fd/62 00:08:36.090 11:19:17 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:36.090 11:19:17 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:36.349 [2024-10-07 11:19:17.817699] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:36.349 [2024-10-07 11:19:17.817809] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60037 ] 00:08:36.349 { 00:08:36.349 "subsystems": [ 00:08:36.349 { 00:08:36.349 "subsystem": "bdev", 00:08:36.349 "config": [ 00:08:36.349 { 00:08:36.349 "params": { 00:08:36.349 "trtype": "pcie", 00:08:36.349 "traddr": "0000:00:10.0", 00:08:36.349 "name": "Nvme0" 00:08:36.349 }, 00:08:36.349 "method": "bdev_nvme_attach_controller" 00:08:36.349 }, 00:08:36.349 { 00:08:36.349 "method": "bdev_wait_for_examine" 00:08:36.349 } 00:08:36.349 ] 00:08:36.349 } 00:08:36.349 ] 00:08:36.349 } 00:08:36.349 [2024-10-07 11:19:17.953493] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:36.349 [2024-10-07 11:19:18.017965] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:36.349 [2024-10-07 11:19:18.049348] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:36.607  [2024-10-07T11:19:18.318Z] Copying: 56/56 [kB] (average 54 MBps) 00:08:36.607 00:08:36.607 11:19:18 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@44 -- # diff -q /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:36.607 11:19:18 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@45 -- # clear_nvme Nvme0n1 '' 57344 00:08:36.607 11:19:18 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@10 -- # local bdev=Nvme0n1 00:08:36.607 11:19:18 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@11 -- # local nvme_ref= 00:08:36.866 11:19:18 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@12 -- # local size=57344 00:08:36.866 11:19:18 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@14 -- # local bs=1048576 00:08:36.866 11:19:18 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@15 -- # local count=1 00:08:36.866 11:19:18 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@18 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/dev/zero --bs=1048576 --ob=Nvme0n1 --count=1 --json /dev/fd/62 00:08:36.866 11:19:18 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@18 -- # gen_conf 00:08:36.866 11:19:18 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:36.866 11:19:18 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:36.866 { 00:08:36.866 "subsystems": [ 00:08:36.866 { 00:08:36.866 "subsystem": "bdev", 00:08:36.866 "config": [ 00:08:36.866 { 00:08:36.866 "params": { 00:08:36.866 "trtype": "pcie", 00:08:36.866 "traddr": "0000:00:10.0", 00:08:36.866 "name": "Nvme0" 00:08:36.866 }, 00:08:36.866 "method": "bdev_nvme_attach_controller" 00:08:36.866 }, 00:08:36.866 { 00:08:36.866 "method": "bdev_wait_for_examine" 00:08:36.866 } 00:08:36.866 ] 00:08:36.866 } 00:08:36.866 ] 00:08:36.866 } 00:08:36.866 [2024-10-07 11:19:18.399254] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:36.866 [2024-10-07 11:19:18.399453] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60053 ] 00:08:36.866 [2024-10-07 11:19:18.552190] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:37.123 [2024-10-07 11:19:18.644309] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:37.123 [2024-10-07 11:19:18.678787] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:37.123  [2024-10-07T11:19:19.093Z] Copying: 1024/1024 [kB] (average 1000 MBps) 00:08:37.382 00:08:37.382 11:19:18 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@21 -- # for bs in "${bss[@]}" 00:08:37.382 11:19:18 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@22 -- # for qd in "${qds[@]}" 00:08:37.382 11:19:18 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@23 -- # count=3 00:08:37.382 11:19:18 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@24 -- # count=3 00:08:37.382 11:19:18 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@25 -- # size=49152 00:08:37.382 11:19:18 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@27 -- # gen_bytes 49152 00:08:37.382 11:19:18 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@98 -- # xtrace_disable 00:08:37.382 11:19:18 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:37.948 11:19:19 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@30 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --ob=Nvme0n1 --bs=16384 --qd=1 --json /dev/fd/62 00:08:37.948 11:19:19 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@30 -- # gen_conf 00:08:37.948 11:19:19 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:37.949 11:19:19 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:37.949 { 00:08:37.949 "subsystems": [ 00:08:37.949 { 00:08:37.949 "subsystem": "bdev", 00:08:37.949 "config": [ 00:08:37.949 { 00:08:37.949 "params": { 00:08:37.949 "trtype": "pcie", 00:08:37.949 "traddr": "0000:00:10.0", 00:08:37.949 "name": "Nvme0" 00:08:37.949 }, 00:08:37.949 "method": "bdev_nvme_attach_controller" 00:08:37.949 }, 00:08:37.949 { 00:08:37.949 "method": "bdev_wait_for_examine" 00:08:37.949 } 00:08:37.949 ] 00:08:37.949 } 00:08:37.949 ] 00:08:37.949 } 00:08:37.949 [2024-10-07 11:19:19.567678] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:37.949 [2024-10-07 11:19:19.567774] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60074 ] 00:08:38.207 [2024-10-07 11:19:19.705806] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:38.207 [2024-10-07 11:19:19.777832] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:38.207 [2024-10-07 11:19:19.811450] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:38.207  [2024-10-07T11:19:20.176Z] Copying: 48/48 [kB] (average 46 MBps) 00:08:38.465 00:08:38.465 11:19:20 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@37 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=Nvme0n1 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --bs=16384 --qd=1 --count=3 --json /dev/fd/62 00:08:38.465 11:19:20 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@37 -- # gen_conf 00:08:38.465 11:19:20 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:38.465 11:19:20 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:38.465 [2024-10-07 11:19:20.124441] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:38.465 [2024-10-07 11:19:20.124536] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60093 ] 00:08:38.465 { 00:08:38.465 "subsystems": [ 00:08:38.465 { 00:08:38.465 "subsystem": "bdev", 00:08:38.465 "config": [ 00:08:38.465 { 00:08:38.465 "params": { 00:08:38.465 "trtype": "pcie", 00:08:38.465 "traddr": "0000:00:10.0", 00:08:38.465 "name": "Nvme0" 00:08:38.465 }, 00:08:38.465 "method": "bdev_nvme_attach_controller" 00:08:38.465 }, 00:08:38.465 { 00:08:38.465 "method": "bdev_wait_for_examine" 00:08:38.465 } 00:08:38.465 ] 00:08:38.465 } 00:08:38.465 ] 00:08:38.465 } 00:08:38.723 [2024-10-07 11:19:20.258627] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:38.723 [2024-10-07 11:19:20.317757] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:38.723 [2024-10-07 11:19:20.347574] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:38.989  [2024-10-07T11:19:20.700Z] Copying: 48/48 [kB] (average 46 MBps) 00:08:38.989 00:08:38.989 11:19:20 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@44 -- # diff -q /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:38.989 11:19:20 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@45 -- # clear_nvme Nvme0n1 '' 49152 00:08:38.989 11:19:20 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@10 -- # local bdev=Nvme0n1 00:08:38.989 11:19:20 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@11 -- # local nvme_ref= 00:08:38.989 11:19:20 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@12 -- # local size=49152 00:08:38.989 11:19:20 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@14 -- # local bs=1048576 00:08:38.989 11:19:20 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@15 -- # local count=1 00:08:38.989 11:19:20 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@18 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/dev/zero --bs=1048576 --ob=Nvme0n1 --count=1 --json /dev/fd/62 00:08:38.989 11:19:20 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@18 -- # gen_conf 00:08:38.989 11:19:20 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:38.989 11:19:20 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:38.989 { 00:08:38.989 "subsystems": [ 00:08:38.989 { 00:08:38.989 "subsystem": "bdev", 00:08:38.989 "config": [ 00:08:38.989 { 00:08:38.989 "params": { 00:08:38.989 "trtype": "pcie", 00:08:38.989 "traddr": "0000:00:10.0", 00:08:38.989 "name": "Nvme0" 00:08:38.989 }, 00:08:38.989 "method": "bdev_nvme_attach_controller" 00:08:38.989 }, 00:08:38.989 { 00:08:38.989 "method": "bdev_wait_for_examine" 00:08:38.989 } 00:08:38.989 ] 00:08:38.989 } 00:08:38.989 ] 00:08:38.989 } 00:08:38.989 [2024-10-07 11:19:20.661658] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:38.989 [2024-10-07 11:19:20.661803] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60103 ] 00:08:39.250 [2024-10-07 11:19:20.799656] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:39.250 [2024-10-07 11:19:20.860034] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:39.250 [2024-10-07 11:19:20.889521] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:39.571  [2024-10-07T11:19:21.282Z] Copying: 1024/1024 [kB] (average 1000 MBps) 00:08:39.571 00:08:39.571 11:19:21 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@22 -- # for qd in "${qds[@]}" 00:08:39.571 11:19:21 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@23 -- # count=3 00:08:39.571 11:19:21 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@24 -- # count=3 00:08:39.571 11:19:21 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@25 -- # size=49152 00:08:39.571 11:19:21 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@27 -- # gen_bytes 49152 00:08:39.571 11:19:21 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@98 -- # xtrace_disable 00:08:39.571 11:19:21 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:40.139 11:19:21 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@30 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --ob=Nvme0n1 --bs=16384 --qd=64 --json /dev/fd/62 00:08:40.139 11:19:21 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@30 -- # gen_conf 00:08:40.139 11:19:21 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:40.139 11:19:21 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:40.139 [2024-10-07 11:19:21.759680] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:40.139 [2024-10-07 11:19:21.759786] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60122 ] 00:08:40.139 { 00:08:40.139 "subsystems": [ 00:08:40.139 { 00:08:40.139 "subsystem": "bdev", 00:08:40.139 "config": [ 00:08:40.139 { 00:08:40.139 "params": { 00:08:40.139 "trtype": "pcie", 00:08:40.139 "traddr": "0000:00:10.0", 00:08:40.139 "name": "Nvme0" 00:08:40.139 }, 00:08:40.139 "method": "bdev_nvme_attach_controller" 00:08:40.139 }, 00:08:40.139 { 00:08:40.139 "method": "bdev_wait_for_examine" 00:08:40.139 } 00:08:40.139 ] 00:08:40.139 } 00:08:40.139 ] 00:08:40.139 } 00:08:40.397 [2024-10-07 11:19:21.898445] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:40.397 [2024-10-07 11:19:21.974302] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:40.397 [2024-10-07 11:19:22.011058] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:40.655  [2024-10-07T11:19:22.366Z] Copying: 48/48 [kB] (average 46 MBps) 00:08:40.655 00:08:40.655 11:19:22 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@37 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=Nvme0n1 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --bs=16384 --qd=64 --count=3 --json /dev/fd/62 00:08:40.655 11:19:22 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@37 -- # gen_conf 00:08:40.655 11:19:22 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:40.655 11:19:22 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:40.655 [2024-10-07 11:19:22.333206] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:40.655 [2024-10-07 11:19:22.333346] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60141 ] 00:08:40.655 { 00:08:40.655 "subsystems": [ 00:08:40.655 { 00:08:40.655 "subsystem": "bdev", 00:08:40.655 "config": [ 00:08:40.655 { 00:08:40.655 "params": { 00:08:40.655 "trtype": "pcie", 00:08:40.655 "traddr": "0000:00:10.0", 00:08:40.655 "name": "Nvme0" 00:08:40.655 }, 00:08:40.655 "method": "bdev_nvme_attach_controller" 00:08:40.655 }, 00:08:40.655 { 00:08:40.655 "method": "bdev_wait_for_examine" 00:08:40.655 } 00:08:40.655 ] 00:08:40.655 } 00:08:40.655 ] 00:08:40.655 } 00:08:40.913 [2024-10-07 11:19:22.471163] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:40.913 [2024-10-07 11:19:22.536595] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:40.913 [2024-10-07 11:19:22.572622] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:41.171  [2024-10-07T11:19:22.882Z] Copying: 48/48 [kB] (average 46 MBps) 00:08:41.171 00:08:41.171 11:19:22 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@44 -- # diff -q /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:41.171 11:19:22 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/basic_rw.sh@45 -- # clear_nvme Nvme0n1 '' 49152 00:08:41.171 11:19:22 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@10 -- # local bdev=Nvme0n1 00:08:41.171 11:19:22 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@11 -- # local nvme_ref= 00:08:41.171 11:19:22 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@12 -- # local size=49152 00:08:41.171 11:19:22 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@14 -- # local bs=1048576 00:08:41.171 11:19:22 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@15 -- # local count=1 00:08:41.171 11:19:22 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@18 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/dev/zero --bs=1048576 --ob=Nvme0n1 --count=1 --json /dev/fd/62 00:08:41.171 11:19:22 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@18 -- # gen_conf 00:08:41.171 11:19:22 spdk_dd.spdk_dd_basic_rw.dd_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:41.171 11:19:22 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:41.433 [2024-10-07 11:19:22.902563] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:41.433 [2024-10-07 11:19:22.903096] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60156 ] 00:08:41.433 { 00:08:41.433 "subsystems": [ 00:08:41.433 { 00:08:41.433 "subsystem": "bdev", 00:08:41.433 "config": [ 00:08:41.433 { 00:08:41.433 "params": { 00:08:41.433 "trtype": "pcie", 00:08:41.433 "traddr": "0000:00:10.0", 00:08:41.433 "name": "Nvme0" 00:08:41.433 }, 00:08:41.433 "method": "bdev_nvme_attach_controller" 00:08:41.433 }, 00:08:41.433 { 00:08:41.433 "method": "bdev_wait_for_examine" 00:08:41.433 } 00:08:41.433 ] 00:08:41.433 } 00:08:41.433 ] 00:08:41.433 } 00:08:41.433 [2024-10-07 11:19:23.035078] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:41.433 [2024-10-07 11:19:23.098120] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:41.433 [2024-10-07 11:19:23.130760] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:41.691  [2024-10-07T11:19:23.402Z] Copying: 1024/1024 [kB] (average 1000 MBps) 00:08:41.691 00:08:41.691 00:08:41.691 real 0m13.986s 00:08:41.691 user 0m10.737s 00:08:41.691 sys 0m3.913s 00:08:41.691 11:19:23 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:41.691 11:19:23 spdk_dd.spdk_dd_basic_rw.dd_rw -- common/autotest_common.sh@10 -- # set +x 00:08:41.691 ************************************ 00:08:41.691 END TEST dd_rw 00:08:41.691 ************************************ 00:08:41.950 11:19:23 spdk_dd.spdk_dd_basic_rw -- dd/basic_rw.sh@104 -- # run_test dd_rw_offset basic_offset 00:08:41.950 11:19:23 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:41.950 11:19:23 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:41.950 11:19:23 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@10 -- # set +x 00:08:41.950 ************************************ 00:08:41.950 START TEST dd_rw_offset 00:08:41.950 ************************************ 00:08:41.950 11:19:23 spdk_dd.spdk_dd_basic_rw.dd_rw_offset -- common/autotest_common.sh@1125 -- # basic_offset 00:08:41.950 11:19:23 spdk_dd.spdk_dd_basic_rw.dd_rw_offset -- dd/basic_rw.sh@52 -- # local count seek skip data data_check 00:08:41.950 11:19:23 spdk_dd.spdk_dd_basic_rw.dd_rw_offset -- dd/basic_rw.sh@54 -- # gen_bytes 4096 00:08:41.950 11:19:23 spdk_dd.spdk_dd_basic_rw.dd_rw_offset -- dd/common.sh@98 -- # xtrace_disable 00:08:41.950 11:19:23 spdk_dd.spdk_dd_basic_rw.dd_rw_offset -- common/autotest_common.sh@10 -- # set +x 00:08:41.950 11:19:23 spdk_dd.spdk_dd_basic_rw.dd_rw_offset -- dd/basic_rw.sh@55 -- # (( count = seek = skip = 1 )) 00:08:41.950 11:19:23 spdk_dd.spdk_dd_basic_rw.dd_rw_offset -- dd/basic_rw.sh@56 -- # data=zb19j8dkochc19tqd2e8pvh1ktp5yjtkntiyod3pbca8afcxuzm8whjb1r8e75on9xgjqeqsghwkrny14cqn24r2pik9rcphxo0twguglyw9ncirzlg1azwad9r0krqlu9aycy8v6wf4kov1npryelmlktrgbalbm09urg11zgaoebhyo1j4yob94axwvi3fu1ez0wnbsjqjeiuaq0mce74n3hr2vwliyvuov3gmoclfi3imit4limnqol7rbywv7lf4jlomg6rkxz6suxxs915dnfmexi1lvjol68t5waasqx4rnob4tll58pfnbc0icwa6rn2056hlpqp5sbk1gnieq7xx120p8bahb5rstiisjki4f2e7kptm94ulnfj7vzth8f8lacr96cvs6c5x3jqlkpb8gobz0go35t8vjzwbfjbjghps6aer885o95upruzq0g38cppp7e4rq0ul5efkgr0580p6oesa1ny11blxc396s10s84d07j1gh1h0a11q5o5xal7o9erjqy65hcbr6n4kr8x4q6thjt15zivbq7unw4k12zsc1aid5iz9vvdxwhe4mu5cgvep8d0rlhrl5rkafn4caag1ah49eice77am7xjj895m8mopzhcpee4mpcn2netbkmjawck3mabehyfxlvvmptqlcuyhky70vdyo23jzcz9baah4gdhrw3v0ml2a10obq93ryeifyxl85258erjnuzi80c3mkle4er2vrkvl4mxfnjj5l8irhjct8d01qcko0zu3bola4g6xqnmd6tjipot3p0b51gdbfmmbklop3zr17ul33tg2rgv396g9msbbrahvc91jeg5fuabr9jgyia64mi7jv6dmagdvikoc2aezspcbst0nb2h5dmsl3yfpm3d2595q11f4uuza5rojvdr83u2jvpkjitx299cdw7qaqmvv0b210zheajtm8vxf9p3y2xx5lymqhhzpzyyc94siukfvw60y8obwx5i9w4evvb5no2jcql0lfqq4kdxyxaxmnti0eubb0m6h5iqil1fc3ezkth1pnnrd24r3rgzg2g68c7vzsfuym3t242xyvc1m7wsak8548jrpd15z2662popfwttncwiildilu73a38c48exmjyc8knits4whd8nfp49971iqbzg7w39m4mvbxbmwrrfowmmfh9lldscs0s0oh9qwcv1rber65duepko26zonhvtp7qyja5u6z15fgp3dyhavwumgdgf46f8bgelnvpsl8xdoskeeu99x1ajwmkmmw82ys9gb6da4uli8tlq0jotkbpvefrpx5f4yz0067608jp173rmy1zzc2mdoxt7gg9yz07eh5t7l4uzs4qz80cdmqsqpnj7dpbearc2g8vxk8163gkh3915zd7idpzccvs480mwlorjrx6r4tslagn1iequaypyk5b328fqu64g8gkctwmsrx1vd66atyibhujh8tkrnhc7a924v3y8rgyussxdszbzi84hi4pomc4ospzx44s20kh3v2wkneew3usxxisk4ob9056a5im6zgxmausfbdz4tjb8srl9ixcum2npqtvjk4izsk234693lw511zpgkf5byev0mhd3aic4s424u5gx64q0zn8094ij2k0bnxfx9d6p3m88fkzqyz22i4fx5l7d1wttldgp5bpy7sgwf0hw4hznvmcgv504mtfca8qi3gv2ejb2tej8jt44io5zprlhgpm3l7lgsj2vral1bqmuzpyoe1ng05vlh50xqwb6h5e27sylijvswwd1sd694xow4d5lzfeu1my5xmpxq8tf6v849g3wtp4mr5aunyybk0j3rcrtdc5yo7q2p5hwm8nc8gb2k127kphtmv9ebbfokfwjzrilo3166cklbvqfyfqga282vl96zaspmq5k9xav5hfa1ixt9e6qrryehb6rsfqwtgrwz9ui54tf38c3va93asnq9o6d78ulfg7i0hee3semiz5negyhaifvyjs3z5rvotep5hg3b2s9ffixtj1z83eei6a9jfg7nwkvr3sywkperf7r00xiohyaoqq0lwaazhdfd3ta0pndul4kkt570gg0380hk47s5eng6daynwaix6o30zd2o5fwgz1b6mjpg58bocb7btmcf4pc6dp08y14zbxs6mer4r2v8wp2q8gkjlfax7ffij6x23w79tf82rj7jn3o0g6quu9nqzdzj5pj682fimuphee3cu8j5xcvm27hnpuv32bqreprwzhor8k36p89xuu6xaq8io2zpkl2gdif77xyi2qm2vxeimnnj0qhvums6duudmgrnd0mrzvdns84146rcz2dttqkpnr3s53ehzj1ug0uzr437c3gttwfb4h9htvpkah2hybcrkuv857dn8qn279l8d4rcwr123xfxy37sox5r17hkkv01crb975fc1lmdh3milykd4sjz7kixlvb1c2zit0fidrhujgpcpftx0i1n5gfowy0306ns7bv8si1tes57rbis93122v6q9udd5ukw7tcg0vtvl57lieht2jmgh22b9iz473rqswjvxq1wz5o308qjc7lry0kgkpc5au3eyx4u9oi04w316doxci156p0eb9l1ldyycgawobifwbgm8axeuqqnjvf518xms37es25am332pip9kaecsntbl6m06nvx9mlw3l5twa9nmc6tcmrq2ij8bzogh3diamjv1ozy73hdc9vct9m5n3afjkr9waaxe47tdxjikurjn00jocv7c84eav3rsmynygb8wu5usm3ngo94eqyct9bcpf2znkkrs41bwkswjdgoullycs6opba5obw5nnbqxdmqwf7sxxokbqperu4wfukhbj84x03iw0i2pokx6vjy941dftdeh19bk743hu71hupesdfj20r6s87jcmt61dpjltwli6udjpzv7jmzqspl1k9vjiqdkg7u1tkvp6455su8mla831scxw6dlx97j95ljnhsk53wkq4wlz51lw2if6myczuqe53w5msyef44zkfd6vpe7lflewn8wqmvzdofq7qoyq7xsylkodchlhzujp26jex8zf0pfdi4dlmsdl9b6v28owqdqmap28t7o5q5mj0vh066ipsxd692egmyx5xflrcob4apppf4m2t0o3tpb6ajj6clwji4nldmufpnbhg754b9lqquhurzsj5o35020auay23gct9k68j7hag76cmlqfi4psvxrpdx5r5s1qmpbvcm89hdwyyy1jdctceiqr7kc4r12dj4p2c27060euh338pmboekd0ht3z9ro4rwa0z56clqb6ei90mgv69uuc7zdbzhohon3u08rroygcpa4sjyct4u4vgo2e2vlrws2wcbgqgm0a2129sn8x9q2lc0ioke4rblehd9be3590qr3bv0rw61sgb10da2zs7xwfs8xjpvgow4riduqrrttd1xb4keh2o26k38bud16bxaec19akn24mjj56csetuejoi7gpo4omadjicemrxrxt0mj1ncu1rfnjizrhwfg445hix58qc3mejyxhtzes3onxfosip8a7ygkyzmef74g4box4hnnkiwqioaoqn6vyxn9lp43amwt37pdotr5531bg63nxff2alxupcychvf1rvzc64i4lrqhv57qz5o8rfqhadheeant0f5xw0whxjqumq15nay2rx1tw9scwffw3s7wh2dkz7ap6g2ujx6dwaps2g4ecc5oo9ukkhpyzafrcmdclr725vd0u99sz7euygajjseeh5qng84e9wbfj1n7e2v21zs6esoglui54ib4gukuzqqtn0ufy7d9ru9neq30pebmjfy5uw61ft4n3w0g1x2py0ocerma9o4njmbnr8f6hhgdofdznp6is6ypyv6qxsct2znkrkji87g104a6kdgpbld8rd61aa6txumtdumt9puxbziddz1c6ipv233s59sc9nwrvrun9f1ra92veji5myt5njy19wgwhw3sf6kuci04l2zwa2uukk4k1iyrw10glvj 00:08:41.950 11:19:23 spdk_dd.spdk_dd_basic_rw.dd_rw_offset -- dd/basic_rw.sh@59 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --ob=Nvme0n1 --seek=1 --json /dev/fd/62 00:08:41.950 11:19:23 spdk_dd.spdk_dd_basic_rw.dd_rw_offset -- dd/basic_rw.sh@59 -- # gen_conf 00:08:41.950 11:19:23 spdk_dd.spdk_dd_basic_rw.dd_rw_offset -- dd/common.sh@31 -- # xtrace_disable 00:08:41.950 11:19:23 spdk_dd.spdk_dd_basic_rw.dd_rw_offset -- common/autotest_common.sh@10 -- # set +x 00:08:41.950 [2024-10-07 11:19:23.557510] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:41.950 [2024-10-07 11:19:23.557618] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60188 ] 00:08:41.950 { 00:08:41.950 "subsystems": [ 00:08:41.950 { 00:08:41.950 "subsystem": "bdev", 00:08:41.950 "config": [ 00:08:41.950 { 00:08:41.951 "params": { 00:08:41.951 "trtype": "pcie", 00:08:41.951 "traddr": "0000:00:10.0", 00:08:41.951 "name": "Nvme0" 00:08:41.951 }, 00:08:41.951 "method": "bdev_nvme_attach_controller" 00:08:41.951 }, 00:08:41.951 { 00:08:41.951 "method": "bdev_wait_for_examine" 00:08:41.951 } 00:08:41.951 ] 00:08:41.951 } 00:08:41.951 ] 00:08:41.951 } 00:08:42.221 [2024-10-07 11:19:23.696581] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:42.221 [2024-10-07 11:19:23.771259] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:42.221 [2024-10-07 11:19:23.807469] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:42.221  [2024-10-07T11:19:24.203Z] Copying: 4096/4096 [B] (average 4000 kBps) 00:08:42.493 00:08:42.493 11:19:24 spdk_dd.spdk_dd_basic_rw.dd_rw_offset -- dd/basic_rw.sh@65 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=Nvme0n1 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --skip=1 --count=1 --json /dev/fd/62 00:08:42.493 11:19:24 spdk_dd.spdk_dd_basic_rw.dd_rw_offset -- dd/basic_rw.sh@65 -- # gen_conf 00:08:42.493 11:19:24 spdk_dd.spdk_dd_basic_rw.dd_rw_offset -- dd/common.sh@31 -- # xtrace_disable 00:08:42.493 11:19:24 spdk_dd.spdk_dd_basic_rw.dd_rw_offset -- common/autotest_common.sh@10 -- # set +x 00:08:42.493 [2024-10-07 11:19:24.142470] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:42.493 [2024-10-07 11:19:24.142556] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60207 ] 00:08:42.493 { 00:08:42.493 "subsystems": [ 00:08:42.493 { 00:08:42.493 "subsystem": "bdev", 00:08:42.493 "config": [ 00:08:42.493 { 00:08:42.493 "params": { 00:08:42.493 "trtype": "pcie", 00:08:42.493 "traddr": "0000:00:10.0", 00:08:42.493 "name": "Nvme0" 00:08:42.493 }, 00:08:42.493 "method": "bdev_nvme_attach_controller" 00:08:42.493 }, 00:08:42.493 { 00:08:42.493 "method": "bdev_wait_for_examine" 00:08:42.493 } 00:08:42.493 ] 00:08:42.493 } 00:08:42.493 ] 00:08:42.493 } 00:08:42.750 [2024-10-07 11:19:24.280544] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:42.750 [2024-10-07 11:19:24.355256] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:42.750 [2024-10-07 11:19:24.389549] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:43.008  [2024-10-07T11:19:24.719Z] Copying: 4096/4096 [B] (average 4000 kBps) 00:08:43.008 00:08:43.008 11:19:24 spdk_dd.spdk_dd_basic_rw.dd_rw_offset -- dd/basic_rw.sh@71 -- # read -rn4096 data_check 00:08:43.009 11:19:24 spdk_dd.spdk_dd_basic_rw.dd_rw_offset -- dd/basic_rw.sh@72 -- # [[ zb19j8dkochc19tqd2e8pvh1ktp5yjtkntiyod3pbca8afcxuzm8whjb1r8e75on9xgjqeqsghwkrny14cqn24r2pik9rcphxo0twguglyw9ncirzlg1azwad9r0krqlu9aycy8v6wf4kov1npryelmlktrgbalbm09urg11zgaoebhyo1j4yob94axwvi3fu1ez0wnbsjqjeiuaq0mce74n3hr2vwliyvuov3gmoclfi3imit4limnqol7rbywv7lf4jlomg6rkxz6suxxs915dnfmexi1lvjol68t5waasqx4rnob4tll58pfnbc0icwa6rn2056hlpqp5sbk1gnieq7xx120p8bahb5rstiisjki4f2e7kptm94ulnfj7vzth8f8lacr96cvs6c5x3jqlkpb8gobz0go35t8vjzwbfjbjghps6aer885o95upruzq0g38cppp7e4rq0ul5efkgr0580p6oesa1ny11blxc396s10s84d07j1gh1h0a11q5o5xal7o9erjqy65hcbr6n4kr8x4q6thjt15zivbq7unw4k12zsc1aid5iz9vvdxwhe4mu5cgvep8d0rlhrl5rkafn4caag1ah49eice77am7xjj895m8mopzhcpee4mpcn2netbkmjawck3mabehyfxlvvmptqlcuyhky70vdyo23jzcz9baah4gdhrw3v0ml2a10obq93ryeifyxl85258erjnuzi80c3mkle4er2vrkvl4mxfnjj5l8irhjct8d01qcko0zu3bola4g6xqnmd6tjipot3p0b51gdbfmmbklop3zr17ul33tg2rgv396g9msbbrahvc91jeg5fuabr9jgyia64mi7jv6dmagdvikoc2aezspcbst0nb2h5dmsl3yfpm3d2595q11f4uuza5rojvdr83u2jvpkjitx299cdw7qaqmvv0b210zheajtm8vxf9p3y2xx5lymqhhzpzyyc94siukfvw60y8obwx5i9w4evvb5no2jcql0lfqq4kdxyxaxmnti0eubb0m6h5iqil1fc3ezkth1pnnrd24r3rgzg2g68c7vzsfuym3t242xyvc1m7wsak8548jrpd15z2662popfwttncwiildilu73a38c48exmjyc8knits4whd8nfp49971iqbzg7w39m4mvbxbmwrrfowmmfh9lldscs0s0oh9qwcv1rber65duepko26zonhvtp7qyja5u6z15fgp3dyhavwumgdgf46f8bgelnvpsl8xdoskeeu99x1ajwmkmmw82ys9gb6da4uli8tlq0jotkbpvefrpx5f4yz0067608jp173rmy1zzc2mdoxt7gg9yz07eh5t7l4uzs4qz80cdmqsqpnj7dpbearc2g8vxk8163gkh3915zd7idpzccvs480mwlorjrx6r4tslagn1iequaypyk5b328fqu64g8gkctwmsrx1vd66atyibhujh8tkrnhc7a924v3y8rgyussxdszbzi84hi4pomc4ospzx44s20kh3v2wkneew3usxxisk4ob9056a5im6zgxmausfbdz4tjb8srl9ixcum2npqtvjk4izsk234693lw511zpgkf5byev0mhd3aic4s424u5gx64q0zn8094ij2k0bnxfx9d6p3m88fkzqyz22i4fx5l7d1wttldgp5bpy7sgwf0hw4hznvmcgv504mtfca8qi3gv2ejb2tej8jt44io5zprlhgpm3l7lgsj2vral1bqmuzpyoe1ng05vlh50xqwb6h5e27sylijvswwd1sd694xow4d5lzfeu1my5xmpxq8tf6v849g3wtp4mr5aunyybk0j3rcrtdc5yo7q2p5hwm8nc8gb2k127kphtmv9ebbfokfwjzrilo3166cklbvqfyfqga282vl96zaspmq5k9xav5hfa1ixt9e6qrryehb6rsfqwtgrwz9ui54tf38c3va93asnq9o6d78ulfg7i0hee3semiz5negyhaifvyjs3z5rvotep5hg3b2s9ffixtj1z83eei6a9jfg7nwkvr3sywkperf7r00xiohyaoqq0lwaazhdfd3ta0pndul4kkt570gg0380hk47s5eng6daynwaix6o30zd2o5fwgz1b6mjpg58bocb7btmcf4pc6dp08y14zbxs6mer4r2v8wp2q8gkjlfax7ffij6x23w79tf82rj7jn3o0g6quu9nqzdzj5pj682fimuphee3cu8j5xcvm27hnpuv32bqreprwzhor8k36p89xuu6xaq8io2zpkl2gdif77xyi2qm2vxeimnnj0qhvums6duudmgrnd0mrzvdns84146rcz2dttqkpnr3s53ehzj1ug0uzr437c3gttwfb4h9htvpkah2hybcrkuv857dn8qn279l8d4rcwr123xfxy37sox5r17hkkv01crb975fc1lmdh3milykd4sjz7kixlvb1c2zit0fidrhujgpcpftx0i1n5gfowy0306ns7bv8si1tes57rbis93122v6q9udd5ukw7tcg0vtvl57lieht2jmgh22b9iz473rqswjvxq1wz5o308qjc7lry0kgkpc5au3eyx4u9oi04w316doxci156p0eb9l1ldyycgawobifwbgm8axeuqqnjvf518xms37es25am332pip9kaecsntbl6m06nvx9mlw3l5twa9nmc6tcmrq2ij8bzogh3diamjv1ozy73hdc9vct9m5n3afjkr9waaxe47tdxjikurjn00jocv7c84eav3rsmynygb8wu5usm3ngo94eqyct9bcpf2znkkrs41bwkswjdgoullycs6opba5obw5nnbqxdmqwf7sxxokbqperu4wfukhbj84x03iw0i2pokx6vjy941dftdeh19bk743hu71hupesdfj20r6s87jcmt61dpjltwli6udjpzv7jmzqspl1k9vjiqdkg7u1tkvp6455su8mla831scxw6dlx97j95ljnhsk53wkq4wlz51lw2if6myczuqe53w5msyef44zkfd6vpe7lflewn8wqmvzdofq7qoyq7xsylkodchlhzujp26jex8zf0pfdi4dlmsdl9b6v28owqdqmap28t7o5q5mj0vh066ipsxd692egmyx5xflrcob4apppf4m2t0o3tpb6ajj6clwji4nldmufpnbhg754b9lqquhurzsj5o35020auay23gct9k68j7hag76cmlqfi4psvxrpdx5r5s1qmpbvcm89hdwyyy1jdctceiqr7kc4r12dj4p2c27060euh338pmboekd0ht3z9ro4rwa0z56clqb6ei90mgv69uuc7zdbzhohon3u08rroygcpa4sjyct4u4vgo2e2vlrws2wcbgqgm0a2129sn8x9q2lc0ioke4rblehd9be3590qr3bv0rw61sgb10da2zs7xwfs8xjpvgow4riduqrrttd1xb4keh2o26k38bud16bxaec19akn24mjj56csetuejoi7gpo4omadjicemrxrxt0mj1ncu1rfnjizrhwfg445hix58qc3mejyxhtzes3onxfosip8a7ygkyzmef74g4box4hnnkiwqioaoqn6vyxn9lp43amwt37pdotr5531bg63nxff2alxupcychvf1rvzc64i4lrqhv57qz5o8rfqhadheeant0f5xw0whxjqumq15nay2rx1tw9scwffw3s7wh2dkz7ap6g2ujx6dwaps2g4ecc5oo9ukkhpyzafrcmdclr725vd0u99sz7euygajjseeh5qng84e9wbfj1n7e2v21zs6esoglui54ib4gukuzqqtn0ufy7d9ru9neq30pebmjfy5uw61ft4n3w0g1x2py0ocerma9o4njmbnr8f6hhgdofdznp6is6ypyv6qxsct2znkrkji87g104a6kdgpbld8rd61aa6txumtdumt9puxbziddz1c6ipv233s59sc9nwrvrun9f1ra92veji5myt5njy19wgwhw3sf6kuci04l2zwa2uukk4k1iyrw10glvj == \z\b\1\9\j\8\d\k\o\c\h\c\1\9\t\q\d\2\e\8\p\v\h\1\k\t\p\5\y\j\t\k\n\t\i\y\o\d\3\p\b\c\a\8\a\f\c\x\u\z\m\8\w\h\j\b\1\r\8\e\7\5\o\n\9\x\g\j\q\e\q\s\g\h\w\k\r\n\y\1\4\c\q\n\2\4\r\2\p\i\k\9\r\c\p\h\x\o\0\t\w\g\u\g\l\y\w\9\n\c\i\r\z\l\g\1\a\z\w\a\d\9\r\0\k\r\q\l\u\9\a\y\c\y\8\v\6\w\f\4\k\o\v\1\n\p\r\y\e\l\m\l\k\t\r\g\b\a\l\b\m\0\9\u\r\g\1\1\z\g\a\o\e\b\h\y\o\1\j\4\y\o\b\9\4\a\x\w\v\i\3\f\u\1\e\z\0\w\n\b\s\j\q\j\e\i\u\a\q\0\m\c\e\7\4\n\3\h\r\2\v\w\l\i\y\v\u\o\v\3\g\m\o\c\l\f\i\3\i\m\i\t\4\l\i\m\n\q\o\l\7\r\b\y\w\v\7\l\f\4\j\l\o\m\g\6\r\k\x\z\6\s\u\x\x\s\9\1\5\d\n\f\m\e\x\i\1\l\v\j\o\l\6\8\t\5\w\a\a\s\q\x\4\r\n\o\b\4\t\l\l\5\8\p\f\n\b\c\0\i\c\w\a\6\r\n\2\0\5\6\h\l\p\q\p\5\s\b\k\1\g\n\i\e\q\7\x\x\1\2\0\p\8\b\a\h\b\5\r\s\t\i\i\s\j\k\i\4\f\2\e\7\k\p\t\m\9\4\u\l\n\f\j\7\v\z\t\h\8\f\8\l\a\c\r\9\6\c\v\s\6\c\5\x\3\j\q\l\k\p\b\8\g\o\b\z\0\g\o\3\5\t\8\v\j\z\w\b\f\j\b\j\g\h\p\s\6\a\e\r\8\8\5\o\9\5\u\p\r\u\z\q\0\g\3\8\c\p\p\p\7\e\4\r\q\0\u\l\5\e\f\k\g\r\0\5\8\0\p\6\o\e\s\a\1\n\y\1\1\b\l\x\c\3\9\6\s\1\0\s\8\4\d\0\7\j\1\g\h\1\h\0\a\1\1\q\5\o\5\x\a\l\7\o\9\e\r\j\q\y\6\5\h\c\b\r\6\n\4\k\r\8\x\4\q\6\t\h\j\t\1\5\z\i\v\b\q\7\u\n\w\4\k\1\2\z\s\c\1\a\i\d\5\i\z\9\v\v\d\x\w\h\e\4\m\u\5\c\g\v\e\p\8\d\0\r\l\h\r\l\5\r\k\a\f\n\4\c\a\a\g\1\a\h\4\9\e\i\c\e\7\7\a\m\7\x\j\j\8\9\5\m\8\m\o\p\z\h\c\p\e\e\4\m\p\c\n\2\n\e\t\b\k\m\j\a\w\c\k\3\m\a\b\e\h\y\f\x\l\v\v\m\p\t\q\l\c\u\y\h\k\y\7\0\v\d\y\o\2\3\j\z\c\z\9\b\a\a\h\4\g\d\h\r\w\3\v\0\m\l\2\a\1\0\o\b\q\9\3\r\y\e\i\f\y\x\l\8\5\2\5\8\e\r\j\n\u\z\i\8\0\c\3\m\k\l\e\4\e\r\2\v\r\k\v\l\4\m\x\f\n\j\j\5\l\8\i\r\h\j\c\t\8\d\0\1\q\c\k\o\0\z\u\3\b\o\l\a\4\g\6\x\q\n\m\d\6\t\j\i\p\o\t\3\p\0\b\5\1\g\d\b\f\m\m\b\k\l\o\p\3\z\r\1\7\u\l\3\3\t\g\2\r\g\v\3\9\6\g\9\m\s\b\b\r\a\h\v\c\9\1\j\e\g\5\f\u\a\b\r\9\j\g\y\i\a\6\4\m\i\7\j\v\6\d\m\a\g\d\v\i\k\o\c\2\a\e\z\s\p\c\b\s\t\0\n\b\2\h\5\d\m\s\l\3\y\f\p\m\3\d\2\5\9\5\q\1\1\f\4\u\u\z\a\5\r\o\j\v\d\r\8\3\u\2\j\v\p\k\j\i\t\x\2\9\9\c\d\w\7\q\a\q\m\v\v\0\b\2\1\0\z\h\e\a\j\t\m\8\v\x\f\9\p\3\y\2\x\x\5\l\y\m\q\h\h\z\p\z\y\y\c\9\4\s\i\u\k\f\v\w\6\0\y\8\o\b\w\x\5\i\9\w\4\e\v\v\b\5\n\o\2\j\c\q\l\0\l\f\q\q\4\k\d\x\y\x\a\x\m\n\t\i\0\e\u\b\b\0\m\6\h\5\i\q\i\l\1\f\c\3\e\z\k\t\h\1\p\n\n\r\d\2\4\r\3\r\g\z\g\2\g\6\8\c\7\v\z\s\f\u\y\m\3\t\2\4\2\x\y\v\c\1\m\7\w\s\a\k\8\5\4\8\j\r\p\d\1\5\z\2\6\6\2\p\o\p\f\w\t\t\n\c\w\i\i\l\d\i\l\u\7\3\a\3\8\c\4\8\e\x\m\j\y\c\8\k\n\i\t\s\4\w\h\d\8\n\f\p\4\9\9\7\1\i\q\b\z\g\7\w\3\9\m\4\m\v\b\x\b\m\w\r\r\f\o\w\m\m\f\h\9\l\l\d\s\c\s\0\s\0\o\h\9\q\w\c\v\1\r\b\e\r\6\5\d\u\e\p\k\o\2\6\z\o\n\h\v\t\p\7\q\y\j\a\5\u\6\z\1\5\f\g\p\3\d\y\h\a\v\w\u\m\g\d\g\f\4\6\f\8\b\g\e\l\n\v\p\s\l\8\x\d\o\s\k\e\e\u\9\9\x\1\a\j\w\m\k\m\m\w\8\2\y\s\9\g\b\6\d\a\4\u\l\i\8\t\l\q\0\j\o\t\k\b\p\v\e\f\r\p\x\5\f\4\y\z\0\0\6\7\6\0\8\j\p\1\7\3\r\m\y\1\z\z\c\2\m\d\o\x\t\7\g\g\9\y\z\0\7\e\h\5\t\7\l\4\u\z\s\4\q\z\8\0\c\d\m\q\s\q\p\n\j\7\d\p\b\e\a\r\c\2\g\8\v\x\k\8\1\6\3\g\k\h\3\9\1\5\z\d\7\i\d\p\z\c\c\v\s\4\8\0\m\w\l\o\r\j\r\x\6\r\4\t\s\l\a\g\n\1\i\e\q\u\a\y\p\y\k\5\b\3\2\8\f\q\u\6\4\g\8\g\k\c\t\w\m\s\r\x\1\v\d\6\6\a\t\y\i\b\h\u\j\h\8\t\k\r\n\h\c\7\a\9\2\4\v\3\y\8\r\g\y\u\s\s\x\d\s\z\b\z\i\8\4\h\i\4\p\o\m\c\4\o\s\p\z\x\4\4\s\2\0\k\h\3\v\2\w\k\n\e\e\w\3\u\s\x\x\i\s\k\4\o\b\9\0\5\6\a\5\i\m\6\z\g\x\m\a\u\s\f\b\d\z\4\t\j\b\8\s\r\l\9\i\x\c\u\m\2\n\p\q\t\v\j\k\4\i\z\s\k\2\3\4\6\9\3\l\w\5\1\1\z\p\g\k\f\5\b\y\e\v\0\m\h\d\3\a\i\c\4\s\4\2\4\u\5\g\x\6\4\q\0\z\n\8\0\9\4\i\j\2\k\0\b\n\x\f\x\9\d\6\p\3\m\8\8\f\k\z\q\y\z\2\2\i\4\f\x\5\l\7\d\1\w\t\t\l\d\g\p\5\b\p\y\7\s\g\w\f\0\h\w\4\h\z\n\v\m\c\g\v\5\0\4\m\t\f\c\a\8\q\i\3\g\v\2\e\j\b\2\t\e\j\8\j\t\4\4\i\o\5\z\p\r\l\h\g\p\m\3\l\7\l\g\s\j\2\v\r\a\l\1\b\q\m\u\z\p\y\o\e\1\n\g\0\5\v\l\h\5\0\x\q\w\b\6\h\5\e\2\7\s\y\l\i\j\v\s\w\w\d\1\s\d\6\9\4\x\o\w\4\d\5\l\z\f\e\u\1\m\y\5\x\m\p\x\q\8\t\f\6\v\8\4\9\g\3\w\t\p\4\m\r\5\a\u\n\y\y\b\k\0\j\3\r\c\r\t\d\c\5\y\o\7\q\2\p\5\h\w\m\8\n\c\8\g\b\2\k\1\2\7\k\p\h\t\m\v\9\e\b\b\f\o\k\f\w\j\z\r\i\l\o\3\1\6\6\c\k\l\b\v\q\f\y\f\q\g\a\2\8\2\v\l\9\6\z\a\s\p\m\q\5\k\9\x\a\v\5\h\f\a\1\i\x\t\9\e\6\q\r\r\y\e\h\b\6\r\s\f\q\w\t\g\r\w\z\9\u\i\5\4\t\f\3\8\c\3\v\a\9\3\a\s\n\q\9\o\6\d\7\8\u\l\f\g\7\i\0\h\e\e\3\s\e\m\i\z\5\n\e\g\y\h\a\i\f\v\y\j\s\3\z\5\r\v\o\t\e\p\5\h\g\3\b\2\s\9\f\f\i\x\t\j\1\z\8\3\e\e\i\6\a\9\j\f\g\7\n\w\k\v\r\3\s\y\w\k\p\e\r\f\7\r\0\0\x\i\o\h\y\a\o\q\q\0\l\w\a\a\z\h\d\f\d\3\t\a\0\p\n\d\u\l\4\k\k\t\5\7\0\g\g\0\3\8\0\h\k\4\7\s\5\e\n\g\6\d\a\y\n\w\a\i\x\6\o\3\0\z\d\2\o\5\f\w\g\z\1\b\6\m\j\p\g\5\8\b\o\c\b\7\b\t\m\c\f\4\p\c\6\d\p\0\8\y\1\4\z\b\x\s\6\m\e\r\4\r\2\v\8\w\p\2\q\8\g\k\j\l\f\a\x\7\f\f\i\j\6\x\2\3\w\7\9\t\f\8\2\r\j\7\j\n\3\o\0\g\6\q\u\u\9\n\q\z\d\z\j\5\p\j\6\8\2\f\i\m\u\p\h\e\e\3\c\u\8\j\5\x\c\v\m\2\7\h\n\p\u\v\3\2\b\q\r\e\p\r\w\z\h\o\r\8\k\3\6\p\8\9\x\u\u\6\x\a\q\8\i\o\2\z\p\k\l\2\g\d\i\f\7\7\x\y\i\2\q\m\2\v\x\e\i\m\n\n\j\0\q\h\v\u\m\s\6\d\u\u\d\m\g\r\n\d\0\m\r\z\v\d\n\s\8\4\1\4\6\r\c\z\2\d\t\t\q\k\p\n\r\3\s\5\3\e\h\z\j\1\u\g\0\u\z\r\4\3\7\c\3\g\t\t\w\f\b\4\h\9\h\t\v\p\k\a\h\2\h\y\b\c\r\k\u\v\8\5\7\d\n\8\q\n\2\7\9\l\8\d\4\r\c\w\r\1\2\3\x\f\x\y\3\7\s\o\x\5\r\1\7\h\k\k\v\0\1\c\r\b\9\7\5\f\c\1\l\m\d\h\3\m\i\l\y\k\d\4\s\j\z\7\k\i\x\l\v\b\1\c\2\z\i\t\0\f\i\d\r\h\u\j\g\p\c\p\f\t\x\0\i\1\n\5\g\f\o\w\y\0\3\0\6\n\s\7\b\v\8\s\i\1\t\e\s\5\7\r\b\i\s\9\3\1\2\2\v\6\q\9\u\d\d\5\u\k\w\7\t\c\g\0\v\t\v\l\5\7\l\i\e\h\t\2\j\m\g\h\2\2\b\9\i\z\4\7\3\r\q\s\w\j\v\x\q\1\w\z\5\o\3\0\8\q\j\c\7\l\r\y\0\k\g\k\p\c\5\a\u\3\e\y\x\4\u\9\o\i\0\4\w\3\1\6\d\o\x\c\i\1\5\6\p\0\e\b\9\l\1\l\d\y\y\c\g\a\w\o\b\i\f\w\b\g\m\8\a\x\e\u\q\q\n\j\v\f\5\1\8\x\m\s\3\7\e\s\2\5\a\m\3\3\2\p\i\p\9\k\a\e\c\s\n\t\b\l\6\m\0\6\n\v\x\9\m\l\w\3\l\5\t\w\a\9\n\m\c\6\t\c\m\r\q\2\i\j\8\b\z\o\g\h\3\d\i\a\m\j\v\1\o\z\y\7\3\h\d\c\9\v\c\t\9\m\5\n\3\a\f\j\k\r\9\w\a\a\x\e\4\7\t\d\x\j\i\k\u\r\j\n\0\0\j\o\c\v\7\c\8\4\e\a\v\3\r\s\m\y\n\y\g\b\8\w\u\5\u\s\m\3\n\g\o\9\4\e\q\y\c\t\9\b\c\p\f\2\z\n\k\k\r\s\4\1\b\w\k\s\w\j\d\g\o\u\l\l\y\c\s\6\o\p\b\a\5\o\b\w\5\n\n\b\q\x\d\m\q\w\f\7\s\x\x\o\k\b\q\p\e\r\u\4\w\f\u\k\h\b\j\8\4\x\0\3\i\w\0\i\2\p\o\k\x\6\v\j\y\9\4\1\d\f\t\d\e\h\1\9\b\k\7\4\3\h\u\7\1\h\u\p\e\s\d\f\j\2\0\r\6\s\8\7\j\c\m\t\6\1\d\p\j\l\t\w\l\i\6\u\d\j\p\z\v\7\j\m\z\q\s\p\l\1\k\9\v\j\i\q\d\k\g\7\u\1\t\k\v\p\6\4\5\5\s\u\8\m\l\a\8\3\1\s\c\x\w\6\d\l\x\9\7\j\9\5\l\j\n\h\s\k\5\3\w\k\q\4\w\l\z\5\1\l\w\2\i\f\6\m\y\c\z\u\q\e\5\3\w\5\m\s\y\e\f\4\4\z\k\f\d\6\v\p\e\7\l\f\l\e\w\n\8\w\q\m\v\z\d\o\f\q\7\q\o\y\q\7\x\s\y\l\k\o\d\c\h\l\h\z\u\j\p\2\6\j\e\x\8\z\f\0\p\f\d\i\4\d\l\m\s\d\l\9\b\6\v\2\8\o\w\q\d\q\m\a\p\2\8\t\7\o\5\q\5\m\j\0\v\h\0\6\6\i\p\s\x\d\6\9\2\e\g\m\y\x\5\x\f\l\r\c\o\b\4\a\p\p\p\f\4\m\2\t\0\o\3\t\p\b\6\a\j\j\6\c\l\w\j\i\4\n\l\d\m\u\f\p\n\b\h\g\7\5\4\b\9\l\q\q\u\h\u\r\z\s\j\5\o\3\5\0\2\0\a\u\a\y\2\3\g\c\t\9\k\6\8\j\7\h\a\g\7\6\c\m\l\q\f\i\4\p\s\v\x\r\p\d\x\5\r\5\s\1\q\m\p\b\v\c\m\8\9\h\d\w\y\y\y\1\j\d\c\t\c\e\i\q\r\7\k\c\4\r\1\2\d\j\4\p\2\c\2\7\0\6\0\e\u\h\3\3\8\p\m\b\o\e\k\d\0\h\t\3\z\9\r\o\4\r\w\a\0\z\5\6\c\l\q\b\6\e\i\9\0\m\g\v\6\9\u\u\c\7\z\d\b\z\h\o\h\o\n\3\u\0\8\r\r\o\y\g\c\p\a\4\s\j\y\c\t\4\u\4\v\g\o\2\e\2\v\l\r\w\s\2\w\c\b\g\q\g\m\0\a\2\1\2\9\s\n\8\x\9\q\2\l\c\0\i\o\k\e\4\r\b\l\e\h\d\9\b\e\3\5\9\0\q\r\3\b\v\0\r\w\6\1\s\g\b\1\0\d\a\2\z\s\7\x\w\f\s\8\x\j\p\v\g\o\w\4\r\i\d\u\q\r\r\t\t\d\1\x\b\4\k\e\h\2\o\2\6\k\3\8\b\u\d\1\6\b\x\a\e\c\1\9\a\k\n\2\4\m\j\j\5\6\c\s\e\t\u\e\j\o\i\7\g\p\o\4\o\m\a\d\j\i\c\e\m\r\x\r\x\t\0\m\j\1\n\c\u\1\r\f\n\j\i\z\r\h\w\f\g\4\4\5\h\i\x\5\8\q\c\3\m\e\j\y\x\h\t\z\e\s\3\o\n\x\f\o\s\i\p\8\a\7\y\g\k\y\z\m\e\f\7\4\g\4\b\o\x\4\h\n\n\k\i\w\q\i\o\a\o\q\n\6\v\y\x\n\9\l\p\4\3\a\m\w\t\3\7\p\d\o\t\r\5\5\3\1\b\g\6\3\n\x\f\f\2\a\l\x\u\p\c\y\c\h\v\f\1\r\v\z\c\6\4\i\4\l\r\q\h\v\5\7\q\z\5\o\8\r\f\q\h\a\d\h\e\e\a\n\t\0\f\5\x\w\0\w\h\x\j\q\u\m\q\1\5\n\a\y\2\r\x\1\t\w\9\s\c\w\f\f\w\3\s\7\w\h\2\d\k\z\7\a\p\6\g\2\u\j\x\6\d\w\a\p\s\2\g\4\e\c\c\5\o\o\9\u\k\k\h\p\y\z\a\f\r\c\m\d\c\l\r\7\2\5\v\d\0\u\9\9\s\z\7\e\u\y\g\a\j\j\s\e\e\h\5\q\n\g\8\4\e\9\w\b\f\j\1\n\7\e\2\v\2\1\z\s\6\e\s\o\g\l\u\i\5\4\i\b\4\g\u\k\u\z\q\q\t\n\0\u\f\y\7\d\9\r\u\9\n\e\q\3\0\p\e\b\m\j\f\y\5\u\w\6\1\f\t\4\n\3\w\0\g\1\x\2\p\y\0\o\c\e\r\m\a\9\o\4\n\j\m\b\n\r\8\f\6\h\h\g\d\o\f\d\z\n\p\6\i\s\6\y\p\y\v\6\q\x\s\c\t\2\z\n\k\r\k\j\i\8\7\g\1\0\4\a\6\k\d\g\p\b\l\d\8\r\d\6\1\a\a\6\t\x\u\m\t\d\u\m\t\9\p\u\x\b\z\i\d\d\z\1\c\6\i\p\v\2\3\3\s\5\9\s\c\9\n\w\r\v\r\u\n\9\f\1\r\a\9\2\v\e\j\i\5\m\y\t\5\n\j\y\1\9\w\g\w\h\w\3\s\f\6\k\u\c\i\0\4\l\2\z\w\a\2\u\u\k\k\4\k\1\i\y\r\w\1\0\g\l\v\j ]] 00:08:43.009 00:08:43.009 real 0m1.222s 00:08:43.009 user 0m0.869s 00:08:43.009 sys 0m0.462s 00:08:43.009 ************************************ 00:08:43.009 END TEST dd_rw_offset 00:08:43.009 ************************************ 00:08:43.009 11:19:24 spdk_dd.spdk_dd_basic_rw.dd_rw_offset -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:43.009 11:19:24 spdk_dd.spdk_dd_basic_rw.dd_rw_offset -- common/autotest_common.sh@10 -- # set +x 00:08:43.009 11:19:24 spdk_dd.spdk_dd_basic_rw -- dd/basic_rw.sh@1 -- # cleanup 00:08:43.009 11:19:24 spdk_dd.spdk_dd_basic_rw -- dd/basic_rw.sh@76 -- # clear_nvme Nvme0n1 00:08:43.009 11:19:24 spdk_dd.spdk_dd_basic_rw -- dd/common.sh@10 -- # local bdev=Nvme0n1 00:08:43.009 11:19:24 spdk_dd.spdk_dd_basic_rw -- dd/common.sh@11 -- # local nvme_ref= 00:08:43.009 11:19:24 spdk_dd.spdk_dd_basic_rw -- dd/common.sh@12 -- # local size=0xffff 00:08:43.009 11:19:24 spdk_dd.spdk_dd_basic_rw -- dd/common.sh@14 -- # local bs=1048576 00:08:43.009 11:19:24 spdk_dd.spdk_dd_basic_rw -- dd/common.sh@15 -- # local count=1 00:08:43.009 11:19:24 spdk_dd.spdk_dd_basic_rw -- dd/common.sh@18 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/dev/zero --bs=1048576 --ob=Nvme0n1 --count=1 --json /dev/fd/62 00:08:43.009 11:19:24 spdk_dd.spdk_dd_basic_rw -- dd/common.sh@18 -- # gen_conf 00:08:43.009 11:19:24 spdk_dd.spdk_dd_basic_rw -- dd/common.sh@31 -- # xtrace_disable 00:08:43.009 11:19:24 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@10 -- # set +x 00:08:43.268 [2024-10-07 11:19:24.761325] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:43.268 [2024-10-07 11:19:24.761423] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60231 ] 00:08:43.268 { 00:08:43.268 "subsystems": [ 00:08:43.268 { 00:08:43.268 "subsystem": "bdev", 00:08:43.268 "config": [ 00:08:43.268 { 00:08:43.268 "params": { 00:08:43.268 "trtype": "pcie", 00:08:43.268 "traddr": "0000:00:10.0", 00:08:43.268 "name": "Nvme0" 00:08:43.268 }, 00:08:43.268 "method": "bdev_nvme_attach_controller" 00:08:43.268 }, 00:08:43.268 { 00:08:43.268 "method": "bdev_wait_for_examine" 00:08:43.268 } 00:08:43.268 ] 00:08:43.268 } 00:08:43.268 ] 00:08:43.268 } 00:08:43.269 [2024-10-07 11:19:24.896174] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:43.269 [2024-10-07 11:19:24.960363] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:43.528 [2024-10-07 11:19:24.992861] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:43.528  [2024-10-07T11:19:25.497Z] Copying: 1024/1024 [kB] (average 1000 MBps) 00:08:43.786 00:08:43.786 11:19:25 spdk_dd.spdk_dd_basic_rw -- dd/basic_rw.sh@77 -- # rm -f /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:43.786 00:08:43.786 real 0m16.856s 00:08:43.786 user 0m12.611s 00:08:43.786 sys 0m4.915s 00:08:43.786 11:19:25 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:43.786 ************************************ 00:08:43.786 END TEST spdk_dd_basic_rw 00:08:43.786 ************************************ 00:08:43.786 11:19:25 spdk_dd.spdk_dd_basic_rw -- common/autotest_common.sh@10 -- # set +x 00:08:43.786 11:19:25 spdk_dd -- dd/dd.sh@21 -- # run_test spdk_dd_posix /home/vagrant/spdk_repo/spdk/test/dd/posix.sh 00:08:43.786 11:19:25 spdk_dd -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:43.786 11:19:25 spdk_dd -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:43.786 11:19:25 spdk_dd -- common/autotest_common.sh@10 -- # set +x 00:08:43.786 ************************************ 00:08:43.786 START TEST spdk_dd_posix 00:08:43.786 ************************************ 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/dd/posix.sh 00:08:43.786 * Looking for test storage... 00:08:43.786 * Found test storage at /home/vagrant/spdk_repo/spdk/test/dd 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1681 -- # lcov --version 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@333 -- # local ver1 ver1_l 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@334 -- # local ver2 ver2_l 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@336 -- # IFS=.-: 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@336 -- # read -ra ver1 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@337 -- # IFS=.-: 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@337 -- # read -ra ver2 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@338 -- # local 'op=<' 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@340 -- # ver1_l=2 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@341 -- # ver2_l=1 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@344 -- # case "$op" in 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@345 -- # : 1 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@364 -- # (( v = 0 )) 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@365 -- # decimal 1 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@353 -- # local d=1 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@355 -- # echo 1 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@365 -- # ver1[v]=1 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@366 -- # decimal 2 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@353 -- # local d=2 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@355 -- # echo 2 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@366 -- # ver2[v]=2 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@368 -- # return 0 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:08:43.786 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:43.786 --rc genhtml_branch_coverage=1 00:08:43.786 --rc genhtml_function_coverage=1 00:08:43.786 --rc genhtml_legend=1 00:08:43.786 --rc geninfo_all_blocks=1 00:08:43.786 --rc geninfo_unexecuted_blocks=1 00:08:43.786 00:08:43.786 ' 00:08:43.786 11:19:25 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:08:43.786 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:43.786 --rc genhtml_branch_coverage=1 00:08:43.786 --rc genhtml_function_coverage=1 00:08:43.786 --rc genhtml_legend=1 00:08:43.786 --rc geninfo_all_blocks=1 00:08:43.786 --rc geninfo_unexecuted_blocks=1 00:08:43.786 00:08:43.787 ' 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:08:43.787 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:43.787 --rc genhtml_branch_coverage=1 00:08:43.787 --rc genhtml_function_coverage=1 00:08:43.787 --rc genhtml_legend=1 00:08:43.787 --rc geninfo_all_blocks=1 00:08:43.787 --rc geninfo_unexecuted_blocks=1 00:08:43.787 00:08:43.787 ' 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:08:43.787 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:43.787 --rc genhtml_branch_coverage=1 00:08:43.787 --rc genhtml_function_coverage=1 00:08:43.787 --rc genhtml_legend=1 00:08:43.787 --rc geninfo_all_blocks=1 00:08:43.787 --rc geninfo_unexecuted_blocks=1 00:08:43.787 00:08:43.787 ' 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- dd/common.sh@7 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@15 -- # shopt -s extglob 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- paths/export.sh@5 -- # export PATH 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- dd/posix.sh@121 -- # msg[0]=', using AIO' 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- dd/posix.sh@122 -- # msg[1]=', liburing in use' 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- dd/posix.sh@123 -- # msg[2]=', disabling liburing, forcing AIO' 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- dd/posix.sh@125 -- # trap cleanup EXIT 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- dd/posix.sh@127 -- # test_file0=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- dd/posix.sh@128 -- # test_file1=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- dd/posix.sh@130 -- # tests 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- dd/posix.sh@99 -- # printf '* First test run%s\n' ', liburing in use' 00:08:43.787 * First test run, liburing in use 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- dd/posix.sh@102 -- # run_test dd_flag_append append 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:43.787 11:19:25 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@10 -- # set +x 00:08:44.045 ************************************ 00:08:44.045 START TEST dd_flag_append 00:08:44.045 ************************************ 00:08:44.045 11:19:25 spdk_dd.spdk_dd_posix.dd_flag_append -- common/autotest_common.sh@1125 -- # append 00:08:44.045 11:19:25 spdk_dd.spdk_dd_posix.dd_flag_append -- dd/posix.sh@16 -- # local dump0 00:08:44.045 11:19:25 spdk_dd.spdk_dd_posix.dd_flag_append -- dd/posix.sh@17 -- # local dump1 00:08:44.045 11:19:25 spdk_dd.spdk_dd_posix.dd_flag_append -- dd/posix.sh@19 -- # gen_bytes 32 00:08:44.045 11:19:25 spdk_dd.spdk_dd_posix.dd_flag_append -- dd/common.sh@98 -- # xtrace_disable 00:08:44.045 11:19:25 spdk_dd.spdk_dd_posix.dd_flag_append -- common/autotest_common.sh@10 -- # set +x 00:08:44.045 11:19:25 spdk_dd.spdk_dd_posix.dd_flag_append -- dd/posix.sh@19 -- # dump0=x5imyolkmgoloynbpgi3ylf0tno4i4jd 00:08:44.045 11:19:25 spdk_dd.spdk_dd_posix.dd_flag_append -- dd/posix.sh@20 -- # gen_bytes 32 00:08:44.045 11:19:25 spdk_dd.spdk_dd_posix.dd_flag_append -- dd/common.sh@98 -- # xtrace_disable 00:08:44.045 11:19:25 spdk_dd.spdk_dd_posix.dd_flag_append -- common/autotest_common.sh@10 -- # set +x 00:08:44.045 11:19:25 spdk_dd.spdk_dd_posix.dd_flag_append -- dd/posix.sh@20 -- # dump1=53zmbgrnfq92k0k086525ll0locwo5bb 00:08:44.045 11:19:25 spdk_dd.spdk_dd_posix.dd_flag_append -- dd/posix.sh@22 -- # printf %s x5imyolkmgoloynbpgi3ylf0tno4i4jd 00:08:44.045 11:19:25 spdk_dd.spdk_dd_posix.dd_flag_append -- dd/posix.sh@23 -- # printf %s 53zmbgrnfq92k0k086525ll0locwo5bb 00:08:44.045 11:19:25 spdk_dd.spdk_dd_posix.dd_flag_append -- dd/posix.sh@25 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=append 00:08:44.045 [2024-10-07 11:19:25.563078] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:44.045 [2024-10-07 11:19:25.563176] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60303 ] 00:08:44.045 [2024-10-07 11:19:25.700246] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:44.302 [2024-10-07 11:19:25.759863] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:44.302 [2024-10-07 11:19:25.789514] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:44.302  [2024-10-07T11:19:26.013Z] Copying: 32/32 [B] (average 31 kBps) 00:08:44.302 00:08:44.302 11:19:25 spdk_dd.spdk_dd_posix.dd_flag_append -- dd/posix.sh@27 -- # [[ 53zmbgrnfq92k0k086525ll0locwo5bbx5imyolkmgoloynbpgi3ylf0tno4i4jd == \5\3\z\m\b\g\r\n\f\q\9\2\k\0\k\0\8\6\5\2\5\l\l\0\l\o\c\w\o\5\b\b\x\5\i\m\y\o\l\k\m\g\o\l\o\y\n\b\p\g\i\3\y\l\f\0\t\n\o\4\i\4\j\d ]] 00:08:44.302 00:08:44.302 real 0m0.463s 00:08:44.302 user 0m0.245s 00:08:44.302 sys 0m0.183s 00:08:44.302 11:19:25 spdk_dd.spdk_dd_posix.dd_flag_append -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:44.302 ************************************ 00:08:44.302 END TEST dd_flag_append 00:08:44.302 ************************************ 00:08:44.302 11:19:25 spdk_dd.spdk_dd_posix.dd_flag_append -- common/autotest_common.sh@10 -- # set +x 00:08:44.302 11:19:26 spdk_dd.spdk_dd_posix -- dd/posix.sh@103 -- # run_test dd_flag_directory directory 00:08:44.302 11:19:26 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:44.302 11:19:26 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:44.302 11:19:26 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@10 -- # set +x 00:08:44.302 ************************************ 00:08:44.302 START TEST dd_flag_directory 00:08:44.302 ************************************ 00:08:44.302 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@1125 -- # directory 00:08:44.303 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- dd/posix.sh@31 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=directory --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:08:44.303 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@650 -- # local es=0 00:08:44.303 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=directory --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:08:44.303 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:44.303 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:44.303 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:44.561 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:44.561 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:44.561 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:44.561 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:44.561 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:08:44.561 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=directory --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:08:44.561 [2024-10-07 11:19:26.071575] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:44.561 [2024-10-07 11:19:26.072097] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60330 ] 00:08:44.561 [2024-10-07 11:19:26.205635] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:44.819 [2024-10-07 11:19:26.293873] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:44.819 [2024-10-07 11:19:26.325531] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:44.819 [2024-10-07 11:19:26.344082] spdk_dd.c: 894:dd_open_file: *ERROR*: Could not open file /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0: Not a directory 00:08:44.819 [2024-10-07 11:19:26.344142] spdk_dd.c:1083:dd_run: *ERROR*: /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0: Not a directory 00:08:44.819 [2024-10-07 11:19:26.344158] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:08:44.819 [2024-10-07 11:19:26.408462] spdk_dd.c:1536:main: *ERROR*: Error occurred while performing copy 00:08:44.819 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@653 -- # es=236 00:08:44.819 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:44.819 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@662 -- # es=108 00:08:44.819 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@663 -- # case "$es" in 00:08:44.819 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@670 -- # es=1 00:08:44.819 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:44.819 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- dd/posix.sh@32 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --oflag=directory 00:08:44.819 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@650 -- # local es=0 00:08:44.819 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --oflag=directory 00:08:44.819 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:44.819 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:44.819 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:44.819 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:44.819 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:44.819 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:44.819 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:44.819 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:08:44.819 11:19:26 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --oflag=directory 00:08:45.085 [2024-10-07 11:19:26.561756] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:45.085 [2024-10-07 11:19:26.561863] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60341 ] 00:08:45.085 [2024-10-07 11:19:26.695623] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:45.085 [2024-10-07 11:19:26.787122] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:45.344 [2024-10-07 11:19:26.824618] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:45.344 [2024-10-07 11:19:26.846013] spdk_dd.c: 894:dd_open_file: *ERROR*: Could not open file /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0: Not a directory 00:08:45.344 [2024-10-07 11:19:26.846080] spdk_dd.c:1132:dd_run: *ERROR*: /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0: Not a directory 00:08:45.344 [2024-10-07 11:19:26.846099] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:08:45.344 [2024-10-07 11:19:26.919692] spdk_dd.c:1536:main: *ERROR*: Error occurred while performing copy 00:08:45.344 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@653 -- # es=236 00:08:45.344 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:45.344 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@662 -- # es=108 00:08:45.344 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@663 -- # case "$es" in 00:08:45.344 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@670 -- # es=1 00:08:45.344 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:45.344 00:08:45.344 real 0m1.011s 00:08:45.344 user 0m0.568s 00:08:45.344 sys 0m0.231s 00:08:45.344 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:45.344 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_directory -- common/autotest_common.sh@10 -- # set +x 00:08:45.344 ************************************ 00:08:45.344 END TEST dd_flag_directory 00:08:45.344 ************************************ 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix -- dd/posix.sh@104 -- # run_test dd_flag_nofollow nofollow 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@10 -- # set +x 00:08:45.602 ************************************ 00:08:45.602 START TEST dd_flag_nofollow 00:08:45.602 ************************************ 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@1125 -- # nofollow 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- dd/posix.sh@36 -- # local test_file0_link=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0.link 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- dd/posix.sh@37 -- # local test_file1_link=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1.link 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- dd/posix.sh@39 -- # ln -fs /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0.link 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- dd/posix.sh@40 -- # ln -fs /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1.link 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- dd/posix.sh@42 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0.link --iflag=nofollow --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@650 -- # local es=0 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0.link --iflag=nofollow --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:08:45.602 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0.link --iflag=nofollow --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:45.602 [2024-10-07 11:19:27.128156] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:45.602 [2024-10-07 11:19:27.128483] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60370 ] 00:08:45.602 [2024-10-07 11:19:27.262763] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:45.860 [2024-10-07 11:19:27.333673] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:45.860 [2024-10-07 11:19:27.363467] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:45.860 [2024-10-07 11:19:27.382210] spdk_dd.c: 894:dd_open_file: *ERROR*: Could not open file /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0.link: Too many levels of symbolic links 00:08:45.860 [2024-10-07 11:19:27.382270] spdk_dd.c:1083:dd_run: *ERROR*: /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0.link: Too many levels of symbolic links 00:08:45.860 [2024-10-07 11:19:27.382287] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:08:45.860 [2024-10-07 11:19:27.448253] spdk_dd.c:1536:main: *ERROR*: Error occurred while performing copy 00:08:45.860 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@653 -- # es=216 00:08:45.860 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:45.860 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@662 -- # es=88 00:08:45.860 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@663 -- # case "$es" in 00:08:45.860 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@670 -- # es=1 00:08:45.860 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:45.860 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- dd/posix.sh@43 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1.link --oflag=nofollow 00:08:45.860 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@650 -- # local es=0 00:08:45.860 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1.link --oflag=nofollow 00:08:45.860 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:45.860 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:45.860 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:45.860 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:45.860 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:45.860 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:45.860 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:45.860 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:08:45.860 11:19:27 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1.link --oflag=nofollow 00:08:46.118 [2024-10-07 11:19:27.601292] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:46.118 [2024-10-07 11:19:27.601484] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60379 ] 00:08:46.118 [2024-10-07 11:19:27.750484] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:46.118 [2024-10-07 11:19:27.820393] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:46.377 [2024-10-07 11:19:27.853635] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:46.377 [2024-10-07 11:19:27.874374] spdk_dd.c: 894:dd_open_file: *ERROR*: Could not open file /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1.link: Too many levels of symbolic links 00:08:46.377 [2024-10-07 11:19:27.874454] spdk_dd.c:1132:dd_run: *ERROR*: /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1.link: Too many levels of symbolic links 00:08:46.377 [2024-10-07 11:19:27.874473] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:08:46.377 [2024-10-07 11:19:27.943863] spdk_dd.c:1536:main: *ERROR*: Error occurred while performing copy 00:08:46.377 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@653 -- # es=216 00:08:46.377 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:46.377 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@662 -- # es=88 00:08:46.377 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@663 -- # case "$es" in 00:08:46.377 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@670 -- # es=1 00:08:46.377 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:46.377 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- dd/posix.sh@46 -- # gen_bytes 512 00:08:46.377 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- dd/common.sh@98 -- # xtrace_disable 00:08:46.377 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@10 -- # set +x 00:08:46.377 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- dd/posix.sh@48 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0.link --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:46.635 [2024-10-07 11:19:28.106467] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:46.635 [2024-10-07 11:19:28.106551] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60381 ] 00:08:46.635 [2024-10-07 11:19:28.238290] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:46.635 [2024-10-07 11:19:28.299190] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:46.635 [2024-10-07 11:19:28.329268] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:46.893  [2024-10-07T11:19:28.604Z] Copying: 512/512 [B] (average 500 kBps) 00:08:46.893 00:08:46.893 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- dd/posix.sh@49 -- # [[ hmhqy43ituj0mhxcvcvysvq9ur5r3eh3izhq5nnsbf619vmzuo3yywd6k96u97r43tzit3rmtb0jelt8z44s0wahzouev8ny6fawafcryev6yr9rod931ujbkosyuezgnxfbv0druste5dywcrjg6yyw1hx4wl379ytx6x3ez6eq5fmybc36acbe9a7hyp95cupo69u1od1xn4wg4momzlyuyaqq0m5zyn0r0xbbigmi1dwfdwkyg4d636qz31tj2nuzhhcb6zs1f3j6badpg62cu1eehwstb2ngl72bp235pl0zfuclvrkgbj52914os6wte2yqv820p3viwekc1tefzmpva787smu9q3m4zaghiogdrde6klmnjyg2jzwfmo7yv8tv7b0bmzij92i5m3x70ib0xobdg4bqlb76pybyh4mahjjav7vppl023a9kf0fftj3xgaesmga24rifdwzuj4rwnos7o2r3o3hiqe6a4721bvatvdtdn0rzhav6 == \h\m\h\q\y\4\3\i\t\u\j\0\m\h\x\c\v\c\v\y\s\v\q\9\u\r\5\r\3\e\h\3\i\z\h\q\5\n\n\s\b\f\6\1\9\v\m\z\u\o\3\y\y\w\d\6\k\9\6\u\9\7\r\4\3\t\z\i\t\3\r\m\t\b\0\j\e\l\t\8\z\4\4\s\0\w\a\h\z\o\u\e\v\8\n\y\6\f\a\w\a\f\c\r\y\e\v\6\y\r\9\r\o\d\9\3\1\u\j\b\k\o\s\y\u\e\z\g\n\x\f\b\v\0\d\r\u\s\t\e\5\d\y\w\c\r\j\g\6\y\y\w\1\h\x\4\w\l\3\7\9\y\t\x\6\x\3\e\z\6\e\q\5\f\m\y\b\c\3\6\a\c\b\e\9\a\7\h\y\p\9\5\c\u\p\o\6\9\u\1\o\d\1\x\n\4\w\g\4\m\o\m\z\l\y\u\y\a\q\q\0\m\5\z\y\n\0\r\0\x\b\b\i\g\m\i\1\d\w\f\d\w\k\y\g\4\d\6\3\6\q\z\3\1\t\j\2\n\u\z\h\h\c\b\6\z\s\1\f\3\j\6\b\a\d\p\g\6\2\c\u\1\e\e\h\w\s\t\b\2\n\g\l\7\2\b\p\2\3\5\p\l\0\z\f\u\c\l\v\r\k\g\b\j\5\2\9\1\4\o\s\6\w\t\e\2\y\q\v\8\2\0\p\3\v\i\w\e\k\c\1\t\e\f\z\m\p\v\a\7\8\7\s\m\u\9\q\3\m\4\z\a\g\h\i\o\g\d\r\d\e\6\k\l\m\n\j\y\g\2\j\z\w\f\m\o\7\y\v\8\t\v\7\b\0\b\m\z\i\j\9\2\i\5\m\3\x\7\0\i\b\0\x\o\b\d\g\4\b\q\l\b\7\6\p\y\b\y\h\4\m\a\h\j\j\a\v\7\v\p\p\l\0\2\3\a\9\k\f\0\f\f\t\j\3\x\g\a\e\s\m\g\a\2\4\r\i\f\d\w\z\u\j\4\r\w\n\o\s\7\o\2\r\3\o\3\h\i\q\e\6\a\4\7\2\1\b\v\a\t\v\d\t\d\n\0\r\z\h\a\v\6 ]] 00:08:46.893 00:08:46.893 real 0m1.440s 00:08:46.893 user 0m0.804s 00:08:46.893 sys 0m0.399s 00:08:46.893 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:46.893 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_nofollow -- common/autotest_common.sh@10 -- # set +x 00:08:46.893 ************************************ 00:08:46.893 END TEST dd_flag_nofollow 00:08:46.893 ************************************ 00:08:46.893 11:19:28 spdk_dd.spdk_dd_posix -- dd/posix.sh@105 -- # run_test dd_flag_noatime noatime 00:08:46.893 11:19:28 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:46.893 11:19:28 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:46.893 11:19:28 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@10 -- # set +x 00:08:46.893 ************************************ 00:08:46.893 START TEST dd_flag_noatime 00:08:46.893 ************************************ 00:08:46.893 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_noatime -- common/autotest_common.sh@1125 -- # noatime 00:08:46.893 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_noatime -- dd/posix.sh@53 -- # local atime_if 00:08:46.893 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_noatime -- dd/posix.sh@54 -- # local atime_of 00:08:46.893 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_noatime -- dd/posix.sh@58 -- # gen_bytes 512 00:08:46.893 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_noatime -- dd/common.sh@98 -- # xtrace_disable 00:08:46.893 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_noatime -- common/autotest_common.sh@10 -- # set +x 00:08:46.893 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_noatime -- dd/posix.sh@60 -- # stat --printf=%X /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:08:46.893 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_noatime -- dd/posix.sh@60 -- # atime_if=1728299968 00:08:46.893 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_noatime -- dd/posix.sh@61 -- # stat --printf=%X /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:46.893 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_noatime -- dd/posix.sh@61 -- # atime_of=1728299968 00:08:46.893 11:19:28 spdk_dd.spdk_dd_posix.dd_flag_noatime -- dd/posix.sh@66 -- # sleep 1 00:08:48.273 11:19:29 spdk_dd.spdk_dd_posix.dd_flag_noatime -- dd/posix.sh@68 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=noatime --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:48.273 [2024-10-07 11:19:29.622427] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:48.273 [2024-10-07 11:19:29.622537] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60429 ] 00:08:48.273 [2024-10-07 11:19:29.757030] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:48.273 [2024-10-07 11:19:29.846565] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:48.273 [2024-10-07 11:19:29.883427] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:48.273  [2024-10-07T11:19:30.241Z] Copying: 512/512 [B] (average 500 kBps) 00:08:48.530 00:08:48.530 11:19:30 spdk_dd.spdk_dd_posix.dd_flag_noatime -- dd/posix.sh@69 -- # stat --printf=%X /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:08:48.530 11:19:30 spdk_dd.spdk_dd_posix.dd_flag_noatime -- dd/posix.sh@69 -- # (( atime_if == 1728299968 )) 00:08:48.530 11:19:30 spdk_dd.spdk_dd_posix.dd_flag_noatime -- dd/posix.sh@70 -- # stat --printf=%X /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:48.530 11:19:30 spdk_dd.spdk_dd_posix.dd_flag_noatime -- dd/posix.sh@70 -- # (( atime_of == 1728299968 )) 00:08:48.531 11:19:30 spdk_dd.spdk_dd_posix.dd_flag_noatime -- dd/posix.sh@72 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:48.531 [2024-10-07 11:19:30.128155] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:48.531 [2024-10-07 11:19:30.128246] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60437 ] 00:08:48.788 [2024-10-07 11:19:30.259283] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:48.788 [2024-10-07 11:19:30.343944] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:48.788 [2024-10-07 11:19:30.374578] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:48.788  [2024-10-07T11:19:30.757Z] Copying: 512/512 [B] (average 500 kBps) 00:08:49.046 00:08:49.046 11:19:30 spdk_dd.spdk_dd_posix.dd_flag_noatime -- dd/posix.sh@73 -- # stat --printf=%X /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:08:49.046 11:19:30 spdk_dd.spdk_dd_posix.dd_flag_noatime -- dd/posix.sh@73 -- # (( atime_if < 1728299970 )) 00:08:49.046 00:08:49.046 real 0m2.008s 00:08:49.046 user 0m0.568s 00:08:49.046 sys 0m0.391s 00:08:49.046 11:19:30 spdk_dd.spdk_dd_posix.dd_flag_noatime -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:49.046 11:19:30 spdk_dd.spdk_dd_posix.dd_flag_noatime -- common/autotest_common.sh@10 -- # set +x 00:08:49.046 ************************************ 00:08:49.046 END TEST dd_flag_noatime 00:08:49.046 ************************************ 00:08:49.046 11:19:30 spdk_dd.spdk_dd_posix -- dd/posix.sh@106 -- # run_test dd_flags_misc io 00:08:49.046 11:19:30 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:49.046 11:19:30 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:49.046 11:19:30 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@10 -- # set +x 00:08:49.046 ************************************ 00:08:49.046 START TEST dd_flags_misc 00:08:49.046 ************************************ 00:08:49.046 11:19:30 spdk_dd.spdk_dd_posix.dd_flags_misc -- common/autotest_common.sh@1125 -- # io 00:08:49.046 11:19:30 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@77 -- # local flags_ro flags_rw flag_ro flag_rw 00:08:49.046 11:19:30 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@81 -- # flags_ro=(direct nonblock) 00:08:49.046 11:19:30 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@82 -- # flags_rw=("${flags_ro[@]}" sync dsync) 00:08:49.046 11:19:30 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@85 -- # for flag_ro in "${flags_ro[@]}" 00:08:49.046 11:19:30 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@86 -- # gen_bytes 512 00:08:49.046 11:19:30 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/common.sh@98 -- # xtrace_disable 00:08:49.046 11:19:30 spdk_dd.spdk_dd_posix.dd_flags_misc -- common/autotest_common.sh@10 -- # set +x 00:08:49.046 11:19:30 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@87 -- # for flag_rw in "${flags_rw[@]}" 00:08:49.046 11:19:30 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@89 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=direct --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=direct 00:08:49.046 [2024-10-07 11:19:30.663986] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:49.046 [2024-10-07 11:19:30.664124] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60471 ] 00:08:49.304 [2024-10-07 11:19:30.807908] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:49.304 [2024-10-07 11:19:30.868067] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:49.304 [2024-10-07 11:19:30.898140] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:49.304  [2024-10-07T11:19:31.274Z] Copying: 512/512 [B] (average 500 kBps) 00:08:49.563 00:08:49.563 11:19:31 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@93 -- # [[ yk29xbg9vucf3jq8tjk6l7x6lsy4uhagvrvfq7pc15bzzlg3j80c2d7jysml200ad6q0f9wq2jb0q9hca0xvjwczjenvaiavp8bi5q7jo0ngogc5s8o8gy65qh315cw6egngke9la0q4xv7i0yauprvmdhu5dhekpg9jqvr80yr83sn5gls16e2h45d97tozqkx08rvgfpk2r6qzta28abyz0e4judenimenspwda70hixwe29iix7w9pk7490jxinv8dh5t0gdf6l4cyd3udmgqto0157ru9qreqmksnrs5poxgqwg4ut2ylimhv9gdoco54em0q9s9ux7nf0eoqk15zciwqavf7h3v6awd1ambet66uefably0b5iikn4sbykvx88rlzv2vaw3pzqrvz2o572s4apy2b7rghfntssyga50i2dgpjfu63f5up65aclm2hlxsee8ri319h5w0qynyr2rk5syiz1ss9xpqfu965cl5wa0v0kmvhoc3io3 == \y\k\2\9\x\b\g\9\v\u\c\f\3\j\q\8\t\j\k\6\l\7\x\6\l\s\y\4\u\h\a\g\v\r\v\f\q\7\p\c\1\5\b\z\z\l\g\3\j\8\0\c\2\d\7\j\y\s\m\l\2\0\0\a\d\6\q\0\f\9\w\q\2\j\b\0\q\9\h\c\a\0\x\v\j\w\c\z\j\e\n\v\a\i\a\v\p\8\b\i\5\q\7\j\o\0\n\g\o\g\c\5\s\8\o\8\g\y\6\5\q\h\3\1\5\c\w\6\e\g\n\g\k\e\9\l\a\0\q\4\x\v\7\i\0\y\a\u\p\r\v\m\d\h\u\5\d\h\e\k\p\g\9\j\q\v\r\8\0\y\r\8\3\s\n\5\g\l\s\1\6\e\2\h\4\5\d\9\7\t\o\z\q\k\x\0\8\r\v\g\f\p\k\2\r\6\q\z\t\a\2\8\a\b\y\z\0\e\4\j\u\d\e\n\i\m\e\n\s\p\w\d\a\7\0\h\i\x\w\e\2\9\i\i\x\7\w\9\p\k\7\4\9\0\j\x\i\n\v\8\d\h\5\t\0\g\d\f\6\l\4\c\y\d\3\u\d\m\g\q\t\o\0\1\5\7\r\u\9\q\r\e\q\m\k\s\n\r\s\5\p\o\x\g\q\w\g\4\u\t\2\y\l\i\m\h\v\9\g\d\o\c\o\5\4\e\m\0\q\9\s\9\u\x\7\n\f\0\e\o\q\k\1\5\z\c\i\w\q\a\v\f\7\h\3\v\6\a\w\d\1\a\m\b\e\t\6\6\u\e\f\a\b\l\y\0\b\5\i\i\k\n\4\s\b\y\k\v\x\8\8\r\l\z\v\2\v\a\w\3\p\z\q\r\v\z\2\o\5\7\2\s\4\a\p\y\2\b\7\r\g\h\f\n\t\s\s\y\g\a\5\0\i\2\d\g\p\j\f\u\6\3\f\5\u\p\6\5\a\c\l\m\2\h\l\x\s\e\e\8\r\i\3\1\9\h\5\w\0\q\y\n\y\r\2\r\k\5\s\y\i\z\1\s\s\9\x\p\q\f\u\9\6\5\c\l\5\w\a\0\v\0\k\m\v\h\o\c\3\i\o\3 ]] 00:08:49.563 11:19:31 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@87 -- # for flag_rw in "${flags_rw[@]}" 00:08:49.563 11:19:31 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@89 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=direct --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=nonblock 00:08:49.563 [2024-10-07 11:19:31.116221] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:49.563 [2024-10-07 11:19:31.116315] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60475 ] 00:08:49.563 [2024-10-07 11:19:31.249958] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:49.821 [2024-10-07 11:19:31.311076] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:49.821 [2024-10-07 11:19:31.342310] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:49.821  [2024-10-07T11:19:31.790Z] Copying: 512/512 [B] (average 500 kBps) 00:08:50.079 00:08:50.079 11:19:31 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@93 -- # [[ yk29xbg9vucf3jq8tjk6l7x6lsy4uhagvrvfq7pc15bzzlg3j80c2d7jysml200ad6q0f9wq2jb0q9hca0xvjwczjenvaiavp8bi5q7jo0ngogc5s8o8gy65qh315cw6egngke9la0q4xv7i0yauprvmdhu5dhekpg9jqvr80yr83sn5gls16e2h45d97tozqkx08rvgfpk2r6qzta28abyz0e4judenimenspwda70hixwe29iix7w9pk7490jxinv8dh5t0gdf6l4cyd3udmgqto0157ru9qreqmksnrs5poxgqwg4ut2ylimhv9gdoco54em0q9s9ux7nf0eoqk15zciwqavf7h3v6awd1ambet66uefably0b5iikn4sbykvx88rlzv2vaw3pzqrvz2o572s4apy2b7rghfntssyga50i2dgpjfu63f5up65aclm2hlxsee8ri319h5w0qynyr2rk5syiz1ss9xpqfu965cl5wa0v0kmvhoc3io3 == \y\k\2\9\x\b\g\9\v\u\c\f\3\j\q\8\t\j\k\6\l\7\x\6\l\s\y\4\u\h\a\g\v\r\v\f\q\7\p\c\1\5\b\z\z\l\g\3\j\8\0\c\2\d\7\j\y\s\m\l\2\0\0\a\d\6\q\0\f\9\w\q\2\j\b\0\q\9\h\c\a\0\x\v\j\w\c\z\j\e\n\v\a\i\a\v\p\8\b\i\5\q\7\j\o\0\n\g\o\g\c\5\s\8\o\8\g\y\6\5\q\h\3\1\5\c\w\6\e\g\n\g\k\e\9\l\a\0\q\4\x\v\7\i\0\y\a\u\p\r\v\m\d\h\u\5\d\h\e\k\p\g\9\j\q\v\r\8\0\y\r\8\3\s\n\5\g\l\s\1\6\e\2\h\4\5\d\9\7\t\o\z\q\k\x\0\8\r\v\g\f\p\k\2\r\6\q\z\t\a\2\8\a\b\y\z\0\e\4\j\u\d\e\n\i\m\e\n\s\p\w\d\a\7\0\h\i\x\w\e\2\9\i\i\x\7\w\9\p\k\7\4\9\0\j\x\i\n\v\8\d\h\5\t\0\g\d\f\6\l\4\c\y\d\3\u\d\m\g\q\t\o\0\1\5\7\r\u\9\q\r\e\q\m\k\s\n\r\s\5\p\o\x\g\q\w\g\4\u\t\2\y\l\i\m\h\v\9\g\d\o\c\o\5\4\e\m\0\q\9\s\9\u\x\7\n\f\0\e\o\q\k\1\5\z\c\i\w\q\a\v\f\7\h\3\v\6\a\w\d\1\a\m\b\e\t\6\6\u\e\f\a\b\l\y\0\b\5\i\i\k\n\4\s\b\y\k\v\x\8\8\r\l\z\v\2\v\a\w\3\p\z\q\r\v\z\2\o\5\7\2\s\4\a\p\y\2\b\7\r\g\h\f\n\t\s\s\y\g\a\5\0\i\2\d\g\p\j\f\u\6\3\f\5\u\p\6\5\a\c\l\m\2\h\l\x\s\e\e\8\r\i\3\1\9\h\5\w\0\q\y\n\y\r\2\r\k\5\s\y\i\z\1\s\s\9\x\p\q\f\u\9\6\5\c\l\5\w\a\0\v\0\k\m\v\h\o\c\3\i\o\3 ]] 00:08:50.079 11:19:31 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@87 -- # for flag_rw in "${flags_rw[@]}" 00:08:50.079 11:19:31 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@89 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=direct --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=sync 00:08:50.079 [2024-10-07 11:19:31.592176] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:50.079 [2024-10-07 11:19:31.592268] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60490 ] 00:08:50.079 [2024-10-07 11:19:31.726615] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:50.337 [2024-10-07 11:19:31.809117] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:50.337 [2024-10-07 11:19:31.842053] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:50.337  [2024-10-07T11:19:32.048Z] Copying: 512/512 [B] (average 125 kBps) 00:08:50.337 00:08:50.337 11:19:32 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@93 -- # [[ yk29xbg9vucf3jq8tjk6l7x6lsy4uhagvrvfq7pc15bzzlg3j80c2d7jysml200ad6q0f9wq2jb0q9hca0xvjwczjenvaiavp8bi5q7jo0ngogc5s8o8gy65qh315cw6egngke9la0q4xv7i0yauprvmdhu5dhekpg9jqvr80yr83sn5gls16e2h45d97tozqkx08rvgfpk2r6qzta28abyz0e4judenimenspwda70hixwe29iix7w9pk7490jxinv8dh5t0gdf6l4cyd3udmgqto0157ru9qreqmksnrs5poxgqwg4ut2ylimhv9gdoco54em0q9s9ux7nf0eoqk15zciwqavf7h3v6awd1ambet66uefably0b5iikn4sbykvx88rlzv2vaw3pzqrvz2o572s4apy2b7rghfntssyga50i2dgpjfu63f5up65aclm2hlxsee8ri319h5w0qynyr2rk5syiz1ss9xpqfu965cl5wa0v0kmvhoc3io3 == \y\k\2\9\x\b\g\9\v\u\c\f\3\j\q\8\t\j\k\6\l\7\x\6\l\s\y\4\u\h\a\g\v\r\v\f\q\7\p\c\1\5\b\z\z\l\g\3\j\8\0\c\2\d\7\j\y\s\m\l\2\0\0\a\d\6\q\0\f\9\w\q\2\j\b\0\q\9\h\c\a\0\x\v\j\w\c\z\j\e\n\v\a\i\a\v\p\8\b\i\5\q\7\j\o\0\n\g\o\g\c\5\s\8\o\8\g\y\6\5\q\h\3\1\5\c\w\6\e\g\n\g\k\e\9\l\a\0\q\4\x\v\7\i\0\y\a\u\p\r\v\m\d\h\u\5\d\h\e\k\p\g\9\j\q\v\r\8\0\y\r\8\3\s\n\5\g\l\s\1\6\e\2\h\4\5\d\9\7\t\o\z\q\k\x\0\8\r\v\g\f\p\k\2\r\6\q\z\t\a\2\8\a\b\y\z\0\e\4\j\u\d\e\n\i\m\e\n\s\p\w\d\a\7\0\h\i\x\w\e\2\9\i\i\x\7\w\9\p\k\7\4\9\0\j\x\i\n\v\8\d\h\5\t\0\g\d\f\6\l\4\c\y\d\3\u\d\m\g\q\t\o\0\1\5\7\r\u\9\q\r\e\q\m\k\s\n\r\s\5\p\o\x\g\q\w\g\4\u\t\2\y\l\i\m\h\v\9\g\d\o\c\o\5\4\e\m\0\q\9\s\9\u\x\7\n\f\0\e\o\q\k\1\5\z\c\i\w\q\a\v\f\7\h\3\v\6\a\w\d\1\a\m\b\e\t\6\6\u\e\f\a\b\l\y\0\b\5\i\i\k\n\4\s\b\y\k\v\x\8\8\r\l\z\v\2\v\a\w\3\p\z\q\r\v\z\2\o\5\7\2\s\4\a\p\y\2\b\7\r\g\h\f\n\t\s\s\y\g\a\5\0\i\2\d\g\p\j\f\u\6\3\f\5\u\p\6\5\a\c\l\m\2\h\l\x\s\e\e\8\r\i\3\1\9\h\5\w\0\q\y\n\y\r\2\r\k\5\s\y\i\z\1\s\s\9\x\p\q\f\u\9\6\5\c\l\5\w\a\0\v\0\k\m\v\h\o\c\3\i\o\3 ]] 00:08:50.337 11:19:32 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@87 -- # for flag_rw in "${flags_rw[@]}" 00:08:50.337 11:19:32 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@89 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=direct --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=dsync 00:08:50.596 [2024-10-07 11:19:32.075721] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:50.596 [2024-10-07 11:19:32.075817] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60494 ] 00:08:50.596 [2024-10-07 11:19:32.207826] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:50.596 [2024-10-07 11:19:32.267165] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:50.596 [2024-10-07 11:19:32.296983] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:50.854  [2024-10-07T11:19:32.565Z] Copying: 512/512 [B] (average 166 kBps) 00:08:50.854 00:08:50.854 11:19:32 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@93 -- # [[ yk29xbg9vucf3jq8tjk6l7x6lsy4uhagvrvfq7pc15bzzlg3j80c2d7jysml200ad6q0f9wq2jb0q9hca0xvjwczjenvaiavp8bi5q7jo0ngogc5s8o8gy65qh315cw6egngke9la0q4xv7i0yauprvmdhu5dhekpg9jqvr80yr83sn5gls16e2h45d97tozqkx08rvgfpk2r6qzta28abyz0e4judenimenspwda70hixwe29iix7w9pk7490jxinv8dh5t0gdf6l4cyd3udmgqto0157ru9qreqmksnrs5poxgqwg4ut2ylimhv9gdoco54em0q9s9ux7nf0eoqk15zciwqavf7h3v6awd1ambet66uefably0b5iikn4sbykvx88rlzv2vaw3pzqrvz2o572s4apy2b7rghfntssyga50i2dgpjfu63f5up65aclm2hlxsee8ri319h5w0qynyr2rk5syiz1ss9xpqfu965cl5wa0v0kmvhoc3io3 == \y\k\2\9\x\b\g\9\v\u\c\f\3\j\q\8\t\j\k\6\l\7\x\6\l\s\y\4\u\h\a\g\v\r\v\f\q\7\p\c\1\5\b\z\z\l\g\3\j\8\0\c\2\d\7\j\y\s\m\l\2\0\0\a\d\6\q\0\f\9\w\q\2\j\b\0\q\9\h\c\a\0\x\v\j\w\c\z\j\e\n\v\a\i\a\v\p\8\b\i\5\q\7\j\o\0\n\g\o\g\c\5\s\8\o\8\g\y\6\5\q\h\3\1\5\c\w\6\e\g\n\g\k\e\9\l\a\0\q\4\x\v\7\i\0\y\a\u\p\r\v\m\d\h\u\5\d\h\e\k\p\g\9\j\q\v\r\8\0\y\r\8\3\s\n\5\g\l\s\1\6\e\2\h\4\5\d\9\7\t\o\z\q\k\x\0\8\r\v\g\f\p\k\2\r\6\q\z\t\a\2\8\a\b\y\z\0\e\4\j\u\d\e\n\i\m\e\n\s\p\w\d\a\7\0\h\i\x\w\e\2\9\i\i\x\7\w\9\p\k\7\4\9\0\j\x\i\n\v\8\d\h\5\t\0\g\d\f\6\l\4\c\y\d\3\u\d\m\g\q\t\o\0\1\5\7\r\u\9\q\r\e\q\m\k\s\n\r\s\5\p\o\x\g\q\w\g\4\u\t\2\y\l\i\m\h\v\9\g\d\o\c\o\5\4\e\m\0\q\9\s\9\u\x\7\n\f\0\e\o\q\k\1\5\z\c\i\w\q\a\v\f\7\h\3\v\6\a\w\d\1\a\m\b\e\t\6\6\u\e\f\a\b\l\y\0\b\5\i\i\k\n\4\s\b\y\k\v\x\8\8\r\l\z\v\2\v\a\w\3\p\z\q\r\v\z\2\o\5\7\2\s\4\a\p\y\2\b\7\r\g\h\f\n\t\s\s\y\g\a\5\0\i\2\d\g\p\j\f\u\6\3\f\5\u\p\6\5\a\c\l\m\2\h\l\x\s\e\e\8\r\i\3\1\9\h\5\w\0\q\y\n\y\r\2\r\k\5\s\y\i\z\1\s\s\9\x\p\q\f\u\9\6\5\c\l\5\w\a\0\v\0\k\m\v\h\o\c\3\i\o\3 ]] 00:08:50.854 11:19:32 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@85 -- # for flag_ro in "${flags_ro[@]}" 00:08:50.854 11:19:32 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@86 -- # gen_bytes 512 00:08:50.854 11:19:32 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/common.sh@98 -- # xtrace_disable 00:08:50.854 11:19:32 spdk_dd.spdk_dd_posix.dd_flags_misc -- common/autotest_common.sh@10 -- # set +x 00:08:50.854 11:19:32 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@87 -- # for flag_rw in "${flags_rw[@]}" 00:08:50.854 11:19:32 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@89 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=nonblock --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=direct 00:08:50.854 [2024-10-07 11:19:32.532010] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:50.854 [2024-10-07 11:19:32.532105] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60509 ] 00:08:51.113 [2024-10-07 11:19:32.667594] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:51.113 [2024-10-07 11:19:32.727974] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:51.113 [2024-10-07 11:19:32.757393] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:51.113  [2024-10-07T11:19:33.081Z] Copying: 512/512 [B] (average 500 kBps) 00:08:51.370 00:08:51.371 11:19:32 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@93 -- # [[ lj1yhffv7blavoo0335f1xd9cfh5xlmm8620v7duzb9bet0fi5jht7zop4y1mrbvrilx493587qi430hzh6puy363vb78yx9tn7k0ledewzr8invt650hu74azusizt90c1ihw92qe2jkpn7dem7hwlo0v3nbcbi9lb3hocbfvvt49kx9t56jfnam9iz586m5kyid8wv5v1hlj65m20cjjje23ydmd1938w0640apznicz91l019qvb1fxjckf4563y07lc0u5tb5e43kzpbu4f0p9ec6u66heoyqugbd3m20m7zcd6cakhf50kyg8hb2jvheb6wdlgluj6uyln1j34nv41v8hln4836bro9gqs1fzl71hhiymjn21oy0iul0uiwvv1j2pmvanru2ffuvvkqy9o0f84ox5jxl8gmtbwdmrptbv0cl5yea9j6zkss1o4xqn45bannitj0dn0pat0rq92wjp6lfrde3adptrsqcrv3z1xzuuhfsm1npk1e == \l\j\1\y\h\f\f\v\7\b\l\a\v\o\o\0\3\3\5\f\1\x\d\9\c\f\h\5\x\l\m\m\8\6\2\0\v\7\d\u\z\b\9\b\e\t\0\f\i\5\j\h\t\7\z\o\p\4\y\1\m\r\b\v\r\i\l\x\4\9\3\5\8\7\q\i\4\3\0\h\z\h\6\p\u\y\3\6\3\v\b\7\8\y\x\9\t\n\7\k\0\l\e\d\e\w\z\r\8\i\n\v\t\6\5\0\h\u\7\4\a\z\u\s\i\z\t\9\0\c\1\i\h\w\9\2\q\e\2\j\k\p\n\7\d\e\m\7\h\w\l\o\0\v\3\n\b\c\b\i\9\l\b\3\h\o\c\b\f\v\v\t\4\9\k\x\9\t\5\6\j\f\n\a\m\9\i\z\5\8\6\m\5\k\y\i\d\8\w\v\5\v\1\h\l\j\6\5\m\2\0\c\j\j\j\e\2\3\y\d\m\d\1\9\3\8\w\0\6\4\0\a\p\z\n\i\c\z\9\1\l\0\1\9\q\v\b\1\f\x\j\c\k\f\4\5\6\3\y\0\7\l\c\0\u\5\t\b\5\e\4\3\k\z\p\b\u\4\f\0\p\9\e\c\6\u\6\6\h\e\o\y\q\u\g\b\d\3\m\2\0\m\7\z\c\d\6\c\a\k\h\f\5\0\k\y\g\8\h\b\2\j\v\h\e\b\6\w\d\l\g\l\u\j\6\u\y\l\n\1\j\3\4\n\v\4\1\v\8\h\l\n\4\8\3\6\b\r\o\9\g\q\s\1\f\z\l\7\1\h\h\i\y\m\j\n\2\1\o\y\0\i\u\l\0\u\i\w\v\v\1\j\2\p\m\v\a\n\r\u\2\f\f\u\v\v\k\q\y\9\o\0\f\8\4\o\x\5\j\x\l\8\g\m\t\b\w\d\m\r\p\t\b\v\0\c\l\5\y\e\a\9\j\6\z\k\s\s\1\o\4\x\q\n\4\5\b\a\n\n\i\t\j\0\d\n\0\p\a\t\0\r\q\9\2\w\j\p\6\l\f\r\d\e\3\a\d\p\t\r\s\q\c\r\v\3\z\1\x\z\u\u\h\f\s\m\1\n\p\k\1\e ]] 00:08:51.371 11:19:32 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@87 -- # for flag_rw in "${flags_rw[@]}" 00:08:51.371 11:19:32 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@89 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=nonblock --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=nonblock 00:08:51.371 [2024-10-07 11:19:32.990666] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:51.371 [2024-10-07 11:19:32.990801] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60513 ] 00:08:51.628 [2024-10-07 11:19:33.132818] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:51.628 [2024-10-07 11:19:33.191788] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:51.628 [2024-10-07 11:19:33.221511] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:51.628  [2024-10-07T11:19:33.597Z] Copying: 512/512 [B] (average 500 kBps) 00:08:51.886 00:08:51.886 11:19:33 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@93 -- # [[ lj1yhffv7blavoo0335f1xd9cfh5xlmm8620v7duzb9bet0fi5jht7zop4y1mrbvrilx493587qi430hzh6puy363vb78yx9tn7k0ledewzr8invt650hu74azusizt90c1ihw92qe2jkpn7dem7hwlo0v3nbcbi9lb3hocbfvvt49kx9t56jfnam9iz586m5kyid8wv5v1hlj65m20cjjje23ydmd1938w0640apznicz91l019qvb1fxjckf4563y07lc0u5tb5e43kzpbu4f0p9ec6u66heoyqugbd3m20m7zcd6cakhf50kyg8hb2jvheb6wdlgluj6uyln1j34nv41v8hln4836bro9gqs1fzl71hhiymjn21oy0iul0uiwvv1j2pmvanru2ffuvvkqy9o0f84ox5jxl8gmtbwdmrptbv0cl5yea9j6zkss1o4xqn45bannitj0dn0pat0rq92wjp6lfrde3adptrsqcrv3z1xzuuhfsm1npk1e == \l\j\1\y\h\f\f\v\7\b\l\a\v\o\o\0\3\3\5\f\1\x\d\9\c\f\h\5\x\l\m\m\8\6\2\0\v\7\d\u\z\b\9\b\e\t\0\f\i\5\j\h\t\7\z\o\p\4\y\1\m\r\b\v\r\i\l\x\4\9\3\5\8\7\q\i\4\3\0\h\z\h\6\p\u\y\3\6\3\v\b\7\8\y\x\9\t\n\7\k\0\l\e\d\e\w\z\r\8\i\n\v\t\6\5\0\h\u\7\4\a\z\u\s\i\z\t\9\0\c\1\i\h\w\9\2\q\e\2\j\k\p\n\7\d\e\m\7\h\w\l\o\0\v\3\n\b\c\b\i\9\l\b\3\h\o\c\b\f\v\v\t\4\9\k\x\9\t\5\6\j\f\n\a\m\9\i\z\5\8\6\m\5\k\y\i\d\8\w\v\5\v\1\h\l\j\6\5\m\2\0\c\j\j\j\e\2\3\y\d\m\d\1\9\3\8\w\0\6\4\0\a\p\z\n\i\c\z\9\1\l\0\1\9\q\v\b\1\f\x\j\c\k\f\4\5\6\3\y\0\7\l\c\0\u\5\t\b\5\e\4\3\k\z\p\b\u\4\f\0\p\9\e\c\6\u\6\6\h\e\o\y\q\u\g\b\d\3\m\2\0\m\7\z\c\d\6\c\a\k\h\f\5\0\k\y\g\8\h\b\2\j\v\h\e\b\6\w\d\l\g\l\u\j\6\u\y\l\n\1\j\3\4\n\v\4\1\v\8\h\l\n\4\8\3\6\b\r\o\9\g\q\s\1\f\z\l\7\1\h\h\i\y\m\j\n\2\1\o\y\0\i\u\l\0\u\i\w\v\v\1\j\2\p\m\v\a\n\r\u\2\f\f\u\v\v\k\q\y\9\o\0\f\8\4\o\x\5\j\x\l\8\g\m\t\b\w\d\m\r\p\t\b\v\0\c\l\5\y\e\a\9\j\6\z\k\s\s\1\o\4\x\q\n\4\5\b\a\n\n\i\t\j\0\d\n\0\p\a\t\0\r\q\9\2\w\j\p\6\l\f\r\d\e\3\a\d\p\t\r\s\q\c\r\v\3\z\1\x\z\u\u\h\f\s\m\1\n\p\k\1\e ]] 00:08:51.886 11:19:33 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@87 -- # for flag_rw in "${flags_rw[@]}" 00:08:51.886 11:19:33 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@89 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=nonblock --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=sync 00:08:51.886 [2024-10-07 11:19:33.430910] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:51.886 [2024-10-07 11:19:33.431004] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60528 ] 00:08:51.886 [2024-10-07 11:19:33.563023] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:52.144 [2024-10-07 11:19:33.624910] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:52.144 [2024-10-07 11:19:33.654119] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:52.144  [2024-10-07T11:19:33.855Z] Copying: 512/512 [B] (average 500 kBps) 00:08:52.144 00:08:52.144 11:19:33 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@93 -- # [[ lj1yhffv7blavoo0335f1xd9cfh5xlmm8620v7duzb9bet0fi5jht7zop4y1mrbvrilx493587qi430hzh6puy363vb78yx9tn7k0ledewzr8invt650hu74azusizt90c1ihw92qe2jkpn7dem7hwlo0v3nbcbi9lb3hocbfvvt49kx9t56jfnam9iz586m5kyid8wv5v1hlj65m20cjjje23ydmd1938w0640apznicz91l019qvb1fxjckf4563y07lc0u5tb5e43kzpbu4f0p9ec6u66heoyqugbd3m20m7zcd6cakhf50kyg8hb2jvheb6wdlgluj6uyln1j34nv41v8hln4836bro9gqs1fzl71hhiymjn21oy0iul0uiwvv1j2pmvanru2ffuvvkqy9o0f84ox5jxl8gmtbwdmrptbv0cl5yea9j6zkss1o4xqn45bannitj0dn0pat0rq92wjp6lfrde3adptrsqcrv3z1xzuuhfsm1npk1e == \l\j\1\y\h\f\f\v\7\b\l\a\v\o\o\0\3\3\5\f\1\x\d\9\c\f\h\5\x\l\m\m\8\6\2\0\v\7\d\u\z\b\9\b\e\t\0\f\i\5\j\h\t\7\z\o\p\4\y\1\m\r\b\v\r\i\l\x\4\9\3\5\8\7\q\i\4\3\0\h\z\h\6\p\u\y\3\6\3\v\b\7\8\y\x\9\t\n\7\k\0\l\e\d\e\w\z\r\8\i\n\v\t\6\5\0\h\u\7\4\a\z\u\s\i\z\t\9\0\c\1\i\h\w\9\2\q\e\2\j\k\p\n\7\d\e\m\7\h\w\l\o\0\v\3\n\b\c\b\i\9\l\b\3\h\o\c\b\f\v\v\t\4\9\k\x\9\t\5\6\j\f\n\a\m\9\i\z\5\8\6\m\5\k\y\i\d\8\w\v\5\v\1\h\l\j\6\5\m\2\0\c\j\j\j\e\2\3\y\d\m\d\1\9\3\8\w\0\6\4\0\a\p\z\n\i\c\z\9\1\l\0\1\9\q\v\b\1\f\x\j\c\k\f\4\5\6\3\y\0\7\l\c\0\u\5\t\b\5\e\4\3\k\z\p\b\u\4\f\0\p\9\e\c\6\u\6\6\h\e\o\y\q\u\g\b\d\3\m\2\0\m\7\z\c\d\6\c\a\k\h\f\5\0\k\y\g\8\h\b\2\j\v\h\e\b\6\w\d\l\g\l\u\j\6\u\y\l\n\1\j\3\4\n\v\4\1\v\8\h\l\n\4\8\3\6\b\r\o\9\g\q\s\1\f\z\l\7\1\h\h\i\y\m\j\n\2\1\o\y\0\i\u\l\0\u\i\w\v\v\1\j\2\p\m\v\a\n\r\u\2\f\f\u\v\v\k\q\y\9\o\0\f\8\4\o\x\5\j\x\l\8\g\m\t\b\w\d\m\r\p\t\b\v\0\c\l\5\y\e\a\9\j\6\z\k\s\s\1\o\4\x\q\n\4\5\b\a\n\n\i\t\j\0\d\n\0\p\a\t\0\r\q\9\2\w\j\p\6\l\f\r\d\e\3\a\d\p\t\r\s\q\c\r\v\3\z\1\x\z\u\u\h\f\s\m\1\n\p\k\1\e ]] 00:08:52.144 11:19:33 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@87 -- # for flag_rw in "${flags_rw[@]}" 00:08:52.144 11:19:33 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@89 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=nonblock --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=dsync 00:08:52.402 [2024-10-07 11:19:33.873254] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:52.402 [2024-10-07 11:19:33.873347] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60532 ] 00:08:52.402 [2024-10-07 11:19:34.036086] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:52.660 [2024-10-07 11:19:34.123215] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:52.660 [2024-10-07 11:19:34.157188] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:52.660  [2024-10-07T11:19:34.371Z] Copying: 512/512 [B] (average 500 kBps) 00:08:52.660 00:08:52.660 11:19:34 spdk_dd.spdk_dd_posix.dd_flags_misc -- dd/posix.sh@93 -- # [[ lj1yhffv7blavoo0335f1xd9cfh5xlmm8620v7duzb9bet0fi5jht7zop4y1mrbvrilx493587qi430hzh6puy363vb78yx9tn7k0ledewzr8invt650hu74azusizt90c1ihw92qe2jkpn7dem7hwlo0v3nbcbi9lb3hocbfvvt49kx9t56jfnam9iz586m5kyid8wv5v1hlj65m20cjjje23ydmd1938w0640apznicz91l019qvb1fxjckf4563y07lc0u5tb5e43kzpbu4f0p9ec6u66heoyqugbd3m20m7zcd6cakhf50kyg8hb2jvheb6wdlgluj6uyln1j34nv41v8hln4836bro9gqs1fzl71hhiymjn21oy0iul0uiwvv1j2pmvanru2ffuvvkqy9o0f84ox5jxl8gmtbwdmrptbv0cl5yea9j6zkss1o4xqn45bannitj0dn0pat0rq92wjp6lfrde3adptrsqcrv3z1xzuuhfsm1npk1e == \l\j\1\y\h\f\f\v\7\b\l\a\v\o\o\0\3\3\5\f\1\x\d\9\c\f\h\5\x\l\m\m\8\6\2\0\v\7\d\u\z\b\9\b\e\t\0\f\i\5\j\h\t\7\z\o\p\4\y\1\m\r\b\v\r\i\l\x\4\9\3\5\8\7\q\i\4\3\0\h\z\h\6\p\u\y\3\6\3\v\b\7\8\y\x\9\t\n\7\k\0\l\e\d\e\w\z\r\8\i\n\v\t\6\5\0\h\u\7\4\a\z\u\s\i\z\t\9\0\c\1\i\h\w\9\2\q\e\2\j\k\p\n\7\d\e\m\7\h\w\l\o\0\v\3\n\b\c\b\i\9\l\b\3\h\o\c\b\f\v\v\t\4\9\k\x\9\t\5\6\j\f\n\a\m\9\i\z\5\8\6\m\5\k\y\i\d\8\w\v\5\v\1\h\l\j\6\5\m\2\0\c\j\j\j\e\2\3\y\d\m\d\1\9\3\8\w\0\6\4\0\a\p\z\n\i\c\z\9\1\l\0\1\9\q\v\b\1\f\x\j\c\k\f\4\5\6\3\y\0\7\l\c\0\u\5\t\b\5\e\4\3\k\z\p\b\u\4\f\0\p\9\e\c\6\u\6\6\h\e\o\y\q\u\g\b\d\3\m\2\0\m\7\z\c\d\6\c\a\k\h\f\5\0\k\y\g\8\h\b\2\j\v\h\e\b\6\w\d\l\g\l\u\j\6\u\y\l\n\1\j\3\4\n\v\4\1\v\8\h\l\n\4\8\3\6\b\r\o\9\g\q\s\1\f\z\l\7\1\h\h\i\y\m\j\n\2\1\o\y\0\i\u\l\0\u\i\w\v\v\1\j\2\p\m\v\a\n\r\u\2\f\f\u\v\v\k\q\y\9\o\0\f\8\4\o\x\5\j\x\l\8\g\m\t\b\w\d\m\r\p\t\b\v\0\c\l\5\y\e\a\9\j\6\z\k\s\s\1\o\4\x\q\n\4\5\b\a\n\n\i\t\j\0\d\n\0\p\a\t\0\r\q\9\2\w\j\p\6\l\f\r\d\e\3\a\d\p\t\r\s\q\c\r\v\3\z\1\x\z\u\u\h\f\s\m\1\n\p\k\1\e ]] 00:08:52.660 00:08:52.660 real 0m3.739s 00:08:52.660 user 0m2.112s 00:08:52.660 sys 0m1.446s 00:08:52.660 11:19:34 spdk_dd.spdk_dd_posix.dd_flags_misc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:52.660 ************************************ 00:08:52.660 END TEST dd_flags_misc 00:08:52.660 11:19:34 spdk_dd.spdk_dd_posix.dd_flags_misc -- common/autotest_common.sh@10 -- # set +x 00:08:52.660 ************************************ 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix -- dd/posix.sh@131 -- # tests_forced_aio 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix -- dd/posix.sh@110 -- # printf '* Second test run%s\n' ', disabling liburing, forcing AIO' 00:08:52.918 * Second test run, disabling liburing, forcing AIO 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix -- dd/posix.sh@113 -- # DD_APP+=("--aio") 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix -- dd/posix.sh@114 -- # run_test dd_flag_append_forced_aio append 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@10 -- # set +x 00:08:52.918 ************************************ 00:08:52.918 START TEST dd_flag_append_forced_aio 00:08:52.918 ************************************ 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_append_forced_aio -- common/autotest_common.sh@1125 -- # append 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_append_forced_aio -- dd/posix.sh@16 -- # local dump0 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_append_forced_aio -- dd/posix.sh@17 -- # local dump1 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_append_forced_aio -- dd/posix.sh@19 -- # gen_bytes 32 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_append_forced_aio -- dd/common.sh@98 -- # xtrace_disable 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_append_forced_aio -- common/autotest_common.sh@10 -- # set +x 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_append_forced_aio -- dd/posix.sh@19 -- # dump0=2wwwuwny8kdm31zuo23x0ge0k02timsh 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_append_forced_aio -- dd/posix.sh@20 -- # gen_bytes 32 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_append_forced_aio -- dd/common.sh@98 -- # xtrace_disable 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_append_forced_aio -- common/autotest_common.sh@10 -- # set +x 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_append_forced_aio -- dd/posix.sh@20 -- # dump1=qs3e2leevyusrrje0zwc4bvg7cqjw1fa 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_append_forced_aio -- dd/posix.sh@22 -- # printf %s 2wwwuwny8kdm31zuo23x0ge0k02timsh 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_append_forced_aio -- dd/posix.sh@23 -- # printf %s qs3e2leevyusrrje0zwc4bvg7cqjw1fa 00:08:52.918 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_append_forced_aio -- dd/posix.sh@25 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=append 00:08:52.918 [2024-10-07 11:19:34.460635] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:52.918 [2024-10-07 11:19:34.460760] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60565 ] 00:08:52.918 [2024-10-07 11:19:34.603389] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:53.176 [2024-10-07 11:19:34.669375] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:53.176 [2024-10-07 11:19:34.698455] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:53.176  [2024-10-07T11:19:35.146Z] Copying: 32/32 [B] (average 31 kBps) 00:08:53.435 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_append_forced_aio -- dd/posix.sh@27 -- # [[ qs3e2leevyusrrje0zwc4bvg7cqjw1fa2wwwuwny8kdm31zuo23x0ge0k02timsh == \q\s\3\e\2\l\e\e\v\y\u\s\r\r\j\e\0\z\w\c\4\b\v\g\7\c\q\j\w\1\f\a\2\w\w\w\u\w\n\y\8\k\d\m\3\1\z\u\o\2\3\x\0\g\e\0\k\0\2\t\i\m\s\h ]] 00:08:53.435 00:08:53.435 real 0m0.529s 00:08:53.435 user 0m0.287s 00:08:53.435 sys 0m0.117s 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_append_forced_aio -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_append_forced_aio -- common/autotest_common.sh@10 -- # set +x 00:08:53.435 ************************************ 00:08:53.435 END TEST dd_flag_append_forced_aio 00:08:53.435 ************************************ 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix -- dd/posix.sh@115 -- # run_test dd_flag_directory_forced_aio directory 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@10 -- # set +x 00:08:53.435 ************************************ 00:08:53.435 START TEST dd_flag_directory_forced_aio 00:08:53.435 ************************************ 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@1125 -- # directory 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- dd/posix.sh@31 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=directory --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@650 -- # local es=0 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=directory --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:08:53.435 11:19:34 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=directory --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:08:53.435 [2024-10-07 11:19:35.017494] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:53.435 [2024-10-07 11:19:35.017676] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60587 ] 00:08:53.693 [2024-10-07 11:19:35.151323] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:53.693 [2024-10-07 11:19:35.226489] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:53.693 [2024-10-07 11:19:35.256584] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:53.693 [2024-10-07 11:19:35.280252] spdk_dd.c: 894:dd_open_file: *ERROR*: Could not open file /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0: Not a directory 00:08:53.693 [2024-10-07 11:19:35.280328] spdk_dd.c:1083:dd_run: *ERROR*: /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0: Not a directory 00:08:53.693 [2024-10-07 11:19:35.280348] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:08:53.693 [2024-10-07 11:19:35.344500] spdk_dd.c:1536:main: *ERROR*: Error occurred while performing copy 00:08:53.951 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@653 -- # es=236 00:08:53.951 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:53.951 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@662 -- # es=108 00:08:53.951 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@663 -- # case "$es" in 00:08:53.951 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@670 -- # es=1 00:08:53.951 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:53.951 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- dd/posix.sh@32 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --oflag=directory 00:08:53.951 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@650 -- # local es=0 00:08:53.951 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --oflag=directory 00:08:53.951 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:53.951 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:53.951 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:53.951 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:53.951 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:53.951 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:53.951 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:53.951 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:08:53.951 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --oflag=directory 00:08:53.951 [2024-10-07 11:19:35.486521] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:53.951 [2024-10-07 11:19:35.486628] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60601 ] 00:08:53.951 [2024-10-07 11:19:35.625063] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:54.209 [2024-10-07 11:19:35.697024] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:54.209 [2024-10-07 11:19:35.729549] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:54.209 [2024-10-07 11:19:35.750760] spdk_dd.c: 894:dd_open_file: *ERROR*: Could not open file /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0: Not a directory 00:08:54.209 [2024-10-07 11:19:35.750829] spdk_dd.c:1132:dd_run: *ERROR*: /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0: Not a directory 00:08:54.209 [2024-10-07 11:19:35.750847] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:08:54.209 [2024-10-07 11:19:35.823499] spdk_dd.c:1536:main: *ERROR*: Error occurred while performing copy 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@653 -- # es=236 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@662 -- # es=108 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@663 -- # case "$es" in 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@670 -- # es=1 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:54.467 00:08:54.467 real 0m0.971s 00:08:54.467 user 0m0.547s 00:08:54.467 sys 0m0.214s 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_directory_forced_aio -- common/autotest_common.sh@10 -- # set +x 00:08:54.467 ************************************ 00:08:54.467 END TEST dd_flag_directory_forced_aio 00:08:54.467 ************************************ 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix -- dd/posix.sh@116 -- # run_test dd_flag_nofollow_forced_aio nofollow 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@10 -- # set +x 00:08:54.467 ************************************ 00:08:54.467 START TEST dd_flag_nofollow_forced_aio 00:08:54.467 ************************************ 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@1125 -- # nofollow 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- dd/posix.sh@36 -- # local test_file0_link=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0.link 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- dd/posix.sh@37 -- # local test_file1_link=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1.link 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- dd/posix.sh@39 -- # ln -fs /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0.link 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- dd/posix.sh@40 -- # ln -fs /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1.link 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- dd/posix.sh@42 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0.link --iflag=nofollow --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@650 -- # local es=0 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0.link --iflag=nofollow --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:08:54.467 11:19:35 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0.link --iflag=nofollow --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:54.467 [2024-10-07 11:19:36.029942] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:54.467 [2024-10-07 11:19:36.030051] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60625 ] 00:08:54.467 [2024-10-07 11:19:36.163877] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:54.725 [2024-10-07 11:19:36.225517] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:54.725 [2024-10-07 11:19:36.255606] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:54.725 [2024-10-07 11:19:36.274926] spdk_dd.c: 894:dd_open_file: *ERROR*: Could not open file /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0.link: Too many levels of symbolic links 00:08:54.725 [2024-10-07 11:19:36.275000] spdk_dd.c:1083:dd_run: *ERROR*: /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0.link: Too many levels of symbolic links 00:08:54.725 [2024-10-07 11:19:36.275027] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:08:54.725 [2024-10-07 11:19:36.346532] spdk_dd.c:1536:main: *ERROR*: Error occurred while performing copy 00:08:54.725 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@653 -- # es=216 00:08:54.725 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:54.983 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@662 -- # es=88 00:08:54.984 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@663 -- # case "$es" in 00:08:54.984 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@670 -- # es=1 00:08:54.984 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:54.984 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- dd/posix.sh@43 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1.link --oflag=nofollow 00:08:54.984 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@650 -- # local es=0 00:08:54.984 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1.link --oflag=nofollow 00:08:54.984 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:54.984 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:54.984 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:54.984 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:54.984 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:54.984 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:54.984 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:08:54.984 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:08:54.984 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1.link --oflag=nofollow 00:08:54.984 [2024-10-07 11:19:36.499499] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:54.984 [2024-10-07 11:19:36.499607] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60635 ] 00:08:54.984 [2024-10-07 11:19:36.632463] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:55.242 [2024-10-07 11:19:36.695668] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:55.242 [2024-10-07 11:19:36.724891] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:55.242 [2024-10-07 11:19:36.743063] spdk_dd.c: 894:dd_open_file: *ERROR*: Could not open file /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1.link: Too many levels of symbolic links 00:08:55.242 [2024-10-07 11:19:36.743119] spdk_dd.c:1132:dd_run: *ERROR*: /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1.link: Too many levels of symbolic links 00:08:55.242 [2024-10-07 11:19:36.743135] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:08:55.242 [2024-10-07 11:19:36.806852] spdk_dd.c:1536:main: *ERROR*: Error occurred while performing copy 00:08:55.242 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@653 -- # es=216 00:08:55.242 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:55.242 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@662 -- # es=88 00:08:55.242 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@663 -- # case "$es" in 00:08:55.242 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@670 -- # es=1 00:08:55.242 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:55.242 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- dd/posix.sh@46 -- # gen_bytes 512 00:08:55.242 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- dd/common.sh@98 -- # xtrace_disable 00:08:55.242 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@10 -- # set +x 00:08:55.242 11:19:36 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- dd/posix.sh@48 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0.link --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:55.500 [2024-10-07 11:19:36.958557] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:55.500 [2024-10-07 11:19:36.958658] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60642 ] 00:08:55.500 [2024-10-07 11:19:37.092344] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:55.500 [2024-10-07 11:19:37.168380] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:55.500 [2024-10-07 11:19:37.200757] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:55.757  [2024-10-07T11:19:37.468Z] Copying: 512/512 [B] (average 500 kBps) 00:08:55.757 00:08:55.757 11:19:37 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- dd/posix.sh@49 -- # [[ fz8ekruiqr0fcxzthxk8j9tl6vhawonypgjzz27jkr8jnyja56wdrycbobtjv9vcc3bkiuw5ncuwif0j3umxchpa3cgenoitqrcew2nko7p445rbt8vyggf461l1kirb7ga2nvb9qbsb5v8a527joypi0dbocs5m68mokggi30htgzi27pl60grn6x1try0jm6s3qszwoo0vdyv9tpbu4psvwv2yqxbj4al7zlrb7m9ndevct90ot4i6eyh1ibmg74tinl4hno42t3rb62tq2zixd1boktk9puz8vtz3t9hvc8j5qngmsy10tluvedx5g0bttydm3ww59r6crcb15ikdeje76u5ljej3sgkwnzukywntdfm542ykwwf0qoohp925jhnt48x0g02fwnwl20cb068qfnfh6ne1a35v5rpgwv87cgyuyfxaoaip6tj47mrvbq4nhpsw3l5c7791rrru32ilelzrpn4wfgv9ljazdwpc0bdcnyffp1bsbw0v == \f\z\8\e\k\r\u\i\q\r\0\f\c\x\z\t\h\x\k\8\j\9\t\l\6\v\h\a\w\o\n\y\p\g\j\z\z\2\7\j\k\r\8\j\n\y\j\a\5\6\w\d\r\y\c\b\o\b\t\j\v\9\v\c\c\3\b\k\i\u\w\5\n\c\u\w\i\f\0\j\3\u\m\x\c\h\p\a\3\c\g\e\n\o\i\t\q\r\c\e\w\2\n\k\o\7\p\4\4\5\r\b\t\8\v\y\g\g\f\4\6\1\l\1\k\i\r\b\7\g\a\2\n\v\b\9\q\b\s\b\5\v\8\a\5\2\7\j\o\y\p\i\0\d\b\o\c\s\5\m\6\8\m\o\k\g\g\i\3\0\h\t\g\z\i\2\7\p\l\6\0\g\r\n\6\x\1\t\r\y\0\j\m\6\s\3\q\s\z\w\o\o\0\v\d\y\v\9\t\p\b\u\4\p\s\v\w\v\2\y\q\x\b\j\4\a\l\7\z\l\r\b\7\m\9\n\d\e\v\c\t\9\0\o\t\4\i\6\e\y\h\1\i\b\m\g\7\4\t\i\n\l\4\h\n\o\4\2\t\3\r\b\6\2\t\q\2\z\i\x\d\1\b\o\k\t\k\9\p\u\z\8\v\t\z\3\t\9\h\v\c\8\j\5\q\n\g\m\s\y\1\0\t\l\u\v\e\d\x\5\g\0\b\t\t\y\d\m\3\w\w\5\9\r\6\c\r\c\b\1\5\i\k\d\e\j\e\7\6\u\5\l\j\e\j\3\s\g\k\w\n\z\u\k\y\w\n\t\d\f\m\5\4\2\y\k\w\w\f\0\q\o\o\h\p\9\2\5\j\h\n\t\4\8\x\0\g\0\2\f\w\n\w\l\2\0\c\b\0\6\8\q\f\n\f\h\6\n\e\1\a\3\5\v\5\r\p\g\w\v\8\7\c\g\y\u\y\f\x\a\o\a\i\p\6\t\j\4\7\m\r\v\b\q\4\n\h\p\s\w\3\l\5\c\7\7\9\1\r\r\r\u\3\2\i\l\e\l\z\r\p\n\4\w\f\g\v\9\l\j\a\z\d\w\p\c\0\b\d\c\n\y\f\f\p\1\b\s\b\w\0\v ]] 00:08:55.757 00:08:55.757 real 0m1.460s 00:08:55.757 user 0m0.827s 00:08:55.757 sys 0m0.289s 00:08:55.757 11:19:37 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:55.757 11:19:37 spdk_dd.spdk_dd_posix.dd_flag_nofollow_forced_aio -- common/autotest_common.sh@10 -- # set +x 00:08:55.757 ************************************ 00:08:55.757 END TEST dd_flag_nofollow_forced_aio 00:08:55.757 ************************************ 00:08:55.757 11:19:37 spdk_dd.spdk_dd_posix -- dd/posix.sh@117 -- # run_test dd_flag_noatime_forced_aio noatime 00:08:55.757 11:19:37 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:55.758 11:19:37 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:56.016 11:19:37 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@10 -- # set +x 00:08:56.016 ************************************ 00:08:56.016 START TEST dd_flag_noatime_forced_aio 00:08:56.016 ************************************ 00:08:56.016 11:19:37 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- common/autotest_common.sh@1125 -- # noatime 00:08:56.016 11:19:37 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- dd/posix.sh@53 -- # local atime_if 00:08:56.016 11:19:37 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- dd/posix.sh@54 -- # local atime_of 00:08:56.016 11:19:37 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- dd/posix.sh@58 -- # gen_bytes 512 00:08:56.016 11:19:37 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- dd/common.sh@98 -- # xtrace_disable 00:08:56.016 11:19:37 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- common/autotest_common.sh@10 -- # set +x 00:08:56.016 11:19:37 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- dd/posix.sh@60 -- # stat --printf=%X /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:08:56.016 11:19:37 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- dd/posix.sh@60 -- # atime_if=1728299977 00:08:56.016 11:19:37 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- dd/posix.sh@61 -- # stat --printf=%X /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:56.016 11:19:37 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- dd/posix.sh@61 -- # atime_of=1728299977 00:08:56.016 11:19:37 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- dd/posix.sh@66 -- # sleep 1 00:08:56.974 11:19:38 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- dd/posix.sh@68 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=noatime --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:56.974 [2024-10-07 11:19:38.562204] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:56.974 [2024-10-07 11:19:38.562334] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60683 ] 00:08:57.232 [2024-10-07 11:19:38.702878] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:57.232 [2024-10-07 11:19:38.773442] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:57.232 [2024-10-07 11:19:38.806987] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:57.232  [2024-10-07T11:19:39.202Z] Copying: 512/512 [B] (average 500 kBps) 00:08:57.491 00:08:57.491 11:19:39 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- dd/posix.sh@69 -- # stat --printf=%X /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:08:57.491 11:19:39 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- dd/posix.sh@69 -- # (( atime_if == 1728299977 )) 00:08:57.491 11:19:39 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- dd/posix.sh@70 -- # stat --printf=%X /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:57.491 11:19:39 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- dd/posix.sh@70 -- # (( atime_of == 1728299977 )) 00:08:57.491 11:19:39 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- dd/posix.sh@72 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:08:57.491 [2024-10-07 11:19:39.096138] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:57.491 [2024-10-07 11:19:39.096271] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60694 ] 00:08:57.750 [2024-10-07 11:19:39.240686] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:57.750 [2024-10-07 11:19:39.318375] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:57.750 [2024-10-07 11:19:39.351342] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:57.750  [2024-10-07T11:19:39.735Z] Copying: 512/512 [B] (average 500 kBps) 00:08:58.024 00:08:58.024 11:19:39 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- dd/posix.sh@73 -- # stat --printf=%X /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:08:58.024 11:19:39 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- dd/posix.sh@73 -- # (( atime_if < 1728299979 )) 00:08:58.024 00:08:58.024 real 0m2.095s 00:08:58.024 user 0m0.619s 00:08:58.024 sys 0m0.231s 00:08:58.024 11:19:39 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:58.024 11:19:39 spdk_dd.spdk_dd_posix.dd_flag_noatime_forced_aio -- common/autotest_common.sh@10 -- # set +x 00:08:58.024 ************************************ 00:08:58.024 END TEST dd_flag_noatime_forced_aio 00:08:58.024 ************************************ 00:08:58.024 11:19:39 spdk_dd.spdk_dd_posix -- dd/posix.sh@118 -- # run_test dd_flags_misc_forced_aio io 00:08:58.024 11:19:39 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:58.024 11:19:39 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:58.024 11:19:39 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@10 -- # set +x 00:08:58.024 ************************************ 00:08:58.024 START TEST dd_flags_misc_forced_aio 00:08:58.024 ************************************ 00:08:58.024 11:19:39 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- common/autotest_common.sh@1125 -- # io 00:08:58.024 11:19:39 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@77 -- # local flags_ro flags_rw flag_ro flag_rw 00:08:58.024 11:19:39 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@81 -- # flags_ro=(direct nonblock) 00:08:58.024 11:19:39 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@82 -- # flags_rw=("${flags_ro[@]}" sync dsync) 00:08:58.024 11:19:39 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@85 -- # for flag_ro in "${flags_ro[@]}" 00:08:58.024 11:19:39 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@86 -- # gen_bytes 512 00:08:58.024 11:19:39 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/common.sh@98 -- # xtrace_disable 00:08:58.024 11:19:39 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- common/autotest_common.sh@10 -- # set +x 00:08:58.024 11:19:39 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@87 -- # for flag_rw in "${flags_rw[@]}" 00:08:58.024 11:19:39 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@89 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=direct --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=direct 00:08:58.024 [2024-10-07 11:19:39.705671] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:58.024 [2024-10-07 11:19:39.705816] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60725 ] 00:08:58.282 [2024-10-07 11:19:39.853833] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:58.282 [2024-10-07 11:19:39.940362] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:58.282 [2024-10-07 11:19:39.969090] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:58.282  [2024-10-07T11:19:40.250Z] Copying: 512/512 [B] (average 500 kBps) 00:08:58.539 00:08:58.539 11:19:40 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@93 -- # [[ 5gte9tbks25inyi33sc1egxb1qi29q2sceg2cwq6nh8e37wyxhvvyretwwa5g6dm8z3n9w4k2q9o9f09ny375carca3n4scbxbt2f25epz8mvj3j865lkwp1id68909g66vnr3r643x29f5yctfea5dhnf0nup6t1t08vkb1xzpq2b8pwctqhvx2vzzaz9gtljbdumdwn7odqiztxdvhw3c6oik6vtgk1s0jtzncu6znq9miiizgdtt2it0z1ccjo41yx6xih41cyecc3px88tpcwat3hni1fvfcdwbpx6tqbrlz11d9r45hfdhs68kxtz94frzq6tqsw23vlkw7iyta33i6c91wiywoua8jo4wy3h4jg0iyo4m4anfq5x8s8l20nnevctu7ru19uwo5pvcxe872dfwwppg9t4e425xixu0q436ueoqrbwtzhkz0xa7hkodum19vthbcij6wzjmoniy11avk8k8sdd6hv9silcf3jdt9n364ixupaiuf == \5\g\t\e\9\t\b\k\s\2\5\i\n\y\i\3\3\s\c\1\e\g\x\b\1\q\i\2\9\q\2\s\c\e\g\2\c\w\q\6\n\h\8\e\3\7\w\y\x\h\v\v\y\r\e\t\w\w\a\5\g\6\d\m\8\z\3\n\9\w\4\k\2\q\9\o\9\f\0\9\n\y\3\7\5\c\a\r\c\a\3\n\4\s\c\b\x\b\t\2\f\2\5\e\p\z\8\m\v\j\3\j\8\6\5\l\k\w\p\1\i\d\6\8\9\0\9\g\6\6\v\n\r\3\r\6\4\3\x\2\9\f\5\y\c\t\f\e\a\5\d\h\n\f\0\n\u\p\6\t\1\t\0\8\v\k\b\1\x\z\p\q\2\b\8\p\w\c\t\q\h\v\x\2\v\z\z\a\z\9\g\t\l\j\b\d\u\m\d\w\n\7\o\d\q\i\z\t\x\d\v\h\w\3\c\6\o\i\k\6\v\t\g\k\1\s\0\j\t\z\n\c\u\6\z\n\q\9\m\i\i\i\z\g\d\t\t\2\i\t\0\z\1\c\c\j\o\4\1\y\x\6\x\i\h\4\1\c\y\e\c\c\3\p\x\8\8\t\p\c\w\a\t\3\h\n\i\1\f\v\f\c\d\w\b\p\x\6\t\q\b\r\l\z\1\1\d\9\r\4\5\h\f\d\h\s\6\8\k\x\t\z\9\4\f\r\z\q\6\t\q\s\w\2\3\v\l\k\w\7\i\y\t\a\3\3\i\6\c\9\1\w\i\y\w\o\u\a\8\j\o\4\w\y\3\h\4\j\g\0\i\y\o\4\m\4\a\n\f\q\5\x\8\s\8\l\2\0\n\n\e\v\c\t\u\7\r\u\1\9\u\w\o\5\p\v\c\x\e\8\7\2\d\f\w\w\p\p\g\9\t\4\e\4\2\5\x\i\x\u\0\q\4\3\6\u\e\o\q\r\b\w\t\z\h\k\z\0\x\a\7\h\k\o\d\u\m\1\9\v\t\h\b\c\i\j\6\w\z\j\m\o\n\i\y\1\1\a\v\k\8\k\8\s\d\d\6\h\v\9\s\i\l\c\f\3\j\d\t\9\n\3\6\4\i\x\u\p\a\i\u\f ]] 00:08:58.539 11:19:40 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@87 -- # for flag_rw in "${flags_rw[@]}" 00:08:58.539 11:19:40 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@89 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=direct --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=nonblock 00:08:58.539 [2024-10-07 11:19:40.204791] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:58.539 [2024-10-07 11:19:40.204890] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60728 ] 00:08:58.798 [2024-10-07 11:19:40.341427] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:58.798 [2024-10-07 11:19:40.413361] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:58.798 [2024-10-07 11:19:40.446628] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:58.798  [2024-10-07T11:19:40.767Z] Copying: 512/512 [B] (average 500 kBps) 00:08:59.056 00:08:59.056 11:19:40 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@93 -- # [[ 5gte9tbks25inyi33sc1egxb1qi29q2sceg2cwq6nh8e37wyxhvvyretwwa5g6dm8z3n9w4k2q9o9f09ny375carca3n4scbxbt2f25epz8mvj3j865lkwp1id68909g66vnr3r643x29f5yctfea5dhnf0nup6t1t08vkb1xzpq2b8pwctqhvx2vzzaz9gtljbdumdwn7odqiztxdvhw3c6oik6vtgk1s0jtzncu6znq9miiizgdtt2it0z1ccjo41yx6xih41cyecc3px88tpcwat3hni1fvfcdwbpx6tqbrlz11d9r45hfdhs68kxtz94frzq6tqsw23vlkw7iyta33i6c91wiywoua8jo4wy3h4jg0iyo4m4anfq5x8s8l20nnevctu7ru19uwo5pvcxe872dfwwppg9t4e425xixu0q436ueoqrbwtzhkz0xa7hkodum19vthbcij6wzjmoniy11avk8k8sdd6hv9silcf3jdt9n364ixupaiuf == \5\g\t\e\9\t\b\k\s\2\5\i\n\y\i\3\3\s\c\1\e\g\x\b\1\q\i\2\9\q\2\s\c\e\g\2\c\w\q\6\n\h\8\e\3\7\w\y\x\h\v\v\y\r\e\t\w\w\a\5\g\6\d\m\8\z\3\n\9\w\4\k\2\q\9\o\9\f\0\9\n\y\3\7\5\c\a\r\c\a\3\n\4\s\c\b\x\b\t\2\f\2\5\e\p\z\8\m\v\j\3\j\8\6\5\l\k\w\p\1\i\d\6\8\9\0\9\g\6\6\v\n\r\3\r\6\4\3\x\2\9\f\5\y\c\t\f\e\a\5\d\h\n\f\0\n\u\p\6\t\1\t\0\8\v\k\b\1\x\z\p\q\2\b\8\p\w\c\t\q\h\v\x\2\v\z\z\a\z\9\g\t\l\j\b\d\u\m\d\w\n\7\o\d\q\i\z\t\x\d\v\h\w\3\c\6\o\i\k\6\v\t\g\k\1\s\0\j\t\z\n\c\u\6\z\n\q\9\m\i\i\i\z\g\d\t\t\2\i\t\0\z\1\c\c\j\o\4\1\y\x\6\x\i\h\4\1\c\y\e\c\c\3\p\x\8\8\t\p\c\w\a\t\3\h\n\i\1\f\v\f\c\d\w\b\p\x\6\t\q\b\r\l\z\1\1\d\9\r\4\5\h\f\d\h\s\6\8\k\x\t\z\9\4\f\r\z\q\6\t\q\s\w\2\3\v\l\k\w\7\i\y\t\a\3\3\i\6\c\9\1\w\i\y\w\o\u\a\8\j\o\4\w\y\3\h\4\j\g\0\i\y\o\4\m\4\a\n\f\q\5\x\8\s\8\l\2\0\n\n\e\v\c\t\u\7\r\u\1\9\u\w\o\5\p\v\c\x\e\8\7\2\d\f\w\w\p\p\g\9\t\4\e\4\2\5\x\i\x\u\0\q\4\3\6\u\e\o\q\r\b\w\t\z\h\k\z\0\x\a\7\h\k\o\d\u\m\1\9\v\t\h\b\c\i\j\6\w\z\j\m\o\n\i\y\1\1\a\v\k\8\k\8\s\d\d\6\h\v\9\s\i\l\c\f\3\j\d\t\9\n\3\6\4\i\x\u\p\a\i\u\f ]] 00:08:59.056 11:19:40 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@87 -- # for flag_rw in "${flags_rw[@]}" 00:08:59.056 11:19:40 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@89 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=direct --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=sync 00:08:59.056 [2024-10-07 11:19:40.708201] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:59.056 [2024-10-07 11:19:40.708288] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60737 ] 00:08:59.313 [2024-10-07 11:19:40.843645] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:59.313 [2024-10-07 11:19:40.922167] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:59.313 [2024-10-07 11:19:40.950751] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:59.313  [2024-10-07T11:19:41.282Z] Copying: 512/512 [B] (average 250 kBps) 00:08:59.571 00:08:59.571 11:19:41 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@93 -- # [[ 5gte9tbks25inyi33sc1egxb1qi29q2sceg2cwq6nh8e37wyxhvvyretwwa5g6dm8z3n9w4k2q9o9f09ny375carca3n4scbxbt2f25epz8mvj3j865lkwp1id68909g66vnr3r643x29f5yctfea5dhnf0nup6t1t08vkb1xzpq2b8pwctqhvx2vzzaz9gtljbdumdwn7odqiztxdvhw3c6oik6vtgk1s0jtzncu6znq9miiizgdtt2it0z1ccjo41yx6xih41cyecc3px88tpcwat3hni1fvfcdwbpx6tqbrlz11d9r45hfdhs68kxtz94frzq6tqsw23vlkw7iyta33i6c91wiywoua8jo4wy3h4jg0iyo4m4anfq5x8s8l20nnevctu7ru19uwo5pvcxe872dfwwppg9t4e425xixu0q436ueoqrbwtzhkz0xa7hkodum19vthbcij6wzjmoniy11avk8k8sdd6hv9silcf3jdt9n364ixupaiuf == \5\g\t\e\9\t\b\k\s\2\5\i\n\y\i\3\3\s\c\1\e\g\x\b\1\q\i\2\9\q\2\s\c\e\g\2\c\w\q\6\n\h\8\e\3\7\w\y\x\h\v\v\y\r\e\t\w\w\a\5\g\6\d\m\8\z\3\n\9\w\4\k\2\q\9\o\9\f\0\9\n\y\3\7\5\c\a\r\c\a\3\n\4\s\c\b\x\b\t\2\f\2\5\e\p\z\8\m\v\j\3\j\8\6\5\l\k\w\p\1\i\d\6\8\9\0\9\g\6\6\v\n\r\3\r\6\4\3\x\2\9\f\5\y\c\t\f\e\a\5\d\h\n\f\0\n\u\p\6\t\1\t\0\8\v\k\b\1\x\z\p\q\2\b\8\p\w\c\t\q\h\v\x\2\v\z\z\a\z\9\g\t\l\j\b\d\u\m\d\w\n\7\o\d\q\i\z\t\x\d\v\h\w\3\c\6\o\i\k\6\v\t\g\k\1\s\0\j\t\z\n\c\u\6\z\n\q\9\m\i\i\i\z\g\d\t\t\2\i\t\0\z\1\c\c\j\o\4\1\y\x\6\x\i\h\4\1\c\y\e\c\c\3\p\x\8\8\t\p\c\w\a\t\3\h\n\i\1\f\v\f\c\d\w\b\p\x\6\t\q\b\r\l\z\1\1\d\9\r\4\5\h\f\d\h\s\6\8\k\x\t\z\9\4\f\r\z\q\6\t\q\s\w\2\3\v\l\k\w\7\i\y\t\a\3\3\i\6\c\9\1\w\i\y\w\o\u\a\8\j\o\4\w\y\3\h\4\j\g\0\i\y\o\4\m\4\a\n\f\q\5\x\8\s\8\l\2\0\n\n\e\v\c\t\u\7\r\u\1\9\u\w\o\5\p\v\c\x\e\8\7\2\d\f\w\w\p\p\g\9\t\4\e\4\2\5\x\i\x\u\0\q\4\3\6\u\e\o\q\r\b\w\t\z\h\k\z\0\x\a\7\h\k\o\d\u\m\1\9\v\t\h\b\c\i\j\6\w\z\j\m\o\n\i\y\1\1\a\v\k\8\k\8\s\d\d\6\h\v\9\s\i\l\c\f\3\j\d\t\9\n\3\6\4\i\x\u\p\a\i\u\f ]] 00:08:59.571 11:19:41 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@87 -- # for flag_rw in "${flags_rw[@]}" 00:08:59.571 11:19:41 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@89 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=direct --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=dsync 00:08:59.571 [2024-10-07 11:19:41.221684] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:59.571 [2024-10-07 11:19:41.221817] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60744 ] 00:08:59.829 [2024-10-07 11:19:41.351203] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:59.829 [2024-10-07 11:19:41.412526] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:59.829 [2024-10-07 11:19:41.443372] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:08:59.829  [2024-10-07T11:19:41.798Z] Copying: 512/512 [B] (average 250 kBps) 00:09:00.087 00:09:00.087 11:19:41 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@93 -- # [[ 5gte9tbks25inyi33sc1egxb1qi29q2sceg2cwq6nh8e37wyxhvvyretwwa5g6dm8z3n9w4k2q9o9f09ny375carca3n4scbxbt2f25epz8mvj3j865lkwp1id68909g66vnr3r643x29f5yctfea5dhnf0nup6t1t08vkb1xzpq2b8pwctqhvx2vzzaz9gtljbdumdwn7odqiztxdvhw3c6oik6vtgk1s0jtzncu6znq9miiizgdtt2it0z1ccjo41yx6xih41cyecc3px88tpcwat3hni1fvfcdwbpx6tqbrlz11d9r45hfdhs68kxtz94frzq6tqsw23vlkw7iyta33i6c91wiywoua8jo4wy3h4jg0iyo4m4anfq5x8s8l20nnevctu7ru19uwo5pvcxe872dfwwppg9t4e425xixu0q436ueoqrbwtzhkz0xa7hkodum19vthbcij6wzjmoniy11avk8k8sdd6hv9silcf3jdt9n364ixupaiuf == \5\g\t\e\9\t\b\k\s\2\5\i\n\y\i\3\3\s\c\1\e\g\x\b\1\q\i\2\9\q\2\s\c\e\g\2\c\w\q\6\n\h\8\e\3\7\w\y\x\h\v\v\y\r\e\t\w\w\a\5\g\6\d\m\8\z\3\n\9\w\4\k\2\q\9\o\9\f\0\9\n\y\3\7\5\c\a\r\c\a\3\n\4\s\c\b\x\b\t\2\f\2\5\e\p\z\8\m\v\j\3\j\8\6\5\l\k\w\p\1\i\d\6\8\9\0\9\g\6\6\v\n\r\3\r\6\4\3\x\2\9\f\5\y\c\t\f\e\a\5\d\h\n\f\0\n\u\p\6\t\1\t\0\8\v\k\b\1\x\z\p\q\2\b\8\p\w\c\t\q\h\v\x\2\v\z\z\a\z\9\g\t\l\j\b\d\u\m\d\w\n\7\o\d\q\i\z\t\x\d\v\h\w\3\c\6\o\i\k\6\v\t\g\k\1\s\0\j\t\z\n\c\u\6\z\n\q\9\m\i\i\i\z\g\d\t\t\2\i\t\0\z\1\c\c\j\o\4\1\y\x\6\x\i\h\4\1\c\y\e\c\c\3\p\x\8\8\t\p\c\w\a\t\3\h\n\i\1\f\v\f\c\d\w\b\p\x\6\t\q\b\r\l\z\1\1\d\9\r\4\5\h\f\d\h\s\6\8\k\x\t\z\9\4\f\r\z\q\6\t\q\s\w\2\3\v\l\k\w\7\i\y\t\a\3\3\i\6\c\9\1\w\i\y\w\o\u\a\8\j\o\4\w\y\3\h\4\j\g\0\i\y\o\4\m\4\a\n\f\q\5\x\8\s\8\l\2\0\n\n\e\v\c\t\u\7\r\u\1\9\u\w\o\5\p\v\c\x\e\8\7\2\d\f\w\w\p\p\g\9\t\4\e\4\2\5\x\i\x\u\0\q\4\3\6\u\e\o\q\r\b\w\t\z\h\k\z\0\x\a\7\h\k\o\d\u\m\1\9\v\t\h\b\c\i\j\6\w\z\j\m\o\n\i\y\1\1\a\v\k\8\k\8\s\d\d\6\h\v\9\s\i\l\c\f\3\j\d\t\9\n\3\6\4\i\x\u\p\a\i\u\f ]] 00:09:00.087 11:19:41 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@85 -- # for flag_ro in "${flags_ro[@]}" 00:09:00.087 11:19:41 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@86 -- # gen_bytes 512 00:09:00.087 11:19:41 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/common.sh@98 -- # xtrace_disable 00:09:00.087 11:19:41 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- common/autotest_common.sh@10 -- # set +x 00:09:00.087 11:19:41 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@87 -- # for flag_rw in "${flags_rw[@]}" 00:09:00.087 11:19:41 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@89 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=nonblock --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=direct 00:09:00.087 [2024-10-07 11:19:41.692207] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:00.087 [2024-10-07 11:19:41.692306] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60752 ] 00:09:00.345 [2024-10-07 11:19:41.825824] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:00.345 [2024-10-07 11:19:41.895111] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:00.345 [2024-10-07 11:19:41.929178] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:00.345  [2024-10-07T11:19:42.314Z] Copying: 512/512 [B] (average 500 kBps) 00:09:00.603 00:09:00.603 11:19:42 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@93 -- # [[ tt69g5tykdh1xnv8kobprssmkj00p9thupalfrw0sd17scfua8jntlj5jnof5q8r3o3vcjy1zq0sl96jlq9k8h3jsob07o05l25km3z9nv6q8cc8f5lv187acpz2kvo93owr2v7hki7q0vpff2zsde3z9d6ifqwmwk215z48hg9jiqfnd2df54xa3cxw2ooa3us7hl0qvt0asc6hes42cnp199xkheudbxpxmdtspdvt1oopmap2xrzoxpb7x5b5wdllaeu12wxmxa56dqawbecqwdba7wj75htn9fmzmbqzxhl4o9rfygale1yprowlfx1o6kwcnoczv3ks81auozpyxztqse4vw7dd5gbwgp1hke996bg8d8kwd8c8for2y0q3bhr0hkr9pmhp58ch3lwrrclrrgy3pj9mxtz4255igfs1gpvsgygmgf5xvafjh9syair7dohpdgyf6reyn7btnm1r24wbqjn8ip0beq7h6vlxx5ltha9sqn4csfpg == \t\t\6\9\g\5\t\y\k\d\h\1\x\n\v\8\k\o\b\p\r\s\s\m\k\j\0\0\p\9\t\h\u\p\a\l\f\r\w\0\s\d\1\7\s\c\f\u\a\8\j\n\t\l\j\5\j\n\o\f\5\q\8\r\3\o\3\v\c\j\y\1\z\q\0\s\l\9\6\j\l\q\9\k\8\h\3\j\s\o\b\0\7\o\0\5\l\2\5\k\m\3\z\9\n\v\6\q\8\c\c\8\f\5\l\v\1\8\7\a\c\p\z\2\k\v\o\9\3\o\w\r\2\v\7\h\k\i\7\q\0\v\p\f\f\2\z\s\d\e\3\z\9\d\6\i\f\q\w\m\w\k\2\1\5\z\4\8\h\g\9\j\i\q\f\n\d\2\d\f\5\4\x\a\3\c\x\w\2\o\o\a\3\u\s\7\h\l\0\q\v\t\0\a\s\c\6\h\e\s\4\2\c\n\p\1\9\9\x\k\h\e\u\d\b\x\p\x\m\d\t\s\p\d\v\t\1\o\o\p\m\a\p\2\x\r\z\o\x\p\b\7\x\5\b\5\w\d\l\l\a\e\u\1\2\w\x\m\x\a\5\6\d\q\a\w\b\e\c\q\w\d\b\a\7\w\j\7\5\h\t\n\9\f\m\z\m\b\q\z\x\h\l\4\o\9\r\f\y\g\a\l\e\1\y\p\r\o\w\l\f\x\1\o\6\k\w\c\n\o\c\z\v\3\k\s\8\1\a\u\o\z\p\y\x\z\t\q\s\e\4\v\w\7\d\d\5\g\b\w\g\p\1\h\k\e\9\9\6\b\g\8\d\8\k\w\d\8\c\8\f\o\r\2\y\0\q\3\b\h\r\0\h\k\r\9\p\m\h\p\5\8\c\h\3\l\w\r\r\c\l\r\r\g\y\3\p\j\9\m\x\t\z\4\2\5\5\i\g\f\s\1\g\p\v\s\g\y\g\m\g\f\5\x\v\a\f\j\h\9\s\y\a\i\r\7\d\o\h\p\d\g\y\f\6\r\e\y\n\7\b\t\n\m\1\r\2\4\w\b\q\j\n\8\i\p\0\b\e\q\7\h\6\v\l\x\x\5\l\t\h\a\9\s\q\n\4\c\s\f\p\g ]] 00:09:00.603 11:19:42 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@87 -- # for flag_rw in "${flags_rw[@]}" 00:09:00.603 11:19:42 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@89 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=nonblock --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=nonblock 00:09:00.603 [2024-10-07 11:19:42.216486] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:00.603 [2024-10-07 11:19:42.216642] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60759 ] 00:09:00.862 [2024-10-07 11:19:42.352704] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:00.862 [2024-10-07 11:19:42.461355] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:00.862 [2024-10-07 11:19:42.504882] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:00.862  [2024-10-07T11:19:42.833Z] Copying: 512/512 [B] (average 500 kBps) 00:09:01.122 00:09:01.123 11:19:42 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@93 -- # [[ tt69g5tykdh1xnv8kobprssmkj00p9thupalfrw0sd17scfua8jntlj5jnof5q8r3o3vcjy1zq0sl96jlq9k8h3jsob07o05l25km3z9nv6q8cc8f5lv187acpz2kvo93owr2v7hki7q0vpff2zsde3z9d6ifqwmwk215z48hg9jiqfnd2df54xa3cxw2ooa3us7hl0qvt0asc6hes42cnp199xkheudbxpxmdtspdvt1oopmap2xrzoxpb7x5b5wdllaeu12wxmxa56dqawbecqwdba7wj75htn9fmzmbqzxhl4o9rfygale1yprowlfx1o6kwcnoczv3ks81auozpyxztqse4vw7dd5gbwgp1hke996bg8d8kwd8c8for2y0q3bhr0hkr9pmhp58ch3lwrrclrrgy3pj9mxtz4255igfs1gpvsgygmgf5xvafjh9syair7dohpdgyf6reyn7btnm1r24wbqjn8ip0beq7h6vlxx5ltha9sqn4csfpg == \t\t\6\9\g\5\t\y\k\d\h\1\x\n\v\8\k\o\b\p\r\s\s\m\k\j\0\0\p\9\t\h\u\p\a\l\f\r\w\0\s\d\1\7\s\c\f\u\a\8\j\n\t\l\j\5\j\n\o\f\5\q\8\r\3\o\3\v\c\j\y\1\z\q\0\s\l\9\6\j\l\q\9\k\8\h\3\j\s\o\b\0\7\o\0\5\l\2\5\k\m\3\z\9\n\v\6\q\8\c\c\8\f\5\l\v\1\8\7\a\c\p\z\2\k\v\o\9\3\o\w\r\2\v\7\h\k\i\7\q\0\v\p\f\f\2\z\s\d\e\3\z\9\d\6\i\f\q\w\m\w\k\2\1\5\z\4\8\h\g\9\j\i\q\f\n\d\2\d\f\5\4\x\a\3\c\x\w\2\o\o\a\3\u\s\7\h\l\0\q\v\t\0\a\s\c\6\h\e\s\4\2\c\n\p\1\9\9\x\k\h\e\u\d\b\x\p\x\m\d\t\s\p\d\v\t\1\o\o\p\m\a\p\2\x\r\z\o\x\p\b\7\x\5\b\5\w\d\l\l\a\e\u\1\2\w\x\m\x\a\5\6\d\q\a\w\b\e\c\q\w\d\b\a\7\w\j\7\5\h\t\n\9\f\m\z\m\b\q\z\x\h\l\4\o\9\r\f\y\g\a\l\e\1\y\p\r\o\w\l\f\x\1\o\6\k\w\c\n\o\c\z\v\3\k\s\8\1\a\u\o\z\p\y\x\z\t\q\s\e\4\v\w\7\d\d\5\g\b\w\g\p\1\h\k\e\9\9\6\b\g\8\d\8\k\w\d\8\c\8\f\o\r\2\y\0\q\3\b\h\r\0\h\k\r\9\p\m\h\p\5\8\c\h\3\l\w\r\r\c\l\r\r\g\y\3\p\j\9\m\x\t\z\4\2\5\5\i\g\f\s\1\g\p\v\s\g\y\g\m\g\f\5\x\v\a\f\j\h\9\s\y\a\i\r\7\d\o\h\p\d\g\y\f\6\r\e\y\n\7\b\t\n\m\1\r\2\4\w\b\q\j\n\8\i\p\0\b\e\q\7\h\6\v\l\x\x\5\l\t\h\a\9\s\q\n\4\c\s\f\p\g ]] 00:09:01.123 11:19:42 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@87 -- # for flag_rw in "${flags_rw[@]}" 00:09:01.123 11:19:42 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@89 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=nonblock --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=sync 00:09:01.123 [2024-10-07 11:19:42.752742] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:01.123 [2024-10-07 11:19:42.752857] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60767 ] 00:09:01.381 [2024-10-07 11:19:42.891323] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:01.381 [2024-10-07 11:19:42.966290] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:01.381 [2024-10-07 11:19:43.000068] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:01.381  [2024-10-07T11:19:43.350Z] Copying: 512/512 [B] (average 500 kBps) 00:09:01.639 00:09:01.639 11:19:43 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@93 -- # [[ tt69g5tykdh1xnv8kobprssmkj00p9thupalfrw0sd17scfua8jntlj5jnof5q8r3o3vcjy1zq0sl96jlq9k8h3jsob07o05l25km3z9nv6q8cc8f5lv187acpz2kvo93owr2v7hki7q0vpff2zsde3z9d6ifqwmwk215z48hg9jiqfnd2df54xa3cxw2ooa3us7hl0qvt0asc6hes42cnp199xkheudbxpxmdtspdvt1oopmap2xrzoxpb7x5b5wdllaeu12wxmxa56dqawbecqwdba7wj75htn9fmzmbqzxhl4o9rfygale1yprowlfx1o6kwcnoczv3ks81auozpyxztqse4vw7dd5gbwgp1hke996bg8d8kwd8c8for2y0q3bhr0hkr9pmhp58ch3lwrrclrrgy3pj9mxtz4255igfs1gpvsgygmgf5xvafjh9syair7dohpdgyf6reyn7btnm1r24wbqjn8ip0beq7h6vlxx5ltha9sqn4csfpg == \t\t\6\9\g\5\t\y\k\d\h\1\x\n\v\8\k\o\b\p\r\s\s\m\k\j\0\0\p\9\t\h\u\p\a\l\f\r\w\0\s\d\1\7\s\c\f\u\a\8\j\n\t\l\j\5\j\n\o\f\5\q\8\r\3\o\3\v\c\j\y\1\z\q\0\s\l\9\6\j\l\q\9\k\8\h\3\j\s\o\b\0\7\o\0\5\l\2\5\k\m\3\z\9\n\v\6\q\8\c\c\8\f\5\l\v\1\8\7\a\c\p\z\2\k\v\o\9\3\o\w\r\2\v\7\h\k\i\7\q\0\v\p\f\f\2\z\s\d\e\3\z\9\d\6\i\f\q\w\m\w\k\2\1\5\z\4\8\h\g\9\j\i\q\f\n\d\2\d\f\5\4\x\a\3\c\x\w\2\o\o\a\3\u\s\7\h\l\0\q\v\t\0\a\s\c\6\h\e\s\4\2\c\n\p\1\9\9\x\k\h\e\u\d\b\x\p\x\m\d\t\s\p\d\v\t\1\o\o\p\m\a\p\2\x\r\z\o\x\p\b\7\x\5\b\5\w\d\l\l\a\e\u\1\2\w\x\m\x\a\5\6\d\q\a\w\b\e\c\q\w\d\b\a\7\w\j\7\5\h\t\n\9\f\m\z\m\b\q\z\x\h\l\4\o\9\r\f\y\g\a\l\e\1\y\p\r\o\w\l\f\x\1\o\6\k\w\c\n\o\c\z\v\3\k\s\8\1\a\u\o\z\p\y\x\z\t\q\s\e\4\v\w\7\d\d\5\g\b\w\g\p\1\h\k\e\9\9\6\b\g\8\d\8\k\w\d\8\c\8\f\o\r\2\y\0\q\3\b\h\r\0\h\k\r\9\p\m\h\p\5\8\c\h\3\l\w\r\r\c\l\r\r\g\y\3\p\j\9\m\x\t\z\4\2\5\5\i\g\f\s\1\g\p\v\s\g\y\g\m\g\f\5\x\v\a\f\j\h\9\s\y\a\i\r\7\d\o\h\p\d\g\y\f\6\r\e\y\n\7\b\t\n\m\1\r\2\4\w\b\q\j\n\8\i\p\0\b\e\q\7\h\6\v\l\x\x\5\l\t\h\a\9\s\q\n\4\c\s\f\p\g ]] 00:09:01.639 11:19:43 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@87 -- # for flag_rw in "${flags_rw[@]}" 00:09:01.639 11:19:43 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@89 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --aio --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --iflag=nonblock --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=dsync 00:09:01.639 [2024-10-07 11:19:43.280282] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:01.639 [2024-10-07 11:19:43.280391] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60774 ] 00:09:01.897 [2024-10-07 11:19:43.419253] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:01.897 [2024-10-07 11:19:43.479096] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:01.897 [2024-10-07 11:19:43.507649] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:01.898  [2024-10-07T11:19:43.868Z] Copying: 512/512 [B] (average 500 kBps) 00:09:02.157 00:09:02.157 11:19:43 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- dd/posix.sh@93 -- # [[ tt69g5tykdh1xnv8kobprssmkj00p9thupalfrw0sd17scfua8jntlj5jnof5q8r3o3vcjy1zq0sl96jlq9k8h3jsob07o05l25km3z9nv6q8cc8f5lv187acpz2kvo93owr2v7hki7q0vpff2zsde3z9d6ifqwmwk215z48hg9jiqfnd2df54xa3cxw2ooa3us7hl0qvt0asc6hes42cnp199xkheudbxpxmdtspdvt1oopmap2xrzoxpb7x5b5wdllaeu12wxmxa56dqawbecqwdba7wj75htn9fmzmbqzxhl4o9rfygale1yprowlfx1o6kwcnoczv3ks81auozpyxztqse4vw7dd5gbwgp1hke996bg8d8kwd8c8for2y0q3bhr0hkr9pmhp58ch3lwrrclrrgy3pj9mxtz4255igfs1gpvsgygmgf5xvafjh9syair7dohpdgyf6reyn7btnm1r24wbqjn8ip0beq7h6vlxx5ltha9sqn4csfpg == \t\t\6\9\g\5\t\y\k\d\h\1\x\n\v\8\k\o\b\p\r\s\s\m\k\j\0\0\p\9\t\h\u\p\a\l\f\r\w\0\s\d\1\7\s\c\f\u\a\8\j\n\t\l\j\5\j\n\o\f\5\q\8\r\3\o\3\v\c\j\y\1\z\q\0\s\l\9\6\j\l\q\9\k\8\h\3\j\s\o\b\0\7\o\0\5\l\2\5\k\m\3\z\9\n\v\6\q\8\c\c\8\f\5\l\v\1\8\7\a\c\p\z\2\k\v\o\9\3\o\w\r\2\v\7\h\k\i\7\q\0\v\p\f\f\2\z\s\d\e\3\z\9\d\6\i\f\q\w\m\w\k\2\1\5\z\4\8\h\g\9\j\i\q\f\n\d\2\d\f\5\4\x\a\3\c\x\w\2\o\o\a\3\u\s\7\h\l\0\q\v\t\0\a\s\c\6\h\e\s\4\2\c\n\p\1\9\9\x\k\h\e\u\d\b\x\p\x\m\d\t\s\p\d\v\t\1\o\o\p\m\a\p\2\x\r\z\o\x\p\b\7\x\5\b\5\w\d\l\l\a\e\u\1\2\w\x\m\x\a\5\6\d\q\a\w\b\e\c\q\w\d\b\a\7\w\j\7\5\h\t\n\9\f\m\z\m\b\q\z\x\h\l\4\o\9\r\f\y\g\a\l\e\1\y\p\r\o\w\l\f\x\1\o\6\k\w\c\n\o\c\z\v\3\k\s\8\1\a\u\o\z\p\y\x\z\t\q\s\e\4\v\w\7\d\d\5\g\b\w\g\p\1\h\k\e\9\9\6\b\g\8\d\8\k\w\d\8\c\8\f\o\r\2\y\0\q\3\b\h\r\0\h\k\r\9\p\m\h\p\5\8\c\h\3\l\w\r\r\c\l\r\r\g\y\3\p\j\9\m\x\t\z\4\2\5\5\i\g\f\s\1\g\p\v\s\g\y\g\m\g\f\5\x\v\a\f\j\h\9\s\y\a\i\r\7\d\o\h\p\d\g\y\f\6\r\e\y\n\7\b\t\n\m\1\r\2\4\w\b\q\j\n\8\i\p\0\b\e\q\7\h\6\v\l\x\x\5\l\t\h\a\9\s\q\n\4\c\s\f\p\g ]] 00:09:02.157 00:09:02.157 real 0m4.073s 00:09:02.157 user 0m2.240s 00:09:02.157 sys 0m0.838s 00:09:02.157 11:19:43 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:02.157 11:19:43 spdk_dd.spdk_dd_posix.dd_flags_misc_forced_aio -- common/autotest_common.sh@10 -- # set +x 00:09:02.157 ************************************ 00:09:02.157 END TEST dd_flags_misc_forced_aio 00:09:02.157 ************************************ 00:09:02.157 11:19:43 spdk_dd.spdk_dd_posix -- dd/posix.sh@1 -- # cleanup 00:09:02.157 11:19:43 spdk_dd.spdk_dd_posix -- dd/posix.sh@11 -- # rm -f /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0.link 00:09:02.157 11:19:43 spdk_dd.spdk_dd_posix -- dd/posix.sh@12 -- # rm -f /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1.link 00:09:02.157 00:09:02.157 real 0m18.432s 00:09:02.157 user 0m9.076s 00:09:02.157 sys 0m4.687s 00:09:02.157 11:19:43 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:02.157 ************************************ 00:09:02.157 END TEST spdk_dd_posix 00:09:02.157 ************************************ 00:09:02.157 11:19:43 spdk_dd.spdk_dd_posix -- common/autotest_common.sh@10 -- # set +x 00:09:02.157 11:19:43 spdk_dd -- dd/dd.sh@22 -- # run_test spdk_dd_malloc /home/vagrant/spdk_repo/spdk/test/dd/malloc.sh 00:09:02.157 11:19:43 spdk_dd -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:02.157 11:19:43 spdk_dd -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:02.157 11:19:43 spdk_dd -- common/autotest_common.sh@10 -- # set +x 00:09:02.157 ************************************ 00:09:02.157 START TEST spdk_dd_malloc 00:09:02.157 ************************************ 00:09:02.157 11:19:43 spdk_dd.spdk_dd_malloc -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/dd/malloc.sh 00:09:02.416 * Looking for test storage... 00:09:02.416 * Found test storage at /home/vagrant/spdk_repo/spdk/test/dd 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- common/autotest_common.sh@1681 -- # lcov --version 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@336 -- # IFS=.-: 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@336 -- # read -ra ver1 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@337 -- # IFS=.-: 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@337 -- # read -ra ver2 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@338 -- # local 'op=<' 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@340 -- # ver1_l=2 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@341 -- # ver2_l=1 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@344 -- # case "$op" in 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@345 -- # : 1 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@365 -- # decimal 1 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@353 -- # local d=1 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@355 -- # echo 1 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@365 -- # ver1[v]=1 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@366 -- # decimal 2 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@353 -- # local d=2 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@355 -- # echo 2 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@366 -- # ver2[v]=2 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@368 -- # return 0 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:02.416 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:02.416 --rc genhtml_branch_coverage=1 00:09:02.416 --rc genhtml_function_coverage=1 00:09:02.416 --rc genhtml_legend=1 00:09:02.416 --rc geninfo_all_blocks=1 00:09:02.416 --rc geninfo_unexecuted_blocks=1 00:09:02.416 00:09:02.416 ' 00:09:02.416 11:19:43 spdk_dd.spdk_dd_malloc -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:02.416 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:02.416 --rc genhtml_branch_coverage=1 00:09:02.417 --rc genhtml_function_coverage=1 00:09:02.417 --rc genhtml_legend=1 00:09:02.417 --rc geninfo_all_blocks=1 00:09:02.417 --rc geninfo_unexecuted_blocks=1 00:09:02.417 00:09:02.417 ' 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:02.417 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:02.417 --rc genhtml_branch_coverage=1 00:09:02.417 --rc genhtml_function_coverage=1 00:09:02.417 --rc genhtml_legend=1 00:09:02.417 --rc geninfo_all_blocks=1 00:09:02.417 --rc geninfo_unexecuted_blocks=1 00:09:02.417 00:09:02.417 ' 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:02.417 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:02.417 --rc genhtml_branch_coverage=1 00:09:02.417 --rc genhtml_function_coverage=1 00:09:02.417 --rc genhtml_legend=1 00:09:02.417 --rc geninfo_all_blocks=1 00:09:02.417 --rc geninfo_unexecuted_blocks=1 00:09:02.417 00:09:02.417 ' 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc -- dd/common.sh@7 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@15 -- # shopt -s extglob 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc -- paths/export.sh@5 -- # export PATH 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc -- dd/malloc.sh@38 -- # run_test dd_malloc_copy malloc_copy 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc -- common/autotest_common.sh@10 -- # set +x 00:09:02.417 ************************************ 00:09:02.417 START TEST dd_malloc_copy 00:09:02.417 ************************************ 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc.dd_malloc_copy -- common/autotest_common.sh@1125 -- # malloc_copy 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc.dd_malloc_copy -- dd/malloc.sh@12 -- # local mbdev0=malloc0 mbdev0_b=1048576 mbdev0_bs=512 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc.dd_malloc_copy -- dd/malloc.sh@13 -- # local mbdev1=malloc1 mbdev1_b=1048576 mbdev1_bs=512 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc.dd_malloc_copy -- dd/malloc.sh@15 -- # method_bdev_malloc_create_0=(['name']='malloc0' ['num_blocks']='1048576' ['block_size']='512') 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc.dd_malloc_copy -- dd/malloc.sh@15 -- # local -A method_bdev_malloc_create_0 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc.dd_malloc_copy -- dd/malloc.sh@21 -- # method_bdev_malloc_create_1=(['name']='malloc1' ['num_blocks']='1048576' ['block_size']='512') 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc.dd_malloc_copy -- dd/malloc.sh@21 -- # local -A method_bdev_malloc_create_1 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc.dd_malloc_copy -- dd/malloc.sh@28 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=malloc0 --ob=malloc1 --json /dev/fd/62 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc.dd_malloc_copy -- dd/malloc.sh@28 -- # gen_conf 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc.dd_malloc_copy -- dd/common.sh@31 -- # xtrace_disable 00:09:02.417 11:19:43 spdk_dd.spdk_dd_malloc.dd_malloc_copy -- common/autotest_common.sh@10 -- # set +x 00:09:02.417 [2024-10-07 11:19:44.056673] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:02.417 [2024-10-07 11:19:44.056837] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60856 ] 00:09:02.417 { 00:09:02.417 "subsystems": [ 00:09:02.417 { 00:09:02.417 "subsystem": "bdev", 00:09:02.417 "config": [ 00:09:02.417 { 00:09:02.417 "params": { 00:09:02.417 "block_size": 512, 00:09:02.417 "num_blocks": 1048576, 00:09:02.417 "name": "malloc0" 00:09:02.417 }, 00:09:02.417 "method": "bdev_malloc_create" 00:09:02.417 }, 00:09:02.417 { 00:09:02.417 "params": { 00:09:02.417 "block_size": 512, 00:09:02.417 "num_blocks": 1048576, 00:09:02.417 "name": "malloc1" 00:09:02.417 }, 00:09:02.417 "method": "bdev_malloc_create" 00:09:02.417 }, 00:09:02.417 { 00:09:02.417 "method": "bdev_wait_for_examine" 00:09:02.417 } 00:09:02.417 ] 00:09:02.417 } 00:09:02.417 ] 00:09:02.417 } 00:09:02.676 [2024-10-07 11:19:44.199904] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:02.676 [2024-10-07 11:19:44.258576] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:02.676 [2024-10-07 11:19:44.288583] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:04.052  [2024-10-07T11:19:46.699Z] Copying: 190/512 [MB] (190 MBps) [2024-10-07T11:19:47.265Z] Copying: 382/512 [MB] (191 MBps) [2024-10-07T11:19:47.832Z] Copying: 512/512 [MB] (average 190 MBps) 00:09:06.121 00:09:06.121 11:19:47 spdk_dd.spdk_dd_malloc.dd_malloc_copy -- dd/malloc.sh@33 -- # gen_conf 00:09:06.121 11:19:47 spdk_dd.spdk_dd_malloc.dd_malloc_copy -- dd/malloc.sh@33 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=malloc1 --ob=malloc0 --json /dev/fd/62 00:09:06.121 11:19:47 spdk_dd.spdk_dd_malloc.dd_malloc_copy -- dd/common.sh@31 -- # xtrace_disable 00:09:06.121 11:19:47 spdk_dd.spdk_dd_malloc.dd_malloc_copy -- common/autotest_common.sh@10 -- # set +x 00:09:06.121 [2024-10-07 11:19:47.593716] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:06.121 [2024-10-07 11:19:47.593829] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60904 ] 00:09:06.121 { 00:09:06.121 "subsystems": [ 00:09:06.121 { 00:09:06.121 "subsystem": "bdev", 00:09:06.121 "config": [ 00:09:06.121 { 00:09:06.121 "params": { 00:09:06.121 "block_size": 512, 00:09:06.121 "num_blocks": 1048576, 00:09:06.121 "name": "malloc0" 00:09:06.121 }, 00:09:06.121 "method": "bdev_malloc_create" 00:09:06.121 }, 00:09:06.121 { 00:09:06.121 "params": { 00:09:06.121 "block_size": 512, 00:09:06.121 "num_blocks": 1048576, 00:09:06.121 "name": "malloc1" 00:09:06.121 }, 00:09:06.121 "method": "bdev_malloc_create" 00:09:06.121 }, 00:09:06.121 { 00:09:06.121 "method": "bdev_wait_for_examine" 00:09:06.121 } 00:09:06.121 ] 00:09:06.121 } 00:09:06.121 ] 00:09:06.121 } 00:09:06.121 [2024-10-07 11:19:47.734575] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:06.121 [2024-10-07 11:19:47.795300] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:06.121 [2024-10-07 11:19:47.826029] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:07.550  [2024-10-07T11:19:50.194Z] Copying: 193/512 [MB] (193 MBps) [2024-10-07T11:19:50.759Z] Copying: 387/512 [MB] (193 MBps) [2024-10-07T11:19:51.017Z] Copying: 512/512 [MB] (average 193 MBps) 00:09:09.306 00:09:09.565 00:09:09.565 real 0m7.036s 00:09:09.565 user 0m6.397s 00:09:09.565 sys 0m0.497s 00:09:09.565 11:19:51 spdk_dd.spdk_dd_malloc.dd_malloc_copy -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:09.565 ************************************ 00:09:09.565 END TEST dd_malloc_copy 00:09:09.565 ************************************ 00:09:09.565 11:19:51 spdk_dd.spdk_dd_malloc.dd_malloc_copy -- common/autotest_common.sh@10 -- # set +x 00:09:09.565 00:09:09.565 real 0m7.260s 00:09:09.565 user 0m6.530s 00:09:09.565 sys 0m0.597s 00:09:09.565 ************************************ 00:09:09.565 END TEST spdk_dd_malloc 00:09:09.565 ************************************ 00:09:09.565 11:19:51 spdk_dd.spdk_dd_malloc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:09.565 11:19:51 spdk_dd.spdk_dd_malloc -- common/autotest_common.sh@10 -- # set +x 00:09:09.565 11:19:51 spdk_dd -- dd/dd.sh@23 -- # run_test spdk_dd_bdev_to_bdev /home/vagrant/spdk_repo/spdk/test/dd/bdev_to_bdev.sh 0000:00:10.0 0000:00:11.0 00:09:09.565 11:19:51 spdk_dd -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:09:09.565 11:19:51 spdk_dd -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:09.565 11:19:51 spdk_dd -- common/autotest_common.sh@10 -- # set +x 00:09:09.565 ************************************ 00:09:09.565 START TEST spdk_dd_bdev_to_bdev 00:09:09.565 ************************************ 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/dd/bdev_to_bdev.sh 0000:00:10.0 0000:00:11.0 00:09:09.565 * Looking for test storage... 00:09:09.565 * Found test storage at /home/vagrant/spdk_repo/spdk/test/dd 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@1681 -- # lcov --version 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@336 -- # IFS=.-: 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@336 -- # read -ra ver1 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@337 -- # IFS=.-: 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@337 -- # read -ra ver2 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@338 -- # local 'op=<' 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@340 -- # ver1_l=2 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@341 -- # ver2_l=1 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@344 -- # case "$op" in 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@345 -- # : 1 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:09.565 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@365 -- # decimal 1 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@353 -- # local d=1 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@355 -- # echo 1 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@365 -- # ver1[v]=1 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@366 -- # decimal 2 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@353 -- # local d=2 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@355 -- # echo 2 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@366 -- # ver2[v]=2 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@368 -- # return 0 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:09.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:09.824 --rc genhtml_branch_coverage=1 00:09:09.824 --rc genhtml_function_coverage=1 00:09:09.824 --rc genhtml_legend=1 00:09:09.824 --rc geninfo_all_blocks=1 00:09:09.824 --rc geninfo_unexecuted_blocks=1 00:09:09.824 00:09:09.824 ' 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:09.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:09.824 --rc genhtml_branch_coverage=1 00:09:09.824 --rc genhtml_function_coverage=1 00:09:09.824 --rc genhtml_legend=1 00:09:09.824 --rc geninfo_all_blocks=1 00:09:09.824 --rc geninfo_unexecuted_blocks=1 00:09:09.824 00:09:09.824 ' 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:09.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:09.824 --rc genhtml_branch_coverage=1 00:09:09.824 --rc genhtml_function_coverage=1 00:09:09.824 --rc genhtml_legend=1 00:09:09.824 --rc geninfo_all_blocks=1 00:09:09.824 --rc geninfo_unexecuted_blocks=1 00:09:09.824 00:09:09.824 ' 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:09.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:09.824 --rc genhtml_branch_coverage=1 00:09:09.824 --rc genhtml_function_coverage=1 00:09:09.824 --rc genhtml_legend=1 00:09:09.824 --rc geninfo_all_blocks=1 00:09:09.824 --rc geninfo_unexecuted_blocks=1 00:09:09.824 00:09:09.824 ' 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/common.sh@7 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@15 -- # shopt -s extglob 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- paths/export.sh@5 -- # export PATH 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@10 -- # nvmes=("$@") 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@47 -- # trap cleanup EXIT 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@49 -- # bs=1048576 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@51 -- # (( 2 > 1 )) 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@52 -- # nvme0=Nvme0 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@52 -- # bdev0=Nvme0n1 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@52 -- # nvme0_pci=0000:00:10.0 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@53 -- # nvme1=Nvme1 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@53 -- # bdev1=Nvme1n1 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@53 -- # nvme1_pci=0000:00:11.0 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@55 -- # method_bdev_nvme_attach_controller_0=(['name']='Nvme0' ['traddr']='0000:00:10.0' ['trtype']='pcie') 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@55 -- # declare -A method_bdev_nvme_attach_controller_0 00:09:09.824 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@60 -- # method_bdev_nvme_attach_controller_1=(['name']='Nvme1' ['traddr']='0000:00:11.0' ['trtype']='pcie') 00:09:09.825 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@60 -- # declare -A method_bdev_nvme_attach_controller_1 00:09:09.825 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@89 -- # test_file0=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:09:09.825 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@90 -- # test_file1=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:09:09.825 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@92 -- # magic='This Is Our Magic, find it' 00:09:09.825 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@93 -- # echo 'This Is Our Magic, find it' 00:09:09.825 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@96 -- # run_test dd_inflate_file /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/dev/zero --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --oflag=append --bs=1048576 --count=64 00:09:09.825 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@1101 -- # '[' 7 -le 1 ']' 00:09:09.825 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:09.825 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@10 -- # set +x 00:09:09.825 ************************************ 00:09:09.825 START TEST dd_inflate_file 00:09:09.825 ************************************ 00:09:09.825 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev.dd_inflate_file -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/dev/zero --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --oflag=append --bs=1048576 --count=64 00:09:09.825 [2024-10-07 11:19:51.358000] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:09.825 [2024-10-07 11:19:51.358325] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61018 ] 00:09:09.825 [2024-10-07 11:19:51.500781] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:10.084 [2024-10-07 11:19:51.573583] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:10.084 [2024-10-07 11:19:51.607476] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:10.084  [2024-10-07T11:19:52.052Z] Copying: 64/64 [MB] (average 1306 MBps) 00:09:10.341 00:09:10.341 00:09:10.341 real 0m0.545s 00:09:10.341 user 0m0.338s 00:09:10.341 sys 0m0.248s 00:09:10.341 ************************************ 00:09:10.341 END TEST dd_inflate_file 00:09:10.341 ************************************ 00:09:10.341 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev.dd_inflate_file -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:10.341 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev.dd_inflate_file -- common/autotest_common.sh@10 -- # set +x 00:09:10.341 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@104 -- # wc -c 00:09:10.341 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@104 -- # test_file0_size=67108891 00:09:10.341 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@107 -- # run_test dd_copy_to_out_bdev /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --ob=Nvme0n1 --json /dev/fd/62 00:09:10.341 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@107 -- # gen_conf 00:09:10.341 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- dd/common.sh@31 -- # xtrace_disable 00:09:10.341 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@1101 -- # '[' 6 -le 1 ']' 00:09:10.341 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@10 -- # set +x 00:09:10.341 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:10.341 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@10 -- # set +x 00:09:10.341 ************************************ 00:09:10.341 START TEST dd_copy_to_out_bdev 00:09:10.341 ************************************ 00:09:10.341 11:19:51 spdk_dd.spdk_dd_bdev_to_bdev.dd_copy_to_out_bdev -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --ob=Nvme0n1 --json /dev/fd/62 00:09:10.341 { 00:09:10.341 "subsystems": [ 00:09:10.341 { 00:09:10.341 "subsystem": "bdev", 00:09:10.341 "config": [ 00:09:10.341 { 00:09:10.341 "params": { 00:09:10.341 "trtype": "pcie", 00:09:10.341 "traddr": "0000:00:10.0", 00:09:10.341 "name": "Nvme0" 00:09:10.341 }, 00:09:10.341 "method": "bdev_nvme_attach_controller" 00:09:10.341 }, 00:09:10.341 { 00:09:10.341 "params": { 00:09:10.341 "trtype": "pcie", 00:09:10.341 "traddr": "0000:00:11.0", 00:09:10.341 "name": "Nvme1" 00:09:10.341 }, 00:09:10.341 "method": "bdev_nvme_attach_controller" 00:09:10.341 }, 00:09:10.341 { 00:09:10.341 "method": "bdev_wait_for_examine" 00:09:10.341 } 00:09:10.341 ] 00:09:10.341 } 00:09:10.341 ] 00:09:10.341 } 00:09:10.341 [2024-10-07 11:19:51.952937] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:10.341 [2024-10-07 11:19:51.953250] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61053 ] 00:09:10.599 [2024-10-07 11:19:52.091984] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:10.599 [2024-10-07 11:19:52.174149] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:10.599 [2024-10-07 11:19:52.217543] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:11.971  [2024-10-07T11:19:53.682Z] Copying: 64/64 [MB] (average 68 MBps) 00:09:11.971 00:09:11.971 00:09:11.971 real 0m1.615s 00:09:11.971 user 0m1.414s 00:09:11.971 sys 0m1.201s 00:09:11.971 ************************************ 00:09:11.971 END TEST dd_copy_to_out_bdev 00:09:11.971 ************************************ 00:09:11.971 11:19:53 spdk_dd.spdk_dd_bdev_to_bdev.dd_copy_to_out_bdev -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:11.971 11:19:53 spdk_dd.spdk_dd_bdev_to_bdev.dd_copy_to_out_bdev -- common/autotest_common.sh@10 -- # set +x 00:09:11.971 11:19:53 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@113 -- # count=65 00:09:11.971 11:19:53 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@115 -- # run_test dd_offset_magic offset_magic 00:09:11.971 11:19:53 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:11.971 11:19:53 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:11.971 11:19:53 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@10 -- # set +x 00:09:11.971 ************************************ 00:09:11.971 START TEST dd_offset_magic 00:09:11.971 ************************************ 00:09:11.971 11:19:53 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- common/autotest_common.sh@1125 -- # offset_magic 00:09:11.971 11:19:53 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/bdev_to_bdev.sh@13 -- # local magic_check 00:09:11.971 11:19:53 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/bdev_to_bdev.sh@14 -- # local offsets offset 00:09:11.971 11:19:53 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/bdev_to_bdev.sh@16 -- # offsets=(16 64) 00:09:11.971 11:19:53 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/bdev_to_bdev.sh@18 -- # for offset in "${offsets[@]}" 00:09:11.971 11:19:53 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/bdev_to_bdev.sh@20 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=Nvme0n1 --ob=Nvme1n1 --count=65 --seek=16 --bs=1048576 --json /dev/fd/62 00:09:11.971 11:19:53 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/bdev_to_bdev.sh@20 -- # gen_conf 00:09:11.971 11:19:53 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/common.sh@31 -- # xtrace_disable 00:09:11.971 11:19:53 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- common/autotest_common.sh@10 -- # set +x 00:09:11.971 [2024-10-07 11:19:53.612711] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:11.971 [2024-10-07 11:19:53.612794] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61091 ] 00:09:11.971 { 00:09:11.971 "subsystems": [ 00:09:11.971 { 00:09:11.971 "subsystem": "bdev", 00:09:11.971 "config": [ 00:09:11.971 { 00:09:11.971 "params": { 00:09:11.971 "trtype": "pcie", 00:09:11.971 "traddr": "0000:00:10.0", 00:09:11.971 "name": "Nvme0" 00:09:11.971 }, 00:09:11.971 "method": "bdev_nvme_attach_controller" 00:09:11.971 }, 00:09:11.971 { 00:09:11.971 "params": { 00:09:11.971 "trtype": "pcie", 00:09:11.972 "traddr": "0000:00:11.0", 00:09:11.972 "name": "Nvme1" 00:09:11.972 }, 00:09:11.972 "method": "bdev_nvme_attach_controller" 00:09:11.972 }, 00:09:11.972 { 00:09:11.972 "method": "bdev_wait_for_examine" 00:09:11.972 } 00:09:11.972 ] 00:09:11.972 } 00:09:11.972 ] 00:09:11.972 } 00:09:12.230 [2024-10-07 11:19:53.750979] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:12.230 [2024-10-07 11:19:53.837758] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:12.230 [2024-10-07 11:19:53.873582] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:12.488  [2024-10-07T11:19:54.457Z] Copying: 65/65 [MB] (average 1326 MBps) 00:09:12.746 00:09:12.746 11:19:54 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/bdev_to_bdev.sh@28 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=Nvme1n1 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --count=1 --skip=16 --bs=1048576 --json /dev/fd/62 00:09:12.746 11:19:54 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/bdev_to_bdev.sh@28 -- # gen_conf 00:09:12.746 11:19:54 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/common.sh@31 -- # xtrace_disable 00:09:12.746 11:19:54 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- common/autotest_common.sh@10 -- # set +x 00:09:12.746 [2024-10-07 11:19:54.343745] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:12.746 [2024-10-07 11:19:54.343876] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61106 ] 00:09:12.746 { 00:09:12.746 "subsystems": [ 00:09:12.746 { 00:09:12.746 "subsystem": "bdev", 00:09:12.746 "config": [ 00:09:12.746 { 00:09:12.746 "params": { 00:09:12.746 "trtype": "pcie", 00:09:12.746 "traddr": "0000:00:10.0", 00:09:12.746 "name": "Nvme0" 00:09:12.746 }, 00:09:12.746 "method": "bdev_nvme_attach_controller" 00:09:12.746 }, 00:09:12.746 { 00:09:12.746 "params": { 00:09:12.746 "trtype": "pcie", 00:09:12.746 "traddr": "0000:00:11.0", 00:09:12.746 "name": "Nvme1" 00:09:12.746 }, 00:09:12.746 "method": "bdev_nvme_attach_controller" 00:09:12.746 }, 00:09:12.746 { 00:09:12.746 "method": "bdev_wait_for_examine" 00:09:12.746 } 00:09:12.746 ] 00:09:12.746 } 00:09:12.746 ] 00:09:12.746 } 00:09:13.004 [2024-10-07 11:19:54.478355] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:13.004 [2024-10-07 11:19:54.552378] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:13.004 [2024-10-07 11:19:54.587181] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:13.262  [2024-10-07T11:19:54.973Z] Copying: 1024/1024 [kB] (average 500 MBps) 00:09:13.262 00:09:13.262 11:19:54 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/bdev_to_bdev.sh@35 -- # read -rn26 magic_check 00:09:13.262 11:19:54 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/bdev_to_bdev.sh@36 -- # [[ This Is Our Magic, find it == \T\h\i\s\ \I\s\ \O\u\r\ \M\a\g\i\c\,\ \f\i\n\d\ \i\t ]] 00:09:13.262 11:19:54 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/bdev_to_bdev.sh@18 -- # for offset in "${offsets[@]}" 00:09:13.262 11:19:54 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/bdev_to_bdev.sh@20 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=Nvme0n1 --ob=Nvme1n1 --count=65 --seek=64 --bs=1048576 --json /dev/fd/62 00:09:13.262 11:19:54 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/bdev_to_bdev.sh@20 -- # gen_conf 00:09:13.262 11:19:54 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/common.sh@31 -- # xtrace_disable 00:09:13.262 11:19:54 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- common/autotest_common.sh@10 -- # set +x 00:09:13.519 { 00:09:13.519 "subsystems": [ 00:09:13.520 { 00:09:13.520 "subsystem": "bdev", 00:09:13.520 "config": [ 00:09:13.520 { 00:09:13.520 "params": { 00:09:13.520 "trtype": "pcie", 00:09:13.520 "traddr": "0000:00:10.0", 00:09:13.520 "name": "Nvme0" 00:09:13.520 }, 00:09:13.520 "method": "bdev_nvme_attach_controller" 00:09:13.520 }, 00:09:13.520 { 00:09:13.520 "params": { 00:09:13.520 "trtype": "pcie", 00:09:13.520 "traddr": "0000:00:11.0", 00:09:13.520 "name": "Nvme1" 00:09:13.520 }, 00:09:13.520 "method": "bdev_nvme_attach_controller" 00:09:13.520 }, 00:09:13.520 { 00:09:13.520 "method": "bdev_wait_for_examine" 00:09:13.520 } 00:09:13.520 ] 00:09:13.520 } 00:09:13.520 ] 00:09:13.520 } 00:09:13.520 [2024-10-07 11:19:55.012214] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:13.520 [2024-10-07 11:19:55.012347] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61128 ] 00:09:13.520 [2024-10-07 11:19:55.146232] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:13.520 [2024-10-07 11:19:55.209008] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:13.824 [2024-10-07 11:19:55.241027] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:13.824  [2024-10-07T11:19:55.794Z] Copying: 65/65 [MB] (average 1511 MBps) 00:09:14.083 00:09:14.083 11:19:55 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/bdev_to_bdev.sh@28 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=Nvme1n1 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --count=1 --skip=64 --bs=1048576 --json /dev/fd/62 00:09:14.083 11:19:55 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/bdev_to_bdev.sh@28 -- # gen_conf 00:09:14.083 11:19:55 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/common.sh@31 -- # xtrace_disable 00:09:14.083 11:19:55 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- common/autotest_common.sh@10 -- # set +x 00:09:14.083 [2024-10-07 11:19:55.713385] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:14.083 [2024-10-07 11:19:55.713493] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61148 ] 00:09:14.083 { 00:09:14.083 "subsystems": [ 00:09:14.083 { 00:09:14.083 "subsystem": "bdev", 00:09:14.083 "config": [ 00:09:14.083 { 00:09:14.083 "params": { 00:09:14.083 "trtype": "pcie", 00:09:14.083 "traddr": "0000:00:10.0", 00:09:14.083 "name": "Nvme0" 00:09:14.083 }, 00:09:14.083 "method": "bdev_nvme_attach_controller" 00:09:14.083 }, 00:09:14.083 { 00:09:14.083 "params": { 00:09:14.083 "trtype": "pcie", 00:09:14.083 "traddr": "0000:00:11.0", 00:09:14.083 "name": "Nvme1" 00:09:14.083 }, 00:09:14.083 "method": "bdev_nvme_attach_controller" 00:09:14.083 }, 00:09:14.083 { 00:09:14.083 "method": "bdev_wait_for_examine" 00:09:14.083 } 00:09:14.083 ] 00:09:14.083 } 00:09:14.083 ] 00:09:14.083 } 00:09:14.342 [2024-10-07 11:19:55.848745] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:14.342 [2024-10-07 11:19:55.924081] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:14.342 [2024-10-07 11:19:55.958777] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:14.600  [2024-10-07T11:19:56.569Z] Copying: 1024/1024 [kB] (average 500 MBps) 00:09:14.858 00:09:14.858 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/bdev_to_bdev.sh@35 -- # read -rn26 magic_check 00:09:14.858 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- dd/bdev_to_bdev.sh@36 -- # [[ This Is Our Magic, find it == \T\h\i\s\ \I\s\ \O\u\r\ \M\a\g\i\c\,\ \f\i\n\d\ \i\t ]] 00:09:14.858 00:09:14.858 real 0m2.758s 00:09:14.858 user 0m2.045s 00:09:14.858 sys 0m0.720s 00:09:14.858 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:14.858 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev.dd_offset_magic -- common/autotest_common.sh@10 -- # set +x 00:09:14.858 ************************************ 00:09:14.858 END TEST dd_offset_magic 00:09:14.858 ************************************ 00:09:14.858 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@1 -- # cleanup 00:09:14.858 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@42 -- # clear_nvme Nvme0n1 '' 4194330 00:09:14.858 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- dd/common.sh@10 -- # local bdev=Nvme0n1 00:09:14.858 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- dd/common.sh@11 -- # local nvme_ref= 00:09:14.858 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- dd/common.sh@12 -- # local size=4194330 00:09:14.858 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- dd/common.sh@14 -- # local bs=1048576 00:09:14.858 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- dd/common.sh@15 -- # local count=5 00:09:14.858 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- dd/common.sh@18 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/dev/zero --bs=1048576 --ob=Nvme0n1 --count=5 --json /dev/fd/62 00:09:14.858 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- dd/common.sh@18 -- # gen_conf 00:09:14.858 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- dd/common.sh@31 -- # xtrace_disable 00:09:14.858 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@10 -- # set +x 00:09:14.858 [2024-10-07 11:19:56.396541] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:14.858 [2024-10-07 11:19:56.396649] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61174 ] 00:09:14.858 { 00:09:14.858 "subsystems": [ 00:09:14.858 { 00:09:14.858 "subsystem": "bdev", 00:09:14.858 "config": [ 00:09:14.858 { 00:09:14.858 "params": { 00:09:14.858 "trtype": "pcie", 00:09:14.858 "traddr": "0000:00:10.0", 00:09:14.858 "name": "Nvme0" 00:09:14.858 }, 00:09:14.858 "method": "bdev_nvme_attach_controller" 00:09:14.858 }, 00:09:14.858 { 00:09:14.858 "params": { 00:09:14.858 "trtype": "pcie", 00:09:14.858 "traddr": "0000:00:11.0", 00:09:14.858 "name": "Nvme1" 00:09:14.858 }, 00:09:14.858 "method": "bdev_nvme_attach_controller" 00:09:14.858 }, 00:09:14.858 { 00:09:14.858 "method": "bdev_wait_for_examine" 00:09:14.858 } 00:09:14.858 ] 00:09:14.858 } 00:09:14.858 ] 00:09:14.858 } 00:09:14.858 [2024-10-07 11:19:56.525620] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:15.117 [2024-10-07 11:19:56.587555] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:15.117 [2024-10-07 11:19:56.617922] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:15.117  [2024-10-07T11:19:57.086Z] Copying: 5120/5120 [kB] (average 1666 MBps) 00:09:15.375 00:09:15.375 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@43 -- # clear_nvme Nvme1n1 '' 4194330 00:09:15.375 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- dd/common.sh@10 -- # local bdev=Nvme1n1 00:09:15.375 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- dd/common.sh@11 -- # local nvme_ref= 00:09:15.375 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- dd/common.sh@12 -- # local size=4194330 00:09:15.375 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- dd/common.sh@14 -- # local bs=1048576 00:09:15.375 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- dd/common.sh@15 -- # local count=5 00:09:15.375 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- dd/common.sh@18 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/dev/zero --bs=1048576 --ob=Nvme1n1 --count=5 --json /dev/fd/62 00:09:15.375 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- dd/common.sh@18 -- # gen_conf 00:09:15.375 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- dd/common.sh@31 -- # xtrace_disable 00:09:15.375 11:19:56 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@10 -- # set +x 00:09:15.375 { 00:09:15.375 "subsystems": [ 00:09:15.375 { 00:09:15.375 "subsystem": "bdev", 00:09:15.375 "config": [ 00:09:15.375 { 00:09:15.375 "params": { 00:09:15.375 "trtype": "pcie", 00:09:15.375 "traddr": "0000:00:10.0", 00:09:15.375 "name": "Nvme0" 00:09:15.375 }, 00:09:15.375 "method": "bdev_nvme_attach_controller" 00:09:15.375 }, 00:09:15.375 { 00:09:15.375 "params": { 00:09:15.375 "trtype": "pcie", 00:09:15.375 "traddr": "0000:00:11.0", 00:09:15.375 "name": "Nvme1" 00:09:15.375 }, 00:09:15.375 "method": "bdev_nvme_attach_controller" 00:09:15.375 }, 00:09:15.375 { 00:09:15.375 "method": "bdev_wait_for_examine" 00:09:15.375 } 00:09:15.375 ] 00:09:15.375 } 00:09:15.375 ] 00:09:15.375 } 00:09:15.375 [2024-10-07 11:19:57.016259] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:15.375 [2024-10-07 11:19:57.016395] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61195 ] 00:09:15.633 [2024-10-07 11:19:57.162700] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:15.633 [2024-10-07 11:19:57.253238] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:15.633 [2024-10-07 11:19:57.291386] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:15.891  [2024-10-07T11:19:57.861Z] Copying: 5120/5120 [kB] (average 1000 MBps) 00:09:16.150 00:09:16.150 11:19:57 spdk_dd.spdk_dd_bdev_to_bdev -- dd/bdev_to_bdev.sh@44 -- # rm -f /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 '' 00:09:16.150 00:09:16.150 real 0m6.546s 00:09:16.150 user 0m4.902s 00:09:16.150 sys 0m2.718s 00:09:16.150 11:19:57 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:16.150 11:19:57 spdk_dd.spdk_dd_bdev_to_bdev -- common/autotest_common.sh@10 -- # set +x 00:09:16.150 ************************************ 00:09:16.150 END TEST spdk_dd_bdev_to_bdev 00:09:16.150 ************************************ 00:09:16.150 11:19:57 spdk_dd -- dd/dd.sh@24 -- # (( SPDK_TEST_URING == 1 )) 00:09:16.150 11:19:57 spdk_dd -- dd/dd.sh@25 -- # run_test spdk_dd_uring /home/vagrant/spdk_repo/spdk/test/dd/uring.sh 00:09:16.150 11:19:57 spdk_dd -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:16.150 11:19:57 spdk_dd -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:16.150 11:19:57 spdk_dd -- common/autotest_common.sh@10 -- # set +x 00:09:16.150 ************************************ 00:09:16.150 START TEST spdk_dd_uring 00:09:16.150 ************************************ 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/dd/uring.sh 00:09:16.150 * Looking for test storage... 00:09:16.150 * Found test storage at /home/vagrant/spdk_repo/spdk/test/dd 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- common/autotest_common.sh@1681 -- # lcov --version 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@336 -- # IFS=.-: 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@336 -- # read -ra ver1 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@337 -- # IFS=.-: 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@337 -- # read -ra ver2 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@338 -- # local 'op=<' 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@340 -- # ver1_l=2 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@341 -- # ver2_l=1 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@344 -- # case "$op" in 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@345 -- # : 1 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:16.150 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@365 -- # decimal 1 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@353 -- # local d=1 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@355 -- # echo 1 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@365 -- # ver1[v]=1 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@366 -- # decimal 2 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@353 -- # local d=2 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@355 -- # echo 2 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@366 -- # ver2[v]=2 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@368 -- # return 0 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:16.408 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:16.408 --rc genhtml_branch_coverage=1 00:09:16.408 --rc genhtml_function_coverage=1 00:09:16.408 --rc genhtml_legend=1 00:09:16.408 --rc geninfo_all_blocks=1 00:09:16.408 --rc geninfo_unexecuted_blocks=1 00:09:16.408 00:09:16.408 ' 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:16.408 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:16.408 --rc genhtml_branch_coverage=1 00:09:16.408 --rc genhtml_function_coverage=1 00:09:16.408 --rc genhtml_legend=1 00:09:16.408 --rc geninfo_all_blocks=1 00:09:16.408 --rc geninfo_unexecuted_blocks=1 00:09:16.408 00:09:16.408 ' 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:16.408 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:16.408 --rc genhtml_branch_coverage=1 00:09:16.408 --rc genhtml_function_coverage=1 00:09:16.408 --rc genhtml_legend=1 00:09:16.408 --rc geninfo_all_blocks=1 00:09:16.408 --rc geninfo_unexecuted_blocks=1 00:09:16.408 00:09:16.408 ' 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:16.408 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:16.408 --rc genhtml_branch_coverage=1 00:09:16.408 --rc genhtml_function_coverage=1 00:09:16.408 --rc genhtml_legend=1 00:09:16.408 --rc geninfo_all_blocks=1 00:09:16.408 --rc geninfo_unexecuted_blocks=1 00:09:16.408 00:09:16.408 ' 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- dd/common.sh@7 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@15 -- # shopt -s extglob 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:16.408 11:19:57 spdk_dd.spdk_dd_uring -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring -- paths/export.sh@5 -- # export PATH 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring -- dd/uring.sh@103 -- # run_test dd_uring_copy uring_zram_copy 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring -- common/autotest_common.sh@10 -- # set +x 00:09:16.409 ************************************ 00:09:16.409 START TEST dd_uring_copy 00:09:16.409 ************************************ 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@1125 -- # uring_zram_copy 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@15 -- # local zram_dev_id 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@16 -- # local magic 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@17 -- # local magic_file0=/home/vagrant/spdk_repo/spdk/test/dd/magic.dump0 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@18 -- # local magic_file1=/home/vagrant/spdk_repo/spdk/test/dd/magic.dump1 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@19 -- # local verify_magic 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@21 -- # init_zram 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/common.sh@159 -- # [[ -e /sys/class/zram-control ]] 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/common.sh@160 -- # return 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@22 -- # create_zram_dev 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/common.sh@164 -- # cat /sys/class/zram-control/hot_add 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@22 -- # zram_dev_id=1 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@23 -- # set_zram_dev 1 512M 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/common.sh@177 -- # local id=1 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/common.sh@178 -- # local size=512M 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/common.sh@180 -- # [[ -e /sys/block/zram1 ]] 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/common.sh@182 -- # echo 512M 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@25 -- # local ubdev=uring0 ufile=/dev/zram1 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@27 -- # method_bdev_uring_create_0=(['filename']='/dev/zram1' ['name']='uring0') 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@27 -- # local -A method_bdev_uring_create_0 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@33 -- # local mbdev=malloc0 mbdev_b=1048576 mbdev_bs=512 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@35 -- # method_bdev_malloc_create_0=(['name']='malloc0' ['num_blocks']='1048576' ['block_size']='512') 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@35 -- # local -A method_bdev_malloc_create_0 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@41 -- # gen_bytes 1024 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/common.sh@98 -- # xtrace_disable 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@10 -- # set +x 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@41 -- # magic=38nfnqog1jznc2yx02gaa29rn9086f1rhurwv8k8lcfwjharorl8no9712u8ma8xknk26vyepawyuhe69zxkwayts2k5g8xqm3uaf4ypjdz684is387az8y4nxoteynbhbotet2edpmq6esebotts9gneiemnxdnzrtre1nlgo6rvt4ek20num6cjb2bs3cvyu22wfn5al2jk8pxegqpfwi2djcy2gan76sfwl3arw03gjwa4m20ghs63k8fec9gckkb56b8odu1kk3slm0np88deeixyw2masikqoc9py5k4nrrp8b056xocki22rn5bduqy7qkkdpu4pc54shnxns6dbypdcdoeya24p7w6jna6nbfebq7asy33m8kzkkt2d986shgw2ae7qcxqjc3s1apz55pvqbyc0y76mg14xuhe94zodckyudsp3lcvxzxhnsa48sq8a05rki6dy8egizu0at1iizxkg268nl9hq9yzawhbbn1akqlvsyhpldsdh81bfxfgxxt4vh8syi0xwr6c5nefeja8r0eiz1sspf8k7y46vq59fye0lrmvdg433hlh4benv3mixzadwlfmwpii8bp4t7n4qyyus1n8gro90ozqkqgo7yepgzvog2vlr0vhz9gaduzw18tgwdzq4647rayylakc1pbg98grdqwh7fkxzwmqov6dfdaconouklgqk4a2ma1ey9cx5rshyaip5635c3f7bntds7t4xv4s6nyqdnv89wywqed42dribxd0nzo8nj6i21hz0m5nhji4waunw4dip7kuwlc2p9s9i5wvlynolr9octjr5smndq034yntlobhyemykmws5qa4e9i8qdxfw7y4s28bhckgmoylrfjvc9pq02xxu1yiykzpemf3k184ql92i70us6mzqquf1q2ukripif88jf54abpb4bsl0zep7u1hnu90143zfjl1fierbxzw2oh67yzw2laefakcsy1hrg2qzb76tcqlmrdnm8f2edhztns 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@42 -- # echo 38nfnqog1jznc2yx02gaa29rn9086f1rhurwv8k8lcfwjharorl8no9712u8ma8xknk26vyepawyuhe69zxkwayts2k5g8xqm3uaf4ypjdz684is387az8y4nxoteynbhbotet2edpmq6esebotts9gneiemnxdnzrtre1nlgo6rvt4ek20num6cjb2bs3cvyu22wfn5al2jk8pxegqpfwi2djcy2gan76sfwl3arw03gjwa4m20ghs63k8fec9gckkb56b8odu1kk3slm0np88deeixyw2masikqoc9py5k4nrrp8b056xocki22rn5bduqy7qkkdpu4pc54shnxns6dbypdcdoeya24p7w6jna6nbfebq7asy33m8kzkkt2d986shgw2ae7qcxqjc3s1apz55pvqbyc0y76mg14xuhe94zodckyudsp3lcvxzxhnsa48sq8a05rki6dy8egizu0at1iizxkg268nl9hq9yzawhbbn1akqlvsyhpldsdh81bfxfgxxt4vh8syi0xwr6c5nefeja8r0eiz1sspf8k7y46vq59fye0lrmvdg433hlh4benv3mixzadwlfmwpii8bp4t7n4qyyus1n8gro90ozqkqgo7yepgzvog2vlr0vhz9gaduzw18tgwdzq4647rayylakc1pbg98grdqwh7fkxzwmqov6dfdaconouklgqk4a2ma1ey9cx5rshyaip5635c3f7bntds7t4xv4s6nyqdnv89wywqed42dribxd0nzo8nj6i21hz0m5nhji4waunw4dip7kuwlc2p9s9i5wvlynolr9octjr5smndq034yntlobhyemykmws5qa4e9i8qdxfw7y4s28bhckgmoylrfjvc9pq02xxu1yiykzpemf3k184ql92i70us6mzqquf1q2ukripif88jf54abpb4bsl0zep7u1hnu90143zfjl1fierbxzw2oh67yzw2laefakcsy1hrg2qzb76tcqlmrdnm8f2edhztns 00:09:16.409 11:19:57 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@46 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/dev/zero --of=/home/vagrant/spdk_repo/spdk/test/dd/magic.dump0 --oflag=append --bs=536869887 --count=1 00:09:16.409 [2024-10-07 11:19:57.965103] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:16.409 [2024-10-07 11:19:57.965211] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61275 ] 00:09:16.409 [2024-10-07 11:19:58.101942] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:16.667 [2024-10-07 11:19:58.161138] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:16.667 [2024-10-07 11:19:58.190033] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:17.250  [2024-10-07T11:19:58.961Z] Copying: 511/511 [MB] (average 1528 MBps) 00:09:17.250 00:09:17.250 11:19:58 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@54 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/magic.dump0 --ob=uring0 --json /dev/fd/62 00:09:17.250 11:19:58 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@54 -- # gen_conf 00:09:17.250 11:19:58 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/common.sh@31 -- # xtrace_disable 00:09:17.250 11:19:58 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@10 -- # set +x 00:09:17.509 [2024-10-07 11:19:58.969990] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:17.509 [2024-10-07 11:19:58.970119] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61291 ] 00:09:17.509 { 00:09:17.509 "subsystems": [ 00:09:17.509 { 00:09:17.509 "subsystem": "bdev", 00:09:17.509 "config": [ 00:09:17.509 { 00:09:17.509 "params": { 00:09:17.509 "block_size": 512, 00:09:17.509 "num_blocks": 1048576, 00:09:17.509 "name": "malloc0" 00:09:17.509 }, 00:09:17.509 "method": "bdev_malloc_create" 00:09:17.509 }, 00:09:17.509 { 00:09:17.509 "params": { 00:09:17.509 "filename": "/dev/zram1", 00:09:17.509 "name": "uring0" 00:09:17.509 }, 00:09:17.509 "method": "bdev_uring_create" 00:09:17.509 }, 00:09:17.509 { 00:09:17.509 "method": "bdev_wait_for_examine" 00:09:17.509 } 00:09:17.509 ] 00:09:17.509 } 00:09:17.509 ] 00:09:17.509 } 00:09:17.509 [2024-10-07 11:19:59.134641] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:17.510 [2024-10-07 11:19:59.196228] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:17.768 [2024-10-07 11:19:59.226238] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:18.700  [2024-10-07T11:20:01.346Z] Copying: 204/512 [MB] (204 MBps) [2024-10-07T11:20:01.912Z] Copying: 408/512 [MB] (204 MBps) [2024-10-07T11:20:02.170Z] Copying: 512/512 [MB] (average 204 MBps) 00:09:20.459 00:09:20.459 11:20:02 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@60 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=uring0 --of=/home/vagrant/spdk_repo/spdk/test/dd/magic.dump1 --json /dev/fd/62 00:09:20.459 11:20:02 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@60 -- # gen_conf 00:09:20.459 11:20:02 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/common.sh@31 -- # xtrace_disable 00:09:20.459 11:20:02 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@10 -- # set +x 00:09:20.459 { 00:09:20.459 "subsystems": [ 00:09:20.459 { 00:09:20.459 "subsystem": "bdev", 00:09:20.459 "config": [ 00:09:20.459 { 00:09:20.459 "params": { 00:09:20.459 "block_size": 512, 00:09:20.459 "num_blocks": 1048576, 00:09:20.459 "name": "malloc0" 00:09:20.459 }, 00:09:20.459 "method": "bdev_malloc_create" 00:09:20.459 }, 00:09:20.459 { 00:09:20.459 "params": { 00:09:20.459 "filename": "/dev/zram1", 00:09:20.459 "name": "uring0" 00:09:20.459 }, 00:09:20.459 "method": "bdev_uring_create" 00:09:20.459 }, 00:09:20.459 { 00:09:20.459 "method": "bdev_wait_for_examine" 00:09:20.459 } 00:09:20.459 ] 00:09:20.459 } 00:09:20.459 ] 00:09:20.459 } 00:09:20.718 [2024-10-07 11:20:02.187614] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:20.718 [2024-10-07 11:20:02.188093] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61335 ] 00:09:20.718 [2024-10-07 11:20:02.332887] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:20.718 [2024-10-07 11:20:02.393905] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:20.718 [2024-10-07 11:20:02.423382] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:22.102  [2024-10-07T11:20:04.747Z] Copying: 142/512 [MB] (142 MBps) [2024-10-07T11:20:05.680Z] Copying: 307/512 [MB] (164 MBps) [2024-10-07T11:20:06.247Z] Copying: 446/512 [MB] (139 MBps) [2024-10-07T11:20:06.507Z] Copying: 512/512 [MB] (average 148 MBps) 00:09:24.796 00:09:24.796 11:20:06 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@65 -- # read -rn1024 verify_magic 00:09:24.796 11:20:06 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@66 -- # [[ 38nfnqog1jznc2yx02gaa29rn9086f1rhurwv8k8lcfwjharorl8no9712u8ma8xknk26vyepawyuhe69zxkwayts2k5g8xqm3uaf4ypjdz684is387az8y4nxoteynbhbotet2edpmq6esebotts9gneiemnxdnzrtre1nlgo6rvt4ek20num6cjb2bs3cvyu22wfn5al2jk8pxegqpfwi2djcy2gan76sfwl3arw03gjwa4m20ghs63k8fec9gckkb56b8odu1kk3slm0np88deeixyw2masikqoc9py5k4nrrp8b056xocki22rn5bduqy7qkkdpu4pc54shnxns6dbypdcdoeya24p7w6jna6nbfebq7asy33m8kzkkt2d986shgw2ae7qcxqjc3s1apz55pvqbyc0y76mg14xuhe94zodckyudsp3lcvxzxhnsa48sq8a05rki6dy8egizu0at1iizxkg268nl9hq9yzawhbbn1akqlvsyhpldsdh81bfxfgxxt4vh8syi0xwr6c5nefeja8r0eiz1sspf8k7y46vq59fye0lrmvdg433hlh4benv3mixzadwlfmwpii8bp4t7n4qyyus1n8gro90ozqkqgo7yepgzvog2vlr0vhz9gaduzw18tgwdzq4647rayylakc1pbg98grdqwh7fkxzwmqov6dfdaconouklgqk4a2ma1ey9cx5rshyaip5635c3f7bntds7t4xv4s6nyqdnv89wywqed42dribxd0nzo8nj6i21hz0m5nhji4waunw4dip7kuwlc2p9s9i5wvlynolr9octjr5smndq034yntlobhyemykmws5qa4e9i8qdxfw7y4s28bhckgmoylrfjvc9pq02xxu1yiykzpemf3k184ql92i70us6mzqquf1q2ukripif88jf54abpb4bsl0zep7u1hnu90143zfjl1fierbxzw2oh67yzw2laefakcsy1hrg2qzb76tcqlmrdnm8f2edhztns == \3\8\n\f\n\q\o\g\1\j\z\n\c\2\y\x\0\2\g\a\a\2\9\r\n\9\0\8\6\f\1\r\h\u\r\w\v\8\k\8\l\c\f\w\j\h\a\r\o\r\l\8\n\o\9\7\1\2\u\8\m\a\8\x\k\n\k\2\6\v\y\e\p\a\w\y\u\h\e\6\9\z\x\k\w\a\y\t\s\2\k\5\g\8\x\q\m\3\u\a\f\4\y\p\j\d\z\6\8\4\i\s\3\8\7\a\z\8\y\4\n\x\o\t\e\y\n\b\h\b\o\t\e\t\2\e\d\p\m\q\6\e\s\e\b\o\t\t\s\9\g\n\e\i\e\m\n\x\d\n\z\r\t\r\e\1\n\l\g\o\6\r\v\t\4\e\k\2\0\n\u\m\6\c\j\b\2\b\s\3\c\v\y\u\2\2\w\f\n\5\a\l\2\j\k\8\p\x\e\g\q\p\f\w\i\2\d\j\c\y\2\g\a\n\7\6\s\f\w\l\3\a\r\w\0\3\g\j\w\a\4\m\2\0\g\h\s\6\3\k\8\f\e\c\9\g\c\k\k\b\5\6\b\8\o\d\u\1\k\k\3\s\l\m\0\n\p\8\8\d\e\e\i\x\y\w\2\m\a\s\i\k\q\o\c\9\p\y\5\k\4\n\r\r\p\8\b\0\5\6\x\o\c\k\i\2\2\r\n\5\b\d\u\q\y\7\q\k\k\d\p\u\4\p\c\5\4\s\h\n\x\n\s\6\d\b\y\p\d\c\d\o\e\y\a\2\4\p\7\w\6\j\n\a\6\n\b\f\e\b\q\7\a\s\y\3\3\m\8\k\z\k\k\t\2\d\9\8\6\s\h\g\w\2\a\e\7\q\c\x\q\j\c\3\s\1\a\p\z\5\5\p\v\q\b\y\c\0\y\7\6\m\g\1\4\x\u\h\e\9\4\z\o\d\c\k\y\u\d\s\p\3\l\c\v\x\z\x\h\n\s\a\4\8\s\q\8\a\0\5\r\k\i\6\d\y\8\e\g\i\z\u\0\a\t\1\i\i\z\x\k\g\2\6\8\n\l\9\h\q\9\y\z\a\w\h\b\b\n\1\a\k\q\l\v\s\y\h\p\l\d\s\d\h\8\1\b\f\x\f\g\x\x\t\4\v\h\8\s\y\i\0\x\w\r\6\c\5\n\e\f\e\j\a\8\r\0\e\i\z\1\s\s\p\f\8\k\7\y\4\6\v\q\5\9\f\y\e\0\l\r\m\v\d\g\4\3\3\h\l\h\4\b\e\n\v\3\m\i\x\z\a\d\w\l\f\m\w\p\i\i\8\b\p\4\t\7\n\4\q\y\y\u\s\1\n\8\g\r\o\9\0\o\z\q\k\q\g\o\7\y\e\p\g\z\v\o\g\2\v\l\r\0\v\h\z\9\g\a\d\u\z\w\1\8\t\g\w\d\z\q\4\6\4\7\r\a\y\y\l\a\k\c\1\p\b\g\9\8\g\r\d\q\w\h\7\f\k\x\z\w\m\q\o\v\6\d\f\d\a\c\o\n\o\u\k\l\g\q\k\4\a\2\m\a\1\e\y\9\c\x\5\r\s\h\y\a\i\p\5\6\3\5\c\3\f\7\b\n\t\d\s\7\t\4\x\v\4\s\6\n\y\q\d\n\v\8\9\w\y\w\q\e\d\4\2\d\r\i\b\x\d\0\n\z\o\8\n\j\6\i\2\1\h\z\0\m\5\n\h\j\i\4\w\a\u\n\w\4\d\i\p\7\k\u\w\l\c\2\p\9\s\9\i\5\w\v\l\y\n\o\l\r\9\o\c\t\j\r\5\s\m\n\d\q\0\3\4\y\n\t\l\o\b\h\y\e\m\y\k\m\w\s\5\q\a\4\e\9\i\8\q\d\x\f\w\7\y\4\s\2\8\b\h\c\k\g\m\o\y\l\r\f\j\v\c\9\p\q\0\2\x\x\u\1\y\i\y\k\z\p\e\m\f\3\k\1\8\4\q\l\9\2\i\7\0\u\s\6\m\z\q\q\u\f\1\q\2\u\k\r\i\p\i\f\8\8\j\f\5\4\a\b\p\b\4\b\s\l\0\z\e\p\7\u\1\h\n\u\9\0\1\4\3\z\f\j\l\1\f\i\e\r\b\x\z\w\2\o\h\6\7\y\z\w\2\l\a\e\f\a\k\c\s\y\1\h\r\g\2\q\z\b\7\6\t\c\q\l\m\r\d\n\m\8\f\2\e\d\h\z\t\n\s ]] 00:09:24.796 11:20:06 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@68 -- # read -rn1024 verify_magic 00:09:24.796 11:20:06 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@69 -- # [[ 38nfnqog1jznc2yx02gaa29rn9086f1rhurwv8k8lcfwjharorl8no9712u8ma8xknk26vyepawyuhe69zxkwayts2k5g8xqm3uaf4ypjdz684is387az8y4nxoteynbhbotet2edpmq6esebotts9gneiemnxdnzrtre1nlgo6rvt4ek20num6cjb2bs3cvyu22wfn5al2jk8pxegqpfwi2djcy2gan76sfwl3arw03gjwa4m20ghs63k8fec9gckkb56b8odu1kk3slm0np88deeixyw2masikqoc9py5k4nrrp8b056xocki22rn5bduqy7qkkdpu4pc54shnxns6dbypdcdoeya24p7w6jna6nbfebq7asy33m8kzkkt2d986shgw2ae7qcxqjc3s1apz55pvqbyc0y76mg14xuhe94zodckyudsp3lcvxzxhnsa48sq8a05rki6dy8egizu0at1iizxkg268nl9hq9yzawhbbn1akqlvsyhpldsdh81bfxfgxxt4vh8syi0xwr6c5nefeja8r0eiz1sspf8k7y46vq59fye0lrmvdg433hlh4benv3mixzadwlfmwpii8bp4t7n4qyyus1n8gro90ozqkqgo7yepgzvog2vlr0vhz9gaduzw18tgwdzq4647rayylakc1pbg98grdqwh7fkxzwmqov6dfdaconouklgqk4a2ma1ey9cx5rshyaip5635c3f7bntds7t4xv4s6nyqdnv89wywqed42dribxd0nzo8nj6i21hz0m5nhji4waunw4dip7kuwlc2p9s9i5wvlynolr9octjr5smndq034yntlobhyemykmws5qa4e9i8qdxfw7y4s28bhckgmoylrfjvc9pq02xxu1yiykzpemf3k184ql92i70us6mzqquf1q2ukripif88jf54abpb4bsl0zep7u1hnu90143zfjl1fierbxzw2oh67yzw2laefakcsy1hrg2qzb76tcqlmrdnm8f2edhztns == \3\8\n\f\n\q\o\g\1\j\z\n\c\2\y\x\0\2\g\a\a\2\9\r\n\9\0\8\6\f\1\r\h\u\r\w\v\8\k\8\l\c\f\w\j\h\a\r\o\r\l\8\n\o\9\7\1\2\u\8\m\a\8\x\k\n\k\2\6\v\y\e\p\a\w\y\u\h\e\6\9\z\x\k\w\a\y\t\s\2\k\5\g\8\x\q\m\3\u\a\f\4\y\p\j\d\z\6\8\4\i\s\3\8\7\a\z\8\y\4\n\x\o\t\e\y\n\b\h\b\o\t\e\t\2\e\d\p\m\q\6\e\s\e\b\o\t\t\s\9\g\n\e\i\e\m\n\x\d\n\z\r\t\r\e\1\n\l\g\o\6\r\v\t\4\e\k\2\0\n\u\m\6\c\j\b\2\b\s\3\c\v\y\u\2\2\w\f\n\5\a\l\2\j\k\8\p\x\e\g\q\p\f\w\i\2\d\j\c\y\2\g\a\n\7\6\s\f\w\l\3\a\r\w\0\3\g\j\w\a\4\m\2\0\g\h\s\6\3\k\8\f\e\c\9\g\c\k\k\b\5\6\b\8\o\d\u\1\k\k\3\s\l\m\0\n\p\8\8\d\e\e\i\x\y\w\2\m\a\s\i\k\q\o\c\9\p\y\5\k\4\n\r\r\p\8\b\0\5\6\x\o\c\k\i\2\2\r\n\5\b\d\u\q\y\7\q\k\k\d\p\u\4\p\c\5\4\s\h\n\x\n\s\6\d\b\y\p\d\c\d\o\e\y\a\2\4\p\7\w\6\j\n\a\6\n\b\f\e\b\q\7\a\s\y\3\3\m\8\k\z\k\k\t\2\d\9\8\6\s\h\g\w\2\a\e\7\q\c\x\q\j\c\3\s\1\a\p\z\5\5\p\v\q\b\y\c\0\y\7\6\m\g\1\4\x\u\h\e\9\4\z\o\d\c\k\y\u\d\s\p\3\l\c\v\x\z\x\h\n\s\a\4\8\s\q\8\a\0\5\r\k\i\6\d\y\8\e\g\i\z\u\0\a\t\1\i\i\z\x\k\g\2\6\8\n\l\9\h\q\9\y\z\a\w\h\b\b\n\1\a\k\q\l\v\s\y\h\p\l\d\s\d\h\8\1\b\f\x\f\g\x\x\t\4\v\h\8\s\y\i\0\x\w\r\6\c\5\n\e\f\e\j\a\8\r\0\e\i\z\1\s\s\p\f\8\k\7\y\4\6\v\q\5\9\f\y\e\0\l\r\m\v\d\g\4\3\3\h\l\h\4\b\e\n\v\3\m\i\x\z\a\d\w\l\f\m\w\p\i\i\8\b\p\4\t\7\n\4\q\y\y\u\s\1\n\8\g\r\o\9\0\o\z\q\k\q\g\o\7\y\e\p\g\z\v\o\g\2\v\l\r\0\v\h\z\9\g\a\d\u\z\w\1\8\t\g\w\d\z\q\4\6\4\7\r\a\y\y\l\a\k\c\1\p\b\g\9\8\g\r\d\q\w\h\7\f\k\x\z\w\m\q\o\v\6\d\f\d\a\c\o\n\o\u\k\l\g\q\k\4\a\2\m\a\1\e\y\9\c\x\5\r\s\h\y\a\i\p\5\6\3\5\c\3\f\7\b\n\t\d\s\7\t\4\x\v\4\s\6\n\y\q\d\n\v\8\9\w\y\w\q\e\d\4\2\d\r\i\b\x\d\0\n\z\o\8\n\j\6\i\2\1\h\z\0\m\5\n\h\j\i\4\w\a\u\n\w\4\d\i\p\7\k\u\w\l\c\2\p\9\s\9\i\5\w\v\l\y\n\o\l\r\9\o\c\t\j\r\5\s\m\n\d\q\0\3\4\y\n\t\l\o\b\h\y\e\m\y\k\m\w\s\5\q\a\4\e\9\i\8\q\d\x\f\w\7\y\4\s\2\8\b\h\c\k\g\m\o\y\l\r\f\j\v\c\9\p\q\0\2\x\x\u\1\y\i\y\k\z\p\e\m\f\3\k\1\8\4\q\l\9\2\i\7\0\u\s\6\m\z\q\q\u\f\1\q\2\u\k\r\i\p\i\f\8\8\j\f\5\4\a\b\p\b\4\b\s\l\0\z\e\p\7\u\1\h\n\u\9\0\1\4\3\z\f\j\l\1\f\i\e\r\b\x\z\w\2\o\h\6\7\y\z\w\2\l\a\e\f\a\k\c\s\y\1\h\r\g\2\q\z\b\7\6\t\c\q\l\m\r\d\n\m\8\f\2\e\d\h\z\t\n\s ]] 00:09:24.796 11:20:06 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@71 -- # diff -q /home/vagrant/spdk_repo/spdk/test/dd/magic.dump0 /home/vagrant/spdk_repo/spdk/test/dd/magic.dump1 00:09:25.055 11:20:06 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@75 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=uring0 --ob=malloc0 --json /dev/fd/62 00:09:25.055 11:20:06 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@75 -- # gen_conf 00:09:25.055 11:20:06 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/common.sh@31 -- # xtrace_disable 00:09:25.055 11:20:06 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@10 -- # set +x 00:09:25.055 { 00:09:25.055 "subsystems": [ 00:09:25.055 { 00:09:25.055 "subsystem": "bdev", 00:09:25.055 "config": [ 00:09:25.055 { 00:09:25.055 "params": { 00:09:25.055 "block_size": 512, 00:09:25.055 "num_blocks": 1048576, 00:09:25.055 "name": "malloc0" 00:09:25.055 }, 00:09:25.055 "method": "bdev_malloc_create" 00:09:25.055 }, 00:09:25.055 { 00:09:25.055 "params": { 00:09:25.055 "filename": "/dev/zram1", 00:09:25.055 "name": "uring0" 00:09:25.055 }, 00:09:25.055 "method": "bdev_uring_create" 00:09:25.055 }, 00:09:25.055 { 00:09:25.055 "method": "bdev_wait_for_examine" 00:09:25.055 } 00:09:25.055 ] 00:09:25.055 } 00:09:25.055 ] 00:09:25.055 } 00:09:25.055 [2024-10-07 11:20:06.704842] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:25.055 [2024-10-07 11:20:06.704942] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61413 ] 00:09:25.342 [2024-10-07 11:20:06.841466] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:25.342 [2024-10-07 11:20:06.942641] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:25.342 [2024-10-07 11:20:06.972199] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:26.717  [2024-10-07T11:20:09.392Z] Copying: 147/512 [MB] (147 MBps) [2024-10-07T11:20:10.324Z] Copying: 296/512 [MB] (148 MBps) [2024-10-07T11:20:10.582Z] Copying: 442/512 [MB] (146 MBps) [2024-10-07T11:20:10.840Z] Copying: 512/512 [MB] (average 147 MBps) 00:09:29.129 00:09:29.129 11:20:10 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@82 -- # method_bdev_uring_delete_0=(['name']='uring0') 00:09:29.130 11:20:10 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@82 -- # local -A method_bdev_uring_delete_0 00:09:29.130 11:20:10 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@87 -- # : 00:09:29.130 11:20:10 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@87 -- # : 00:09:29.130 11:20:10 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@87 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/dev/fd/62 --of=/dev/fd/61 --json /dev/fd/59 00:09:29.130 11:20:10 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@87 -- # gen_conf 00:09:29.130 11:20:10 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/common.sh@31 -- # xtrace_disable 00:09:29.130 11:20:10 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@10 -- # set +x 00:09:29.388 [2024-10-07 11:20:10.861830] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:29.389 [2024-10-07 11:20:10.861932] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61474 ] 00:09:29.389 { 00:09:29.389 "subsystems": [ 00:09:29.389 { 00:09:29.389 "subsystem": "bdev", 00:09:29.389 "config": [ 00:09:29.389 { 00:09:29.389 "params": { 00:09:29.389 "block_size": 512, 00:09:29.389 "num_blocks": 1048576, 00:09:29.389 "name": "malloc0" 00:09:29.389 }, 00:09:29.389 "method": "bdev_malloc_create" 00:09:29.389 }, 00:09:29.389 { 00:09:29.389 "params": { 00:09:29.389 "filename": "/dev/zram1", 00:09:29.389 "name": "uring0" 00:09:29.389 }, 00:09:29.389 "method": "bdev_uring_create" 00:09:29.389 }, 00:09:29.389 { 00:09:29.389 "params": { 00:09:29.389 "name": "uring0" 00:09:29.389 }, 00:09:29.389 "method": "bdev_uring_delete" 00:09:29.389 }, 00:09:29.389 { 00:09:29.389 "method": "bdev_wait_for_examine" 00:09:29.389 } 00:09:29.389 ] 00:09:29.389 } 00:09:29.389 ] 00:09:29.389 } 00:09:29.389 [2024-10-07 11:20:10.996434] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:29.389 [2024-10-07 11:20:11.068486] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:29.647 [2024-10-07 11:20:11.103369] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:29.647  [2024-10-07T11:20:11.617Z] Copying: 0/0 [B] (average 0 Bps) 00:09:29.906 00:09:29.906 11:20:11 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@94 -- # : 00:09:29.906 11:20:11 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@94 -- # gen_conf 00:09:29.906 11:20:11 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@94 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=uring0 --of=/dev/fd/62 --json /dev/fd/61 00:09:29.906 11:20:11 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/common.sh@31 -- # xtrace_disable 00:09:29.906 11:20:11 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@650 -- # local es=0 00:09:29.906 11:20:11 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@10 -- # set +x 00:09:29.906 11:20:11 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=uring0 --of=/dev/fd/62 --json /dev/fd/61 00:09:29.906 11:20:11 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:29.906 11:20:11 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:29.906 11:20:11 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:29.906 11:20:11 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:29.906 11:20:11 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:29.906 11:20:11 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:29.906 11:20:11 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:29.906 11:20:11 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:09:29.906 11:20:11 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=uring0 --of=/dev/fd/62 --json /dev/fd/61 00:09:29.906 [2024-10-07 11:20:11.559028] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:29.906 [2024-10-07 11:20:11.559127] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61503 ] 00:09:29.906 { 00:09:29.906 "subsystems": [ 00:09:29.906 { 00:09:29.906 "subsystem": "bdev", 00:09:29.906 "config": [ 00:09:29.906 { 00:09:29.906 "params": { 00:09:29.906 "block_size": 512, 00:09:29.906 "num_blocks": 1048576, 00:09:29.906 "name": "malloc0" 00:09:29.906 }, 00:09:29.906 "method": "bdev_malloc_create" 00:09:29.906 }, 00:09:29.906 { 00:09:29.906 "params": { 00:09:29.906 "filename": "/dev/zram1", 00:09:29.906 "name": "uring0" 00:09:29.906 }, 00:09:29.906 "method": "bdev_uring_create" 00:09:29.906 }, 00:09:29.906 { 00:09:29.906 "params": { 00:09:29.906 "name": "uring0" 00:09:29.906 }, 00:09:29.906 "method": "bdev_uring_delete" 00:09:29.906 }, 00:09:29.906 { 00:09:29.906 "method": "bdev_wait_for_examine" 00:09:29.906 } 00:09:29.906 ] 00:09:29.906 } 00:09:29.906 ] 00:09:29.906 } 00:09:30.165 [2024-10-07 11:20:11.700176] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:30.165 [2024-10-07 11:20:11.771826] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:30.165 [2024-10-07 11:20:11.805054] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:30.460 [2024-10-07 11:20:11.941199] bdev.c:8281:bdev_open_ext: *NOTICE*: Currently unable to find bdev with name: uring0 00:09:30.460 [2024-10-07 11:20:11.941273] spdk_dd.c: 933:dd_open_bdev: *ERROR*: Could not open bdev uring0: No such device 00:09:30.460 [2024-10-07 11:20:11.941287] spdk_dd.c:1090:dd_run: *ERROR*: uring0: No such device 00:09:30.460 [2024-10-07 11:20:11.941301] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:09:30.460 [2024-10-07 11:20:12.122248] spdk_dd.c:1536:main: *ERROR*: Error occurred while performing copy 00:09:30.718 11:20:12 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@653 -- # es=237 00:09:30.718 11:20:12 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:30.718 11:20:12 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@662 -- # es=109 00:09:30.718 11:20:12 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@663 -- # case "$es" in 00:09:30.718 11:20:12 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@670 -- # es=1 00:09:30.718 11:20:12 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:30.718 11:20:12 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@99 -- # remove_zram_dev 1 00:09:30.718 11:20:12 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/common.sh@168 -- # local id=1 00:09:30.718 11:20:12 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/common.sh@170 -- # [[ -e /sys/block/zram1 ]] 00:09:30.718 11:20:12 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/common.sh@172 -- # echo 1 00:09:30.718 11:20:12 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/common.sh@173 -- # echo 1 00:09:30.718 11:20:12 spdk_dd.spdk_dd_uring.dd_uring_copy -- dd/uring.sh@100 -- # rm -f /home/vagrant/spdk_repo/spdk/test/dd/magic.dump0 /home/vagrant/spdk_repo/spdk/test/dd/magic.dump1 00:09:30.977 00:09:30.977 real 0m14.622s 00:09:30.977 user 0m10.064s 00:09:30.977 sys 0m12.882s 00:09:30.977 11:20:12 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:30.977 11:20:12 spdk_dd.spdk_dd_uring.dd_uring_copy -- common/autotest_common.sh@10 -- # set +x 00:09:30.977 ************************************ 00:09:30.977 END TEST dd_uring_copy 00:09:30.977 ************************************ 00:09:30.977 00:09:30.977 real 0m14.852s 00:09:30.977 user 0m10.191s 00:09:30.977 sys 0m12.990s 00:09:30.977 11:20:12 spdk_dd.spdk_dd_uring -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:30.977 11:20:12 spdk_dd.spdk_dd_uring -- common/autotest_common.sh@10 -- # set +x 00:09:30.977 ************************************ 00:09:30.977 END TEST spdk_dd_uring 00:09:30.977 ************************************ 00:09:30.977 11:20:12 spdk_dd -- dd/dd.sh@27 -- # run_test spdk_dd_sparse /home/vagrant/spdk_repo/spdk/test/dd/sparse.sh 00:09:30.977 11:20:12 spdk_dd -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:30.977 11:20:12 spdk_dd -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:30.977 11:20:12 spdk_dd -- common/autotest_common.sh@10 -- # set +x 00:09:30.977 ************************************ 00:09:30.977 START TEST spdk_dd_sparse 00:09:30.977 ************************************ 00:09:30.977 11:20:12 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/dd/sparse.sh 00:09:30.977 * Looking for test storage... 00:09:30.977 * Found test storage at /home/vagrant/spdk_repo/spdk/test/dd 00:09:30.977 11:20:12 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:30.977 11:20:12 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@1681 -- # lcov --version 00:09:30.977 11:20:12 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@336 -- # IFS=.-: 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@336 -- # read -ra ver1 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@337 -- # IFS=.-: 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@337 -- # read -ra ver2 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@338 -- # local 'op=<' 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@340 -- # ver1_l=2 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@341 -- # ver2_l=1 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@344 -- # case "$op" in 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@345 -- # : 1 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@365 -- # decimal 1 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@353 -- # local d=1 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@355 -- # echo 1 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@365 -- # ver1[v]=1 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@366 -- # decimal 2 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@353 -- # local d=2 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@355 -- # echo 2 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@366 -- # ver2[v]=2 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@368 -- # return 0 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:31.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:31.236 --rc genhtml_branch_coverage=1 00:09:31.236 --rc genhtml_function_coverage=1 00:09:31.236 --rc genhtml_legend=1 00:09:31.236 --rc geninfo_all_blocks=1 00:09:31.236 --rc geninfo_unexecuted_blocks=1 00:09:31.236 00:09:31.236 ' 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:31.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:31.236 --rc genhtml_branch_coverage=1 00:09:31.236 --rc genhtml_function_coverage=1 00:09:31.236 --rc genhtml_legend=1 00:09:31.236 --rc geninfo_all_blocks=1 00:09:31.236 --rc geninfo_unexecuted_blocks=1 00:09:31.236 00:09:31.236 ' 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:31.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:31.236 --rc genhtml_branch_coverage=1 00:09:31.236 --rc genhtml_function_coverage=1 00:09:31.236 --rc genhtml_legend=1 00:09:31.236 --rc geninfo_all_blocks=1 00:09:31.236 --rc geninfo_unexecuted_blocks=1 00:09:31.236 00:09:31.236 ' 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:31.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:31.236 --rc genhtml_branch_coverage=1 00:09:31.236 --rc genhtml_function_coverage=1 00:09:31.236 --rc genhtml_legend=1 00:09:31.236 --rc geninfo_all_blocks=1 00:09:31.236 --rc geninfo_unexecuted_blocks=1 00:09:31.236 00:09:31.236 ' 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- dd/common.sh@7 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@15 -- # shopt -s extglob 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:31.236 11:20:12 spdk_dd.spdk_dd_sparse -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- paths/export.sh@5 -- # export PATH 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@108 -- # aio_disk=dd_sparse_aio_disk 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@109 -- # aio_bdev=dd_aio 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@110 -- # file1=file_zero1 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@111 -- # file2=file_zero2 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@112 -- # file3=file_zero3 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@113 -- # lvstore=dd_lvstore 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@114 -- # lvol=dd_lvol 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@116 -- # trap cleanup EXIT 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@118 -- # prepare 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@18 -- # truncate dd_sparse_aio_disk --size 104857600 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@20 -- # dd if=/dev/zero of=file_zero1 bs=4M count=1 00:09:31.237 1+0 records in 00:09:31.237 1+0 records out 00:09:31.237 4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00612065 s, 685 MB/s 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@21 -- # dd if=/dev/zero of=file_zero1 bs=4M count=1 seek=4 00:09:31.237 1+0 records in 00:09:31.237 1+0 records out 00:09:31.237 4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00653103 s, 642 MB/s 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@22 -- # dd if=/dev/zero of=file_zero1 bs=4M count=1 seek=8 00:09:31.237 1+0 records in 00:09:31.237 1+0 records out 00:09:31.237 4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00615957 s, 681 MB/s 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@120 -- # run_test dd_sparse_file_to_file file_to_file 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@10 -- # set +x 00:09:31.237 ************************************ 00:09:31.237 START TEST dd_sparse_file_to_file 00:09:31.237 ************************************ 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- common/autotest_common.sh@1125 -- # file_to_file 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- dd/sparse.sh@26 -- # local stat1_s stat1_b 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- dd/sparse.sh@27 -- # local stat2_s stat2_b 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- dd/sparse.sh@29 -- # method_bdev_aio_create_0=(['filename']='dd_sparse_aio_disk' ['name']='dd_aio' ['block_size']='4096') 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- dd/sparse.sh@29 -- # local -A method_bdev_aio_create_0 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- dd/sparse.sh@35 -- # method_bdev_lvol_create_lvstore_1=(['bdev_name']='dd_aio' ['lvs_name']='dd_lvstore') 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- dd/sparse.sh@35 -- # local -A method_bdev_lvol_create_lvstore_1 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- dd/sparse.sh@41 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=file_zero1 --of=file_zero2 --bs=12582912 --sparse --json /dev/fd/62 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- dd/sparse.sh@41 -- # gen_conf 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- dd/common.sh@31 -- # xtrace_disable 00:09:31.237 11:20:12 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- common/autotest_common.sh@10 -- # set +x 00:09:31.237 [2024-10-07 11:20:12.866029] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:31.237 [2024-10-07 11:20:12.866113] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61597 ] 00:09:31.237 { 00:09:31.237 "subsystems": [ 00:09:31.237 { 00:09:31.237 "subsystem": "bdev", 00:09:31.237 "config": [ 00:09:31.237 { 00:09:31.237 "params": { 00:09:31.237 "block_size": 4096, 00:09:31.237 "filename": "dd_sparse_aio_disk", 00:09:31.237 "name": "dd_aio" 00:09:31.237 }, 00:09:31.237 "method": "bdev_aio_create" 00:09:31.237 }, 00:09:31.237 { 00:09:31.237 "params": { 00:09:31.237 "lvs_name": "dd_lvstore", 00:09:31.237 "bdev_name": "dd_aio" 00:09:31.237 }, 00:09:31.237 "method": "bdev_lvol_create_lvstore" 00:09:31.237 }, 00:09:31.237 { 00:09:31.237 "method": "bdev_wait_for_examine" 00:09:31.237 } 00:09:31.237 ] 00:09:31.237 } 00:09:31.237 ] 00:09:31.237 } 00:09:31.495 [2024-10-07 11:20:13.001189] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:31.495 [2024-10-07 11:20:13.071683] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:31.495 [2024-10-07 11:20:13.104705] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:31.495  [2024-10-07T11:20:13.464Z] Copying: 12/36 [MB] (average 571 MBps) 00:09:31.753 00:09:31.753 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- dd/sparse.sh@47 -- # stat --printf=%s file_zero1 00:09:31.753 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- dd/sparse.sh@47 -- # stat1_s=37748736 00:09:31.753 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- dd/sparse.sh@48 -- # stat --printf=%s file_zero2 00:09:31.753 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- dd/sparse.sh@48 -- # stat2_s=37748736 00:09:31.753 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- dd/sparse.sh@50 -- # [[ 37748736 == \3\7\7\4\8\7\3\6 ]] 00:09:31.753 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- dd/sparse.sh@52 -- # stat --printf=%b file_zero1 00:09:31.753 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- dd/sparse.sh@52 -- # stat1_b=24576 00:09:31.753 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- dd/sparse.sh@53 -- # stat --printf=%b file_zero2 00:09:31.753 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- dd/sparse.sh@53 -- # stat2_b=24576 00:09:31.753 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- dd/sparse.sh@55 -- # [[ 24576 == \2\4\5\7\6 ]] 00:09:31.753 00:09:31.753 real 0m0.605s 00:09:31.753 user 0m0.387s 00:09:31.753 sys 0m0.281s 00:09:31.753 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:31.753 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_file -- common/autotest_common.sh@10 -- # set +x 00:09:31.753 ************************************ 00:09:31.753 END TEST dd_sparse_file_to_file 00:09:31.753 ************************************ 00:09:31.753 11:20:13 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@121 -- # run_test dd_sparse_file_to_bdev file_to_bdev 00:09:31.753 11:20:13 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:31.753 11:20:13 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:31.753 11:20:13 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@10 -- # set +x 00:09:32.011 ************************************ 00:09:32.011 START TEST dd_sparse_file_to_bdev 00:09:32.011 ************************************ 00:09:32.011 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_bdev -- common/autotest_common.sh@1125 -- # file_to_bdev 00:09:32.011 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_bdev -- dd/sparse.sh@59 -- # method_bdev_aio_create_0=(['filename']='dd_sparse_aio_disk' ['name']='dd_aio' ['block_size']='4096') 00:09:32.011 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_bdev -- dd/sparse.sh@59 -- # local -A method_bdev_aio_create_0 00:09:32.011 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_bdev -- dd/sparse.sh@65 -- # method_bdev_lvol_create_1=(['lvs_name']='dd_lvstore' ['lvol_name']='dd_lvol' ['size_in_mib']='36' ['thin_provision']='true') 00:09:32.011 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_bdev -- dd/sparse.sh@65 -- # local -A method_bdev_lvol_create_1 00:09:32.011 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_bdev -- dd/sparse.sh@73 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=file_zero2 --ob=dd_lvstore/dd_lvol --bs=12582912 --sparse --json /dev/fd/62 00:09:32.011 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_bdev -- dd/sparse.sh@73 -- # gen_conf 00:09:32.011 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_bdev -- dd/common.sh@31 -- # xtrace_disable 00:09:32.011 11:20:13 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_bdev -- common/autotest_common.sh@10 -- # set +x 00:09:32.011 [2024-10-07 11:20:13.535378] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:32.011 [2024-10-07 11:20:13.535543] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61644 ] 00:09:32.011 { 00:09:32.011 "subsystems": [ 00:09:32.011 { 00:09:32.011 "subsystem": "bdev", 00:09:32.011 "config": [ 00:09:32.011 { 00:09:32.011 "params": { 00:09:32.011 "block_size": 4096, 00:09:32.011 "filename": "dd_sparse_aio_disk", 00:09:32.011 "name": "dd_aio" 00:09:32.011 }, 00:09:32.011 "method": "bdev_aio_create" 00:09:32.011 }, 00:09:32.011 { 00:09:32.011 "params": { 00:09:32.011 "lvs_name": "dd_lvstore", 00:09:32.011 "lvol_name": "dd_lvol", 00:09:32.011 "size_in_mib": 36, 00:09:32.011 "thin_provision": true 00:09:32.011 }, 00:09:32.011 "method": "bdev_lvol_create" 00:09:32.011 }, 00:09:32.011 { 00:09:32.011 "method": "bdev_wait_for_examine" 00:09:32.011 } 00:09:32.011 ] 00:09:32.011 } 00:09:32.011 ] 00:09:32.011 } 00:09:32.011 [2024-10-07 11:20:13.674961] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:32.270 [2024-10-07 11:20:13.739389] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:32.270 [2024-10-07 11:20:13.776678] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:32.270  [2024-10-07T11:20:14.239Z] Copying: 12/36 [MB] (average 600 MBps) 00:09:32.528 00:09:32.528 00:09:32.528 real 0m0.568s 00:09:32.528 user 0m0.395s 00:09:32.528 sys 0m0.258s 00:09:32.528 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_bdev -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:32.528 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_file_to_bdev -- common/autotest_common.sh@10 -- # set +x 00:09:32.528 ************************************ 00:09:32.528 END TEST dd_sparse_file_to_bdev 00:09:32.528 ************************************ 00:09:32.528 11:20:14 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@122 -- # run_test dd_sparse_bdev_to_file bdev_to_file 00:09:32.528 11:20:14 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:32.528 11:20:14 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:32.528 11:20:14 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@10 -- # set +x 00:09:32.528 ************************************ 00:09:32.528 START TEST dd_sparse_bdev_to_file 00:09:32.528 ************************************ 00:09:32.528 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- common/autotest_common.sh@1125 -- # bdev_to_file 00:09:32.528 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- dd/sparse.sh@81 -- # local stat2_s stat2_b 00:09:32.528 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- dd/sparse.sh@82 -- # local stat3_s stat3_b 00:09:32.528 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- dd/sparse.sh@84 -- # method_bdev_aio_create_0=(['filename']='dd_sparse_aio_disk' ['name']='dd_aio' ['block_size']='4096') 00:09:32.528 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- dd/sparse.sh@84 -- # local -A method_bdev_aio_create_0 00:09:32.528 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- dd/sparse.sh@91 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=dd_lvstore/dd_lvol --of=file_zero3 --bs=12582912 --sparse --json /dev/fd/62 00:09:32.528 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- dd/sparse.sh@91 -- # gen_conf 00:09:32.528 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- dd/common.sh@31 -- # xtrace_disable 00:09:32.528 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- common/autotest_common.sh@10 -- # set +x 00:09:32.528 { 00:09:32.528 "subsystems": [ 00:09:32.528 { 00:09:32.528 "subsystem": "bdev", 00:09:32.528 "config": [ 00:09:32.528 { 00:09:32.528 "params": { 00:09:32.528 "block_size": 4096, 00:09:32.528 "filename": "dd_sparse_aio_disk", 00:09:32.528 "name": "dd_aio" 00:09:32.528 }, 00:09:32.528 "method": "bdev_aio_create" 00:09:32.528 }, 00:09:32.528 { 00:09:32.528 "method": "bdev_wait_for_examine" 00:09:32.528 } 00:09:32.528 ] 00:09:32.528 } 00:09:32.528 ] 00:09:32.528 } 00:09:32.528 [2024-10-07 11:20:14.143226] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:32.528 [2024-10-07 11:20:14.143364] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61678 ] 00:09:32.786 [2024-10-07 11:20:14.283065] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:32.786 [2024-10-07 11:20:14.357273] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:32.786 [2024-10-07 11:20:14.390944] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:32.786  [2024-10-07T11:20:14.757Z] Copying: 12/36 [MB] (average 1500 MBps) 00:09:33.046 00:09:33.046 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- dd/sparse.sh@97 -- # stat --printf=%s file_zero2 00:09:33.046 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- dd/sparse.sh@97 -- # stat2_s=37748736 00:09:33.046 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- dd/sparse.sh@98 -- # stat --printf=%s file_zero3 00:09:33.046 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- dd/sparse.sh@98 -- # stat3_s=37748736 00:09:33.046 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- dd/sparse.sh@100 -- # [[ 37748736 == \3\7\7\4\8\7\3\6 ]] 00:09:33.046 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- dd/sparse.sh@102 -- # stat --printf=%b file_zero2 00:09:33.046 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- dd/sparse.sh@102 -- # stat2_b=24576 00:09:33.046 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- dd/sparse.sh@103 -- # stat --printf=%b file_zero3 00:09:33.046 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- dd/sparse.sh@103 -- # stat3_b=24576 00:09:33.046 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- dd/sparse.sh@105 -- # [[ 24576 == \2\4\5\7\6 ]] 00:09:33.046 00:09:33.046 real 0m0.571s 00:09:33.046 user 0m0.372s 00:09:33.046 sys 0m0.250s 00:09:33.046 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:33.046 11:20:14 spdk_dd.spdk_dd_sparse.dd_sparse_bdev_to_file -- common/autotest_common.sh@10 -- # set +x 00:09:33.046 ************************************ 00:09:33.046 END TEST dd_sparse_bdev_to_file 00:09:33.046 ************************************ 00:09:33.046 11:20:14 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@1 -- # cleanup 00:09:33.046 11:20:14 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@11 -- # rm dd_sparse_aio_disk 00:09:33.046 11:20:14 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@12 -- # rm file_zero1 00:09:33.046 11:20:14 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@13 -- # rm file_zero2 00:09:33.046 11:20:14 spdk_dd.spdk_dd_sparse -- dd/sparse.sh@14 -- # rm file_zero3 00:09:33.046 00:09:33.046 real 0m2.105s 00:09:33.046 user 0m1.325s 00:09:33.046 sys 0m0.981s 00:09:33.046 11:20:14 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:33.046 11:20:14 spdk_dd.spdk_dd_sparse -- common/autotest_common.sh@10 -- # set +x 00:09:33.046 ************************************ 00:09:33.046 END TEST spdk_dd_sparse 00:09:33.046 ************************************ 00:09:33.046 11:20:14 spdk_dd -- dd/dd.sh@28 -- # run_test spdk_dd_negative /home/vagrant/spdk_repo/spdk/test/dd/negative_dd.sh 00:09:33.046 11:20:14 spdk_dd -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:33.046 11:20:14 spdk_dd -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:33.046 11:20:14 spdk_dd -- common/autotest_common.sh@10 -- # set +x 00:09:33.046 ************************************ 00:09:33.046 START TEST spdk_dd_negative 00:09:33.046 ************************************ 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/dd/negative_dd.sh 00:09:33.306 * Looking for test storage... 00:09:33.306 * Found test storage at /home/vagrant/spdk_repo/spdk/test/dd 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1681 -- # lcov --version 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@336 -- # IFS=.-: 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@336 -- # read -ra ver1 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@337 -- # IFS=.-: 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@337 -- # read -ra ver2 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@338 -- # local 'op=<' 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@340 -- # ver1_l=2 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@341 -- # ver2_l=1 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@344 -- # case "$op" in 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@345 -- # : 1 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@365 -- # decimal 1 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@353 -- # local d=1 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@355 -- # echo 1 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@365 -- # ver1[v]=1 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@366 -- # decimal 2 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@353 -- # local d=2 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@355 -- # echo 2 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@366 -- # ver2[v]=2 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@368 -- # return 0 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:33.306 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:33.306 --rc genhtml_branch_coverage=1 00:09:33.306 --rc genhtml_function_coverage=1 00:09:33.306 --rc genhtml_legend=1 00:09:33.306 --rc geninfo_all_blocks=1 00:09:33.306 --rc geninfo_unexecuted_blocks=1 00:09:33.306 00:09:33.306 ' 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:33.306 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:33.306 --rc genhtml_branch_coverage=1 00:09:33.306 --rc genhtml_function_coverage=1 00:09:33.306 --rc genhtml_legend=1 00:09:33.306 --rc geninfo_all_blocks=1 00:09:33.306 --rc geninfo_unexecuted_blocks=1 00:09:33.306 00:09:33.306 ' 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:33.306 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:33.306 --rc genhtml_branch_coverage=1 00:09:33.306 --rc genhtml_function_coverage=1 00:09:33.306 --rc genhtml_legend=1 00:09:33.306 --rc geninfo_all_blocks=1 00:09:33.306 --rc geninfo_unexecuted_blocks=1 00:09:33.306 00:09:33.306 ' 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:33.306 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:33.306 --rc genhtml_branch_coverage=1 00:09:33.306 --rc genhtml_function_coverage=1 00:09:33.306 --rc genhtml_legend=1 00:09:33.306 --rc geninfo_all_blocks=1 00:09:33.306 --rc geninfo_unexecuted_blocks=1 00:09:33.306 00:09:33.306 ' 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- dd/common.sh@7 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@15 -- # shopt -s extglob 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- paths/export.sh@5 -- # export PATH 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@210 -- # test_file0=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@211 -- # test_file1=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@213 -- # touch /home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@214 -- # touch /home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@216 -- # run_test dd_invalid_arguments invalid_arguments 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:33.306 11:20:14 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@10 -- # set +x 00:09:33.307 ************************************ 00:09:33.307 START TEST dd_invalid_arguments 00:09:33.307 ************************************ 00:09:33.307 11:20:14 spdk_dd.spdk_dd_negative.dd_invalid_arguments -- common/autotest_common.sh@1125 -- # invalid_arguments 00:09:33.307 11:20:14 spdk_dd.spdk_dd_negative.dd_invalid_arguments -- dd/negative_dd.sh@12 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ii= --ob= 00:09:33.307 11:20:14 spdk_dd.spdk_dd_negative.dd_invalid_arguments -- common/autotest_common.sh@650 -- # local es=0 00:09:33.307 11:20:14 spdk_dd.spdk_dd_negative.dd_invalid_arguments -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ii= --ob= 00:09:33.307 11:20:14 spdk_dd.spdk_dd_negative.dd_invalid_arguments -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.307 11:20:14 spdk_dd.spdk_dd_negative.dd_invalid_arguments -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:33.307 11:20:14 spdk_dd.spdk_dd_negative.dd_invalid_arguments -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.307 11:20:14 spdk_dd.spdk_dd_negative.dd_invalid_arguments -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:33.307 11:20:14 spdk_dd.spdk_dd_negative.dd_invalid_arguments -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.307 11:20:14 spdk_dd.spdk_dd_negative.dd_invalid_arguments -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:33.307 11:20:14 spdk_dd.spdk_dd_negative.dd_invalid_arguments -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.307 11:20:14 spdk_dd.spdk_dd_negative.dd_invalid_arguments -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:09:33.307 11:20:14 spdk_dd.spdk_dd_negative.dd_invalid_arguments -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ii= --ob= 00:09:33.567 /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd [options] 00:09:33.567 00:09:33.567 CPU options: 00:09:33.567 -m, --cpumask core mask (like 0xF) or core list of '[]' embraced for DPDK 00:09:33.567 (like [0,1,10]) 00:09:33.567 --lcores lcore to CPU mapping list. The list is in the format: 00:09:33.567 [<,lcores[@CPUs]>...] 00:09:33.567 lcores and cpus list are grouped by '(' and ')', e.g '--lcores "(5-7)@(10-12)"' 00:09:33.567 Within the group, '-' is used for range separator, 00:09:33.567 ',' is used for single number separator. 00:09:33.567 '( )' can be omitted for single element group, 00:09:33.567 '@' can be omitted if cpus and lcores have the same value 00:09:33.567 --disable-cpumask-locks Disable CPU core lock files. 00:09:33.567 --interrupt-mode set app to interrupt mode (Warning: CPU usage will be reduced only if all 00:09:33.567 pollers in the app support interrupt mode) 00:09:33.567 -p, --main-core main (primary) core for DPDK 00:09:33.567 00:09:33.567 Configuration options: 00:09:33.567 -c, --config, --json JSON config file 00:09:33.567 -r, --rpc-socket RPC listen address (default /var/tmp/spdk.sock) 00:09:33.567 --no-rpc-server skip RPC server initialization. This option ignores '--rpc-socket' value. 00:09:33.567 --wait-for-rpc wait for RPCs to initialize subsystems 00:09:33.567 --rpcs-allowed comma-separated list of permitted RPCS 00:09:33.567 --json-ignore-init-errors don't exit on invalid config entry 00:09:33.567 00:09:33.567 Memory options: 00:09:33.567 --iova-mode set IOVA mode ('pa' for IOVA_PA and 'va' for IOVA_VA) 00:09:33.567 --base-virtaddr the base virtual address for DPDK (default: 0x200000000000) 00:09:33.567 --huge-dir use a specific hugetlbfs mount to reserve memory from 00:09:33.567 -R, --huge-unlink unlink huge files after initialization 00:09:33.567 -n, --mem-channels number of memory channels used for DPDK 00:09:33.567 -s, --mem-size memory size in MB for DPDK (default: 0MB) 00:09:33.567 --msg-mempool-size global message memory pool size in count (default: 262143) 00:09:33.567 --no-huge run without using hugepages 00:09:33.567 --enforce-numa enforce NUMA allocations from the specified NUMA node 00:09:33.567 -i, --shm-id shared memory ID (optional) 00:09:33.567 -g, --single-file-segments force creating just one hugetlbfs file 00:09:33.567 00:09:33.567 PCI options: 00:09:33.567 -A, --pci-allowed pci addr to allow (-B and -A cannot be used at the same time) 00:09:33.567 -B, --pci-blocked pci addr to block (can be used more than once) 00:09:33.567 -u, --no-pci disable PCI access 00:09:33.567 --vfio-vf-token VF token (UUID) shared between SR-IOV PF and VFs for vfio_pci driver 00:09:33.567 00:09:33.567 Log options: 00:09:33.567 -L, --logflag enable log flag (all, accel, accel_dsa, accel_iaa, accel_ioat, aio, 00:09:33.567 app_config, app_rpc, bdev, bdev_concat, bdev_ftl, bdev_malloc, 00:09:33.567 bdev_null, bdev_nvme, bdev_raid, bdev_raid0, bdev_raid1, bdev_raid_sb, 00:09:33.567 blob, blob_esnap, blob_rw, blobfs, blobfs_bdev, blobfs_bdev_rpc, 00:09:33.567 blobfs_rw, fsdev, fsdev_aio, ftl_core, ftl_init, gpt_parse, idxd, ioat, 00:09:33.567 iscsi_init, json_util, keyring, log_rpc, lvol, lvol_rpc, notify_rpc, 00:09:33.567 nvme, nvme_auth, nvme_cuse, opal, reactor, rpc, rpc_client, sock, 00:09:33.567 sock_posix, spdk_aio_mgr_io, thread, trace, uring, vbdev_delay, 00:09:33.567 vbdev_gpt, vbdev_lvol, vbdev_opal, vbdev_passthru, vbdev_split, 00:09:33.567 vbdev_zone_block, vfio_pci, vfio_user, virtio, virtio_blk, virtio_dev, 00:09:33.567 virtio_pci, virtio_user, virtio_vfio_user, vmd) 00:09:33.567 --silence-noticelog disable notice level logging to stderr 00:09:33.567 00:09:33.567 Trace options: 00:09:33.567 --num-trace-entries number of trace entries for each core, must be power of 2, 00:09:33.567 setting 0 to disable trace (default 32768) 00:09:33.567 Tracepoints vary in size and can use more than one trace entry. 00:09:33.567 -e, --tpoint-group [:] 00:09:33.567 /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd: unrecognized option '--ii=' 00:09:33.567 [2024-10-07 11:20:15.052554] spdk_dd.c:1480:main: *ERROR*: Invalid arguments 00:09:33.567 group_name - tracepoint group name for spdk trace buffers (bdev, ftl, 00:09:33.567 blobfs, dsa, thread, nvme_pcie, iaa, nvme_tcp, bdev_nvme, sock, blob, 00:09:33.567 bdev_raid, scheduler, all). 00:09:33.567 tpoint_mask - tracepoint mask for enabling individual tpoints inside 00:09:33.567 a tracepoint group. First tpoint inside a group can be enabled by 00:09:33.567 setting tpoint_mask to 1 (e.g. bdev:0x1). Groups and masks can be 00:09:33.567 combined (e.g. thread,bdev:0x1). All available tpoints can be found 00:09:33.567 in /include/spdk_internal/trace_defs.h 00:09:33.567 00:09:33.567 Other options: 00:09:33.567 -h, --help show this usage 00:09:33.567 -v, --version print SPDK version 00:09:33.567 -d, --limit-coredump do not set max coredump size to RLIM_INFINITY 00:09:33.568 --env-context Opaque context for use of the env implementation 00:09:33.568 00:09:33.568 Application specific: 00:09:33.568 [--------- DD Options ---------] 00:09:33.568 --if Input file. Must specify either --if or --ib. 00:09:33.568 --ib Input bdev. Must specifier either --if or --ib 00:09:33.568 --of Output file. Must specify either --of or --ob. 00:09:33.568 --ob Output bdev. Must specify either --of or --ob. 00:09:33.568 --iflag Input file flags. 00:09:33.568 --oflag Output file flags. 00:09:33.568 --bs I/O unit size (default: 4096) 00:09:33.568 --qd Queue depth (default: 2) 00:09:33.568 --count I/O unit count. The number of I/O units to copy. (default: all) 00:09:33.568 --skip Skip this many I/O units at start of input. (default: 0) 00:09:33.568 --seek Skip this many I/O units at start of output. (default: 0) 00:09:33.568 --aio Force usage of AIO. (by default io_uring is used if available) 00:09:33.568 --sparse Enable hole skipping in input target 00:09:33.568 Available iflag and oflag values: 00:09:33.568 append - append mode 00:09:33.568 direct - use direct I/O for data 00:09:33.568 directory - fail unless a directory 00:09:33.568 dsync - use synchronized I/O for data 00:09:33.568 noatime - do not update access time 00:09:33.568 noctty - do not assign controlling terminal from file 00:09:33.568 nofollow - do not follow symlinks 00:09:33.568 nonblock - use non-blocking I/O 00:09:33.568 sync - use synchronized I/O for data and metadata 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_invalid_arguments -- common/autotest_common.sh@653 -- # es=2 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_invalid_arguments -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_invalid_arguments -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_invalid_arguments -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:33.568 00:09:33.568 real 0m0.088s 00:09:33.568 user 0m0.061s 00:09:33.568 sys 0m0.026s 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_invalid_arguments -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:33.568 ************************************ 00:09:33.568 END TEST dd_invalid_arguments 00:09:33.568 ************************************ 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_invalid_arguments -- common/autotest_common.sh@10 -- # set +x 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@217 -- # run_test dd_double_input double_input 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@10 -- # set +x 00:09:33.568 ************************************ 00:09:33.568 START TEST dd_double_input 00:09:33.568 ************************************ 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_input -- common/autotest_common.sh@1125 -- # double_input 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_input -- dd/negative_dd.sh@19 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --ib= --ob= 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_input -- common/autotest_common.sh@650 -- # local es=0 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_input -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --ib= --ob= 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_input -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_input -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_input -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_input -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_input -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_input -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_input -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_input -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_input -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --ib= --ob= 00:09:33.568 [2024-10-07 11:20:15.182945] spdk_dd.c:1487:main: *ERROR*: You may specify either --if or --ib, but not both. 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_input -- common/autotest_common.sh@653 -- # es=22 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_input -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_input -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_input -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:33.568 00:09:33.568 real 0m0.082s 00:09:33.568 user 0m0.052s 00:09:33.568 sys 0m0.029s 00:09:33.568 ************************************ 00:09:33.568 END TEST dd_double_input 00:09:33.568 ************************************ 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_input -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_input -- common/autotest_common.sh@10 -- # set +x 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@218 -- # run_test dd_double_output double_output 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@10 -- # set +x 00:09:33.568 ************************************ 00:09:33.568 START TEST dd_double_output 00:09:33.568 ************************************ 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_output -- common/autotest_common.sh@1125 -- # double_output 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_output -- dd/negative_dd.sh@27 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --ob= 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_output -- common/autotest_common.sh@650 -- # local es=0 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_output -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --ob= 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_output -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_output -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_output -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_output -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_output -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_output -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_output -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_output -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:09:33.568 11:20:15 spdk_dd.spdk_dd_negative.dd_double_output -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --ob= 00:09:33.839 [2024-10-07 11:20:15.305514] spdk_dd.c:1493:main: *ERROR*: You may specify either --of or --ob, but not both. 00:09:33.839 11:20:15 spdk_dd.spdk_dd_negative.dd_double_output -- common/autotest_common.sh@653 -- # es=22 00:09:33.839 11:20:15 spdk_dd.spdk_dd_negative.dd_double_output -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:33.839 11:20:15 spdk_dd.spdk_dd_negative.dd_double_output -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:09:33.839 11:20:15 spdk_dd.spdk_dd_negative.dd_double_output -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:33.839 00:09:33.839 real 0m0.077s 00:09:33.839 user 0m0.048s 00:09:33.839 sys 0m0.027s 00:09:33.839 11:20:15 spdk_dd.spdk_dd_negative.dd_double_output -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:33.839 11:20:15 spdk_dd.spdk_dd_negative.dd_double_output -- common/autotest_common.sh@10 -- # set +x 00:09:33.839 ************************************ 00:09:33.839 END TEST dd_double_output 00:09:33.840 ************************************ 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@219 -- # run_test dd_no_input no_input 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@10 -- # set +x 00:09:33.840 ************************************ 00:09:33.840 START TEST dd_no_input 00:09:33.840 ************************************ 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_input -- common/autotest_common.sh@1125 -- # no_input 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_input -- dd/negative_dd.sh@35 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ob= 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_input -- common/autotest_common.sh@650 -- # local es=0 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_input -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ob= 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_input -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_input -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_input -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_input -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_input -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_input -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_input -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_input -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_input -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ob= 00:09:33.840 [2024-10-07 11:20:15.452838] spdk_dd.c:1499:main: *ERROR*: You must specify either --if or --ib 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_input -- common/autotest_common.sh@653 -- # es=22 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_input -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_input -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_input -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:33.840 00:09:33.840 real 0m0.113s 00:09:33.840 user 0m0.067s 00:09:33.840 sys 0m0.043s 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_input -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:33.840 ************************************ 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_input -- common/autotest_common.sh@10 -- # set +x 00:09:33.840 END TEST dd_no_input 00:09:33.840 ************************************ 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@220 -- # run_test dd_no_output no_output 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@10 -- # set +x 00:09:33.840 ************************************ 00:09:33.840 START TEST dd_no_output 00:09:33.840 ************************************ 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_output -- common/autotest_common.sh@1125 -- # no_output 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_output -- dd/negative_dd.sh@41 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_output -- common/autotest_common.sh@650 -- # local es=0 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_output -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_output -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_output -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_output -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_output -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_output -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_output -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_output -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_output -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:09:33.840 11:20:15 spdk_dd.spdk_dd_negative.dd_no_output -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 00:09:34.098 [2024-10-07 11:20:15.599324] spdk_dd.c:1505:main: *ERROR*: You must specify either --of or --ob 00:09:34.098 11:20:15 spdk_dd.spdk_dd_negative.dd_no_output -- common/autotest_common.sh@653 -- # es=22 00:09:34.098 11:20:15 spdk_dd.spdk_dd_negative.dd_no_output -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:34.098 11:20:15 spdk_dd.spdk_dd_negative.dd_no_output -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:09:34.098 11:20:15 spdk_dd.spdk_dd_negative.dd_no_output -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:34.098 00:09:34.098 real 0m0.097s 00:09:34.098 user 0m0.061s 00:09:34.098 sys 0m0.034s 00:09:34.098 11:20:15 spdk_dd.spdk_dd_negative.dd_no_output -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:34.098 11:20:15 spdk_dd.spdk_dd_negative.dd_no_output -- common/autotest_common.sh@10 -- # set +x 00:09:34.098 ************************************ 00:09:34.098 END TEST dd_no_output 00:09:34.098 ************************************ 00:09:34.098 11:20:15 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@221 -- # run_test dd_wrong_blocksize wrong_blocksize 00:09:34.098 11:20:15 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:34.098 11:20:15 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:34.098 11:20:15 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@10 -- # set +x 00:09:34.098 ************************************ 00:09:34.098 START TEST dd_wrong_blocksize 00:09:34.098 ************************************ 00:09:34.098 11:20:15 spdk_dd.spdk_dd_negative.dd_wrong_blocksize -- common/autotest_common.sh@1125 -- # wrong_blocksize 00:09:34.098 11:20:15 spdk_dd.spdk_dd_negative.dd_wrong_blocksize -- dd/negative_dd.sh@47 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --bs=0 00:09:34.098 11:20:15 spdk_dd.spdk_dd_negative.dd_wrong_blocksize -- common/autotest_common.sh@650 -- # local es=0 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_wrong_blocksize -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --bs=0 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_wrong_blocksize -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_wrong_blocksize -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_wrong_blocksize -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_wrong_blocksize -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_wrong_blocksize -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_wrong_blocksize -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_wrong_blocksize -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_wrong_blocksize -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_wrong_blocksize -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --bs=0 00:09:34.099 [2024-10-07 11:20:15.724308] spdk_dd.c:1511:main: *ERROR*: Invalid --bs value 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_wrong_blocksize -- common/autotest_common.sh@653 -- # es=22 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_wrong_blocksize -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_wrong_blocksize -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_wrong_blocksize -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:34.099 00:09:34.099 real 0m0.067s 00:09:34.099 user 0m0.044s 00:09:34.099 sys 0m0.022s 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_wrong_blocksize -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_wrong_blocksize -- common/autotest_common.sh@10 -- # set +x 00:09:34.099 ************************************ 00:09:34.099 END TEST dd_wrong_blocksize 00:09:34.099 ************************************ 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@222 -- # run_test dd_smaller_blocksize smaller_blocksize 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@10 -- # set +x 00:09:34.099 ************************************ 00:09:34.099 START TEST dd_smaller_blocksize 00:09:34.099 ************************************ 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@1125 -- # smaller_blocksize 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- dd/negative_dd.sh@55 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --bs=99999999999999 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@650 -- # local es=0 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --bs=99999999999999 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:09:34.099 11:20:15 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --bs=99999999999999 00:09:34.357 [2024-10-07 11:20:15.830785] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:34.357 [2024-10-07 11:20:15.830883] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61904 ] 00:09:34.357 [2024-10-07 11:20:15.964646] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:34.357 [2024-10-07 11:20:16.037181] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:34.615 [2024-10-07 11:20:16.070500] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:34.872 EAL: eal_memalloc_alloc_seg_bulk(): couldn't find suitable memseg_list 00:09:35.131 EAL: eal_memalloc_alloc_seg_bulk(): couldn't find suitable memseg_list 00:09:35.131 [2024-10-07 11:20:16.612529] spdk_dd.c:1184:dd_run: *ERROR*: Cannot allocate memory - try smaller block size value 00:09:35.131 [2024-10-07 11:20:16.612614] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:09:35.131 [2024-10-07 11:20:16.680231] spdk_dd.c:1536:main: *ERROR*: Error occurred while performing copy 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@653 -- # es=244 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@662 -- # es=116 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@663 -- # case "$es" in 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@670 -- # es=1 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:35.131 00:09:35.131 real 0m0.989s 00:09:35.131 user 0m0.380s 00:09:35.131 sys 0m0.501s 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_smaller_blocksize -- common/autotest_common.sh@10 -- # set +x 00:09:35.131 ************************************ 00:09:35.131 END TEST dd_smaller_blocksize 00:09:35.131 ************************************ 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@223 -- # run_test dd_invalid_count invalid_count 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@10 -- # set +x 00:09:35.131 ************************************ 00:09:35.131 START TEST dd_invalid_count 00:09:35.131 ************************************ 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_count -- common/autotest_common.sh@1125 -- # invalid_count 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_count -- dd/negative_dd.sh@63 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --count=-9 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_count -- common/autotest_common.sh@650 -- # local es=0 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_count -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --count=-9 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_count -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_count -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_count -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_count -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_count -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_count -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_count -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_count -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:09:35.131 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_count -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --count=-9 00:09:35.390 [2024-10-07 11:20:16.867042] spdk_dd.c:1517:main: *ERROR*: Invalid --count value 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_count -- common/autotest_common.sh@653 -- # es=22 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_count -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_count -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_count -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:35.390 00:09:35.390 real 0m0.071s 00:09:35.390 user 0m0.042s 00:09:35.390 sys 0m0.028s 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_count -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_count -- common/autotest_common.sh@10 -- # set +x 00:09:35.390 ************************************ 00:09:35.390 END TEST dd_invalid_count 00:09:35.390 ************************************ 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@224 -- # run_test dd_invalid_oflag invalid_oflag 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@10 -- # set +x 00:09:35.390 ************************************ 00:09:35.390 START TEST dd_invalid_oflag 00:09:35.390 ************************************ 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_oflag -- common/autotest_common.sh@1125 -- # invalid_oflag 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_oflag -- dd/negative_dd.sh@71 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib= --ob= --oflag=0 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_oflag -- common/autotest_common.sh@650 -- # local es=0 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_oflag -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib= --ob= --oflag=0 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_oflag -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_oflag -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_oflag -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_oflag -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_oflag -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_oflag -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_oflag -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_oflag -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_oflag -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib= --ob= --oflag=0 00:09:35.390 [2024-10-07 11:20:16.981813] spdk_dd.c:1523:main: *ERROR*: --oflags may be used only with --of 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_oflag -- common/autotest_common.sh@653 -- # es=22 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_oflag -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_oflag -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_oflag -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:35.390 00:09:35.390 real 0m0.070s 00:09:35.390 user 0m0.041s 00:09:35.390 sys 0m0.028s 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_oflag -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:35.390 11:20:16 spdk_dd.spdk_dd_negative.dd_invalid_oflag -- common/autotest_common.sh@10 -- # set +x 00:09:35.390 ************************************ 00:09:35.390 END TEST dd_invalid_oflag 00:09:35.390 ************************************ 00:09:35.390 11:20:17 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@225 -- # run_test dd_invalid_iflag invalid_iflag 00:09:35.390 11:20:17 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:35.390 11:20:17 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:35.390 11:20:17 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@10 -- # set +x 00:09:35.390 ************************************ 00:09:35.390 START TEST dd_invalid_iflag 00:09:35.390 ************************************ 00:09:35.390 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_iflag -- common/autotest_common.sh@1125 -- # invalid_iflag 00:09:35.390 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_iflag -- dd/negative_dd.sh@79 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib= --ob= --iflag=0 00:09:35.390 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_iflag -- common/autotest_common.sh@650 -- # local es=0 00:09:35.390 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_iflag -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib= --ob= --iflag=0 00:09:35.390 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_iflag -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:35.390 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_iflag -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:35.390 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_iflag -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:35.390 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_iflag -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:35.390 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_iflag -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:35.390 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_iflag -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:35.390 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_iflag -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:35.390 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_iflag -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:09:35.390 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_iflag -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib= --ob= --iflag=0 00:09:35.649 [2024-10-07 11:20:17.107534] spdk_dd.c:1529:main: *ERROR*: --iflags may be used only with --if 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_iflag -- common/autotest_common.sh@653 -- # es=22 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_iflag -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_iflag -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_iflag -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:35.649 00:09:35.649 real 0m0.096s 00:09:35.649 user 0m0.057s 00:09:35.649 sys 0m0.038s 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_iflag -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_iflag -- common/autotest_common.sh@10 -- # set +x 00:09:35.649 ************************************ 00:09:35.649 END TEST dd_invalid_iflag 00:09:35.649 ************************************ 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@226 -- # run_test dd_unknown_flag unknown_flag 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@10 -- # set +x 00:09:35.649 ************************************ 00:09:35.649 START TEST dd_unknown_flag 00:09:35.649 ************************************ 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@1125 -- # unknown_flag 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- dd/negative_dd.sh@87 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=-1 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@650 -- # local es=0 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=-1 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:09:35.649 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --oflag=-1 00:09:35.649 [2024-10-07 11:20:17.249608] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:35.649 [2024-10-07 11:20:17.249704] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid62002 ] 00:09:35.906 [2024-10-07 11:20:17.382209] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:35.906 [2024-10-07 11:20:17.443958] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:35.906 [2024-10-07 11:20:17.474051] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:35.906 [2024-10-07 11:20:17.494051] spdk_dd.c: 986:parse_flags: *ERROR*: Unknown file flag: -1 00:09:35.906 [2024-10-07 11:20:17.494115] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:09:35.906 [2024-10-07 11:20:17.494182] spdk_dd.c: 986:parse_flags: *ERROR*: Unknown file flag: -1 00:09:35.906 [2024-10-07 11:20:17.494200] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:09:35.906 [2024-10-07 11:20:17.494451] spdk_dd.c:1218:dd_run: *ERROR*: Failed to register files with io_uring: -9 (Bad file descriptor) 00:09:35.906 [2024-10-07 11:20:17.494469] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:09:35.906 [2024-10-07 11:20:17.494524] app.c:1047:app_stop: *NOTICE*: spdk_app_stop called twice 00:09:35.906 [2024-10-07 11:20:17.494535] app.c:1047:app_stop: *NOTICE*: spdk_app_stop called twice 00:09:35.906 [2024-10-07 11:20:17.567181] spdk_dd.c:1536:main: *ERROR*: Error occurred while performing copy 00:09:36.187 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@653 -- # es=234 00:09:36.187 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:36.187 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@662 -- # es=106 00:09:36.187 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@663 -- # case "$es" in 00:09:36.187 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@670 -- # es=1 00:09:36.187 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:36.187 00:09:36.187 real 0m0.478s 00:09:36.187 user 0m0.264s 00:09:36.187 sys 0m0.119s 00:09:36.187 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:36.187 11:20:17 spdk_dd.spdk_dd_negative.dd_unknown_flag -- common/autotest_common.sh@10 -- # set +x 00:09:36.187 ************************************ 00:09:36.187 END TEST dd_unknown_flag 00:09:36.187 ************************************ 00:09:36.188 11:20:17 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@227 -- # run_test dd_invalid_json invalid_json 00:09:36.188 11:20:17 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:36.188 11:20:17 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:36.188 11:20:17 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@10 -- # set +x 00:09:36.188 ************************************ 00:09:36.188 START TEST dd_invalid_json 00:09:36.188 ************************************ 00:09:36.188 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@1125 -- # invalid_json 00:09:36.188 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_json -- dd/negative_dd.sh@94 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --json /dev/fd/62 00:09:36.188 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@650 -- # local es=0 00:09:36.188 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_json -- dd/negative_dd.sh@94 -- # : 00:09:36.188 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --json /dev/fd/62 00:09:36.188 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:36.188 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:36.188 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:36.188 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:36.188 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:36.188 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:36.188 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:36.188 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:09:36.188 11:20:17 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --of=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump1 --json /dev/fd/62 00:09:36.188 [2024-10-07 11:20:17.753717] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:36.188 [2024-10-07 11:20:17.753812] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid62025 ] 00:09:36.188 [2024-10-07 11:20:17.889311] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:36.446 [2024-10-07 11:20:17.951278] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:36.446 [2024-10-07 11:20:17.951376] json_config.c: 535:parse_json: *ERROR*: JSON data cannot be empty 00:09:36.446 [2024-10-07 11:20:17.951418] rpc.c: 190:spdk_rpc_server_finish: *ERROR*: No server listening on provided address: 00:09:36.446 [2024-10-07 11:20:17.951436] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:09:36.446 [2024-10-07 11:20:17.951505] spdk_dd.c:1536:main: *ERROR*: Error occurred while performing copy 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@653 -- # es=234 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@662 -- # es=106 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@663 -- # case "$es" in 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@670 -- # es=1 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:36.446 00:09:36.446 real 0m0.365s 00:09:36.446 user 0m0.209s 00:09:36.446 sys 0m0.053s 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:36.446 ************************************ 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_json -- common/autotest_common.sh@10 -- # set +x 00:09:36.446 END TEST dd_invalid_json 00:09:36.446 ************************************ 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@228 -- # run_test dd_invalid_seek invalid_seek 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@10 -- # set +x 00:09:36.446 ************************************ 00:09:36.446 START TEST dd_invalid_seek 00:09:36.446 ************************************ 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@1125 -- # invalid_seek 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- dd/negative_dd.sh@102 -- # local mbdev0=malloc0 mbdev0_b=512 mbdev0_bs=512 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- dd/negative_dd.sh@103 -- # method_bdev_malloc_create_0=(['name']='malloc0' ['num_blocks']='512' ['block_size']='512') 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- dd/negative_dd.sh@103 -- # local -A method_bdev_malloc_create_0 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- dd/negative_dd.sh@108 -- # local mbdev1=malloc1 mbdev1_b=512 mbdev1_bs=512 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- dd/negative_dd.sh@109 -- # method_bdev_malloc_create_1=(['name']='malloc1' ['num_blocks']='512' ['block_size']='512') 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- dd/negative_dd.sh@109 -- # local -A method_bdev_malloc_create_1 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- dd/negative_dd.sh@115 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=malloc0 --ob=malloc1 --seek=513 --json /dev/fd/62 --bs=512 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- dd/negative_dd.sh@115 -- # gen_conf 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@650 -- # local es=0 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- dd/common.sh@31 -- # xtrace_disable 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=malloc0 --ob=malloc1 --seek=513 --json /dev/fd/62 --bs=512 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@10 -- # set +x 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:09:36.446 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=malloc0 --ob=malloc1 --seek=513 --json /dev/fd/62 --bs=512 00:09:36.704 { 00:09:36.704 "subsystems": [ 00:09:36.704 { 00:09:36.704 "subsystem": "bdev", 00:09:36.704 "config": [ 00:09:36.704 { 00:09:36.704 "params": { 00:09:36.704 "block_size": 512, 00:09:36.704 "num_blocks": 512, 00:09:36.704 "name": "malloc0" 00:09:36.704 }, 00:09:36.704 "method": "bdev_malloc_create" 00:09:36.704 }, 00:09:36.704 { 00:09:36.704 "params": { 00:09:36.704 "block_size": 512, 00:09:36.705 "num_blocks": 512, 00:09:36.705 "name": "malloc1" 00:09:36.705 }, 00:09:36.705 "method": "bdev_malloc_create" 00:09:36.705 }, 00:09:36.705 { 00:09:36.705 "method": "bdev_wait_for_examine" 00:09:36.705 } 00:09:36.705 ] 00:09:36.705 } 00:09:36.705 ] 00:09:36.705 } 00:09:36.705 [2024-10-07 11:20:18.169957] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:36.705 [2024-10-07 11:20:18.170051] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid62060 ] 00:09:36.705 [2024-10-07 11:20:18.302159] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:36.705 [2024-10-07 11:20:18.362750] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:36.705 [2024-10-07 11:20:18.391916] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:36.963 [2024-10-07 11:20:18.436627] spdk_dd.c:1145:dd_run: *ERROR*: --seek value too big (513) - only 512 blocks available in output 00:09:36.963 [2024-10-07 11:20:18.436699] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:09:36.963 [2024-10-07 11:20:18.504638] spdk_dd.c:1536:main: *ERROR*: Error occurred while performing copy 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@653 -- # es=228 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@662 -- # es=100 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@663 -- # case "$es" in 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@670 -- # es=1 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:36.963 00:09:36.963 real 0m0.482s 00:09:36.963 user 0m0.321s 00:09:36.963 sys 0m0.110s 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:36.963 ************************************ 00:09:36.963 END TEST dd_invalid_seek 00:09:36.963 ************************************ 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_seek -- common/autotest_common.sh@10 -- # set +x 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@229 -- # run_test dd_invalid_skip invalid_skip 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@10 -- # set +x 00:09:36.963 ************************************ 00:09:36.963 START TEST dd_invalid_skip 00:09:36.963 ************************************ 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@1125 -- # invalid_skip 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- dd/negative_dd.sh@125 -- # local mbdev0=malloc0 mbdev0_b=512 mbdev0_bs=512 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- dd/negative_dd.sh@126 -- # method_bdev_malloc_create_0=(['name']='malloc0' ['num_blocks']='512' ['block_size']='512') 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- dd/negative_dd.sh@126 -- # local -A method_bdev_malloc_create_0 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- dd/negative_dd.sh@131 -- # local mbdev1=malloc1 mbdev1_b=512 mbdev1_bs=512 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- dd/negative_dd.sh@132 -- # method_bdev_malloc_create_1=(['name']='malloc1' ['num_blocks']='512' ['block_size']='512') 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- dd/negative_dd.sh@132 -- # local -A method_bdev_malloc_create_1 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- dd/negative_dd.sh@138 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=malloc0 --ob=malloc1 --skip=513 --json /dev/fd/62 --bs=512 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@650 -- # local es=0 00:09:36.963 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- dd/negative_dd.sh@138 -- # gen_conf 00:09:36.964 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=malloc0 --ob=malloc1 --skip=513 --json /dev/fd/62 --bs=512 00:09:36.964 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:36.964 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- dd/common.sh@31 -- # xtrace_disable 00:09:36.964 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@10 -- # set +x 00:09:36.964 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:36.964 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:36.964 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:36.964 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:36.964 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:36.964 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:36.964 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:09:36.964 11:20:18 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=malloc0 --ob=malloc1 --skip=513 --json /dev/fd/62 --bs=512 00:09:37.222 { 00:09:37.222 "subsystems": [ 00:09:37.222 { 00:09:37.222 "subsystem": "bdev", 00:09:37.222 "config": [ 00:09:37.222 { 00:09:37.222 "params": { 00:09:37.222 "block_size": 512, 00:09:37.222 "num_blocks": 512, 00:09:37.222 "name": "malloc0" 00:09:37.222 }, 00:09:37.222 "method": "bdev_malloc_create" 00:09:37.222 }, 00:09:37.222 { 00:09:37.222 "params": { 00:09:37.222 "block_size": 512, 00:09:37.222 "num_blocks": 512, 00:09:37.222 "name": "malloc1" 00:09:37.222 }, 00:09:37.222 "method": "bdev_malloc_create" 00:09:37.222 }, 00:09:37.222 { 00:09:37.222 "method": "bdev_wait_for_examine" 00:09:37.222 } 00:09:37.222 ] 00:09:37.222 } 00:09:37.222 ] 00:09:37.222 } 00:09:37.222 [2024-10-07 11:20:18.714138] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:37.222 [2024-10-07 11:20:18.714239] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid62088 ] 00:09:37.222 [2024-10-07 11:20:18.852761] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:37.222 [2024-10-07 11:20:18.912462] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:37.481 [2024-10-07 11:20:18.942990] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:37.481 [2024-10-07 11:20:18.987734] spdk_dd.c:1102:dd_run: *ERROR*: --skip value too big (513) - only 512 blocks available in input 00:09:37.481 [2024-10-07 11:20:18.987805] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:09:37.481 [2024-10-07 11:20:19.062771] spdk_dd.c:1536:main: *ERROR*: Error occurred while performing copy 00:09:37.481 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@653 -- # es=228 00:09:37.481 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:37.481 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@662 -- # es=100 00:09:37.481 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@663 -- # case "$es" in 00:09:37.481 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@670 -- # es=1 00:09:37.481 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:37.481 00:09:37.481 real 0m0.518s 00:09:37.481 user 0m0.339s 00:09:37.481 sys 0m0.130s 00:09:37.481 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:37.481 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_skip -- common/autotest_common.sh@10 -- # set +x 00:09:37.481 ************************************ 00:09:37.481 END TEST dd_invalid_skip 00:09:37.481 ************************************ 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@230 -- # run_test dd_invalid_input_count invalid_input_count 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@10 -- # set +x 00:09:37.740 ************************************ 00:09:37.740 START TEST dd_invalid_input_count 00:09:37.740 ************************************ 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@1125 -- # invalid_input_count 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- dd/negative_dd.sh@149 -- # local mbdev0=malloc0 mbdev0_b=512 mbdev0_bs=512 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- dd/negative_dd.sh@150 -- # method_bdev_malloc_create_0=(['name']='malloc0' ['num_blocks']='512' ['block_size']='512') 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- dd/negative_dd.sh@150 -- # local -A method_bdev_malloc_create_0 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- dd/negative_dd.sh@155 -- # local mbdev1=malloc1 mbdev1_b=512 mbdev1_bs=512 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- dd/negative_dd.sh@156 -- # method_bdev_malloc_create_1=(['name']='malloc1' ['num_blocks']='512' ['block_size']='512') 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- dd/negative_dd.sh@156 -- # local -A method_bdev_malloc_create_1 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- dd/negative_dd.sh@162 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=malloc0 --ob=malloc1 --count=513 --json /dev/fd/62 --bs=512 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@650 -- # local es=0 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=malloc0 --ob=malloc1 --count=513 --json /dev/fd/62 --bs=512 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- dd/negative_dd.sh@162 -- # gen_conf 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- dd/common.sh@31 -- # xtrace_disable 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@10 -- # set +x 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:09:37.740 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=malloc0 --ob=malloc1 --count=513 --json /dev/fd/62 --bs=512 00:09:37.741 [2024-10-07 11:20:19.270603] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:37.741 [2024-10-07 11:20:19.270894] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid62127 ] 00:09:37.741 { 00:09:37.741 "subsystems": [ 00:09:37.741 { 00:09:37.741 "subsystem": "bdev", 00:09:37.741 "config": [ 00:09:37.741 { 00:09:37.741 "params": { 00:09:37.741 "block_size": 512, 00:09:37.741 "num_blocks": 512, 00:09:37.741 "name": "malloc0" 00:09:37.741 }, 00:09:37.741 "method": "bdev_malloc_create" 00:09:37.741 }, 00:09:37.741 { 00:09:37.741 "params": { 00:09:37.741 "block_size": 512, 00:09:37.741 "num_blocks": 512, 00:09:37.741 "name": "malloc1" 00:09:37.741 }, 00:09:37.741 "method": "bdev_malloc_create" 00:09:37.741 }, 00:09:37.741 { 00:09:37.741 "method": "bdev_wait_for_examine" 00:09:37.741 } 00:09:37.741 ] 00:09:37.741 } 00:09:37.741 ] 00:09:37.741 } 00:09:37.741 [2024-10-07 11:20:19.405576] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:37.999 [2024-10-07 11:20:19.464902] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:37.999 [2024-10-07 11:20:19.495630] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:37.999 [2024-10-07 11:20:19.540352] spdk_dd.c:1110:dd_run: *ERROR*: --count value too big (513) - only 512 blocks available from input 00:09:37.999 [2024-10-07 11:20:19.540438] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:09:37.999 [2024-10-07 11:20:19.614227] spdk_dd.c:1536:main: *ERROR*: Error occurred while performing copy 00:09:37.999 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@653 -- # es=228 00:09:37.999 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:37.999 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@662 -- # es=100 00:09:37.999 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@663 -- # case "$es" in 00:09:37.999 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@670 -- # es=1 00:09:37.999 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:37.999 00:09:37.999 real 0m0.489s 00:09:37.999 user 0m0.340s 00:09:37.999 sys 0m0.116s 00:09:37.999 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:37.999 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_input_count -- common/autotest_common.sh@10 -- # set +x 00:09:37.999 ************************************ 00:09:37.999 END TEST dd_invalid_input_count 00:09:37.999 ************************************ 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@231 -- # run_test dd_invalid_output_count invalid_output_count 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@10 -- # set +x 00:09:38.258 ************************************ 00:09:38.258 START TEST dd_invalid_output_count 00:09:38.258 ************************************ 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@1125 -- # invalid_output_count 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- dd/negative_dd.sh@173 -- # local mbdev0=malloc0 mbdev0_b=512 mbdev0_bs=512 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- dd/negative_dd.sh@174 -- # method_bdev_malloc_create_0=(['name']='malloc0' ['num_blocks']='512' ['block_size']='512') 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- dd/negative_dd.sh@174 -- # local -A method_bdev_malloc_create_0 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- dd/negative_dd.sh@180 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --ob=malloc0 --count=513 --json /dev/fd/62 --bs=512 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@650 -- # local es=0 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --ob=malloc0 --count=513 --json /dev/fd/62 --bs=512 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- dd/negative_dd.sh@180 -- # gen_conf 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- dd/common.sh@31 -- # xtrace_disable 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@10 -- # set +x 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:09:38.258 11:20:19 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --if=/home/vagrant/spdk_repo/spdk/test/dd/dd.dump0 --ob=malloc0 --count=513 --json /dev/fd/62 --bs=512 00:09:38.258 { 00:09:38.258 "subsystems": [ 00:09:38.258 { 00:09:38.258 "subsystem": "bdev", 00:09:38.258 "config": [ 00:09:38.258 { 00:09:38.258 "params": { 00:09:38.258 "block_size": 512, 00:09:38.258 "num_blocks": 512, 00:09:38.258 "name": "malloc0" 00:09:38.258 }, 00:09:38.258 "method": "bdev_malloc_create" 00:09:38.258 }, 00:09:38.258 { 00:09:38.258 "method": "bdev_wait_for_examine" 00:09:38.258 } 00:09:38.258 ] 00:09:38.258 } 00:09:38.258 ] 00:09:38.258 } 00:09:38.258 [2024-10-07 11:20:19.817144] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:38.258 [2024-10-07 11:20:19.817238] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid62155 ] 00:09:38.258 [2024-10-07 11:20:19.956433] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:38.517 [2024-10-07 11:20:20.027824] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:38.517 [2024-10-07 11:20:20.060746] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:38.517 [2024-10-07 11:20:20.099757] spdk_dd.c:1152:dd_run: *ERROR*: --count value too big (513) - only 512 blocks available in output 00:09:38.517 [2024-10-07 11:20:20.099822] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:09:38.517 [2024-10-07 11:20:20.171175] spdk_dd.c:1536:main: *ERROR*: Error occurred while performing copy 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@653 -- # es=228 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@662 -- # es=100 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@663 -- # case "$es" in 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@670 -- # es=1 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:38.776 00:09:38.776 real 0m0.503s 00:09:38.776 user 0m0.337s 00:09:38.776 sys 0m0.122s 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:38.776 ************************************ 00:09:38.776 END TEST dd_invalid_output_count 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_invalid_output_count -- common/autotest_common.sh@10 -- # set +x 00:09:38.776 ************************************ 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative -- dd/negative_dd.sh@232 -- # run_test dd_bs_not_multiple bs_not_multiple 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@10 -- # set +x 00:09:38.776 ************************************ 00:09:38.776 START TEST dd_bs_not_multiple 00:09:38.776 ************************************ 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@1125 -- # bs_not_multiple 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- dd/negative_dd.sh@190 -- # local mbdev0=malloc0 mbdev0_b=512 mbdev0_bs=512 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- dd/negative_dd.sh@191 -- # method_bdev_malloc_create_0=(['name']='malloc0' ['num_blocks']='512' ['block_size']='512') 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- dd/negative_dd.sh@191 -- # local -A method_bdev_malloc_create_0 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- dd/negative_dd.sh@196 -- # local mbdev1=malloc1 mbdev1_b=512 mbdev1_bs=512 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- dd/negative_dd.sh@197 -- # method_bdev_malloc_create_1=(['name']='malloc1' ['num_blocks']='512' ['block_size']='512') 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- dd/negative_dd.sh@197 -- # local -A method_bdev_malloc_create_1 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- dd/negative_dd.sh@203 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=malloc0 --ob=malloc1 --bs=513 --json /dev/fd/62 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@650 -- # local es=0 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=malloc0 --ob=malloc1 --bs=513 --json /dev/fd/62 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- dd/negative_dd.sh@203 -- # gen_conf 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- dd/common.sh@31 -- # xtrace_disable 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@10 -- # set +x 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_dd 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd ]] 00:09:38.776 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_dd --ib=malloc0 --ob=malloc1 --bs=513 --json /dev/fd/62 00:09:38.776 { 00:09:38.776 "subsystems": [ 00:09:38.776 { 00:09:38.776 "subsystem": "bdev", 00:09:38.776 "config": [ 00:09:38.776 { 00:09:38.776 "params": { 00:09:38.776 "block_size": 512, 00:09:38.776 "num_blocks": 512, 00:09:38.776 "name": "malloc0" 00:09:38.776 }, 00:09:38.776 "method": "bdev_malloc_create" 00:09:38.776 }, 00:09:38.776 { 00:09:38.776 "params": { 00:09:38.776 "block_size": 512, 00:09:38.776 "num_blocks": 512, 00:09:38.776 "name": "malloc1" 00:09:38.776 }, 00:09:38.776 "method": "bdev_malloc_create" 00:09:38.776 }, 00:09:38.776 { 00:09:38.776 "method": "bdev_wait_for_examine" 00:09:38.776 } 00:09:38.776 ] 00:09:38.776 } 00:09:38.776 ] 00:09:38.776 } 00:09:38.776 [2024-10-07 11:20:20.358915] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:38.776 [2024-10-07 11:20:20.358992] [ DPDK EAL parameters: spdk_dd --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid62192 ] 00:09:39.034 [2024-10-07 11:20:20.493638] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:39.034 [2024-10-07 11:20:20.555896] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:39.034 [2024-10-07 11:20:20.585130] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:39.034 [2024-10-07 11:20:20.629621] spdk_dd.c:1168:dd_run: *ERROR*: --bs value must be a multiple of input native block size (512) 00:09:39.034 [2024-10-07 11:20:20.629690] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:09:39.034 [2024-10-07 11:20:20.695632] spdk_dd.c:1536:main: *ERROR*: Error occurred while performing copy 00:09:39.292 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@653 -- # es=234 00:09:39.292 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:39.292 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@662 -- # es=106 00:09:39.292 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@663 -- # case "$es" in 00:09:39.292 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@670 -- # es=1 00:09:39.292 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:39.292 00:09:39.292 real 0m0.491s 00:09:39.292 user 0m0.322s 00:09:39.292 sys 0m0.119s 00:09:39.292 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:39.292 11:20:20 spdk_dd.spdk_dd_negative.dd_bs_not_multiple -- common/autotest_common.sh@10 -- # set +x 00:09:39.292 ************************************ 00:09:39.292 END TEST dd_bs_not_multiple 00:09:39.292 ************************************ 00:09:39.292 00:09:39.292 real 0m6.077s 00:09:39.292 user 0m3.414s 00:09:39.292 sys 0m2.075s 00:09:39.292 11:20:20 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:39.292 11:20:20 spdk_dd.spdk_dd_negative -- common/autotest_common.sh@10 -- # set +x 00:09:39.292 ************************************ 00:09:39.292 END TEST spdk_dd_negative 00:09:39.292 ************************************ 00:09:39.292 00:09:39.292 real 1m13.174s 00:09:39.292 user 0m48.507s 00:09:39.292 sys 0m29.562s 00:09:39.292 11:20:20 spdk_dd -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:39.292 11:20:20 spdk_dd -- common/autotest_common.sh@10 -- # set +x 00:09:39.292 ************************************ 00:09:39.292 END TEST spdk_dd 00:09:39.292 ************************************ 00:09:39.292 11:20:20 -- spdk/autotest.sh@207 -- # '[' 0 -eq 1 ']' 00:09:39.292 11:20:20 -- spdk/autotest.sh@252 -- # '[' 0 -eq 1 ']' 00:09:39.292 11:20:20 -- spdk/autotest.sh@256 -- # timing_exit lib 00:09:39.292 11:20:20 -- common/autotest_common.sh@730 -- # xtrace_disable 00:09:39.292 11:20:20 -- common/autotest_common.sh@10 -- # set +x 00:09:39.292 11:20:20 -- spdk/autotest.sh@258 -- # '[' 0 -eq 1 ']' 00:09:39.292 11:20:20 -- spdk/autotest.sh@263 -- # '[' 0 -eq 1 ']' 00:09:39.292 11:20:20 -- spdk/autotest.sh@272 -- # '[' 1 -eq 1 ']' 00:09:39.292 11:20:20 -- spdk/autotest.sh@273 -- # export NET_TYPE 00:09:39.292 11:20:20 -- spdk/autotest.sh@276 -- # '[' tcp = rdma ']' 00:09:39.292 11:20:20 -- spdk/autotest.sh@279 -- # '[' tcp = tcp ']' 00:09:39.292 11:20:20 -- spdk/autotest.sh@280 -- # run_test nvmf_tcp /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh --transport=tcp 00:09:39.292 11:20:20 -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:09:39.292 11:20:20 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:39.292 11:20:20 -- common/autotest_common.sh@10 -- # set +x 00:09:39.292 ************************************ 00:09:39.292 START TEST nvmf_tcp 00:09:39.292 ************************************ 00:09:39.292 11:20:20 nvmf_tcp -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh --transport=tcp 00:09:39.550 * Looking for test storage... 00:09:39.550 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf 00:09:39.550 11:20:21 nvmf_tcp -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:39.550 11:20:21 nvmf_tcp -- common/autotest_common.sh@1681 -- # lcov --version 00:09:39.550 11:20:21 nvmf_tcp -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:39.550 11:20:21 nvmf_tcp -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@336 -- # IFS=.-: 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@336 -- # read -ra ver1 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@337 -- # IFS=.-: 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@337 -- # read -ra ver2 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@338 -- # local 'op=<' 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@340 -- # ver1_l=2 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@341 -- # ver2_l=1 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@344 -- # case "$op" in 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@345 -- # : 1 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@365 -- # decimal 1 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@353 -- # local d=1 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@355 -- # echo 1 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@365 -- # ver1[v]=1 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@366 -- # decimal 2 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@353 -- # local d=2 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@355 -- # echo 2 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@366 -- # ver2[v]=2 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:39.550 11:20:21 nvmf_tcp -- scripts/common.sh@368 -- # return 0 00:09:39.550 11:20:21 nvmf_tcp -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:39.551 11:20:21 nvmf_tcp -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:39.551 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:39.551 --rc genhtml_branch_coverage=1 00:09:39.551 --rc genhtml_function_coverage=1 00:09:39.551 --rc genhtml_legend=1 00:09:39.551 --rc geninfo_all_blocks=1 00:09:39.551 --rc geninfo_unexecuted_blocks=1 00:09:39.551 00:09:39.551 ' 00:09:39.551 11:20:21 nvmf_tcp -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:39.551 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:39.551 --rc genhtml_branch_coverage=1 00:09:39.551 --rc genhtml_function_coverage=1 00:09:39.551 --rc genhtml_legend=1 00:09:39.551 --rc geninfo_all_blocks=1 00:09:39.551 --rc geninfo_unexecuted_blocks=1 00:09:39.551 00:09:39.551 ' 00:09:39.551 11:20:21 nvmf_tcp -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:39.551 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:39.551 --rc genhtml_branch_coverage=1 00:09:39.551 --rc genhtml_function_coverage=1 00:09:39.551 --rc genhtml_legend=1 00:09:39.551 --rc geninfo_all_blocks=1 00:09:39.551 --rc geninfo_unexecuted_blocks=1 00:09:39.551 00:09:39.551 ' 00:09:39.551 11:20:21 nvmf_tcp -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:39.551 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:39.551 --rc genhtml_branch_coverage=1 00:09:39.551 --rc genhtml_function_coverage=1 00:09:39.551 --rc genhtml_legend=1 00:09:39.551 --rc geninfo_all_blocks=1 00:09:39.551 --rc geninfo_unexecuted_blocks=1 00:09:39.551 00:09:39.551 ' 00:09:39.551 11:20:21 nvmf_tcp -- nvmf/nvmf.sh@10 -- # uname -s 00:09:39.551 11:20:21 nvmf_tcp -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:09:39.551 11:20:21 nvmf_tcp -- nvmf/nvmf.sh@14 -- # run_test nvmf_target_core /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_target_core.sh --transport=tcp 00:09:39.551 11:20:21 nvmf_tcp -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:09:39.551 11:20:21 nvmf_tcp -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:39.551 11:20:21 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:09:39.551 ************************************ 00:09:39.551 START TEST nvmf_target_core 00:09:39.551 ************************************ 00:09:39.551 11:20:21 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_target_core.sh --transport=tcp 00:09:39.551 * Looking for test storage... 00:09:39.551 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf 00:09:39.551 11:20:21 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:39.551 11:20:21 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1681 -- # lcov --version 00:09:39.551 11:20:21 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@336 -- # IFS=.-: 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@336 -- # read -ra ver1 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@337 -- # IFS=.-: 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@337 -- # read -ra ver2 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@338 -- # local 'op=<' 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@340 -- # ver1_l=2 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@341 -- # ver2_l=1 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@344 -- # case "$op" in 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@345 -- # : 1 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@365 -- # decimal 1 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@353 -- # local d=1 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@355 -- # echo 1 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@365 -- # ver1[v]=1 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@366 -- # decimal 2 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@353 -- # local d=2 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@355 -- # echo 2 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@366 -- # ver2[v]=2 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@368 -- # return 0 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:39.809 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:39.809 --rc genhtml_branch_coverage=1 00:09:39.809 --rc genhtml_function_coverage=1 00:09:39.809 --rc genhtml_legend=1 00:09:39.809 --rc geninfo_all_blocks=1 00:09:39.809 --rc geninfo_unexecuted_blocks=1 00:09:39.809 00:09:39.809 ' 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:39.809 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:39.809 --rc genhtml_branch_coverage=1 00:09:39.809 --rc genhtml_function_coverage=1 00:09:39.809 --rc genhtml_legend=1 00:09:39.809 --rc geninfo_all_blocks=1 00:09:39.809 --rc geninfo_unexecuted_blocks=1 00:09:39.809 00:09:39.809 ' 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:39.809 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:39.809 --rc genhtml_branch_coverage=1 00:09:39.809 --rc genhtml_function_coverage=1 00:09:39.809 --rc genhtml_legend=1 00:09:39.809 --rc geninfo_all_blocks=1 00:09:39.809 --rc geninfo_unexecuted_blocks=1 00:09:39.809 00:09:39.809 ' 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:39.809 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:39.809 --rc genhtml_branch_coverage=1 00:09:39.809 --rc genhtml_function_coverage=1 00:09:39.809 --rc genhtml_legend=1 00:09:39.809 --rc geninfo_all_blocks=1 00:09:39.809 --rc geninfo_unexecuted_blocks=1 00:09:39.809 00:09:39.809 ' 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@10 -- # uname -s 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@10 -- # '[' '!' Linux = Linux ']' 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@14 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@7 -- # uname -s 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:39.809 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@15 -- # shopt -s extglob 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- paths/export.sh@5 -- # export PATH 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@51 -- # : 0 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:09:39.810 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@55 -- # have_pci_nics=0 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@18 -- # TEST_ARGS=("$@") 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@20 -- # [[ 1 -eq 0 ]] 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@26 -- # run_test nvmf_host_management /home/vagrant/spdk_repo/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:09:39.810 ************************************ 00:09:39.810 START TEST nvmf_host_management 00:09:39.810 ************************************ 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:09:39.810 * Looking for test storage... 00:09:39.810 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1681 -- # lcov --version 00:09:39.810 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@336 -- # IFS=.-: 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@336 -- # read -ra ver1 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@337 -- # IFS=.-: 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@337 -- # read -ra ver2 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@338 -- # local 'op=<' 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@340 -- # ver1_l=2 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@341 -- # ver2_l=1 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@344 -- # case "$op" in 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@345 -- # : 1 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@365 -- # decimal 1 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@353 -- # local d=1 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@355 -- # echo 1 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@365 -- # ver1[v]=1 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@366 -- # decimal 2 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@353 -- # local d=2 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@355 -- # echo 2 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@366 -- # ver2[v]=2 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@368 -- # return 0 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:40.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:40.069 --rc genhtml_branch_coverage=1 00:09:40.069 --rc genhtml_function_coverage=1 00:09:40.069 --rc genhtml_legend=1 00:09:40.069 --rc geninfo_all_blocks=1 00:09:40.069 --rc geninfo_unexecuted_blocks=1 00:09:40.069 00:09:40.069 ' 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:40.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:40.069 --rc genhtml_branch_coverage=1 00:09:40.069 --rc genhtml_function_coverage=1 00:09:40.069 --rc genhtml_legend=1 00:09:40.069 --rc geninfo_all_blocks=1 00:09:40.069 --rc geninfo_unexecuted_blocks=1 00:09:40.069 00:09:40.069 ' 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:40.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:40.069 --rc genhtml_branch_coverage=1 00:09:40.069 --rc genhtml_function_coverage=1 00:09:40.069 --rc genhtml_legend=1 00:09:40.069 --rc geninfo_all_blocks=1 00:09:40.069 --rc geninfo_unexecuted_blocks=1 00:09:40.069 00:09:40.069 ' 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:40.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:40.069 --rc genhtml_branch_coverage=1 00:09:40.069 --rc genhtml_function_coverage=1 00:09:40.069 --rc genhtml_legend=1 00:09:40.069 --rc geninfo_all_blocks=1 00:09:40.069 --rc geninfo_unexecuted_blocks=1 00:09:40.069 00:09:40.069 ' 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@7 -- # uname -s 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@15 -- # shopt -s extglob 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@5 -- # export PATH 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:40.069 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@51 -- # : 0 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:09:40.070 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@55 -- # have_pci_nics=0 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@105 -- # nvmftestinit 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@474 -- # prepare_net_devs 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@436 -- # local -g is_hw=no 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@438 -- # remove_spdk_ns 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@458 -- # nvmf_veth_init 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:09:40.070 Cannot find device "nvmf_init_br" 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@162 -- # true 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:09:40.070 Cannot find device "nvmf_init_br2" 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@163 -- # true 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:09:40.070 Cannot find device "nvmf_tgt_br" 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@164 -- # true 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:09:40.070 Cannot find device "nvmf_tgt_br2" 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@165 -- # true 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:09:40.070 Cannot find device "nvmf_init_br" 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@166 -- # true 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:09:40.070 Cannot find device "nvmf_init_br2" 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@167 -- # true 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:09:40.070 Cannot find device "nvmf_tgt_br" 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@168 -- # true 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:09:40.070 Cannot find device "nvmf_tgt_br2" 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@169 -- # true 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:09:40.070 Cannot find device "nvmf_br" 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@170 -- # true 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:09:40.070 Cannot find device "nvmf_init_if" 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@171 -- # true 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:09:40.070 Cannot find device "nvmf_init_if2" 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@172 -- # true 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:09:40.070 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@173 -- # true 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:09:40.070 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@174 -- # true 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:09:40.070 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:09:40.333 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:09:40.333 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:09:40.591 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:09:40.591 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.116 ms 00:09:40.591 00:09:40.591 --- 10.0.0.3 ping statistics --- 00:09:40.591 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:40.591 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:09:40.591 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:09:40.591 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.056 ms 00:09:40.591 00:09:40.591 --- 10.0.0.4 ping statistics --- 00:09:40.591 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:40.591 rtt min/avg/max/mdev = 0.056/0.056/0.056/0.000 ms 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:09:40.591 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:40.591 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.041 ms 00:09:40.591 00:09:40.591 --- 10.0.0.1 ping statistics --- 00:09:40.591 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:40.591 rtt min/avg/max/mdev = 0.041/0.041/0.041/0.000 ms 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:09:40.591 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:40.591 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.087 ms 00:09:40.591 00:09:40.591 --- 10.0.0.2 ping statistics --- 00:09:40.591 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:40.591 rtt min/avg/max/mdev = 0.087/0.087/0.087/0.000 ms 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@459 -- # return 0 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@107 -- # nvmf_host_management 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@69 -- # starttarget 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@724 -- # xtrace_disable 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@507 -- # nvmfpid=62533 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@508 -- # waitforlisten 62533 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@831 -- # '[' -z 62533 ']' 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:40.591 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:40.591 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:09:40.591 [2024-10-07 11:20:22.187211] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:40.591 [2024-10-07 11:20:22.187367] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:40.849 [2024-10-07 11:20:22.328712] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:40.849 [2024-10-07 11:20:22.391361] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:40.849 [2024-10-07 11:20:22.391440] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:40.849 [2024-10-07 11:20:22.391453] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:40.849 [2024-10-07 11:20:22.391462] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:40.849 [2024-10-07 11:20:22.391469] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:40.849 [2024-10-07 11:20:22.392318] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:09:40.849 [2024-10-07 11:20:22.392485] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:09:40.849 [2024-10-07 11:20:22.392488] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:09:40.849 [2024-10-07 11:20:22.392437] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:09:40.849 [2024-10-07 11:20:22.423376] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:40.849 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:40.849 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@864 -- # return 0 00:09:40.849 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:09:40.849 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@730 -- # xtrace_disable 00:09:40.849 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:09:40.849 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:40.849 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:40.849 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:40.849 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:09:40.849 [2024-10-07 11:20:22.522739] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:40.849 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:40.849 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:09:40.849 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@724 -- # xtrace_disable 00:09:40.849 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:09:40.849 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@22 -- # rm -rf /home/vagrant/spdk_repo/spdk/test/nvmf/target/rpcs.txt 00:09:40.849 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@23 -- # cat 00:09:40.849 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@30 -- # rpc_cmd 00:09:40.849 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:40.849 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:09:41.107 Malloc0 00:09:41.107 [2024-10-07 11:20:22.583458] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:09:41.107 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:41.107 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:09:41.107 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@730 -- # xtrace_disable 00:09:41.107 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:09:41.107 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@73 -- # perfpid=62580 00:09:41.107 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@74 -- # waitforlisten 62580 /var/tmp/bdevperf.sock 00:09:41.107 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@831 -- # '[' -z 62580 ']' 00:09:41.107 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:09:41.107 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:41.107 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:09:41.107 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@72 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:09:41.107 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:09:41.107 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:09:41.107 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:41.107 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@558 -- # config=() 00:09:41.107 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:09:41.107 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@558 -- # local subsystem config 00:09:41.107 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:09:41.107 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:09:41.107 { 00:09:41.107 "params": { 00:09:41.107 "name": "Nvme$subsystem", 00:09:41.107 "trtype": "$TEST_TRANSPORT", 00:09:41.107 "traddr": "$NVMF_FIRST_TARGET_IP", 00:09:41.107 "adrfam": "ipv4", 00:09:41.107 "trsvcid": "$NVMF_PORT", 00:09:41.107 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:09:41.107 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:09:41.107 "hdgst": ${hdgst:-false}, 00:09:41.107 "ddgst": ${ddgst:-false} 00:09:41.107 }, 00:09:41.107 "method": "bdev_nvme_attach_controller" 00:09:41.108 } 00:09:41.108 EOF 00:09:41.108 )") 00:09:41.108 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@580 -- # cat 00:09:41.108 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@582 -- # jq . 00:09:41.108 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@583 -- # IFS=, 00:09:41.108 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:09:41.108 "params": { 00:09:41.108 "name": "Nvme0", 00:09:41.108 "trtype": "tcp", 00:09:41.108 "traddr": "10.0.0.3", 00:09:41.108 "adrfam": "ipv4", 00:09:41.108 "trsvcid": "4420", 00:09:41.108 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:09:41.108 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:09:41.108 "hdgst": false, 00:09:41.108 "ddgst": false 00:09:41.108 }, 00:09:41.108 "method": "bdev_nvme_attach_controller" 00:09:41.108 }' 00:09:41.108 [2024-10-07 11:20:22.700244] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:41.108 [2024-10-07 11:20:22.700369] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid62580 ] 00:09:41.366 [2024-10-07 11:20:22.844838] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:41.366 [2024-10-07 11:20:22.908283] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:41.366 [2024-10-07 11:20:22.948951] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:41.366 Running I/O for 10 seconds... 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@864 -- # return 0 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@52 -- # local ret=1 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@53 -- # local i 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@54 -- # (( i = 10 )) 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@54 -- # (( i != 0 )) 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@55 -- # read_io_count=131 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@58 -- # '[' 131 -ge 100 ']' 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@59 -- # ret=0 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@60 -- # break 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@64 -- # return 0 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:41.626 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@87 -- # sleep 1 00:09:41.626 [2024-10-07 11:20:23.263013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.626 [2024-10-07 11:20:23.263070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.626 [2024-10-07 11:20:23.263112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.626 [2024-10-07 11:20:23.263125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.626 [2024-10-07 11:20:23.263137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.626 [2024-10-07 11:20:23.263147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.626 [2024-10-07 11:20:23.263159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.626 [2024-10-07 11:20:23.263169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.626 [2024-10-07 11:20:23.263180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.626 [2024-10-07 11:20:23.263190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.626 [2024-10-07 11:20:23.263201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.626 [2024-10-07 11:20:23.263210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.626 [2024-10-07 11:20:23.263222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.626 [2024-10-07 11:20:23.263231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.626 [2024-10-07 11:20:23.263243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.626 [2024-10-07 11:20:23.263252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.626 [2024-10-07 11:20:23.263263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.263985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.263997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.264006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.264018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.264027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.264040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.264049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.264061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.264070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.264082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.264092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.264104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.627 [2024-10-07 11:20:23.264115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.627 [2024-10-07 11:20:23.264127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.628 [2024-10-07 11:20:23.264137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.628 [2024-10-07 11:20:23.264159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.628 [2024-10-07 11:20:23.264182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.628 [2024-10-07 11:20:23.264204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.628 [2024-10-07 11:20:23.264225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.628 [2024-10-07 11:20:23.264246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.628 [2024-10-07 11:20:23.264268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.628 [2024-10-07 11:20:23.264289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.628 [2024-10-07 11:20:23.264309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.628 [2024-10-07 11:20:23.264330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.628 [2024-10-07 11:20:23.264351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.628 [2024-10-07 11:20:23.264372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.628 [2024-10-07 11:20:23.264413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.628 [2024-10-07 11:20:23.264450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.628 [2024-10-07 11:20:23.264479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.628 [2024-10-07 11:20:23.264518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:09:41.628 [2024-10-07 11:20:23.264541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264552] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x245e6b0 is same with the state(6) to be set 00:09:41.628 [2024-10-07 11:20:23.264632] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x245e6b0 was disconnected and freed. reset controller. 00:09:41.628 [2024-10-07 11:20:23.264783] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:09:41.628 [2024-10-07 11:20:23.264807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264827] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:09:41.628 [2024-10-07 11:20:23.264843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264858] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:09:41.628 [2024-10-07 11:20:23.264868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264879] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:09:41.628 [2024-10-07 11:20:23.264888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:09:41.628 [2024-10-07 11:20:23.264897] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x245eb20 is same with the state(6) to be set 00:09:41.628 [2024-10-07 11:20:23.266107] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:09:41.628 task offset: 32768 on job bdev=Nvme0n1 fails 00:09:41.628 00:09:41.628 Latency(us) 00:09:41.628 [2024-10-07T11:20:23.339Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:09:41.628 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:09:41.628 Job: Nvme0n1 ended in about 0.21 seconds with error 00:09:41.628 Verification LBA range: start 0x0 length 0x400 00:09:41.628 Nvme0n1 : 0.21 1239.60 77.48 309.90 0.00 38682.53 2412.92 39083.29 00:09:41.628 [2024-10-07T11:20:23.339Z] =================================================================================================================== 00:09:41.628 [2024-10-07T11:20:23.339Z] Total : 1239.60 77.48 309.90 0.00 38682.53 2412.92 39083.29 00:09:41.628 [2024-10-07 11:20:23.268332] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:09:41.628 [2024-10-07 11:20:23.268381] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x245eb20 (9): Bad file descriptor 00:09:41.628 [2024-10-07 11:20:23.277007] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:09:42.564 11:20:24 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@91 -- # kill -9 62580 00:09:42.564 /home/vagrant/spdk_repo/spdk/test/nvmf/target/host_management.sh: line 91: kill: (62580) - No such process 00:09:42.564 11:20:24 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@91 -- # true 00:09:42.564 11:20:24 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:09:42.564 11:20:24 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@100 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:09:42.564 11:20:24 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:09:42.564 11:20:24 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@558 -- # config=() 00:09:42.564 11:20:24 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@558 -- # local subsystem config 00:09:42.564 11:20:24 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:09:42.564 11:20:24 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:09:42.564 { 00:09:42.564 "params": { 00:09:42.564 "name": "Nvme$subsystem", 00:09:42.564 "trtype": "$TEST_TRANSPORT", 00:09:42.564 "traddr": "$NVMF_FIRST_TARGET_IP", 00:09:42.564 "adrfam": "ipv4", 00:09:42.564 "trsvcid": "$NVMF_PORT", 00:09:42.564 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:09:42.564 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:09:42.564 "hdgst": ${hdgst:-false}, 00:09:42.564 "ddgst": ${ddgst:-false} 00:09:42.564 }, 00:09:42.564 "method": "bdev_nvme_attach_controller" 00:09:42.564 } 00:09:42.564 EOF 00:09:42.564 )") 00:09:42.564 11:20:24 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@580 -- # cat 00:09:42.564 11:20:24 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@582 -- # jq . 00:09:42.564 11:20:24 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@583 -- # IFS=, 00:09:42.565 11:20:24 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:09:42.565 "params": { 00:09:42.565 "name": "Nvme0", 00:09:42.565 "trtype": "tcp", 00:09:42.565 "traddr": "10.0.0.3", 00:09:42.565 "adrfam": "ipv4", 00:09:42.565 "trsvcid": "4420", 00:09:42.565 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:09:42.565 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:09:42.565 "hdgst": false, 00:09:42.565 "ddgst": false 00:09:42.565 }, 00:09:42.565 "method": "bdev_nvme_attach_controller" 00:09:42.565 }' 00:09:42.822 [2024-10-07 11:20:24.326286] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:42.822 [2024-10-07 11:20:24.326427] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid62616 ] 00:09:42.822 [2024-10-07 11:20:24.466812] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:43.080 [2024-10-07 11:20:24.567826] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:43.080 [2024-10-07 11:20:24.612230] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:43.080 Running I/O for 1 seconds... 00:09:44.454 768.00 IOPS, 48.00 MiB/s 00:09:44.454 Latency(us) 00:09:44.454 [2024-10-07T11:20:26.165Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:09:44.454 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:09:44.454 Verification LBA range: start 0x0 length 0x400 00:09:44.454 Nvme0n1 : 1.02 819.67 51.23 0.00 0.00 76094.23 10068.71 73876.95 00:09:44.454 [2024-10-07T11:20:26.165Z] =================================================================================================================== 00:09:44.454 [2024-10-07T11:20:26.165Z] Total : 819.67 51.23 0.00 0.00 76094.23 10068.71 73876.95 00:09:44.454 11:20:25 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@102 -- # stoptarget 00:09:44.454 11:20:25 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:09:44.454 11:20:25 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@37 -- # rm -rf /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdevperf.conf 00:09:44.454 11:20:25 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@38 -- # rm -rf /home/vagrant/spdk_repo/spdk/test/nvmf/target/rpcs.txt 00:09:44.454 11:20:25 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@40 -- # nvmftestfini 00:09:44.454 11:20:25 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@514 -- # nvmfcleanup 00:09:44.454 11:20:25 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@121 -- # sync 00:09:44.454 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:09:44.454 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@124 -- # set +e 00:09:44.454 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@125 -- # for i in {1..20} 00:09:44.454 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:09:44.454 rmmod nvme_tcp 00:09:44.454 rmmod nvme_fabrics 00:09:44.454 rmmod nvme_keyring 00:09:44.454 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:09:44.454 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@128 -- # set -e 00:09:44.454 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@129 -- # return 0 00:09:44.454 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@515 -- # '[' -n 62533 ']' 00:09:44.454 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@516 -- # killprocess 62533 00:09:44.454 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@950 -- # '[' -z 62533 ']' 00:09:44.454 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@954 -- # kill -0 62533 00:09:44.454 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@955 -- # uname 00:09:44.455 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:44.455 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 62533 00:09:44.455 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:09:44.455 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:09:44.455 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@968 -- # echo 'killing process with pid 62533' 00:09:44.455 killing process with pid 62533 00:09:44.455 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@969 -- # kill 62533 00:09:44.455 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@974 -- # wait 62533 00:09:44.713 [2024-10-07 11:20:26.321895] app.c: 719:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:09:44.713 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:09:44.713 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:09:44.713 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:09:44.713 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@297 -- # iptr 00:09:44.713 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@789 -- # iptables-save 00:09:44.713 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:09:44.713 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@789 -- # iptables-restore 00:09:44.713 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:09:44.713 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:09:44.713 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:09:44.713 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:09:44.713 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:09:44.713 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@246 -- # remove_spdk_ns 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@300 -- # return 0 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@109 -- # trap - SIGINT SIGTERM EXIT 00:09:44.972 00:09:44.972 real 0m5.237s 00:09:44.972 user 0m18.099s 00:09:44.972 sys 0m1.307s 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:09:44.972 ************************************ 00:09:44.972 END TEST nvmf_host_management 00:09:44.972 ************************************ 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@27 -- # run_test nvmf_lvol /home/vagrant/spdk_repo/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:09:44.972 ************************************ 00:09:44.972 START TEST nvmf_lvol 00:09:44.972 ************************************ 00:09:44.972 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:09:45.232 * Looking for test storage... 00:09:45.232 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1681 -- # lcov --version 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@336 -- # IFS=.-: 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@336 -- # read -ra ver1 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@337 -- # IFS=.-: 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@337 -- # read -ra ver2 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@338 -- # local 'op=<' 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@340 -- # ver1_l=2 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@341 -- # ver2_l=1 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@344 -- # case "$op" in 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@345 -- # : 1 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@365 -- # decimal 1 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@353 -- # local d=1 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@355 -- # echo 1 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@365 -- # ver1[v]=1 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@366 -- # decimal 2 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@353 -- # local d=2 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@355 -- # echo 2 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@366 -- # ver2[v]=2 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:45.232 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@368 -- # return 0 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:45.233 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:45.233 --rc genhtml_branch_coverage=1 00:09:45.233 --rc genhtml_function_coverage=1 00:09:45.233 --rc genhtml_legend=1 00:09:45.233 --rc geninfo_all_blocks=1 00:09:45.233 --rc geninfo_unexecuted_blocks=1 00:09:45.233 00:09:45.233 ' 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:45.233 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:45.233 --rc genhtml_branch_coverage=1 00:09:45.233 --rc genhtml_function_coverage=1 00:09:45.233 --rc genhtml_legend=1 00:09:45.233 --rc geninfo_all_blocks=1 00:09:45.233 --rc geninfo_unexecuted_blocks=1 00:09:45.233 00:09:45.233 ' 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:45.233 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:45.233 --rc genhtml_branch_coverage=1 00:09:45.233 --rc genhtml_function_coverage=1 00:09:45.233 --rc genhtml_legend=1 00:09:45.233 --rc geninfo_all_blocks=1 00:09:45.233 --rc geninfo_unexecuted_blocks=1 00:09:45.233 00:09:45.233 ' 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:45.233 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:45.233 --rc genhtml_branch_coverage=1 00:09:45.233 --rc genhtml_function_coverage=1 00:09:45.233 --rc genhtml_legend=1 00:09:45.233 --rc geninfo_all_blocks=1 00:09:45.233 --rc geninfo_unexecuted_blocks=1 00:09:45.233 00:09:45.233 ' 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@7 -- # uname -s 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@15 -- # shopt -s extglob 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@5 -- # export PATH 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@51 -- # : 0 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:09:45.233 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@55 -- # have_pci_nics=0 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@16 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@474 -- # prepare_net_devs 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@436 -- # local -g is_hw=no 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@438 -- # remove_spdk_ns 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@458 -- # nvmf_veth_init 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:09:45.233 Cannot find device "nvmf_init_br" 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@162 -- # true 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:09:45.233 Cannot find device "nvmf_init_br2" 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@163 -- # true 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:09:45.233 Cannot find device "nvmf_tgt_br" 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@164 -- # true 00:09:45.233 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:09:45.234 Cannot find device "nvmf_tgt_br2" 00:09:45.234 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@165 -- # true 00:09:45.234 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:09:45.234 Cannot find device "nvmf_init_br" 00:09:45.234 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@166 -- # true 00:09:45.234 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:09:45.234 Cannot find device "nvmf_init_br2" 00:09:45.234 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@167 -- # true 00:09:45.234 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:09:45.234 Cannot find device "nvmf_tgt_br" 00:09:45.234 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@168 -- # true 00:09:45.234 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:09:45.234 Cannot find device "nvmf_tgt_br2" 00:09:45.234 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@169 -- # true 00:09:45.234 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:09:45.492 Cannot find device "nvmf_br" 00:09:45.492 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@170 -- # true 00:09:45.492 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:09:45.492 Cannot find device "nvmf_init_if" 00:09:45.492 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@171 -- # true 00:09:45.492 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:09:45.492 Cannot find device "nvmf_init_if2" 00:09:45.492 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@172 -- # true 00:09:45.492 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:09:45.492 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:09:45.492 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@173 -- # true 00:09:45.492 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:09:45.492 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:09:45.492 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@174 -- # true 00:09:45.492 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:09:45.492 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:09:45.492 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:09:45.492 11:20:26 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:09:45.492 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:09:45.492 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:09:45.492 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:09:45.492 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:09:45.492 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:09:45.492 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:09:45.492 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:09:45.492 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:09:45.492 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:09:45.492 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:09:45.492 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:09:45.492 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:09:45.492 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:09:45.492 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:09:45.492 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:09:45.492 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:09:45.492 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:09:45.492 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:09:45.493 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:09:45.493 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:09:45.493 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:09:45.493 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:09:45.493 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:09:45.493 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:09:45.493 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:09:45.493 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:09:45.493 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:09:45.493 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:09:45.751 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:09:45.751 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:09:45.751 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.099 ms 00:09:45.751 00:09:45.751 --- 10.0.0.3 ping statistics --- 00:09:45.751 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:45.751 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:09:45.751 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:09:45.751 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:09:45.751 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.069 ms 00:09:45.751 00:09:45.751 --- 10.0.0.4 ping statistics --- 00:09:45.751 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:45.751 rtt min/avg/max/mdev = 0.069/0.069/0.069/0.000 ms 00:09:45.751 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:09:45.751 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:45.751 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.040 ms 00:09:45.751 00:09:45.751 --- 10.0.0.1 ping statistics --- 00:09:45.751 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:45.751 rtt min/avg/max/mdev = 0.040/0.040/0.040/0.000 ms 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:09:45.752 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:45.752 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.070 ms 00:09:45.752 00:09:45.752 --- 10.0.0.2 ping statistics --- 00:09:45.752 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:45.752 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@459 -- # return 0 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@724 -- # xtrace_disable 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@10 -- # set +x 00:09:45.752 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@507 -- # nvmfpid=62883 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@508 -- # waitforlisten 62883 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@831 -- # '[' -z 62883 ']' 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@10 -- # set +x 00:09:45.752 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:09:45.752 [2024-10-07 11:20:27.308754] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:45.752 [2024-10-07 11:20:27.308835] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:45.752 [2024-10-07 11:20:27.441273] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:09:46.010 [2024-10-07 11:20:27.502114] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:46.010 [2024-10-07 11:20:27.502174] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:46.010 [2024-10-07 11:20:27.502185] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:46.010 [2024-10-07 11:20:27.502194] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:46.010 [2024-10-07 11:20:27.502201] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:46.010 [2024-10-07 11:20:27.502630] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:09:46.010 [2024-10-07 11:20:27.503353] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:09:46.010 [2024-10-07 11:20:27.503385] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:46.010 [2024-10-07 11:20:27.536976] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:09:46.010 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:46.010 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@864 -- # return 0 00:09:46.010 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:09:46.010 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@730 -- # xtrace_disable 00:09:46.010 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@10 -- # set +x 00:09:46.010 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:46.010 11:20:27 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@21 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:09:46.268 [2024-10-07 11:20:27.959818] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:46.526 11:20:28 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@24 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:09:46.782 11:20:28 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:09:46.782 11:20:28 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@25 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:09:47.039 11:20:28 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:09:47.039 11:20:28 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@26 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:09:47.604 11:20:29 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@29 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:09:47.862 11:20:29 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@29 -- # lvs=62ca45e0-4f5d-4bdb-ab7d-9915cf10525a 00:09:47.862 11:20:29 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@32 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_create -u 62ca45e0-4f5d-4bdb-ab7d-9915cf10525a lvol 20 00:09:48.429 11:20:29 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@32 -- # lvol=8e16836d-d262-42a3-9cdc-83286ffe7e38 00:09:48.429 11:20:29 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:09:48.695 11:20:30 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@36 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 8e16836d-d262-42a3-9cdc-83286ffe7e38 00:09:49.279 11:20:30 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@37 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4420 00:09:49.279 [2024-10-07 11:20:30.975602] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:09:49.538 11:20:30 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@38 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:09:49.796 11:20:31 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@42 -- # perf_pid=62962 00:09:49.796 11:20:31 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@44 -- # sleep 1 00:09:49.796 11:20:31 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@41 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:09:50.730 11:20:32 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@47 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_snapshot 8e16836d-d262-42a3-9cdc-83286ffe7e38 MY_SNAPSHOT 00:09:50.987 11:20:32 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@47 -- # snapshot=8e5a5d4b-b498-4eab-833d-d72d3790b254 00:09:50.987 11:20:32 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@48 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_resize 8e16836d-d262-42a3-9cdc-83286ffe7e38 30 00:09:51.554 11:20:32 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@49 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_clone 8e5a5d4b-b498-4eab-833d-d72d3790b254 MY_CLONE 00:09:51.812 11:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@49 -- # clone=6058b89f-1007-4075-ab08-9e95f913969f 00:09:51.812 11:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_inflate 6058b89f-1007-4075-ab08-9e95f913969f 00:09:52.379 11:20:33 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@53 -- # wait 62962 00:10:00.491 Initializing NVMe Controllers 00:10:00.491 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode0 00:10:00.491 Controller IO queue size 128, less than required. 00:10:00.491 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:10:00.491 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:10:00.491 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:10:00.491 Initialization complete. Launching workers. 00:10:00.491 ======================================================== 00:10:00.491 Latency(us) 00:10:00.491 Device Information : IOPS MiB/s Average min max 00:10:00.491 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 9525.10 37.21 13437.57 2158.49 62087.97 00:10:00.491 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 9310.80 36.37 13759.27 261.89 113221.74 00:10:00.491 ======================================================== 00:10:00.491 Total : 18835.90 73.58 13596.59 261.89 113221.74 00:10:00.491 00:10:00.491 11:20:41 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@56 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:10:00.491 11:20:41 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_delete 8e16836d-d262-42a3-9cdc-83286ffe7e38 00:10:00.749 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 62ca45e0-4f5d-4bdb-ab7d-9915cf10525a 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@60 -- # rm -f 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@514 -- # nvmfcleanup 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@121 -- # sync 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@124 -- # set +e 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@125 -- # for i in {1..20} 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:10:01.315 rmmod nvme_tcp 00:10:01.315 rmmod nvme_fabrics 00:10:01.315 rmmod nvme_keyring 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@128 -- # set -e 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@129 -- # return 0 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@515 -- # '[' -n 62883 ']' 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@516 -- # killprocess 62883 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@950 -- # '[' -z 62883 ']' 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@954 -- # kill -0 62883 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@955 -- # uname 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 62883 00:10:01.315 killing process with pid 62883 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@968 -- # echo 'killing process with pid 62883' 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@969 -- # kill 62883 00:10:01.315 11:20:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@974 -- # wait 62883 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@297 -- # iptr 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@789 -- # iptables-save 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@789 -- # iptables-restore 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:10:01.573 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:01.832 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:01.832 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@246 -- # remove_spdk_ns 00:10:01.832 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:01.832 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:01.832 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:01.832 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@300 -- # return 0 00:10:01.832 ************************************ 00:10:01.832 END TEST nvmf_lvol 00:10:01.832 ************************************ 00:10:01.832 00:10:01.832 real 0m16.700s 00:10:01.832 user 1m8.347s 00:10:01.832 sys 0m4.542s 00:10:01.832 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:01.832 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@10 -- # set +x 00:10:01.832 11:20:43 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@28 -- # run_test nvmf_lvs_grow /home/vagrant/spdk_repo/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:10:01.832 11:20:43 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:10:01.832 11:20:43 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:01.832 11:20:43 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:10:01.832 ************************************ 00:10:01.832 START TEST nvmf_lvs_grow 00:10:01.832 ************************************ 00:10:01.832 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:10:01.832 * Looking for test storage... 00:10:01.832 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:10:01.832 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:10:01.832 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1681 -- # lcov --version 00:10:01.832 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@333 -- # local ver1 ver1_l 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@334 -- # local ver2 ver2_l 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@336 -- # IFS=.-: 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@336 -- # read -ra ver1 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@337 -- # IFS=.-: 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@337 -- # read -ra ver2 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@338 -- # local 'op=<' 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@340 -- # ver1_l=2 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@341 -- # ver2_l=1 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@344 -- # case "$op" in 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@345 -- # : 1 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@364 -- # (( v = 0 )) 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@365 -- # decimal 1 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@353 -- # local d=1 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@355 -- # echo 1 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@365 -- # ver1[v]=1 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@366 -- # decimal 2 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@353 -- # local d=2 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@355 -- # echo 2 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@366 -- # ver2[v]=2 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@368 -- # return 0 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:10:02.091 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:02.091 --rc genhtml_branch_coverage=1 00:10:02.091 --rc genhtml_function_coverage=1 00:10:02.091 --rc genhtml_legend=1 00:10:02.091 --rc geninfo_all_blocks=1 00:10:02.091 --rc geninfo_unexecuted_blocks=1 00:10:02.091 00:10:02.091 ' 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:10:02.091 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:02.091 --rc genhtml_branch_coverage=1 00:10:02.091 --rc genhtml_function_coverage=1 00:10:02.091 --rc genhtml_legend=1 00:10:02.091 --rc geninfo_all_blocks=1 00:10:02.091 --rc geninfo_unexecuted_blocks=1 00:10:02.091 00:10:02.091 ' 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:10:02.091 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:02.091 --rc genhtml_branch_coverage=1 00:10:02.091 --rc genhtml_function_coverage=1 00:10:02.091 --rc genhtml_legend=1 00:10:02.091 --rc geninfo_all_blocks=1 00:10:02.091 --rc geninfo_unexecuted_blocks=1 00:10:02.091 00:10:02.091 ' 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:10:02.091 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:02.091 --rc genhtml_branch_coverage=1 00:10:02.091 --rc genhtml_function_coverage=1 00:10:02.091 --rc genhtml_legend=1 00:10:02.091 --rc geninfo_all_blocks=1 00:10:02.091 --rc geninfo_unexecuted_blocks=1 00:10:02.091 00:10:02.091 ' 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@7 -- # uname -s 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@15 -- # shopt -s extglob 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@5 -- # export PATH 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@51 -- # : 0 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:02.091 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:10:02.091 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@55 -- # have_pci_nics=0 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@98 -- # nvmftestinit 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@474 -- # prepare_net_devs 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@436 -- # local -g is_hw=no 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@438 -- # remove_spdk_ns 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@458 -- # nvmf_veth_init 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:10:02.092 Cannot find device "nvmf_init_br" 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@162 -- # true 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:10:02.092 Cannot find device "nvmf_init_br2" 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@163 -- # true 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:10:02.092 Cannot find device "nvmf_tgt_br" 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@164 -- # true 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:10:02.092 Cannot find device "nvmf_tgt_br2" 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@165 -- # true 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:10:02.092 Cannot find device "nvmf_init_br" 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@166 -- # true 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:10:02.092 Cannot find device "nvmf_init_br2" 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@167 -- # true 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:10:02.092 Cannot find device "nvmf_tgt_br" 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@168 -- # true 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:10:02.092 Cannot find device "nvmf_tgt_br2" 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@169 -- # true 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:10:02.092 Cannot find device "nvmf_br" 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@170 -- # true 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:10:02.092 Cannot find device "nvmf_init_if" 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@171 -- # true 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:10:02.092 Cannot find device "nvmf_init_if2" 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@172 -- # true 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:02.092 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@173 -- # true 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:02.092 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@174 -- # true 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:10:02.092 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:10:02.351 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:10:02.351 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:10:02.351 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:10:02.351 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:10:02.351 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:10:02.351 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:10:02.351 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:10:02.351 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:10:02.351 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:10:02.351 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:10:02.351 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:10:02.351 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:10:02.351 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:10:02.351 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:10:02.351 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:10:02.351 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:10:02.351 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:10:02.351 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:10:02.351 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:10:02.352 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:10:02.352 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.103 ms 00:10:02.352 00:10:02.352 --- 10.0.0.3 ping statistics --- 00:10:02.352 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:02.352 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:10:02.352 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:10:02.352 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.062 ms 00:10:02.352 00:10:02.352 --- 10.0.0.4 ping statistics --- 00:10:02.352 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:02.352 rtt min/avg/max/mdev = 0.062/0.062/0.062/0.000 ms 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:10:02.352 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:10:02.352 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.041 ms 00:10:02.352 00:10:02.352 --- 10.0.0.1 ping statistics --- 00:10:02.352 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:02.352 rtt min/avg/max/mdev = 0.041/0.041/0.041/0.000 ms 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:10:02.352 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:10:02.352 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.087 ms 00:10:02.352 00:10:02.352 --- 10.0.0.2 ping statistics --- 00:10:02.352 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:02.352 rtt min/avg/max/mdev = 0.087/0.087/0.087/0.000 ms 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@459 -- # return 0 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@99 -- # nvmfappstart -m 0x1 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@724 -- # xtrace_disable 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@507 -- # nvmfpid=63355 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@508 -- # waitforlisten 63355 00:10:02.352 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@831 -- # '[' -z 63355 ']' 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:02.352 11:20:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:10:02.352 [2024-10-07 11:20:44.038340] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:10:02.352 [2024-10-07 11:20:44.038687] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:02.610 [2024-10-07 11:20:44.174476] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:10:02.610 [2024-10-07 11:20:44.241721] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:02.610 [2024-10-07 11:20:44.241793] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:02.610 [2024-10-07 11:20:44.241807] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:02.610 [2024-10-07 11:20:44.241815] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:02.610 [2024-10-07 11:20:44.241823] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:02.610 [2024-10-07 11:20:44.242139] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:10:02.610 [2024-10-07 11:20:44.273202] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:10:02.868 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:02.868 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@864 -- # return 0 00:10:02.868 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:10:02.868 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@730 -- # xtrace_disable 00:10:02.868 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:10:02.868 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:02.868 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@100 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:10:03.126 [2024-10-07 11:20:44.714516] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:10:03.126 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_clean lvs_grow 00:10:03.126 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:10:03.126 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:03.126 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:10:03.126 ************************************ 00:10:03.126 START TEST lvs_grow_clean 00:10:03.126 ************************************ 00:10:03.126 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@1125 -- # lvs_grow 00:10:03.126 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:10:03.126 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:10:03.126 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:10:03.126 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:10:03.126 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:10:03.126 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:10:03.126 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@23 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:10:03.126 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:10:03.126 11:20:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@25 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_create /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:10:03.384 11:20:45 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:10:03.384 11:20:45 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:10:03.950 11:20:45 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@28 -- # lvs=af8c4438-ff83-44a3-8754-606373be75ab 00:10:03.950 11:20:45 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@29 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u af8c4438-ff83-44a3-8754-606373be75ab 00:10:03.950 11:20:45 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:10:04.209 11:20:45 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:10:04.209 11:20:45 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:10:04.209 11:20:45 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_create -u af8c4438-ff83-44a3-8754-606373be75ab lvol 150 00:10:04.467 11:20:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@33 -- # lvol=939b920e-b589-4603-8fc3-00e8fd01eeec 00:10:04.467 11:20:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:10:04.467 11:20:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@37 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:10:04.725 [2024-10-07 11:20:46.339575] bdev_aio.c:1044:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:10:04.725 [2024-10-07 11:20:46.339715] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:10:04.725 true 00:10:04.725 11:20:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:10:04.725 11:20:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@38 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u af8c4438-ff83-44a3-8754-606373be75ab 00:10:05.351 11:20:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:10:05.352 11:20:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@41 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:10:05.610 11:20:47 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@42 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 939b920e-b589-4603-8fc3-00e8fd01eeec 00:10:05.868 11:20:47 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@43 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4420 00:10:06.432 [2024-10-07 11:20:47.916662] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:10:06.432 11:20:47 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@44 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:10:06.691 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:10:06.691 11:20:48 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=63441 00:10:06.691 11:20:48 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@47 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:10:06.691 11:20:48 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:10:06.691 11:20:48 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 63441 /var/tmp/bdevperf.sock 00:10:06.691 11:20:48 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@831 -- # '[' -z 63441 ']' 00:10:06.691 11:20:48 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:10:06.691 11:20:48 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:06.691 11:20:48 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:10:06.691 11:20:48 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:06.691 11:20:48 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@10 -- # set +x 00:10:06.691 [2024-10-07 11:20:48.367654] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:10:06.691 [2024-10-07 11:20:48.367791] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid63441 ] 00:10:06.949 [2024-10-07 11:20:48.505146] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:10:06.949 [2024-10-07 11:20:48.580517] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:10:06.949 [2024-10-07 11:20:48.619192] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:10:07.208 11:20:48 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:07.208 11:20:48 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@864 -- # return 0 00:10:07.208 11:20:48 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:10:07.466 Nvme0n1 00:10:07.466 11:20:49 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:10:08.032 [ 00:10:08.032 { 00:10:08.032 "name": "Nvme0n1", 00:10:08.032 "aliases": [ 00:10:08.032 "939b920e-b589-4603-8fc3-00e8fd01eeec" 00:10:08.032 ], 00:10:08.032 "product_name": "NVMe disk", 00:10:08.032 "block_size": 4096, 00:10:08.032 "num_blocks": 38912, 00:10:08.032 "uuid": "939b920e-b589-4603-8fc3-00e8fd01eeec", 00:10:08.032 "numa_id": -1, 00:10:08.032 "assigned_rate_limits": { 00:10:08.032 "rw_ios_per_sec": 0, 00:10:08.032 "rw_mbytes_per_sec": 0, 00:10:08.032 "r_mbytes_per_sec": 0, 00:10:08.032 "w_mbytes_per_sec": 0 00:10:08.032 }, 00:10:08.032 "claimed": false, 00:10:08.032 "zoned": false, 00:10:08.032 "supported_io_types": { 00:10:08.032 "read": true, 00:10:08.032 "write": true, 00:10:08.032 "unmap": true, 00:10:08.032 "flush": true, 00:10:08.032 "reset": true, 00:10:08.032 "nvme_admin": true, 00:10:08.032 "nvme_io": true, 00:10:08.032 "nvme_io_md": false, 00:10:08.032 "write_zeroes": true, 00:10:08.032 "zcopy": false, 00:10:08.032 "get_zone_info": false, 00:10:08.032 "zone_management": false, 00:10:08.032 "zone_append": false, 00:10:08.032 "compare": true, 00:10:08.032 "compare_and_write": true, 00:10:08.032 "abort": true, 00:10:08.032 "seek_hole": false, 00:10:08.032 "seek_data": false, 00:10:08.032 "copy": true, 00:10:08.032 "nvme_iov_md": false 00:10:08.032 }, 00:10:08.032 "memory_domains": [ 00:10:08.032 { 00:10:08.032 "dma_device_id": "system", 00:10:08.032 "dma_device_type": 1 00:10:08.032 } 00:10:08.032 ], 00:10:08.032 "driver_specific": { 00:10:08.032 "nvme": [ 00:10:08.032 { 00:10:08.032 "trid": { 00:10:08.032 "trtype": "TCP", 00:10:08.032 "adrfam": "IPv4", 00:10:08.032 "traddr": "10.0.0.3", 00:10:08.032 "trsvcid": "4420", 00:10:08.032 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:10:08.032 }, 00:10:08.032 "ctrlr_data": { 00:10:08.032 "cntlid": 1, 00:10:08.032 "vendor_id": "0x8086", 00:10:08.032 "model_number": "SPDK bdev Controller", 00:10:08.032 "serial_number": "SPDK0", 00:10:08.032 "firmware_revision": "25.01", 00:10:08.032 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:10:08.032 "oacs": { 00:10:08.032 "security": 0, 00:10:08.032 "format": 0, 00:10:08.032 "firmware": 0, 00:10:08.032 "ns_manage": 0 00:10:08.032 }, 00:10:08.032 "multi_ctrlr": true, 00:10:08.032 "ana_reporting": false 00:10:08.032 }, 00:10:08.032 "vs": { 00:10:08.032 "nvme_version": "1.3" 00:10:08.032 }, 00:10:08.032 "ns_data": { 00:10:08.032 "id": 1, 00:10:08.032 "can_share": true 00:10:08.032 } 00:10:08.032 } 00:10:08.032 ], 00:10:08.032 "mp_policy": "active_passive" 00:10:08.032 } 00:10:08.032 } 00:10:08.032 ] 00:10:08.032 11:20:49 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=63457 00:10:08.032 11:20:49 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@55 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:10:08.032 11:20:49 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:10:08.032 Running I/O for 10 seconds... 00:10:08.980 Latency(us) 00:10:08.980 [2024-10-07T11:20:50.691Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:10:08.980 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:08.980 Nvme0n1 : 1.00 5653.00 22.08 0.00 0.00 0.00 0.00 0.00 00:10:08.980 [2024-10-07T11:20:50.691Z] =================================================================================================================== 00:10:08.980 [2024-10-07T11:20:50.691Z] Total : 5653.00 22.08 0.00 0.00 0.00 0.00 0.00 00:10:08.980 00:10:09.914 11:20:51 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u af8c4438-ff83-44a3-8754-606373be75ab 00:10:10.171 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:10.171 Nvme0n1 : 2.00 6065.00 23.69 0.00 0.00 0.00 0.00 0.00 00:10:10.171 [2024-10-07T11:20:51.882Z] =================================================================================================================== 00:10:10.171 [2024-10-07T11:20:51.882Z] Total : 6065.00 23.69 0.00 0.00 0.00 0.00 0.00 00:10:10.171 00:10:10.171 true 00:10:10.171 11:20:51 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:10:10.171 11:20:51 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@61 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u af8c4438-ff83-44a3-8754-606373be75ab 00:10:10.737 11:20:52 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:10:10.737 11:20:52 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:10:10.737 11:20:52 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@65 -- # wait 63457 00:10:10.995 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:10.995 Nvme0n1 : 3.00 6075.33 23.73 0.00 0.00 0.00 0.00 0.00 00:10:10.995 [2024-10-07T11:20:52.706Z] =================================================================================================================== 00:10:10.995 [2024-10-07T11:20:52.706Z] Total : 6075.33 23.73 0.00 0.00 0.00 0.00 0.00 00:10:10.995 00:10:12.002 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:12.002 Nvme0n1 : 4.00 6080.50 23.75 0.00 0.00 0.00 0.00 0.00 00:10:12.002 [2024-10-07T11:20:53.713Z] =================================================================================================================== 00:10:12.002 [2024-10-07T11:20:53.713Z] Total : 6080.50 23.75 0.00 0.00 0.00 0.00 0.00 00:10:12.002 00:10:12.952 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:12.952 Nvme0n1 : 5.00 6045.20 23.61 0.00 0.00 0.00 0.00 0.00 00:10:12.952 [2024-10-07T11:20:54.663Z] =================================================================================================================== 00:10:12.952 [2024-10-07T11:20:54.663Z] Total : 6045.20 23.61 0.00 0.00 0.00 0.00 0.00 00:10:12.952 00:10:14.324 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:14.324 Nvme0n1 : 6.00 6096.00 23.81 0.00 0.00 0.00 0.00 0.00 00:10:14.324 [2024-10-07T11:20:56.035Z] =================================================================================================================== 00:10:14.324 [2024-10-07T11:20:56.035Z] Total : 6096.00 23.81 0.00 0.00 0.00 0.00 0.00 00:10:14.324 00:10:15.258 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:15.258 Nvme0n1 : 7.00 6040.71 23.60 0.00 0.00 0.00 0.00 0.00 00:10:15.258 [2024-10-07T11:20:56.969Z] =================================================================================================================== 00:10:15.258 [2024-10-07T11:20:56.969Z] Total : 6040.71 23.60 0.00 0.00 0.00 0.00 0.00 00:10:15.258 00:10:16.191 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:16.191 Nvme0n1 : 8.00 6067.62 23.70 0.00 0.00 0.00 0.00 0.00 00:10:16.192 [2024-10-07T11:20:57.903Z] =================================================================================================================== 00:10:16.192 [2024-10-07T11:20:57.903Z] Total : 6067.62 23.70 0.00 0.00 0.00 0.00 0.00 00:10:16.192 00:10:17.129 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:17.129 Nvme0n1 : 9.00 6099.00 23.82 0.00 0.00 0.00 0.00 0.00 00:10:17.129 [2024-10-07T11:20:58.840Z] =================================================================================================================== 00:10:17.129 [2024-10-07T11:20:58.840Z] Total : 6099.00 23.82 0.00 0.00 0.00 0.00 0.00 00:10:17.129 00:10:18.118 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:18.118 Nvme0n1 : 10.00 6060.60 23.67 0.00 0.00 0.00 0.00 0.00 00:10:18.118 [2024-10-07T11:20:59.829Z] =================================================================================================================== 00:10:18.118 [2024-10-07T11:20:59.829Z] Total : 6060.60 23.67 0.00 0.00 0.00 0.00 0.00 00:10:18.118 00:10:18.118 00:10:18.118 Latency(us) 00:10:18.118 [2024-10-07T11:20:59.829Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:10:18.118 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:18.118 Nvme0n1 : 10.01 6067.78 23.70 0.00 0.00 21088.71 4706.68 131548.63 00:10:18.118 [2024-10-07T11:20:59.829Z] =================================================================================================================== 00:10:18.118 [2024-10-07T11:20:59.829Z] Total : 6067.78 23.70 0.00 0.00 21088.71 4706.68 131548.63 00:10:18.118 { 00:10:18.118 "results": [ 00:10:18.118 { 00:10:18.118 "job": "Nvme0n1", 00:10:18.118 "core_mask": "0x2", 00:10:18.118 "workload": "randwrite", 00:10:18.118 "status": "finished", 00:10:18.118 "queue_depth": 128, 00:10:18.118 "io_size": 4096, 00:10:18.118 "runtime": 10.009267, 00:10:18.118 "iops": 6067.776991062383, 00:10:18.118 "mibps": 23.702253871337433, 00:10:18.118 "io_failed": 0, 00:10:18.118 "io_timeout": 0, 00:10:18.118 "avg_latency_us": 21088.70608705024, 00:10:18.118 "min_latency_us": 4706.676363636364, 00:10:18.118 "max_latency_us": 131548.62545454546 00:10:18.118 } 00:10:18.118 ], 00:10:18.118 "core_count": 1 00:10:18.118 } 00:10:18.118 11:20:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@66 -- # killprocess 63441 00:10:18.118 11:20:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@950 -- # '[' -z 63441 ']' 00:10:18.118 11:20:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@954 -- # kill -0 63441 00:10:18.118 11:20:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@955 -- # uname 00:10:18.118 11:20:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:10:18.118 11:20:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 63441 00:10:18.118 killing process with pid 63441 00:10:18.118 Received shutdown signal, test time was about 10.000000 seconds 00:10:18.118 00:10:18.118 Latency(us) 00:10:18.118 [2024-10-07T11:20:59.829Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:10:18.118 [2024-10-07T11:20:59.829Z] =================================================================================================================== 00:10:18.118 [2024-10-07T11:20:59.829Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:10:18.118 11:20:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:10:18.118 11:20:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:10:18.118 11:20:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@968 -- # echo 'killing process with pid 63441' 00:10:18.118 11:20:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@969 -- # kill 63441 00:10:18.118 11:20:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@974 -- # wait 63441 00:10:18.376 11:20:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@68 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:10:18.635 11:21:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@69 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:10:18.893 11:21:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@70 -- # jq -r '.[0].free_clusters' 00:10:18.893 11:21:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@70 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u af8c4438-ff83-44a3-8754-606373be75ab 00:10:19.152 11:21:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@70 -- # free_clusters=61 00:10:19.152 11:21:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@72 -- # [[ '' == \d\i\r\t\y ]] 00:10:19.152 11:21:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@84 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:10:19.409 [2024-10-07 11:21:01.074007] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:10:19.667 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@85 -- # NOT /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u af8c4438-ff83-44a3-8754-606373be75ab 00:10:19.667 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@650 -- # local es=0 00:10:19.667 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u af8c4438-ff83-44a3-8754-606373be75ab 00:10:19.667 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:10:19.667 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:10:19.667 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:10:19.667 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:10:19.667 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:10:19.667 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:10:19.667 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:10:19.667 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/scripts/rpc.py ]] 00:10:19.667 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u af8c4438-ff83-44a3-8754-606373be75ab 00:10:19.926 request: 00:10:19.926 { 00:10:19.926 "uuid": "af8c4438-ff83-44a3-8754-606373be75ab", 00:10:19.926 "method": "bdev_lvol_get_lvstores", 00:10:19.926 "req_id": 1 00:10:19.926 } 00:10:19.926 Got JSON-RPC error response 00:10:19.926 response: 00:10:19.926 { 00:10:19.926 "code": -19, 00:10:19.926 "message": "No such device" 00:10:19.926 } 00:10:19.926 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@653 -- # es=1 00:10:19.926 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:10:19.926 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:10:19.926 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:10:19.926 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@86 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_create /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:10:20.184 aio_bdev 00:10:20.184 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@87 -- # waitforbdev 939b920e-b589-4603-8fc3-00e8fd01eeec 00:10:20.184 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@899 -- # local bdev_name=939b920e-b589-4603-8fc3-00e8fd01eeec 00:10:20.184 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@900 -- # local bdev_timeout= 00:10:20.184 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@901 -- # local i 00:10:20.184 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@902 -- # [[ -z '' ]] 00:10:20.184 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@902 -- # bdev_timeout=2000 00:10:20.184 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@904 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_wait_for_examine 00:10:20.442 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@906 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_get_bdevs -b 939b920e-b589-4603-8fc3-00e8fd01eeec -t 2000 00:10:20.735 [ 00:10:20.735 { 00:10:20.735 "name": "939b920e-b589-4603-8fc3-00e8fd01eeec", 00:10:20.735 "aliases": [ 00:10:20.735 "lvs/lvol" 00:10:20.735 ], 00:10:20.735 "product_name": "Logical Volume", 00:10:20.735 "block_size": 4096, 00:10:20.735 "num_blocks": 38912, 00:10:20.735 "uuid": "939b920e-b589-4603-8fc3-00e8fd01eeec", 00:10:20.735 "assigned_rate_limits": { 00:10:20.735 "rw_ios_per_sec": 0, 00:10:20.735 "rw_mbytes_per_sec": 0, 00:10:20.735 "r_mbytes_per_sec": 0, 00:10:20.735 "w_mbytes_per_sec": 0 00:10:20.735 }, 00:10:20.735 "claimed": false, 00:10:20.735 "zoned": false, 00:10:20.735 "supported_io_types": { 00:10:20.735 "read": true, 00:10:20.735 "write": true, 00:10:20.735 "unmap": true, 00:10:20.735 "flush": false, 00:10:20.735 "reset": true, 00:10:20.735 "nvme_admin": false, 00:10:20.735 "nvme_io": false, 00:10:20.735 "nvme_io_md": false, 00:10:20.735 "write_zeroes": true, 00:10:20.735 "zcopy": false, 00:10:20.735 "get_zone_info": false, 00:10:20.735 "zone_management": false, 00:10:20.735 "zone_append": false, 00:10:20.735 "compare": false, 00:10:20.735 "compare_and_write": false, 00:10:20.735 "abort": false, 00:10:20.735 "seek_hole": true, 00:10:20.735 "seek_data": true, 00:10:20.735 "copy": false, 00:10:20.735 "nvme_iov_md": false 00:10:20.735 }, 00:10:20.735 "driver_specific": { 00:10:20.735 "lvol": { 00:10:20.735 "lvol_store_uuid": "af8c4438-ff83-44a3-8754-606373be75ab", 00:10:20.735 "base_bdev": "aio_bdev", 00:10:20.735 "thin_provision": false, 00:10:20.735 "num_allocated_clusters": 38, 00:10:20.735 "snapshot": false, 00:10:20.735 "clone": false, 00:10:20.735 "esnap_clone": false 00:10:20.735 } 00:10:20.735 } 00:10:20.735 } 00:10:20.735 ] 00:10:20.735 11:21:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@907 -- # return 0 00:10:20.735 11:21:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@88 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u af8c4438-ff83-44a3-8754-606373be75ab 00:10:20.735 11:21:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].free_clusters' 00:10:20.994 11:21:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@88 -- # (( free_clusters == 61 )) 00:10:20.994 11:21:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@89 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u af8c4438-ff83-44a3-8754-606373be75ab 00:10:20.994 11:21:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@89 -- # jq -r '.[0].total_data_clusters' 00:10:21.252 11:21:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@89 -- # (( data_clusters == 99 )) 00:10:21.252 11:21:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@92 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_delete 939b920e-b589-4603-8fc3-00e8fd01eeec 00:10:21.510 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@93 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u af8c4438-ff83-44a3-8754-606373be75ab 00:10:21.767 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@94 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:10:22.025 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@95 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:10:22.591 ************************************ 00:10:22.591 END TEST lvs_grow_clean 00:10:22.591 ************************************ 00:10:22.591 00:10:22.591 real 0m19.402s 00:10:22.591 user 0m18.400s 00:10:22.591 sys 0m2.722s 00:10:22.591 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:22.591 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@10 -- # set +x 00:10:22.592 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@103 -- # run_test lvs_grow_dirty lvs_grow dirty 00:10:22.592 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:10:22.592 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:22.592 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:10:22.592 ************************************ 00:10:22.592 START TEST lvs_grow_dirty 00:10:22.592 ************************************ 00:10:22.592 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@1125 -- # lvs_grow dirty 00:10:22.592 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:10:22.592 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:10:22.592 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:10:22.592 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:10:22.592 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:10:22.592 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:10:22.592 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@23 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:10:22.592 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:10:22.592 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@25 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_create /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:10:22.850 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:10:22.850 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:10:23.416 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@28 -- # lvs=c476547b-f7a3-4e1b-b792-725d05fad5c2 00:10:23.416 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:10:23.416 11:21:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@29 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c476547b-f7a3-4e1b-b792-725d05fad5c2 00:10:23.674 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:10:23.674 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:10:23.674 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_create -u c476547b-f7a3-4e1b-b792-725d05fad5c2 lvol 150 00:10:23.931 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@33 -- # lvol=249addcb-9e70-4d71-86d7-d85b11d4db6b 00:10:23.931 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:10:23.931 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@37 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:10:24.189 [2024-10-07 11:21:05.757265] bdev_aio.c:1044:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:10:24.189 [2024-10-07 11:21:05.757364] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:10:24.189 true 00:10:24.189 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:10:24.189 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@38 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c476547b-f7a3-4e1b-b792-725d05fad5c2 00:10:24.447 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:10:24.447 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@41 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:10:24.706 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@42 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 249addcb-9e70-4d71-86d7-d85b11d4db6b 00:10:24.964 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@43 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4420 00:10:25.529 [2024-10-07 11:21:07.017904] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:10:25.529 11:21:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@44 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:10:25.787 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:10:25.787 11:21:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=63723 00:10:25.787 11:21:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@47 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:10:25.787 11:21:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:10:25.787 11:21:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 63723 /var/tmp/bdevperf.sock 00:10:25.787 11:21:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@831 -- # '[' -z 63723 ']' 00:10:25.787 11:21:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:10:25.787 11:21:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:25.787 11:21:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:10:25.787 11:21:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:25.787 11:21:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:10:25.787 [2024-10-07 11:21:07.366611] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:10:25.787 [2024-10-07 11:21:07.366911] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid63723 ] 00:10:26.045 [2024-10-07 11:21:07.522910] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:10:26.045 [2024-10-07 11:21:07.608929] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:10:26.045 [2024-10-07 11:21:07.650664] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:10:26.979 11:21:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:26.979 11:21:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@864 -- # return 0 00:10:26.979 11:21:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:10:27.236 Nvme0n1 00:10:27.236 11:21:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:10:27.800 [ 00:10:27.800 { 00:10:27.800 "name": "Nvme0n1", 00:10:27.800 "aliases": [ 00:10:27.800 "249addcb-9e70-4d71-86d7-d85b11d4db6b" 00:10:27.800 ], 00:10:27.800 "product_name": "NVMe disk", 00:10:27.800 "block_size": 4096, 00:10:27.800 "num_blocks": 38912, 00:10:27.800 "uuid": "249addcb-9e70-4d71-86d7-d85b11d4db6b", 00:10:27.801 "numa_id": -1, 00:10:27.801 "assigned_rate_limits": { 00:10:27.801 "rw_ios_per_sec": 0, 00:10:27.801 "rw_mbytes_per_sec": 0, 00:10:27.801 "r_mbytes_per_sec": 0, 00:10:27.801 "w_mbytes_per_sec": 0 00:10:27.801 }, 00:10:27.801 "claimed": false, 00:10:27.801 "zoned": false, 00:10:27.801 "supported_io_types": { 00:10:27.801 "read": true, 00:10:27.801 "write": true, 00:10:27.801 "unmap": true, 00:10:27.801 "flush": true, 00:10:27.801 "reset": true, 00:10:27.801 "nvme_admin": true, 00:10:27.801 "nvme_io": true, 00:10:27.801 "nvme_io_md": false, 00:10:27.801 "write_zeroes": true, 00:10:27.801 "zcopy": false, 00:10:27.801 "get_zone_info": false, 00:10:27.801 "zone_management": false, 00:10:27.801 "zone_append": false, 00:10:27.801 "compare": true, 00:10:27.801 "compare_and_write": true, 00:10:27.801 "abort": true, 00:10:27.801 "seek_hole": false, 00:10:27.801 "seek_data": false, 00:10:27.801 "copy": true, 00:10:27.801 "nvme_iov_md": false 00:10:27.801 }, 00:10:27.801 "memory_domains": [ 00:10:27.801 { 00:10:27.801 "dma_device_id": "system", 00:10:27.801 "dma_device_type": 1 00:10:27.801 } 00:10:27.801 ], 00:10:27.801 "driver_specific": { 00:10:27.801 "nvme": [ 00:10:27.801 { 00:10:27.801 "trid": { 00:10:27.801 "trtype": "TCP", 00:10:27.801 "adrfam": "IPv4", 00:10:27.801 "traddr": "10.0.0.3", 00:10:27.801 "trsvcid": "4420", 00:10:27.801 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:10:27.801 }, 00:10:27.801 "ctrlr_data": { 00:10:27.801 "cntlid": 1, 00:10:27.801 "vendor_id": "0x8086", 00:10:27.801 "model_number": "SPDK bdev Controller", 00:10:27.801 "serial_number": "SPDK0", 00:10:27.801 "firmware_revision": "25.01", 00:10:27.801 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:10:27.801 "oacs": { 00:10:27.801 "security": 0, 00:10:27.801 "format": 0, 00:10:27.801 "firmware": 0, 00:10:27.801 "ns_manage": 0 00:10:27.801 }, 00:10:27.801 "multi_ctrlr": true, 00:10:27.801 "ana_reporting": false 00:10:27.801 }, 00:10:27.801 "vs": { 00:10:27.801 "nvme_version": "1.3" 00:10:27.801 }, 00:10:27.801 "ns_data": { 00:10:27.801 "id": 1, 00:10:27.801 "can_share": true 00:10:27.801 } 00:10:27.801 } 00:10:27.801 ], 00:10:27.801 "mp_policy": "active_passive" 00:10:27.801 } 00:10:27.801 } 00:10:27.801 ] 00:10:27.801 11:21:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=63752 00:10:27.801 11:21:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@55 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:10:27.801 11:21:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:10:27.801 Running I/O for 10 seconds... 00:10:28.734 Latency(us) 00:10:28.734 [2024-10-07T11:21:10.445Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:10:28.734 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:28.734 Nvme0n1 : 1.00 6731.00 26.29 0.00 0.00 0.00 0.00 0.00 00:10:28.734 [2024-10-07T11:21:10.445Z] =================================================================================================================== 00:10:28.734 [2024-10-07T11:21:10.445Z] Total : 6731.00 26.29 0.00 0.00 0.00 0.00 0.00 00:10:28.734 00:10:29.669 11:21:11 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u c476547b-f7a3-4e1b-b792-725d05fad5c2 00:10:29.927 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:29.927 Nvme0n1 : 2.00 6350.00 24.80 0.00 0.00 0.00 0.00 0.00 00:10:29.927 [2024-10-07T11:21:11.638Z] =================================================================================================================== 00:10:29.927 [2024-10-07T11:21:11.638Z] Total : 6350.00 24.80 0.00 0.00 0.00 0.00 0.00 00:10:29.927 00:10:30.185 true 00:10:30.185 11:21:11 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@61 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c476547b-f7a3-4e1b-b792-725d05fad5c2 00:10:30.185 11:21:11 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:10:30.443 11:21:12 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:10:30.443 11:21:12 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:10:30.443 11:21:12 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@65 -- # wait 63752 00:10:30.702 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:30.702 Nvme0n1 : 3.00 6138.33 23.98 0.00 0.00 0.00 0.00 0.00 00:10:30.702 [2024-10-07T11:21:12.413Z] =================================================================================================================== 00:10:30.702 [2024-10-07T11:21:12.413Z] Total : 6138.33 23.98 0.00 0.00 0.00 0.00 0.00 00:10:30.702 00:10:32.074 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:32.075 Nvme0n1 : 4.00 6127.75 23.94 0.00 0.00 0.00 0.00 0.00 00:10:32.075 [2024-10-07T11:21:13.786Z] =================================================================================================================== 00:10:32.075 [2024-10-07T11:21:13.786Z] Total : 6127.75 23.94 0.00 0.00 0.00 0.00 0.00 00:10:32.075 00:10:32.679 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:32.679 Nvme0n1 : 5.00 5956.40 23.27 0.00 0.00 0.00 0.00 0.00 00:10:32.679 [2024-10-07T11:21:14.390Z] =================================================================================================================== 00:10:32.679 [2024-10-07T11:21:14.390Z] Total : 5956.40 23.27 0.00 0.00 0.00 0.00 0.00 00:10:32.679 00:10:34.051 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:34.051 Nvme0n1 : 6.00 5895.00 23.03 0.00 0.00 0.00 0.00 0.00 00:10:34.051 [2024-10-07T11:21:15.762Z] =================================================================================================================== 00:10:34.051 [2024-10-07T11:21:15.762Z] Total : 5895.00 23.03 0.00 0.00 0.00 0.00 0.00 00:10:34.051 00:10:34.985 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:34.985 Nvme0n1 : 7.00 5923.71 23.14 0.00 0.00 0.00 0.00 0.00 00:10:34.985 [2024-10-07T11:21:16.696Z] =================================================================================================================== 00:10:34.985 [2024-10-07T11:21:16.696Z] Total : 5923.71 23.14 0.00 0.00 0.00 0.00 0.00 00:10:34.985 00:10:35.918 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:35.918 Nvme0n1 : 8.00 5945.25 23.22 0.00 0.00 0.00 0.00 0.00 00:10:35.918 [2024-10-07T11:21:17.629Z] =================================================================================================================== 00:10:35.918 [2024-10-07T11:21:17.629Z] Total : 5945.25 23.22 0.00 0.00 0.00 0.00 0.00 00:10:35.918 00:10:36.854 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:36.854 Nvme0n1 : 9.00 5891.56 23.01 0.00 0.00 0.00 0.00 0.00 00:10:36.854 [2024-10-07T11:21:18.565Z] =================================================================================================================== 00:10:36.854 [2024-10-07T11:21:18.565Z] Total : 5891.56 23.01 0.00 0.00 0.00 0.00 0.00 00:10:36.854 00:10:37.787 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:37.787 Nvme0n1 : 10.00 5823.10 22.75 0.00 0.00 0.00 0.00 0.00 00:10:37.787 [2024-10-07T11:21:19.498Z] =================================================================================================================== 00:10:37.787 [2024-10-07T11:21:19.498Z] Total : 5823.10 22.75 0.00 0.00 0.00 0.00 0.00 00:10:37.787 00:10:37.787 00:10:37.787 Latency(us) 00:10:37.787 [2024-10-07T11:21:19.498Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:10:37.787 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:10:37.787 Nvme0n1 : 10.02 5824.88 22.75 0.00 0.00 21968.65 13941.29 117249.86 00:10:37.787 [2024-10-07T11:21:19.498Z] =================================================================================================================== 00:10:37.787 [2024-10-07T11:21:19.498Z] Total : 5824.88 22.75 0.00 0.00 21968.65 13941.29 117249.86 00:10:37.787 { 00:10:37.787 "results": [ 00:10:37.787 { 00:10:37.788 "job": "Nvme0n1", 00:10:37.788 "core_mask": "0x2", 00:10:37.788 "workload": "randwrite", 00:10:37.788 "status": "finished", 00:10:37.788 "queue_depth": 128, 00:10:37.788 "io_size": 4096, 00:10:37.788 "runtime": 10.01892, 00:10:37.788 "iops": 5824.879328310836, 00:10:37.788 "mibps": 22.753434876214204, 00:10:37.788 "io_failed": 0, 00:10:37.788 "io_timeout": 0, 00:10:37.788 "avg_latency_us": 21968.648296733852, 00:10:37.788 "min_latency_us": 13941.294545454546, 00:10:37.788 "max_latency_us": 117249.86181818182 00:10:37.788 } 00:10:37.788 ], 00:10:37.788 "core_count": 1 00:10:37.788 } 00:10:37.788 11:21:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@66 -- # killprocess 63723 00:10:37.788 11:21:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@950 -- # '[' -z 63723 ']' 00:10:37.788 11:21:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@954 -- # kill -0 63723 00:10:37.788 11:21:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@955 -- # uname 00:10:37.788 11:21:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:10:37.788 11:21:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 63723 00:10:37.788 killing process with pid 63723 00:10:37.788 11:21:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:10:37.788 11:21:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:10:37.788 11:21:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@968 -- # echo 'killing process with pid 63723' 00:10:37.788 11:21:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@969 -- # kill 63723 00:10:37.788 Received shutdown signal, test time was about 10.000000 seconds 00:10:37.788 00:10:37.788 Latency(us) 00:10:37.788 [2024-10-07T11:21:19.499Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:10:37.788 [2024-10-07T11:21:19.499Z] =================================================================================================================== 00:10:37.788 [2024-10-07T11:21:19.499Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:10:37.788 11:21:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@974 -- # wait 63723 00:10:38.045 11:21:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@68 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:10:38.304 11:21:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@69 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:10:38.562 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@70 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c476547b-f7a3-4e1b-b792-725d05fad5c2 00:10:38.562 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@70 -- # jq -r '.[0].free_clusters' 00:10:39.128 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@70 -- # free_clusters=61 00:10:39.128 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@72 -- # [[ dirty == \d\i\r\t\y ]] 00:10:39.128 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@74 -- # kill -9 63355 00:10:39.128 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@75 -- # wait 63355 00:10:39.128 /home/vagrant/spdk_repo/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 75: 63355 Killed "${NVMF_APP[@]}" "$@" 00:10:39.128 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@75 -- # true 00:10:39.128 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@76 -- # nvmfappstart -m 0x1 00:10:39.128 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:10:39.128 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@724 -- # xtrace_disable 00:10:39.128 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:10:39.128 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:39.128 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@507 -- # nvmfpid=63885 00:10:39.128 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:10:39.128 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@508 -- # waitforlisten 63885 00:10:39.128 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@831 -- # '[' -z 63885 ']' 00:10:39.128 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:39.128 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:39.128 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:39.128 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:39.128 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:10:39.128 [2024-10-07 11:21:20.710561] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:10:39.128 [2024-10-07 11:21:20.710880] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:39.386 [2024-10-07 11:21:20.846547] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:10:39.386 [2024-10-07 11:21:20.905901] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:39.386 [2024-10-07 11:21:20.906213] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:39.386 [2024-10-07 11:21:20.906451] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:39.386 [2024-10-07 11:21:20.906691] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:39.386 [2024-10-07 11:21:20.906862] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:39.386 [2024-10-07 11:21:20.907332] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:10:39.386 [2024-10-07 11:21:20.938308] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:10:39.386 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:39.386 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@864 -- # return 0 00:10:39.386 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:10:39.386 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@730 -- # xtrace_disable 00:10:39.386 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:10:39.386 11:21:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:39.386 11:21:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@77 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_create /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:10:39.645 [2024-10-07 11:21:21.328469] blobstore.c:4875:bs_recover: *NOTICE*: Performing recovery on blobstore 00:10:39.645 [2024-10-07 11:21:21.328744] blobstore.c:4822:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:10:39.645 [2024-10-07 11:21:21.328919] blobstore.c:4822:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:10:39.902 11:21:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@77 -- # aio_bdev=aio_bdev 00:10:39.902 11:21:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@78 -- # waitforbdev 249addcb-9e70-4d71-86d7-d85b11d4db6b 00:10:39.902 11:21:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@899 -- # local bdev_name=249addcb-9e70-4d71-86d7-d85b11d4db6b 00:10:39.902 11:21:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@900 -- # local bdev_timeout= 00:10:39.902 11:21:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@901 -- # local i 00:10:39.902 11:21:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@902 -- # [[ -z '' ]] 00:10:39.902 11:21:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@902 -- # bdev_timeout=2000 00:10:39.902 11:21:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@904 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_wait_for_examine 00:10:40.160 11:21:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@906 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_get_bdevs -b 249addcb-9e70-4d71-86d7-d85b11d4db6b -t 2000 00:10:40.419 [ 00:10:40.419 { 00:10:40.419 "name": "249addcb-9e70-4d71-86d7-d85b11d4db6b", 00:10:40.419 "aliases": [ 00:10:40.419 "lvs/lvol" 00:10:40.419 ], 00:10:40.419 "product_name": "Logical Volume", 00:10:40.419 "block_size": 4096, 00:10:40.419 "num_blocks": 38912, 00:10:40.419 "uuid": "249addcb-9e70-4d71-86d7-d85b11d4db6b", 00:10:40.419 "assigned_rate_limits": { 00:10:40.419 "rw_ios_per_sec": 0, 00:10:40.419 "rw_mbytes_per_sec": 0, 00:10:40.419 "r_mbytes_per_sec": 0, 00:10:40.419 "w_mbytes_per_sec": 0 00:10:40.419 }, 00:10:40.419 "claimed": false, 00:10:40.419 "zoned": false, 00:10:40.419 "supported_io_types": { 00:10:40.419 "read": true, 00:10:40.419 "write": true, 00:10:40.419 "unmap": true, 00:10:40.419 "flush": false, 00:10:40.419 "reset": true, 00:10:40.419 "nvme_admin": false, 00:10:40.419 "nvme_io": false, 00:10:40.419 "nvme_io_md": false, 00:10:40.419 "write_zeroes": true, 00:10:40.419 "zcopy": false, 00:10:40.419 "get_zone_info": false, 00:10:40.419 "zone_management": false, 00:10:40.419 "zone_append": false, 00:10:40.419 "compare": false, 00:10:40.419 "compare_and_write": false, 00:10:40.419 "abort": false, 00:10:40.419 "seek_hole": true, 00:10:40.419 "seek_data": true, 00:10:40.419 "copy": false, 00:10:40.419 "nvme_iov_md": false 00:10:40.419 }, 00:10:40.419 "driver_specific": { 00:10:40.419 "lvol": { 00:10:40.419 "lvol_store_uuid": "c476547b-f7a3-4e1b-b792-725d05fad5c2", 00:10:40.419 "base_bdev": "aio_bdev", 00:10:40.419 "thin_provision": false, 00:10:40.419 "num_allocated_clusters": 38, 00:10:40.419 "snapshot": false, 00:10:40.419 "clone": false, 00:10:40.419 "esnap_clone": false 00:10:40.419 } 00:10:40.419 } 00:10:40.419 } 00:10:40.419 ] 00:10:40.419 11:21:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@907 -- # return 0 00:10:40.419 11:21:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@79 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c476547b-f7a3-4e1b-b792-725d05fad5c2 00:10:40.419 11:21:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].free_clusters' 00:10:40.677 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@79 -- # (( free_clusters == 61 )) 00:10:40.677 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@80 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c476547b-f7a3-4e1b-b792-725d05fad5c2 00:10:40.677 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@80 -- # jq -r '.[0].total_data_clusters' 00:10:40.935 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@80 -- # (( data_clusters == 99 )) 00:10:40.935 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@84 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:10:41.193 [2024-10-07 11:21:22.794269] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:10:41.193 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@85 -- # NOT /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c476547b-f7a3-4e1b-b792-725d05fad5c2 00:10:41.193 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@650 -- # local es=0 00:10:41.193 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c476547b-f7a3-4e1b-b792-725d05fad5c2 00:10:41.193 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:10:41.193 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:10:41.193 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:10:41.193 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:10:41.193 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:10:41.193 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:10:41.193 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:10:41.193 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/scripts/rpc.py ]] 00:10:41.193 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c476547b-f7a3-4e1b-b792-725d05fad5c2 00:10:41.451 request: 00:10:41.451 { 00:10:41.451 "uuid": "c476547b-f7a3-4e1b-b792-725d05fad5c2", 00:10:41.451 "method": "bdev_lvol_get_lvstores", 00:10:41.451 "req_id": 1 00:10:41.451 } 00:10:41.451 Got JSON-RPC error response 00:10:41.451 response: 00:10:41.451 { 00:10:41.451 "code": -19, 00:10:41.451 "message": "No such device" 00:10:41.451 } 00:10:41.451 11:21:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@653 -- # es=1 00:10:41.451 11:21:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:10:41.451 11:21:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:10:41.451 11:21:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:10:41.451 11:21:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@86 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_create /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:10:41.709 aio_bdev 00:10:41.709 11:21:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@87 -- # waitforbdev 249addcb-9e70-4d71-86d7-d85b11d4db6b 00:10:41.709 11:21:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@899 -- # local bdev_name=249addcb-9e70-4d71-86d7-d85b11d4db6b 00:10:41.709 11:21:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@900 -- # local bdev_timeout= 00:10:41.709 11:21:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@901 -- # local i 00:10:41.709 11:21:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@902 -- # [[ -z '' ]] 00:10:41.709 11:21:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@902 -- # bdev_timeout=2000 00:10:41.709 11:21:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@904 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_wait_for_examine 00:10:42.274 11:21:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@906 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_get_bdevs -b 249addcb-9e70-4d71-86d7-d85b11d4db6b -t 2000 00:10:42.533 [ 00:10:42.533 { 00:10:42.533 "name": "249addcb-9e70-4d71-86d7-d85b11d4db6b", 00:10:42.533 "aliases": [ 00:10:42.533 "lvs/lvol" 00:10:42.533 ], 00:10:42.533 "product_name": "Logical Volume", 00:10:42.533 "block_size": 4096, 00:10:42.533 "num_blocks": 38912, 00:10:42.533 "uuid": "249addcb-9e70-4d71-86d7-d85b11d4db6b", 00:10:42.533 "assigned_rate_limits": { 00:10:42.533 "rw_ios_per_sec": 0, 00:10:42.533 "rw_mbytes_per_sec": 0, 00:10:42.533 "r_mbytes_per_sec": 0, 00:10:42.533 "w_mbytes_per_sec": 0 00:10:42.533 }, 00:10:42.533 "claimed": false, 00:10:42.533 "zoned": false, 00:10:42.533 "supported_io_types": { 00:10:42.533 "read": true, 00:10:42.533 "write": true, 00:10:42.533 "unmap": true, 00:10:42.533 "flush": false, 00:10:42.533 "reset": true, 00:10:42.533 "nvme_admin": false, 00:10:42.533 "nvme_io": false, 00:10:42.533 "nvme_io_md": false, 00:10:42.533 "write_zeroes": true, 00:10:42.533 "zcopy": false, 00:10:42.533 "get_zone_info": false, 00:10:42.533 "zone_management": false, 00:10:42.533 "zone_append": false, 00:10:42.533 "compare": false, 00:10:42.533 "compare_and_write": false, 00:10:42.533 "abort": false, 00:10:42.533 "seek_hole": true, 00:10:42.533 "seek_data": true, 00:10:42.533 "copy": false, 00:10:42.533 "nvme_iov_md": false 00:10:42.533 }, 00:10:42.533 "driver_specific": { 00:10:42.533 "lvol": { 00:10:42.533 "lvol_store_uuid": "c476547b-f7a3-4e1b-b792-725d05fad5c2", 00:10:42.533 "base_bdev": "aio_bdev", 00:10:42.533 "thin_provision": false, 00:10:42.533 "num_allocated_clusters": 38, 00:10:42.533 "snapshot": false, 00:10:42.533 "clone": false, 00:10:42.533 "esnap_clone": false 00:10:42.533 } 00:10:42.533 } 00:10:42.533 } 00:10:42.533 ] 00:10:42.533 11:21:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@907 -- # return 0 00:10:42.533 11:21:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@88 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c476547b-f7a3-4e1b-b792-725d05fad5c2 00:10:42.533 11:21:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].free_clusters' 00:10:42.791 11:21:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@88 -- # (( free_clusters == 61 )) 00:10:42.791 11:21:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@89 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c476547b-f7a3-4e1b-b792-725d05fad5c2 00:10:42.791 11:21:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@89 -- # jq -r '.[0].total_data_clusters' 00:10:43.055 11:21:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@89 -- # (( data_clusters == 99 )) 00:10:43.055 11:21:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@92 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_delete 249addcb-9e70-4d71-86d7-d85b11d4db6b 00:10:43.336 11:21:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@93 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u c476547b-f7a3-4e1b-b792-725d05fad5c2 00:10:43.900 11:21:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@94 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:10:44.158 11:21:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@95 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:10:44.416 ************************************ 00:10:44.416 END TEST lvs_grow_dirty 00:10:44.416 ************************************ 00:10:44.416 00:10:44.416 real 0m21.888s 00:10:44.416 user 0m46.797s 00:10:44.416 sys 0m8.096s 00:10:44.416 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:44.416 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@808 -- # type=--id 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@809 -- # id=0 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@810 -- # '[' --id = --pid ']' 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@814 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@814 -- # shm_files=nvmf_trace.0 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@816 -- # [[ -z nvmf_trace.0 ]] 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@820 -- # for n in $shm_files 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@821 -- # tar -C /dev/shm/ -cvzf /home/vagrant/spdk_repo/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:10:44.674 nvmf_trace.0 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@823 -- # return 0 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@514 -- # nvmfcleanup 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@121 -- # sync 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@124 -- # set +e 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@125 -- # for i in {1..20} 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:10:44.674 rmmod nvme_tcp 00:10:44.674 rmmod nvme_fabrics 00:10:44.674 rmmod nvme_keyring 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@128 -- # set -e 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@129 -- # return 0 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@515 -- # '[' -n 63885 ']' 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@516 -- # killprocess 63885 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@950 -- # '[' -z 63885 ']' 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@954 -- # kill -0 63885 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@955 -- # uname 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:10:44.674 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 63885 00:10:44.932 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:10:44.932 killing process with pid 63885 00:10:44.932 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:10:44.932 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@968 -- # echo 'killing process with pid 63885' 00:10:44.933 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@969 -- # kill 63885 00:10:44.933 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@974 -- # wait 63885 00:10:44.933 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:10:44.933 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:10:44.933 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:10:44.933 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@297 -- # iptr 00:10:44.933 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:10:44.933 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@789 -- # iptables-restore 00:10:44.933 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@789 -- # iptables-save 00:10:44.933 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:10:44.933 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:10:44.933 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:10:44.933 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:10:44.933 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@246 -- # remove_spdk_ns 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@300 -- # return 0 00:10:45.191 00:10:45.191 real 0m43.400s 00:10:45.191 user 1m11.746s 00:10:45.191 sys 0m11.501s 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:45.191 ************************************ 00:10:45.191 END TEST nvmf_lvs_grow 00:10:45.191 ************************************ 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@29 -- # run_test nvmf_bdev_io_wait /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:10:45.191 ************************************ 00:10:45.191 START TEST nvmf_bdev_io_wait 00:10:45.191 ************************************ 00:10:45.191 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:10:45.450 * Looking for test storage... 00:10:45.450 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:10:45.450 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:10:45.451 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1681 -- # lcov --version 00:10:45.451 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@333 -- # local ver1 ver1_l 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@334 -- # local ver2 ver2_l 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@336 -- # IFS=.-: 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@336 -- # read -ra ver1 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@337 -- # IFS=.-: 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@337 -- # read -ra ver2 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@338 -- # local 'op=<' 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@340 -- # ver1_l=2 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@341 -- # ver2_l=1 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@344 -- # case "$op" in 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@345 -- # : 1 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@364 -- # (( v = 0 )) 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@365 -- # decimal 1 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@353 -- # local d=1 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@355 -- # echo 1 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@365 -- # ver1[v]=1 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@366 -- # decimal 2 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@353 -- # local d=2 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@355 -- # echo 2 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@366 -- # ver2[v]=2 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@368 -- # return 0 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:10:45.451 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:45.451 --rc genhtml_branch_coverage=1 00:10:45.451 --rc genhtml_function_coverage=1 00:10:45.451 --rc genhtml_legend=1 00:10:45.451 --rc geninfo_all_blocks=1 00:10:45.451 --rc geninfo_unexecuted_blocks=1 00:10:45.451 00:10:45.451 ' 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:10:45.451 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:45.451 --rc genhtml_branch_coverage=1 00:10:45.451 --rc genhtml_function_coverage=1 00:10:45.451 --rc genhtml_legend=1 00:10:45.451 --rc geninfo_all_blocks=1 00:10:45.451 --rc geninfo_unexecuted_blocks=1 00:10:45.451 00:10:45.451 ' 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:10:45.451 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:45.451 --rc genhtml_branch_coverage=1 00:10:45.451 --rc genhtml_function_coverage=1 00:10:45.451 --rc genhtml_legend=1 00:10:45.451 --rc geninfo_all_blocks=1 00:10:45.451 --rc geninfo_unexecuted_blocks=1 00:10:45.451 00:10:45.451 ' 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:10:45.451 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:45.451 --rc genhtml_branch_coverage=1 00:10:45.451 --rc genhtml_function_coverage=1 00:10:45.451 --rc genhtml_legend=1 00:10:45.451 --rc geninfo_all_blocks=1 00:10:45.451 --rc geninfo_unexecuted_blocks=1 00:10:45.451 00:10:45.451 ' 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@7 -- # uname -s 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@15 -- # shopt -s extglob 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@5 -- # export PATH 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@51 -- # : 0 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:45.451 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:10:45.451 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@55 -- # have_pci_nics=0 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@474 -- # prepare_net_devs 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@436 -- # local -g is_hw=no 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@438 -- # remove_spdk_ns 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@458 -- # nvmf_veth_init 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:10:45.452 Cannot find device "nvmf_init_br" 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@162 -- # true 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:10:45.452 Cannot find device "nvmf_init_br2" 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@163 -- # true 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:10:45.452 Cannot find device "nvmf_tgt_br" 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@164 -- # true 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:10:45.452 Cannot find device "nvmf_tgt_br2" 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@165 -- # true 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:10:45.452 Cannot find device "nvmf_init_br" 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@166 -- # true 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:10:45.452 Cannot find device "nvmf_init_br2" 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@167 -- # true 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:10:45.452 Cannot find device "nvmf_tgt_br" 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@168 -- # true 00:10:45.452 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:10:45.711 Cannot find device "nvmf_tgt_br2" 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@169 -- # true 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:10:45.711 Cannot find device "nvmf_br" 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@170 -- # true 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:10:45.711 Cannot find device "nvmf_init_if" 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@171 -- # true 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:10:45.711 Cannot find device "nvmf_init_if2" 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@172 -- # true 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:45.711 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@173 -- # true 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:45.711 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@174 -- # true 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:10:45.711 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:10:45.712 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:10:45.712 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:10:45.712 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:10:45.970 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:10:45.970 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.063 ms 00:10:45.970 00:10:45.970 --- 10.0.0.3 ping statistics --- 00:10:45.970 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:45.970 rtt min/avg/max/mdev = 0.063/0.063/0.063/0.000 ms 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:10:45.970 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:10:45.970 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.061 ms 00:10:45.970 00:10:45.970 --- 10.0.0.4 ping statistics --- 00:10:45.970 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:45.970 rtt min/avg/max/mdev = 0.061/0.061/0.061/0.000 ms 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:10:45.970 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:10:45.970 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.050 ms 00:10:45.970 00:10:45.970 --- 10.0.0.1 ping statistics --- 00:10:45.970 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:45.970 rtt min/avg/max/mdev = 0.050/0.050/0.050/0.000 ms 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:10:45.970 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:10:45.970 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.062 ms 00:10:45.970 00:10:45.970 --- 10.0.0.2 ping statistics --- 00:10:45.970 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:45.970 rtt min/avg/max/mdev = 0.062/0.062/0.062/0.000 ms 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@459 -- # return 0 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@724 -- # xtrace_disable 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@507 -- # nvmfpid=64264 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@508 -- # waitforlisten 64264 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@831 -- # '[' -z 64264 ']' 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:45.970 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:45.970 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:10:45.970 [2024-10-07 11:21:27.546844] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:10:45.970 [2024-10-07 11:21:27.546942] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:45.970 [2024-10-07 11:21:27.679890] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:10:46.229 [2024-10-07 11:21:27.767681] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:46.229 [2024-10-07 11:21:27.767766] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:46.229 [2024-10-07 11:21:27.767790] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:46.229 [2024-10-07 11:21:27.767805] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:46.229 [2024-10-07 11:21:27.767817] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:46.229 [2024-10-07 11:21:27.768889] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:10:46.229 [2024-10-07 11:21:27.769010] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:10:46.229 [2024-10-07 11:21:27.769106] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:10:46.229 [2024-10-07 11:21:27.769094] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:10:46.229 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:46.229 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@864 -- # return 0 00:10:46.229 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:10:46.229 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@730 -- # xtrace_disable 00:10:46.229 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:10:46.229 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:46.229 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:10:46.229 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:46.229 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:10:46.229 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:46.229 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:10:46.229 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:46.229 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:10:46.229 [2024-10-07 11:21:27.928970] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:10:46.229 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:46.229 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:10:46.229 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:46.229 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:10:46.229 [2024-10-07 11:21:27.940501] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:10:46.487 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:46.487 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:10:46.487 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:46.487 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:10:46.487 Malloc0 00:10:46.487 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:46.487 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:10:46.487 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:46.487 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:10:46.487 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:46.487 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:10:46.487 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:46.487 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:10:46.487 [2024-10-07 11:21:28.005799] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@28 -- # WRITE_PID=64287 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@30 -- # READ_PID=64289 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # config=() 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # local subsystem config 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:10:46.487 { 00:10:46.487 "params": { 00:10:46.487 "name": "Nvme$subsystem", 00:10:46.487 "trtype": "$TEST_TRANSPORT", 00:10:46.487 "traddr": "$NVMF_FIRST_TARGET_IP", 00:10:46.487 "adrfam": "ipv4", 00:10:46.487 "trsvcid": "$NVMF_PORT", 00:10:46.487 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:10:46.487 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:10:46.487 "hdgst": ${hdgst:-false}, 00:10:46.487 "ddgst": ${ddgst:-false} 00:10:46.487 }, 00:10:46.487 "method": "bdev_nvme_attach_controller" 00:10:46.487 } 00:10:46.487 EOF 00:10:46.487 )") 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@29 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=64291 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # config=() 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # local subsystem config 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:10:46.487 { 00:10:46.487 "params": { 00:10:46.487 "name": "Nvme$subsystem", 00:10:46.487 "trtype": "$TEST_TRANSPORT", 00:10:46.487 "traddr": "$NVMF_FIRST_TARGET_IP", 00:10:46.487 "adrfam": "ipv4", 00:10:46.487 "trsvcid": "$NVMF_PORT", 00:10:46.487 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:10:46.487 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:10:46.487 "hdgst": ${hdgst:-false}, 00:10:46.487 "ddgst": ${ddgst:-false} 00:10:46.487 }, 00:10:46.487 "method": "bdev_nvme_attach_controller" 00:10:46.487 } 00:10:46.487 EOF 00:10:46.487 )") 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@31 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # cat 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@33 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # cat 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # config=() 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # local subsystem config 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:10:46.487 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:10:46.487 { 00:10:46.487 "params": { 00:10:46.487 "name": "Nvme$subsystem", 00:10:46.487 "trtype": "$TEST_TRANSPORT", 00:10:46.487 "traddr": "$NVMF_FIRST_TARGET_IP", 00:10:46.488 "adrfam": "ipv4", 00:10:46.488 "trsvcid": "$NVMF_PORT", 00:10:46.488 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:10:46.488 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:10:46.488 "hdgst": ${hdgst:-false}, 00:10:46.488 "ddgst": ${ddgst:-false} 00:10:46.488 }, 00:10:46.488 "method": "bdev_nvme_attach_controller" 00:10:46.488 } 00:10:46.488 EOF 00:10:46.488 )") 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@582 -- # jq . 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # config=() 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # local subsystem config 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:10:46.488 { 00:10:46.488 "params": { 00:10:46.488 "name": "Nvme$subsystem", 00:10:46.488 "trtype": "$TEST_TRANSPORT", 00:10:46.488 "traddr": "$NVMF_FIRST_TARGET_IP", 00:10:46.488 "adrfam": "ipv4", 00:10:46.488 "trsvcid": "$NVMF_PORT", 00:10:46.488 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:10:46.488 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:10:46.488 "hdgst": ${hdgst:-false}, 00:10:46.488 "ddgst": ${ddgst:-false} 00:10:46.488 }, 00:10:46.488 "method": "bdev_nvme_attach_controller" 00:10:46.488 } 00:10:46.488 EOF 00:10:46.488 )") 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # cat 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@583 -- # IFS=, 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:10:46.488 "params": { 00:10:46.488 "name": "Nvme1", 00:10:46.488 "trtype": "tcp", 00:10:46.488 "traddr": "10.0.0.3", 00:10:46.488 "adrfam": "ipv4", 00:10:46.488 "trsvcid": "4420", 00:10:46.488 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:10:46.488 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:10:46.488 "hdgst": false, 00:10:46.488 "ddgst": false 00:10:46.488 }, 00:10:46.488 "method": "bdev_nvme_attach_controller" 00:10:46.488 }' 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@582 -- # jq . 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # cat 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=64294 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@35 -- # sync 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@583 -- # IFS=, 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:10:46.488 "params": { 00:10:46.488 "name": "Nvme1", 00:10:46.488 "trtype": "tcp", 00:10:46.488 "traddr": "10.0.0.3", 00:10:46.488 "adrfam": "ipv4", 00:10:46.488 "trsvcid": "4420", 00:10:46.488 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:10:46.488 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:10:46.488 "hdgst": false, 00:10:46.488 "ddgst": false 00:10:46.488 }, 00:10:46.488 "method": "bdev_nvme_attach_controller" 00:10:46.488 }' 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@582 -- # jq . 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@582 -- # jq . 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@583 -- # IFS=, 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:10:46.488 "params": { 00:10:46.488 "name": "Nvme1", 00:10:46.488 "trtype": "tcp", 00:10:46.488 "traddr": "10.0.0.3", 00:10:46.488 "adrfam": "ipv4", 00:10:46.488 "trsvcid": "4420", 00:10:46.488 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:10:46.488 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:10:46.488 "hdgst": false, 00:10:46.488 "ddgst": false 00:10:46.488 }, 00:10:46.488 "method": "bdev_nvme_attach_controller" 00:10:46.488 }' 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@583 -- # IFS=, 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:10:46.488 "params": { 00:10:46.488 "name": "Nvme1", 00:10:46.488 "trtype": "tcp", 00:10:46.488 "traddr": "10.0.0.3", 00:10:46.488 "adrfam": "ipv4", 00:10:46.488 "trsvcid": "4420", 00:10:46.488 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:10:46.488 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:10:46.488 "hdgst": false, 00:10:46.488 "ddgst": false 00:10:46.488 }, 00:10:46.488 "method": "bdev_nvme_attach_controller" 00:10:46.488 }' 00:10:46.488 [2024-10-07 11:21:28.078067] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:10:46.488 [2024-10-07 11:21:28.078176] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:10:46.488 [2024-10-07 11:21:28.085537] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:10:46.488 [2024-10-07 11:21:28.085819] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:10:46.488 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@37 -- # wait 64287 00:10:46.488 [2024-10-07 11:21:28.101818] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:10:46.488 [2024-10-07 11:21:28.101923] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:10:46.488 [2024-10-07 11:21:28.109754] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:10:46.488 [2024-10-07 11:21:28.109863] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:10:46.746 [2024-10-07 11:21:28.256782] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:10:46.746 [2024-10-07 11:21:28.304991] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:10:46.746 [2024-10-07 11:21:28.332098] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:10:46.746 [2024-10-07 11:21:28.336304] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:10:46.746 [2024-10-07 11:21:28.357842] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:10:46.746 [2024-10-07 11:21:28.403149] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 7 00:10:46.746 [2024-10-07 11:21:28.404753] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:10:46.746 [2024-10-07 11:21:28.429294] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 5 00:10:46.746 [2024-10-07 11:21:28.442241] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:10:47.005 Running I/O for 1 seconds... 00:10:47.005 [2024-10-07 11:21:28.465734] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:10:47.005 [2024-10-07 11:21:28.478299] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 6 00:10:47.005 [2024-10-07 11:21:28.513930] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:10:47.005 Running I/O for 1 seconds... 00:10:47.005 Running I/O for 1 seconds... 00:10:47.005 Running I/O for 1 seconds... 00:10:47.939 4658.00 IOPS, 18.20 MiB/s 00:10:47.939 Latency(us) 00:10:47.939 [2024-10-07T11:21:29.650Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:10:47.939 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:10:47.939 Nvme1n1 : 1.03 4654.83 18.18 0.00 0.00 27002.56 4379.00 56718.43 00:10:47.939 [2024-10-07T11:21:29.650Z] =================================================================================================================== 00:10:47.939 [2024-10-07T11:21:29.650Z] Total : 4654.83 18.18 0.00 0.00 27002.56 4379.00 56718.43 00:10:47.939 4724.00 IOPS, 18.45 MiB/s 00:10:47.939 Latency(us) 00:10:47.939 [2024-10-07T11:21:29.650Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:10:47.939 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:10:47.939 Nvme1n1 : 1.02 4866.32 19.01 0.00 0.00 26191.84 8340.95 62914.56 00:10:47.939 [2024-10-07T11:21:29.650Z] =================================================================================================================== 00:10:47.939 [2024-10-07T11:21:29.650Z] Total : 4866.32 19.01 0.00 0.00 26191.84 8340.95 62914.56 00:10:48.197 6230.00 IOPS, 24.34 MiB/s 00:10:48.197 Latency(us) 00:10:48.197 [2024-10-07T11:21:29.908Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:10:48.197 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:10:48.197 Nvme1n1 : 1.01 6271.93 24.50 0.00 0.00 20254.89 8043.05 29193.31 00:10:48.197 [2024-10-07T11:21:29.908Z] =================================================================================================================== 00:10:48.197 [2024-10-07T11:21:29.908Z] Total : 6271.93 24.50 0.00 0.00 20254.89 8043.05 29193.31 00:10:48.197 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@38 -- # wait 64289 00:10:48.197 151944.00 IOPS, 593.53 MiB/s 00:10:48.197 Latency(us) 00:10:48.197 [2024-10-07T11:21:29.908Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:10:48.197 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:10:48.197 Nvme1n1 : 1.00 151611.18 592.23 0.00 0.00 839.88 458.01 5064.15 00:10:48.197 [2024-10-07T11:21:29.908Z] =================================================================================================================== 00:10:48.197 [2024-10-07T11:21:29.908Z] Total : 151611.18 592.23 0.00 0.00 839.88 458.01 5064.15 00:10:48.197 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@39 -- # wait 64291 00:10:48.197 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@40 -- # wait 64294 00:10:48.197 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:48.197 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:48.197 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:10:48.197 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:48.197 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:10:48.197 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:10:48.197 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@514 -- # nvmfcleanup 00:10:48.197 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@121 -- # sync 00:10:48.456 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:10:48.456 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@124 -- # set +e 00:10:48.456 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@125 -- # for i in {1..20} 00:10:48.456 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:10:48.456 rmmod nvme_tcp 00:10:48.456 rmmod nvme_fabrics 00:10:48.456 rmmod nvme_keyring 00:10:48.456 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:10:48.456 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@128 -- # set -e 00:10:48.456 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@129 -- # return 0 00:10:48.456 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@515 -- # '[' -n 64264 ']' 00:10:48.456 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@516 -- # killprocess 64264 00:10:48.456 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@950 -- # '[' -z 64264 ']' 00:10:48.456 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@954 -- # kill -0 64264 00:10:48.456 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@955 -- # uname 00:10:48.456 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:10:48.456 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 64264 00:10:48.456 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:10:48.456 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:10:48.456 killing process with pid 64264 00:10:48.456 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@968 -- # echo 'killing process with pid 64264' 00:10:48.456 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@969 -- # kill 64264 00:10:48.456 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@974 -- # wait 64264 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@297 -- # iptr 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@789 -- # iptables-save 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@789 -- # iptables-restore 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@246 -- # remove_spdk_ns 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:48.715 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@300 -- # return 0 00:10:48.973 00:10:48.973 real 0m3.599s 00:10:48.973 user 0m13.998s 00:10:48.973 sys 0m2.400s 00:10:48.973 ************************************ 00:10:48.973 END TEST nvmf_bdev_io_wait 00:10:48.973 ************************************ 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@30 -- # run_test nvmf_queue_depth /home/vagrant/spdk_repo/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:10:48.973 ************************************ 00:10:48.973 START TEST nvmf_queue_depth 00:10:48.973 ************************************ 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:10:48.973 * Looking for test storage... 00:10:48.973 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1681 -- # lcov --version 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@333 -- # local ver1 ver1_l 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@334 -- # local ver2 ver2_l 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@336 -- # IFS=.-: 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@336 -- # read -ra ver1 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@337 -- # IFS=.-: 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@337 -- # read -ra ver2 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@338 -- # local 'op=<' 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@340 -- # ver1_l=2 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@341 -- # ver2_l=1 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@344 -- # case "$op" in 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@345 -- # : 1 00:10:48.973 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@364 -- # (( v = 0 )) 00:10:48.974 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:10:48.974 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@365 -- # decimal 1 00:10:48.974 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@353 -- # local d=1 00:10:48.974 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:10:48.974 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@355 -- # echo 1 00:10:48.974 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@365 -- # ver1[v]=1 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@366 -- # decimal 2 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@353 -- # local d=2 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@355 -- # echo 2 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@366 -- # ver2[v]=2 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@368 -- # return 0 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:10:49.233 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:49.233 --rc genhtml_branch_coverage=1 00:10:49.233 --rc genhtml_function_coverage=1 00:10:49.233 --rc genhtml_legend=1 00:10:49.233 --rc geninfo_all_blocks=1 00:10:49.233 --rc geninfo_unexecuted_blocks=1 00:10:49.233 00:10:49.233 ' 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:10:49.233 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:49.233 --rc genhtml_branch_coverage=1 00:10:49.233 --rc genhtml_function_coverage=1 00:10:49.233 --rc genhtml_legend=1 00:10:49.233 --rc geninfo_all_blocks=1 00:10:49.233 --rc geninfo_unexecuted_blocks=1 00:10:49.233 00:10:49.233 ' 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:10:49.233 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:49.233 --rc genhtml_branch_coverage=1 00:10:49.233 --rc genhtml_function_coverage=1 00:10:49.233 --rc genhtml_legend=1 00:10:49.233 --rc geninfo_all_blocks=1 00:10:49.233 --rc geninfo_unexecuted_blocks=1 00:10:49.233 00:10:49.233 ' 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:10:49.233 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:49.233 --rc genhtml_branch_coverage=1 00:10:49.233 --rc genhtml_function_coverage=1 00:10:49.233 --rc genhtml_legend=1 00:10:49.233 --rc geninfo_all_blocks=1 00:10:49.233 --rc geninfo_unexecuted_blocks=1 00:10:49.233 00:10:49.233 ' 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@12 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@7 -- # uname -s 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@15 -- # shopt -s extglob 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@5 -- # export PATH 00:10:49.233 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@51 -- # : 0 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:10:49.234 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@55 -- # have_pci_nics=0 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@19 -- # nvmftestinit 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@474 -- # prepare_net_devs 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@436 -- # local -g is_hw=no 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@438 -- # remove_spdk_ns 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@458 -- # nvmf_veth_init 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:10:49.234 Cannot find device "nvmf_init_br" 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@162 -- # true 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:10:49.234 Cannot find device "nvmf_init_br2" 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@163 -- # true 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:10:49.234 Cannot find device "nvmf_tgt_br" 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@164 -- # true 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:10:49.234 Cannot find device "nvmf_tgt_br2" 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@165 -- # true 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:10:49.234 Cannot find device "nvmf_init_br" 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@166 -- # true 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:10:49.234 Cannot find device "nvmf_init_br2" 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@167 -- # true 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:10:49.234 Cannot find device "nvmf_tgt_br" 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@168 -- # true 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:10:49.234 Cannot find device "nvmf_tgt_br2" 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@169 -- # true 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:10:49.234 Cannot find device "nvmf_br" 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@170 -- # true 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:10:49.234 Cannot find device "nvmf_init_if" 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@171 -- # true 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:10:49.234 Cannot find device "nvmf_init_if2" 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@172 -- # true 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:49.234 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@173 -- # true 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:49.234 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@174 -- # true 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:10:49.234 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:10:49.493 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:10:49.493 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:10:49.493 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:10:49.493 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:10:49.493 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:10:49.493 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:10:49.493 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:10:49.493 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:10:49.493 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:10:49.493 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:10:49.493 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:10:49.493 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:10:49.493 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:10:49.493 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:10:49.493 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:10:49.493 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:10:49.493 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:10:49.493 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:10:49.494 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:10:49.494 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.101 ms 00:10:49.494 00:10:49.494 --- 10.0.0.3 ping statistics --- 00:10:49.494 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:49.494 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:10:49.494 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:10:49.494 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.077 ms 00:10:49.494 00:10:49.494 --- 10.0.0.4 ping statistics --- 00:10:49.494 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:49.494 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:10:49.494 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:10:49.494 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.032 ms 00:10:49.494 00:10:49.494 --- 10.0.0.1 ping statistics --- 00:10:49.494 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:49.494 rtt min/avg/max/mdev = 0.032/0.032/0.032/0.000 ms 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:10:49.494 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:10:49.494 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.094 ms 00:10:49.494 00:10:49.494 --- 10.0.0.2 ping statistics --- 00:10:49.494 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:49.494 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@459 -- # return 0 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@724 -- # xtrace_disable 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@507 -- # nvmfpid=64552 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@508 -- # waitforlisten 64552 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@831 -- # '[' -z 64552 ']' 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:49.494 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:49.494 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:10:49.752 [2024-10-07 11:21:31.210928] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:10:49.752 [2024-10-07 11:21:31.211068] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:49.752 [2024-10-07 11:21:31.360100] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:10:49.752 [2024-10-07 11:21:31.417519] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:49.752 [2024-10-07 11:21:31.417587] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:49.752 [2024-10-07 11:21:31.417599] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:49.752 [2024-10-07 11:21:31.417607] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:49.752 [2024-10-07 11:21:31.417615] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:49.752 [2024-10-07 11:21:31.417933] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:10:49.752 [2024-10-07 11:21:31.448559] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@864 -- # return 0 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@730 -- # xtrace_disable 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:10:50.685 [2024-10-07 11:21:32.272091] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:10:50.685 Malloc0 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:10:50.685 [2024-10-07 11:21:32.325923] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:10:50.685 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@30 -- # bdevperf_pid=64584 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:10:50.685 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@29 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:10:50.686 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@33 -- # waitforlisten 64584 /var/tmp/bdevperf.sock 00:10:50.686 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@831 -- # '[' -z 64584 ']' 00:10:50.686 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:10:50.686 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:50.686 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:10:50.686 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:50.686 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:10:50.686 [2024-10-07 11:21:32.395570] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:10:50.686 [2024-10-07 11:21:32.395982] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid64584 ] 00:10:50.944 [2024-10-07 11:21:32.534832] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:10:50.944 [2024-10-07 11:21:32.602120] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:10:50.944 [2024-10-07 11:21:32.632846] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:10:51.202 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:51.202 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@864 -- # return 0 00:10:51.202 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:10:51.202 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:51.202 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:10:51.202 NVMe0n1 00:10:51.202 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:51.202 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@35 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:10:51.460 Running I/O for 10 seconds... 00:10:53.328 5822.00 IOPS, 22.74 MiB/s [2024-10-07T11:21:35.973Z] 6151.00 IOPS, 24.03 MiB/s [2024-10-07T11:21:36.924Z] 6508.67 IOPS, 25.42 MiB/s [2024-10-07T11:21:38.298Z] 6822.00 IOPS, 26.65 MiB/s [2024-10-07T11:21:39.231Z] 6981.20 IOPS, 27.27 MiB/s [2024-10-07T11:21:40.166Z] 7108.33 IOPS, 27.77 MiB/s [2024-10-07T11:21:41.101Z] 7195.57 IOPS, 28.11 MiB/s [2024-10-07T11:21:42.036Z] 7336.75 IOPS, 28.66 MiB/s [2024-10-07T11:21:42.972Z] 7436.67 IOPS, 29.05 MiB/s [2024-10-07T11:21:43.232Z] 7454.00 IOPS, 29.12 MiB/s 00:11:01.521 Latency(us) 00:11:01.521 [2024-10-07T11:21:43.232Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:11:01.521 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:11:01.521 Verification LBA range: start 0x0 length 0x4000 00:11:01.521 NVMe0n1 : 10.10 7481.67 29.23 0.00 0.00 136103.54 28001.75 155379.90 00:11:01.521 [2024-10-07T11:21:43.232Z] =================================================================================================================== 00:11:01.521 [2024-10-07T11:21:43.232Z] Total : 7481.67 29.23 0.00 0.00 136103.54 28001.75 155379.90 00:11:01.521 { 00:11:01.521 "results": [ 00:11:01.521 { 00:11:01.521 "job": "NVMe0n1", 00:11:01.522 "core_mask": "0x1", 00:11:01.522 "workload": "verify", 00:11:01.522 "status": "finished", 00:11:01.522 "verify_range": { 00:11:01.522 "start": 0, 00:11:01.522 "length": 16384 00:11:01.522 }, 00:11:01.522 "queue_depth": 1024, 00:11:01.522 "io_size": 4096, 00:11:01.522 "runtime": 10.099889, 00:11:01.522 "iops": 7481.666382670146, 00:11:01.522 "mibps": 29.225259307305258, 00:11:01.522 "io_failed": 0, 00:11:01.522 "io_timeout": 0, 00:11:01.522 "avg_latency_us": 136103.53766690247, 00:11:01.522 "min_latency_us": 28001.745454545453, 00:11:01.522 "max_latency_us": 155379.8981818182 00:11:01.522 } 00:11:01.522 ], 00:11:01.522 "core_count": 1 00:11:01.522 } 00:11:01.522 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@39 -- # killprocess 64584 00:11:01.522 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@950 -- # '[' -z 64584 ']' 00:11:01.522 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@954 -- # kill -0 64584 00:11:01.522 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@955 -- # uname 00:11:01.522 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:11:01.522 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 64584 00:11:01.522 killing process with pid 64584 00:11:01.522 Received shutdown signal, test time was about 10.000000 seconds 00:11:01.522 00:11:01.522 Latency(us) 00:11:01.522 [2024-10-07T11:21:43.233Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:11:01.522 [2024-10-07T11:21:43.233Z] =================================================================================================================== 00:11:01.522 [2024-10-07T11:21:43.233Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:11:01.522 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:11:01.522 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:11:01.522 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@968 -- # echo 'killing process with pid 64584' 00:11:01.522 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@969 -- # kill 64584 00:11:01.522 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@974 -- # wait 64584 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@43 -- # nvmftestfini 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@514 -- # nvmfcleanup 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@121 -- # sync 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@124 -- # set +e 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@125 -- # for i in {1..20} 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:11:01.803 rmmod nvme_tcp 00:11:01.803 rmmod nvme_fabrics 00:11:01.803 rmmod nvme_keyring 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@128 -- # set -e 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@129 -- # return 0 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@515 -- # '[' -n 64552 ']' 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@516 -- # killprocess 64552 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@950 -- # '[' -z 64552 ']' 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@954 -- # kill -0 64552 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@955 -- # uname 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 64552 00:11:01.803 killing process with pid 64552 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@968 -- # echo 'killing process with pid 64552' 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@969 -- # kill 64552 00:11:01.803 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@974 -- # wait 64552 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@297 -- # iptr 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@789 -- # iptables-save 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@789 -- # iptables-restore 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@246 -- # remove_spdk_ns 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@300 -- # return 0 00:11:02.073 00:11:02.073 real 0m13.280s 00:11:02.073 user 0m22.380s 00:11:02.073 sys 0m2.207s 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1126 -- # xtrace_disable 00:11:02.073 ************************************ 00:11:02.073 END TEST nvmf_queue_depth 00:11:02.073 ************************************ 00:11:02.073 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@31 -- # run_test nvmf_target_multipath /home/vagrant/spdk_repo/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:11:02.333 ************************************ 00:11:02.333 START TEST nvmf_target_multipath 00:11:02.333 ************************************ 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:11:02.333 * Looking for test storage... 00:11:02.333 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1681 -- # lcov --version 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@333 -- # local ver1 ver1_l 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@334 -- # local ver2 ver2_l 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@336 -- # IFS=.-: 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@336 -- # read -ra ver1 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@337 -- # IFS=.-: 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@337 -- # read -ra ver2 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@338 -- # local 'op=<' 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@340 -- # ver1_l=2 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@341 -- # ver2_l=1 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@344 -- # case "$op" in 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@345 -- # : 1 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@364 -- # (( v = 0 )) 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@365 -- # decimal 1 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@353 -- # local d=1 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@355 -- # echo 1 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@365 -- # ver1[v]=1 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@366 -- # decimal 2 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@353 -- # local d=2 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@355 -- # echo 2 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@366 -- # ver2[v]=2 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@368 -- # return 0 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:11:02.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:02.333 --rc genhtml_branch_coverage=1 00:11:02.333 --rc genhtml_function_coverage=1 00:11:02.333 --rc genhtml_legend=1 00:11:02.333 --rc geninfo_all_blocks=1 00:11:02.333 --rc geninfo_unexecuted_blocks=1 00:11:02.333 00:11:02.333 ' 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:11:02.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:02.333 --rc genhtml_branch_coverage=1 00:11:02.333 --rc genhtml_function_coverage=1 00:11:02.333 --rc genhtml_legend=1 00:11:02.333 --rc geninfo_all_blocks=1 00:11:02.333 --rc geninfo_unexecuted_blocks=1 00:11:02.333 00:11:02.333 ' 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:11:02.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:02.333 --rc genhtml_branch_coverage=1 00:11:02.333 --rc genhtml_function_coverage=1 00:11:02.333 --rc genhtml_legend=1 00:11:02.333 --rc geninfo_all_blocks=1 00:11:02.333 --rc geninfo_unexecuted_blocks=1 00:11:02.333 00:11:02.333 ' 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:11:02.333 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:02.333 --rc genhtml_branch_coverage=1 00:11:02.333 --rc genhtml_function_coverage=1 00:11:02.333 --rc genhtml_legend=1 00:11:02.333 --rc geninfo_all_blocks=1 00:11:02.333 --rc geninfo_unexecuted_blocks=1 00:11:02.333 00:11:02.333 ' 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@7 -- # uname -s 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:02.333 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@15 -- # shopt -s extglob 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@5 -- # export PATH 00:11:02.333 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@51 -- # : 0 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:11:02.334 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@55 -- # have_pci_nics=0 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@15 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@43 -- # nvmftestinit 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@474 -- # prepare_net_devs 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@436 -- # local -g is_hw=no 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@438 -- # remove_spdk_ns 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@458 -- # nvmf_veth_init 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:11:02.334 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:11:02.593 Cannot find device "nvmf_init_br" 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@162 -- # true 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:11:02.593 Cannot find device "nvmf_init_br2" 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@163 -- # true 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:11:02.593 Cannot find device "nvmf_tgt_br" 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@164 -- # true 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:11:02.593 Cannot find device "nvmf_tgt_br2" 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@165 -- # true 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:11:02.593 Cannot find device "nvmf_init_br" 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@166 -- # true 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:11:02.593 Cannot find device "nvmf_init_br2" 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@167 -- # true 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:11:02.593 Cannot find device "nvmf_tgt_br" 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@168 -- # true 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:11:02.593 Cannot find device "nvmf_tgt_br2" 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@169 -- # true 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:11:02.593 Cannot find device "nvmf_br" 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@170 -- # true 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:11:02.593 Cannot find device "nvmf_init_if" 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@171 -- # true 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:11:02.593 Cannot find device "nvmf_init_if2" 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@172 -- # true 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:02.593 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@173 -- # true 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:02.593 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@174 -- # true 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:11:02.593 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:11:02.852 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:11:02.852 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:11:02.852 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:11:02.852 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:11:02.853 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:11:02.853 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.061 ms 00:11:02.853 00:11:02.853 --- 10.0.0.3 ping statistics --- 00:11:02.853 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:02.853 rtt min/avg/max/mdev = 0.061/0.061/0.061/0.000 ms 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:11:02.853 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:11:02.853 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.040 ms 00:11:02.853 00:11:02.853 --- 10.0.0.4 ping statistics --- 00:11:02.853 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:02.853 rtt min/avg/max/mdev = 0.040/0.040/0.040/0.000 ms 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:11:02.853 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:02.853 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.031 ms 00:11:02.853 00:11:02.853 --- 10.0.0.1 ping statistics --- 00:11:02.853 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:02.853 rtt min/avg/max/mdev = 0.031/0.031/0.031/0.000 ms 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:11:02.853 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:02.853 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.045 ms 00:11:02.853 00:11:02.853 --- 10.0.0.2 ping statistics --- 00:11:02.853 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:02.853 rtt min/avg/max/mdev = 0.045/0.045/0.045/0.000 ms 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@459 -- # return 0 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@45 -- # '[' -z 10.0.0.4 ']' 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@51 -- # '[' tcp '!=' tcp ']' 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@57 -- # nvmfappstart -m 0xF 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@724 -- # xtrace_disable 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@10 -- # set +x 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@507 -- # nvmfpid=64950 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@508 -- # waitforlisten 64950 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@831 -- # '[' -z 64950 ']' 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:02.853 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:02.853 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@10 -- # set +x 00:11:02.853 [2024-10-07 11:21:44.478624] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:11:02.853 [2024-10-07 11:21:44.478946] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:03.112 [2024-10-07 11:21:44.616480] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:03.112 [2024-10-07 11:21:44.691841] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:03.112 [2024-10-07 11:21:44.691891] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:03.112 [2024-10-07 11:21:44.691904] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:03.112 [2024-10-07 11:21:44.691912] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:03.112 [2024-10-07 11:21:44.691919] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:03.112 [2024-10-07 11:21:44.692695] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:11:03.112 [2024-10-07 11:21:44.692732] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:11:03.112 [2024-10-07 11:21:44.694073] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:11:03.112 [2024-10-07 11:21:44.694121] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:11:03.112 [2024-10-07 11:21:44.723619] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:11:04.048 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:04.048 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@864 -- # return 0 00:11:04.048 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:11:04.048 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@730 -- # xtrace_disable 00:11:04.048 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@10 -- # set +x 00:11:04.048 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:04.048 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:11:04.306 [2024-10-07 11:21:45.807479] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:04.306 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@61 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:11:04.563 Malloc0 00:11:04.564 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@62 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -r 00:11:04.822 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:11:05.081 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@64 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:11:05.339 [2024-10-07 11:21:47.031591] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:05.598 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@65 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.4 -s 4420 00:11:05.598 [2024-10-07 11:21:47.295834] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.4 port 4420 *** 00:11:05.858 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@67 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid=801d435b-e3d4-4ca3-aead-ebb283315d5b -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 -g -G 00:11:05.858 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@68 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid=801d435b-e3d4-4ca3-aead-ebb283315d5b -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.4 -s 4420 -g -G 00:11:06.117 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@69 -- # waitforserial SPDKISFASTANDAWESOME 00:11:06.117 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1198 -- # local i=0 00:11:06.117 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:11:06.117 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:11:06.117 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1205 -- # sleep 2 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1208 -- # return 0 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@72 -- # get_subsystem nqn.2016-06.io.spdk:cnode1 SPDKISFASTANDAWESOME 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@34 -- # local nqn=nqn.2016-06.io.spdk:cnode1 serial=SPDKISFASTANDAWESOME s 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@36 -- # for s in /sys/class/nvme-subsystem/* 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@37 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@37 -- # [[ SPDKISFASTANDAWESOME == \S\P\D\K\I\S\F\A\S\T\A\N\D\A\W\E\S\O\M\E ]] 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@38 -- # echo nvme-subsys0 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@38 -- # return 0 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@72 -- # subsystem=nvme-subsys0 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@73 -- # paths=(/sys/class/nvme-subsystem/$subsystem/nvme*/nvme*c*) 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@74 -- # paths=("${paths[@]##*/}") 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@76 -- # (( 2 == 2 )) 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@78 -- # p0=nvme0c0n1 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@79 -- # p1=nvme0c1n1 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@81 -- # check_ana_state nvme0c0n1 optimized 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c0n1 ana_state=optimized 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c0n1/ana_state 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c0n1/ana_state ]] 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ optimized != \o\p\t\i\m\i\z\e\d ]] 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@82 -- # check_ana_state nvme0c1n1 optimized 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c1n1 ana_state=optimized 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c1n1/ana_state 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ optimized != \o\p\t\i\m\i\z\e\d ]] 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@85 -- # echo numa 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@88 -- # fio_pid=65045 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@87 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randrw -r 6 -v 00:11:08.016 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@90 -- # sleep 1 00:11:08.016 [global] 00:11:08.016 thread=1 00:11:08.016 invalidate=1 00:11:08.016 rw=randrw 00:11:08.016 time_based=1 00:11:08.016 runtime=6 00:11:08.016 ioengine=libaio 00:11:08.016 direct=1 00:11:08.016 bs=4096 00:11:08.016 iodepth=128 00:11:08.016 norandommap=0 00:11:08.016 numjobs=1 00:11:08.016 00:11:08.016 verify_dump=1 00:11:08.016 verify_backlog=512 00:11:08.016 verify_state_save=0 00:11:08.016 do_verify=1 00:11:08.016 verify=crc32c-intel 00:11:08.016 [job0] 00:11:08.016 filename=/dev/nvme0n1 00:11:08.016 Could not set queue depth (nvme0n1) 00:11:08.274 job0: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:11:08.274 fio-3.35 00:11:08.274 Starting 1 thread 00:11:09.209 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@92 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -n inaccessible 00:11:09.466 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@93 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.4 -s 4420 -n non_optimized 00:11:09.724 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@95 -- # check_ana_state nvme0c0n1 inaccessible 00:11:09.724 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c0n1 ana_state=inaccessible 00:11:09.724 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:11:09.724 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c0n1/ana_state 00:11:09.724 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c0n1/ana_state ]] 00:11:09.724 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ inaccessible != \i\n\a\c\c\e\s\s\i\b\l\e ]] 00:11:09.724 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@96 -- # check_ana_state nvme0c1n1 non-optimized 00:11:09.724 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c1n1 ana_state=non-optimized 00:11:09.724 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:11:09.724 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c1n1/ana_state 00:11:09.724 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:11:09.724 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ non-optimized != \n\o\n\-\o\p\t\i\m\i\z\e\d ]] 00:11:09.724 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@98 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -n non_optimized 00:11:09.982 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@99 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.4 -s 4420 -n inaccessible 00:11:10.239 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@101 -- # check_ana_state nvme0c0n1 non-optimized 00:11:10.239 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c0n1 ana_state=non-optimized 00:11:10.239 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:11:10.239 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c0n1/ana_state 00:11:10.239 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c0n1/ana_state ]] 00:11:10.239 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ non-optimized != \n\o\n\-\o\p\t\i\m\i\z\e\d ]] 00:11:10.239 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@102 -- # check_ana_state nvme0c1n1 inaccessible 00:11:10.239 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c1n1 ana_state=inaccessible 00:11:10.239 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:11:10.239 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c1n1/ana_state 00:11:10.240 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:11:10.240 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ inaccessible != \i\n\a\c\c\e\s\s\i\b\l\e ]] 00:11:10.240 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@104 -- # wait 65045 00:11:14.426 00:11:14.426 job0: (groupid=0, jobs=1): err= 0: pid=65072: Mon Oct 7 11:21:55 2024 00:11:14.426 read: IOPS=10.1k, BW=39.4MiB/s (41.3MB/s)(237MiB/6005msec) 00:11:14.426 slat (usec): min=6, max=6268, avg=57.34, stdev=231.10 00:11:14.426 clat (usec): min=1591, max=15012, avg=8598.01, stdev=1503.85 00:11:14.426 lat (usec): min=1605, max=15021, avg=8655.36, stdev=1508.64 00:11:14.426 clat percentiles (usec): 00:11:14.426 | 1.00th=[ 4490], 5.00th=[ 6456], 10.00th=[ 7308], 20.00th=[ 7832], 00:11:14.426 | 30.00th=[ 8094], 40.00th=[ 8291], 50.00th=[ 8455], 60.00th=[ 8586], 00:11:14.426 | 70.00th=[ 8848], 80.00th=[ 9241], 90.00th=[ 9896], 95.00th=[12125], 00:11:14.426 | 99.00th=[13304], 99.50th=[13566], 99.90th=[13960], 99.95th=[14222], 00:11:14.426 | 99.99th=[14746] 00:11:14.426 bw ( KiB/s): min= 8464, max=27208, per=52.60%, avg=21220.36, stdev=6151.18, samples=11 00:11:14.426 iops : min= 2116, max= 6802, avg=5305.09, stdev=1537.80, samples=11 00:11:14.426 write: IOPS=5933, BW=23.2MiB/s (24.3MB/s)(125MiB/5410msec); 0 zone resets 00:11:14.426 slat (usec): min=13, max=4061, avg=68.60, stdev=165.12 00:11:14.426 clat (usec): min=937, max=14676, avg=7510.74, stdev=1311.16 00:11:14.426 lat (usec): min=1008, max=14697, avg=7579.34, stdev=1315.58 00:11:14.426 clat percentiles (usec): 00:11:14.426 | 1.00th=[ 3458], 5.00th=[ 4621], 10.00th=[ 5932], 20.00th=[ 6980], 00:11:14.426 | 30.00th=[ 7242], 40.00th=[ 7504], 50.00th=[ 7701], 60.00th=[ 7832], 00:11:14.426 | 70.00th=[ 8029], 80.00th=[ 8291], 90.00th=[ 8586], 95.00th=[ 9110], 00:11:14.426 | 99.00th=[11469], 99.50th=[11994], 99.90th=[13304], 99.95th=[13960], 00:11:14.426 | 99.99th=[14615] 00:11:14.426 bw ( KiB/s): min= 8760, max=27584, per=89.56%, avg=21255.27, stdev=6024.00, samples=11 00:11:14.426 iops : min= 2190, max= 6896, avg=5313.82, stdev=1506.00, samples=11 00:11:14.426 lat (usec) : 1000=0.01% 00:11:14.426 lat (msec) : 2=0.07%, 4=1.18%, 10=91.65%, 20=7.09% 00:11:14.426 cpu : usr=5.10%, sys=22.65%, ctx=5301, majf=0, minf=78 00:11:14.426 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:11:14.426 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:14.426 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:11:14.426 issued rwts: total=60559,32100,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:14.426 latency : target=0, window=0, percentile=100.00%, depth=128 00:11:14.426 00:11:14.426 Run status group 0 (all jobs): 00:11:14.426 READ: bw=39.4MiB/s (41.3MB/s), 39.4MiB/s-39.4MiB/s (41.3MB/s-41.3MB/s), io=237MiB (248MB), run=6005-6005msec 00:11:14.426 WRITE: bw=23.2MiB/s (24.3MB/s), 23.2MiB/s-23.2MiB/s (24.3MB/s-24.3MB/s), io=125MiB (131MB), run=5410-5410msec 00:11:14.426 00:11:14.426 Disk stats (read/write): 00:11:14.426 nvme0n1: ios=59615/31510, merge=0/0, ticks=491371/222646, in_queue=714017, util=98.67% 00:11:14.426 11:21:55 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@106 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -n optimized 00:11:14.684 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@107 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.4 -s 4420 -n optimized 00:11:15.251 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@109 -- # check_ana_state nvme0c0n1 optimized 00:11:15.251 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c0n1 ana_state=optimized 00:11:15.251 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:11:15.251 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c0n1/ana_state 00:11:15.251 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c0n1/ana_state ]] 00:11:15.251 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ optimized != \o\p\t\i\m\i\z\e\d ]] 00:11:15.251 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@110 -- # check_ana_state nvme0c1n1 optimized 00:11:15.251 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c1n1 ana_state=optimized 00:11:15.251 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:11:15.251 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c1n1/ana_state 00:11:15.251 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:11:15.251 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ optimized != \o\p\t\i\m\i\z\e\d ]] 00:11:15.251 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@113 -- # echo round-robin 00:11:15.251 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@116 -- # fio_pid=65152 00:11:15.251 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@115 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randrw -r 6 -v 00:11:15.251 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@118 -- # sleep 1 00:11:15.251 [global] 00:11:15.251 thread=1 00:11:15.251 invalidate=1 00:11:15.251 rw=randrw 00:11:15.251 time_based=1 00:11:15.251 runtime=6 00:11:15.251 ioengine=libaio 00:11:15.251 direct=1 00:11:15.251 bs=4096 00:11:15.251 iodepth=128 00:11:15.251 norandommap=0 00:11:15.251 numjobs=1 00:11:15.251 00:11:15.251 verify_dump=1 00:11:15.251 verify_backlog=512 00:11:15.251 verify_state_save=0 00:11:15.251 do_verify=1 00:11:15.251 verify=crc32c-intel 00:11:15.251 [job0] 00:11:15.251 filename=/dev/nvme0n1 00:11:15.251 Could not set queue depth (nvme0n1) 00:11:15.251 job0: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:11:15.251 fio-3.35 00:11:15.251 Starting 1 thread 00:11:16.196 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@120 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -n inaccessible 00:11:16.455 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@121 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.4 -s 4420 -n non_optimized 00:11:16.718 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@123 -- # check_ana_state nvme0c0n1 inaccessible 00:11:16.718 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c0n1 ana_state=inaccessible 00:11:16.719 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:11:16.719 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c0n1/ana_state 00:11:16.719 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c0n1/ana_state ]] 00:11:16.719 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ inaccessible != \i\n\a\c\c\e\s\s\i\b\l\e ]] 00:11:16.719 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@124 -- # check_ana_state nvme0c1n1 non-optimized 00:11:16.719 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c1n1 ana_state=non-optimized 00:11:16.719 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:11:16.719 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c1n1/ana_state 00:11:16.719 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:11:16.719 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ non-optimized != \n\o\n\-\o\p\t\i\m\i\z\e\d ]] 00:11:16.719 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@126 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -n non_optimized 00:11:16.985 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@127 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.4 -s 4420 -n inaccessible 00:11:17.243 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@129 -- # check_ana_state nvme0c0n1 non-optimized 00:11:17.243 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c0n1 ana_state=non-optimized 00:11:17.243 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:11:17.243 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c0n1/ana_state 00:11:17.243 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c0n1/ana_state ]] 00:11:17.243 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ non-optimized != \n\o\n\-\o\p\t\i\m\i\z\e\d ]] 00:11:17.243 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@130 -- # check_ana_state nvme0c1n1 inaccessible 00:11:17.243 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c1n1 ana_state=inaccessible 00:11:17.243 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:11:17.243 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c1n1/ana_state 00:11:17.243 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:11:17.243 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ inaccessible != \i\n\a\c\c\e\s\s\i\b\l\e ]] 00:11:17.243 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@132 -- # wait 65152 00:11:21.427 00:11:21.427 job0: (groupid=0, jobs=1): err= 0: pid=65173: Mon Oct 7 11:22:02 2024 00:11:21.427 read: IOPS=11.0k, BW=42.8MiB/s (44.9MB/s)(257MiB/6002msec) 00:11:21.427 slat (usec): min=3, max=6304, avg=44.29, stdev=198.08 00:11:21.427 clat (usec): min=264, max=27702, avg=7960.27, stdev=2734.60 00:11:21.427 lat (usec): min=284, max=27716, avg=8004.57, stdev=2747.17 00:11:21.427 clat percentiles (usec): 00:11:21.427 | 1.00th=[ 758], 5.00th=[ 2442], 10.00th=[ 4686], 20.00th=[ 6063], 00:11:21.427 | 30.00th=[ 7308], 40.00th=[ 7898], 50.00th=[ 8225], 60.00th=[ 8455], 00:11:21.427 | 70.00th=[ 8848], 80.00th=[ 9372], 90.00th=[11469], 95.00th=[12518], 00:11:21.427 | 99.00th=[13829], 99.50th=[15795], 99.90th=[20841], 99.95th=[22414], 00:11:21.427 | 99.99th=[26870] 00:11:21.427 bw ( KiB/s): min= 6816, max=38464, per=53.02%, avg=23253.09, stdev=9237.39, samples=11 00:11:21.427 iops : min= 1704, max= 9616, avg=5813.27, stdev=2309.35, samples=11 00:11:21.427 write: IOPS=6522, BW=25.5MiB/s (26.7MB/s)(137MiB/5376msec); 0 zone resets 00:11:21.427 slat (usec): min=7, max=13353, avg=58.49, stdev=154.51 00:11:21.427 clat (usec): min=446, max=25476, avg=6788.85, stdev=2184.77 00:11:21.427 lat (usec): min=486, max=26503, avg=6847.34, stdev=2199.24 00:11:21.427 clat percentiles (usec): 00:11:21.427 | 1.00th=[ 1844], 5.00th=[ 3425], 10.00th=[ 3916], 20.00th=[ 4621], 00:11:21.427 | 30.00th=[ 5538], 40.00th=[ 6849], 50.00th=[ 7308], 60.00th=[ 7635], 00:11:21.427 | 70.00th=[ 7898], 80.00th=[ 8225], 90.00th=[ 8717], 95.00th=[ 9503], 00:11:21.427 | 99.00th=[12256], 99.50th=[15401], 99.90th=[21365], 99.95th=[23987], 00:11:21.427 | 99.99th=[25297] 00:11:21.427 bw ( KiB/s): min= 7240, max=37688, per=89.18%, avg=23266.18, stdev=9033.00, samples=11 00:11:21.427 iops : min= 1810, max= 9422, avg=5816.55, stdev=2258.25, samples=11 00:11:21.427 lat (usec) : 500=0.05%, 750=0.59%, 1000=1.16% 00:11:21.427 lat (msec) : 2=1.68%, 4=5.07%, 10=80.89%, 20=10.43%, 50=0.13% 00:11:21.427 cpu : usr=6.32%, sys=24.26%, ctx=6336, majf=0, minf=102 00:11:21.427 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:11:21.427 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:21.427 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:11:21.427 issued rwts: total=65806,35063,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:21.427 latency : target=0, window=0, percentile=100.00%, depth=128 00:11:21.427 00:11:21.427 Run status group 0 (all jobs): 00:11:21.427 READ: bw=42.8MiB/s (44.9MB/s), 42.8MiB/s-42.8MiB/s (44.9MB/s-44.9MB/s), io=257MiB (270MB), run=6002-6002msec 00:11:21.427 WRITE: bw=25.5MiB/s (26.7MB/s), 25.5MiB/s-25.5MiB/s (26.7MB/s-26.7MB/s), io=137MiB (144MB), run=5376-5376msec 00:11:21.427 00:11:21.427 Disk stats (read/write): 00:11:21.427 nvme0n1: ios=64971/34551, merge=0/0, ticks=491576/216442, in_queue=708018, util=98.63% 00:11:21.427 11:22:02 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@134 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:21.427 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:11:21.427 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@135 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:21.427 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1219 -- # local i=0 00:11:21.427 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:21.427 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:11:21.427 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:11:21.427 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:21.427 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1231 -- # return 0 00:11:21.427 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@137 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:21.685 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@139 -- # rm -f ./local-job0-0-verify.state 00:11:21.685 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@140 -- # rm -f ./local-job1-1-verify.state 00:11:21.685 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@142 -- # trap - SIGINT SIGTERM EXIT 00:11:21.685 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@144 -- # nvmftestfini 00:11:21.685 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@514 -- # nvmfcleanup 00:11:21.685 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@121 -- # sync 00:11:21.685 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:11:21.685 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@124 -- # set +e 00:11:21.685 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@125 -- # for i in {1..20} 00:11:21.685 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:11:21.685 rmmod nvme_tcp 00:11:21.943 rmmod nvme_fabrics 00:11:21.943 rmmod nvme_keyring 00:11:21.943 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:11:21.943 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@128 -- # set -e 00:11:21.943 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@129 -- # return 0 00:11:21.943 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@515 -- # '[' -n 64950 ']' 00:11:21.943 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@516 -- # killprocess 64950 00:11:21.943 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@950 -- # '[' -z 64950 ']' 00:11:21.943 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@954 -- # kill -0 64950 00:11:21.943 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@955 -- # uname 00:11:21.943 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:11:21.943 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 64950 00:11:21.943 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:11:21.943 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:11:21.943 killing process with pid 64950 00:11:21.943 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@968 -- # echo 'killing process with pid 64950' 00:11:21.943 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@969 -- # kill 64950 00:11:21.943 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@974 -- # wait 64950 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@297 -- # iptr 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@789 -- # iptables-save 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@789 -- # iptables-restore 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:22.202 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:22.460 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@246 -- # remove_spdk_ns 00:11:22.460 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:22.460 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:22.460 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:22.460 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@300 -- # return 0 00:11:22.460 00:11:22.460 real 0m20.137s 00:11:22.460 user 1m15.399s 00:11:22.460 sys 0m9.717s 00:11:22.460 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1126 -- # xtrace_disable 00:11:22.460 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@10 -- # set +x 00:11:22.460 ************************************ 00:11:22.460 END TEST nvmf_target_multipath 00:11:22.460 ************************************ 00:11:22.460 11:22:03 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@32 -- # run_test nvmf_zcopy /home/vagrant/spdk_repo/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:11:22.460 11:22:03 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:11:22.460 11:22:03 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:22.460 11:22:03 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:11:22.460 ************************************ 00:11:22.460 START TEST nvmf_zcopy 00:11:22.460 ************************************ 00:11:22.460 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:11:22.460 * Looking for test storage... 00:11:22.460 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:11:22.460 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:11:22.460 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1681 -- # lcov --version 00:11:22.460 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@333 -- # local ver1 ver1_l 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@334 -- # local ver2 ver2_l 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@336 -- # IFS=.-: 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@336 -- # read -ra ver1 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@337 -- # IFS=.-: 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@337 -- # read -ra ver2 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@338 -- # local 'op=<' 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@340 -- # ver1_l=2 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@341 -- # ver2_l=1 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@344 -- # case "$op" in 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@345 -- # : 1 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@364 -- # (( v = 0 )) 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@365 -- # decimal 1 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@353 -- # local d=1 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@355 -- # echo 1 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@365 -- # ver1[v]=1 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@366 -- # decimal 2 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@353 -- # local d=2 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@355 -- # echo 2 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@366 -- # ver2[v]=2 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@368 -- # return 0 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:11:22.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:22.719 --rc genhtml_branch_coverage=1 00:11:22.719 --rc genhtml_function_coverage=1 00:11:22.719 --rc genhtml_legend=1 00:11:22.719 --rc geninfo_all_blocks=1 00:11:22.719 --rc geninfo_unexecuted_blocks=1 00:11:22.719 00:11:22.719 ' 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:11:22.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:22.719 --rc genhtml_branch_coverage=1 00:11:22.719 --rc genhtml_function_coverage=1 00:11:22.719 --rc genhtml_legend=1 00:11:22.719 --rc geninfo_all_blocks=1 00:11:22.719 --rc geninfo_unexecuted_blocks=1 00:11:22.719 00:11:22.719 ' 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:11:22.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:22.719 --rc genhtml_branch_coverage=1 00:11:22.719 --rc genhtml_function_coverage=1 00:11:22.719 --rc genhtml_legend=1 00:11:22.719 --rc geninfo_all_blocks=1 00:11:22.719 --rc geninfo_unexecuted_blocks=1 00:11:22.719 00:11:22.719 ' 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:11:22.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:22.719 --rc genhtml_branch_coverage=1 00:11:22.719 --rc genhtml_function_coverage=1 00:11:22.719 --rc genhtml_legend=1 00:11:22.719 --rc geninfo_all_blocks=1 00:11:22.719 --rc geninfo_unexecuted_blocks=1 00:11:22.719 00:11:22.719 ' 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@7 -- # uname -s 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:22.719 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@15 -- # shopt -s extglob 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@5 -- # export PATH 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@51 -- # : 0 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:11:22.720 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@55 -- # have_pci_nics=0 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@12 -- # nvmftestinit 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@474 -- # prepare_net_devs 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@436 -- # local -g is_hw=no 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@438 -- # remove_spdk_ns 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@458 -- # nvmf_veth_init 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:11:22.720 Cannot find device "nvmf_init_br" 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@162 -- # true 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:11:22.720 Cannot find device "nvmf_init_br2" 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@163 -- # true 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:11:22.720 Cannot find device "nvmf_tgt_br" 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@164 -- # true 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:11:22.720 Cannot find device "nvmf_tgt_br2" 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@165 -- # true 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:11:22.720 Cannot find device "nvmf_init_br" 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@166 -- # true 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:11:22.720 Cannot find device "nvmf_init_br2" 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@167 -- # true 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:11:22.720 Cannot find device "nvmf_tgt_br" 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@168 -- # true 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:11:22.720 Cannot find device "nvmf_tgt_br2" 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@169 -- # true 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:11:22.720 Cannot find device "nvmf_br" 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@170 -- # true 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:11:22.720 Cannot find device "nvmf_init_if" 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@171 -- # true 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:11:22.720 Cannot find device "nvmf_init_if2" 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@172 -- # true 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:22.720 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@173 -- # true 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:22.720 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:22.720 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@174 -- # true 00:11:22.721 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:11:22.721 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:11:22.721 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:11:22.721 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:11:22.721 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:11:22.979 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:11:22.979 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:11:22.979 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:11:22.979 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:11:22.979 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:11:22.979 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:11:22.979 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:11:22.980 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:11:22.980 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.108 ms 00:11:22.980 00:11:22.980 --- 10.0.0.3 ping statistics --- 00:11:22.980 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:22.980 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:11:22.980 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:11:22.980 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.062 ms 00:11:22.980 00:11:22.980 --- 10.0.0.4 ping statistics --- 00:11:22.980 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:22.980 rtt min/avg/max/mdev = 0.062/0.062/0.062/0.000 ms 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:11:22.980 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:22.980 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.023 ms 00:11:22.980 00:11:22.980 --- 10.0.0.1 ping statistics --- 00:11:22.980 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:22.980 rtt min/avg/max/mdev = 0.023/0.023/0.023/0.000 ms 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:11:22.980 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:22.980 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.072 ms 00:11:22.980 00:11:22.980 --- 10.0.0.2 ping statistics --- 00:11:22.980 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:22.980 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@459 -- # return 0 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@724 -- # xtrace_disable 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@507 -- # nvmfpid=65479 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@508 -- # waitforlisten 65479 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@831 -- # '[' -z 65479 ']' 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:22.980 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:22.980 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:11:23.239 [2024-10-07 11:22:04.726840] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:11:23.239 [2024-10-07 11:22:04.726955] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:23.239 [2024-10-07 11:22:04.860991] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:11:23.239 [2024-10-07 11:22:04.917775] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:23.239 [2024-10-07 11:22:04.917829] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:23.239 [2024-10-07 11:22:04.917840] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:23.239 [2024-10-07 11:22:04.917848] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:23.239 [2024-10-07 11:22:04.917855] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:23.239 [2024-10-07 11:22:04.918154] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:11:23.239 [2024-10-07 11:22:04.946734] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:11:23.497 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:23.497 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@864 -- # return 0 00:11:23.497 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:11:23.497 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@730 -- # xtrace_disable 00:11:23.497 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:11:23.497 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:23.497 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:11:23.497 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:11:23.497 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:23.497 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:11:23.497 [2024-10-07 11:22:05.034003] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:23.497 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:23.497 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:11:23.497 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:23.497 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:11:23.497 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:23.497 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:11:23.498 [2024-10-07 11:22:05.050124] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:11:23.498 malloc0 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@33 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@558 -- # config=() 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@558 -- # local subsystem config 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:11:23.498 { 00:11:23.498 "params": { 00:11:23.498 "name": "Nvme$subsystem", 00:11:23.498 "trtype": "$TEST_TRANSPORT", 00:11:23.498 "traddr": "$NVMF_FIRST_TARGET_IP", 00:11:23.498 "adrfam": "ipv4", 00:11:23.498 "trsvcid": "$NVMF_PORT", 00:11:23.498 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:11:23.498 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:11:23.498 "hdgst": ${hdgst:-false}, 00:11:23.498 "ddgst": ${ddgst:-false} 00:11:23.498 }, 00:11:23.498 "method": "bdev_nvme_attach_controller" 00:11:23.498 } 00:11:23.498 EOF 00:11:23.498 )") 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@580 -- # cat 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@582 -- # jq . 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@583 -- # IFS=, 00:11:23.498 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:11:23.498 "params": { 00:11:23.498 "name": "Nvme1", 00:11:23.498 "trtype": "tcp", 00:11:23.498 "traddr": "10.0.0.3", 00:11:23.498 "adrfam": "ipv4", 00:11:23.498 "trsvcid": "4420", 00:11:23.498 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:11:23.498 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:11:23.498 "hdgst": false, 00:11:23.498 "ddgst": false 00:11:23.498 }, 00:11:23.498 "method": "bdev_nvme_attach_controller" 00:11:23.498 }' 00:11:23.498 [2024-10-07 11:22:05.150731] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:11:23.498 [2024-10-07 11:22:05.150821] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid65505 ] 00:11:23.757 [2024-10-07 11:22:05.305749] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:11:23.757 [2024-10-07 11:22:05.367655] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:11:23.757 [2024-10-07 11:22:05.405972] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:11:24.015 Running I/O for 10 seconds... 00:11:25.933 5592.00 IOPS, 43.69 MiB/s [2024-10-07T11:22:08.578Z] 5592.50 IOPS, 43.69 MiB/s [2024-10-07T11:22:09.512Z] 5624.00 IOPS, 43.94 MiB/s [2024-10-07T11:22:10.887Z] 5627.75 IOPS, 43.97 MiB/s [2024-10-07T11:22:11.822Z] 5647.80 IOPS, 44.12 MiB/s [2024-10-07T11:22:12.756Z] 5665.17 IOPS, 44.26 MiB/s [2024-10-07T11:22:13.690Z] 5682.43 IOPS, 44.39 MiB/s [2024-10-07T11:22:14.624Z] 5694.00 IOPS, 44.48 MiB/s [2024-10-07T11:22:15.558Z] 5701.00 IOPS, 44.54 MiB/s [2024-10-07T11:22:15.558Z] 5709.70 IOPS, 44.61 MiB/s 00:11:33.847 Latency(us) 00:11:33.847 [2024-10-07T11:22:15.558Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:11:33.847 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:11:33.847 Verification LBA range: start 0x0 length 0x1000 00:11:33.847 Nvme1n1 : 10.02 5711.97 44.62 0.00 0.00 22337.81 2829.96 32172.22 00:11:33.847 [2024-10-07T11:22:15.558Z] =================================================================================================================== 00:11:33.847 [2024-10-07T11:22:15.558Z] Total : 5711.97 44.62 0.00 0.00 22337.81 2829.96 32172.22 00:11:34.106 11:22:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@39 -- # perfpid=65622 00:11:34.106 11:22:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@41 -- # xtrace_disable 00:11:34.106 11:22:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:11:34.106 11:22:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:11:34.106 11:22:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@37 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:11:34.106 11:22:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@558 -- # config=() 00:11:34.106 11:22:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@558 -- # local subsystem config 00:11:34.106 11:22:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:11:34.106 11:22:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:11:34.106 { 00:11:34.106 "params": { 00:11:34.106 "name": "Nvme$subsystem", 00:11:34.106 "trtype": "$TEST_TRANSPORT", 00:11:34.106 "traddr": "$NVMF_FIRST_TARGET_IP", 00:11:34.106 "adrfam": "ipv4", 00:11:34.106 "trsvcid": "$NVMF_PORT", 00:11:34.106 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:11:34.106 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:11:34.106 "hdgst": ${hdgst:-false}, 00:11:34.106 "ddgst": ${ddgst:-false} 00:11:34.106 }, 00:11:34.106 "method": "bdev_nvme_attach_controller" 00:11:34.106 } 00:11:34.106 EOF 00:11:34.106 )") 00:11:34.106 11:22:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@580 -- # cat 00:11:34.106 11:22:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@582 -- # jq . 00:11:34.106 [2024-10-07 11:22:15.700647] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.106 [2024-10-07 11:22:15.700691] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.106 11:22:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@583 -- # IFS=, 00:11:34.106 11:22:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:11:34.106 "params": { 00:11:34.106 "name": "Nvme1", 00:11:34.106 "trtype": "tcp", 00:11:34.106 "traddr": "10.0.0.3", 00:11:34.106 "adrfam": "ipv4", 00:11:34.106 "trsvcid": "4420", 00:11:34.106 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:11:34.106 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:11:34.106 "hdgst": false, 00:11:34.106 "ddgst": false 00:11:34.106 }, 00:11:34.106 "method": "bdev_nvme_attach_controller" 00:11:34.106 }' 00:11:34.106 [2024-10-07 11:22:15.712630] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.106 [2024-10-07 11:22:15.712663] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.106 [2024-10-07 11:22:15.724621] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.106 [2024-10-07 11:22:15.724654] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.106 [2024-10-07 11:22:15.736652] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.106 [2024-10-07 11:22:15.736695] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.106 [2024-10-07 11:22:15.746386] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:11:34.106 [2024-10-07 11:22:15.746482] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid65622 ] 00:11:34.106 [2024-10-07 11:22:15.748620] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.106 [2024-10-07 11:22:15.748651] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.106 [2024-10-07 11:22:15.760621] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.106 [2024-10-07 11:22:15.760648] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.106 [2024-10-07 11:22:15.772656] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.106 [2024-10-07 11:22:15.772706] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.106 [2024-10-07 11:22:15.784627] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.106 [2024-10-07 11:22:15.784653] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.106 [2024-10-07 11:22:15.796625] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.106 [2024-10-07 11:22:15.796651] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.106 [2024-10-07 11:22:15.808627] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.106 [2024-10-07 11:22:15.808652] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:15.820633] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:15.820659] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:15.832642] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:15.832672] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:15.844640] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:15.844669] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:15.856655] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:15.856681] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:15.868646] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:15.868674] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:15.880649] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:15.880676] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:15.885523] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:11:34.365 [2024-10-07 11:22:15.892683] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:15.892722] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:15.904669] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:15.904702] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:15.916674] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:15.916702] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:15.928685] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:15.928721] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:15.940684] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:15.940717] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:15.952674] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:15.952704] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:15.964676] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:15.964702] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:15.967856] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:11:34.365 [2024-10-07 11:22:15.976674] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:15.976700] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:15.988710] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:15.988749] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:16.000710] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:16.000747] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:16.012704] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:16.012743] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:16.013103] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:11:34.365 [2024-10-07 11:22:16.024718] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:16.024758] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:16.036700] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:16.036729] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:16.048803] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:16.048839] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:16.064807] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:16.064844] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.365 [2024-10-07 11:22:16.072815] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.365 [2024-10-07 11:22:16.072852] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.623 [2024-10-07 11:22:16.084865] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.623 [2024-10-07 11:22:16.084898] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.623 [2024-10-07 11:22:16.096828] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.623 [2024-10-07 11:22:16.096859] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.623 [2024-10-07 11:22:16.104842] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.623 [2024-10-07 11:22:16.104876] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.623 Running I/O for 5 seconds... 00:11:34.623 [2024-10-07 11:22:16.122365] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.623 [2024-10-07 11:22:16.122418] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.623 [2024-10-07 11:22:16.133008] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.623 [2024-10-07 11:22:16.133042] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.624 [2024-10-07 11:22:16.144164] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.624 [2024-10-07 11:22:16.144199] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.624 [2024-10-07 11:22:16.159420] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.624 [2024-10-07 11:22:16.159454] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.624 [2024-10-07 11:22:16.170072] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.624 [2024-10-07 11:22:16.170108] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.624 [2024-10-07 11:22:16.184586] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.624 [2024-10-07 11:22:16.184621] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.624 [2024-10-07 11:22:16.201391] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.624 [2024-10-07 11:22:16.201450] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.624 [2024-10-07 11:22:16.216712] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.624 [2024-10-07 11:22:16.216759] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.624 [2024-10-07 11:22:16.226035] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.624 [2024-10-07 11:22:16.226073] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.624 [2024-10-07 11:22:16.243064] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.624 [2024-10-07 11:22:16.243105] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.624 [2024-10-07 11:22:16.259616] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.624 [2024-10-07 11:22:16.259657] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.624 [2024-10-07 11:22:16.276899] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.624 [2024-10-07 11:22:16.276941] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.624 [2024-10-07 11:22:16.291543] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.624 [2024-10-07 11:22:16.291583] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.624 [2024-10-07 11:22:16.308009] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.624 [2024-10-07 11:22:16.308053] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.624 [2024-10-07 11:22:16.323732] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.624 [2024-10-07 11:22:16.323766] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.624 [2024-10-07 11:22:16.333176] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.624 [2024-10-07 11:22:16.333218] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.882 [2024-10-07 11:22:16.349316] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.882 [2024-10-07 11:22:16.349351] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.882 [2024-10-07 11:22:16.365498] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.882 [2024-10-07 11:22:16.365531] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.882 [2024-10-07 11:22:16.383130] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.882 [2024-10-07 11:22:16.383164] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.882 [2024-10-07 11:22:16.398745] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.882 [2024-10-07 11:22:16.398779] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.882 [2024-10-07 11:22:16.408130] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.882 [2024-10-07 11:22:16.408177] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.882 [2024-10-07 11:22:16.422725] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.882 [2024-10-07 11:22:16.422760] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.882 [2024-10-07 11:22:16.438905] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.882 [2024-10-07 11:22:16.438939] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.882 [2024-10-07 11:22:16.455920] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.882 [2024-10-07 11:22:16.455968] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.882 [2024-10-07 11:22:16.473627] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.883 [2024-10-07 11:22:16.473660] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.883 [2024-10-07 11:22:16.489586] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.883 [2024-10-07 11:22:16.489618] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.883 [2024-10-07 11:22:16.506019] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.883 [2024-10-07 11:22:16.506054] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.883 [2024-10-07 11:22:16.522470] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.883 [2024-10-07 11:22:16.522503] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.883 [2024-10-07 11:22:16.539564] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.883 [2024-10-07 11:22:16.539599] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.883 [2024-10-07 11:22:16.555800] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.883 [2024-10-07 11:22:16.555835] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.883 [2024-10-07 11:22:16.572806] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.883 [2024-10-07 11:22:16.572842] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:34.883 [2024-10-07 11:22:16.589127] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:34.883 [2024-10-07 11:22:16.589175] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.141 [2024-10-07 11:22:16.605961] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.141 [2024-10-07 11:22:16.605997] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.141 [2024-10-07 11:22:16.622397] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.141 [2024-10-07 11:22:16.622444] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.141 [2024-10-07 11:22:16.639527] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.141 [2024-10-07 11:22:16.639560] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.141 [2024-10-07 11:22:16.656371] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.141 [2024-10-07 11:22:16.656425] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.141 [2024-10-07 11:22:16.673044] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.141 [2024-10-07 11:22:16.673081] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.141 [2024-10-07 11:22:16.689054] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.141 [2024-10-07 11:22:16.689105] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.141 [2024-10-07 11:22:16.706279] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.141 [2024-10-07 11:22:16.706328] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.141 [2024-10-07 11:22:16.721680] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.141 [2024-10-07 11:22:16.721721] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.141 [2024-10-07 11:22:16.731099] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.141 [2024-10-07 11:22:16.731134] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.141 [2024-10-07 11:22:16.744866] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.141 [2024-10-07 11:22:16.744900] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.141 [2024-10-07 11:22:16.760317] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.141 [2024-10-07 11:22:16.760361] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.141 [2024-10-07 11:22:16.777115] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.141 [2024-10-07 11:22:16.777159] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.141 [2024-10-07 11:22:16.794646] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.141 [2024-10-07 11:22:16.794680] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.141 [2024-10-07 11:22:16.809366] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.141 [2024-10-07 11:22:16.809411] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.141 [2024-10-07 11:22:16.825258] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.141 [2024-10-07 11:22:16.825291] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.141 [2024-10-07 11:22:16.841433] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.141 [2024-10-07 11:22:16.841485] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.400 [2024-10-07 11:22:16.859475] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.400 [2024-10-07 11:22:16.859515] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.400 [2024-10-07 11:22:16.874393] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.400 [2024-10-07 11:22:16.874438] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.400 [2024-10-07 11:22:16.890395] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.400 [2024-10-07 11:22:16.890442] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.400 [2024-10-07 11:22:16.908481] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.400 [2024-10-07 11:22:16.908513] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.400 [2024-10-07 11:22:16.923583] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.400 [2024-10-07 11:22:16.923616] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.400 [2024-10-07 11:22:16.933591] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.400 [2024-10-07 11:22:16.933627] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.400 [2024-10-07 11:22:16.949980] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.400 [2024-10-07 11:22:16.950018] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.400 [2024-10-07 11:22:16.966057] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.400 [2024-10-07 11:22:16.966116] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.400 [2024-10-07 11:22:16.983831] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.400 [2024-10-07 11:22:16.983874] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.400 [2024-10-07 11:22:16.999949] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.400 [2024-10-07 11:22:16.999988] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.400 [2024-10-07 11:22:17.016384] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.400 [2024-10-07 11:22:17.016433] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.400 [2024-10-07 11:22:17.034038] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.400 [2024-10-07 11:22:17.034076] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.400 [2024-10-07 11:22:17.048888] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.400 [2024-10-07 11:22:17.048925] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.400 [2024-10-07 11:22:17.066622] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.400 [2024-10-07 11:22:17.066665] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.400 [2024-10-07 11:22:17.081834] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.400 [2024-10-07 11:22:17.081870] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.400 [2024-10-07 11:22:17.091674] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.400 [2024-10-07 11:22:17.091710] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.400 [2024-10-07 11:22:17.108680] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.400 [2024-10-07 11:22:17.108740] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.658 11380.00 IOPS, 88.91 MiB/s [2024-10-07T11:22:17.369Z] [2024-10-07 11:22:17.125476] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.658 [2024-10-07 11:22:17.125535] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.658 [2024-10-07 11:22:17.142504] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.658 [2024-10-07 11:22:17.142542] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.658 [2024-10-07 11:22:17.158480] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.658 [2024-10-07 11:22:17.158524] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.658 [2024-10-07 11:22:17.176965] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.658 [2024-10-07 11:22:17.177001] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.658 [2024-10-07 11:22:17.191904] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.658 [2024-10-07 11:22:17.191940] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.659 [2024-10-07 11:22:17.207794] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.659 [2024-10-07 11:22:17.207835] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.659 [2024-10-07 11:22:17.224246] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.659 [2024-10-07 11:22:17.224282] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.659 [2024-10-07 11:22:17.240979] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.659 [2024-10-07 11:22:17.241014] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.659 [2024-10-07 11:22:17.258692] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.659 [2024-10-07 11:22:17.258726] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.659 [2024-10-07 11:22:17.273364] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.659 [2024-10-07 11:22:17.273397] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.659 [2024-10-07 11:22:17.291104] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.659 [2024-10-07 11:22:17.291141] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.659 [2024-10-07 11:22:17.306832] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.659 [2024-10-07 11:22:17.306880] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.659 [2024-10-07 11:22:17.323277] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.659 [2024-10-07 11:22:17.323325] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.659 [2024-10-07 11:22:17.339612] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.659 [2024-10-07 11:22:17.339648] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.659 [2024-10-07 11:22:17.356673] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.659 [2024-10-07 11:22:17.356708] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.917 [2024-10-07 11:22:17.373045] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.917 [2024-10-07 11:22:17.373080] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.917 [2024-10-07 11:22:17.391342] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.917 [2024-10-07 11:22:17.391378] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.917 [2024-10-07 11:22:17.406148] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.917 [2024-10-07 11:22:17.406181] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.917 [2024-10-07 11:22:17.421022] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.917 [2024-10-07 11:22:17.421056] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.917 [2024-10-07 11:22:17.439019] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.917 [2024-10-07 11:22:17.439063] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.917 [2024-10-07 11:22:17.454288] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.917 [2024-10-07 11:22:17.454324] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.917 [2024-10-07 11:22:17.471882] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.917 [2024-10-07 11:22:17.471919] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.917 [2024-10-07 11:22:17.488813] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.917 [2024-10-07 11:22:17.488848] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.917 [2024-10-07 11:22:17.505311] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.917 [2024-10-07 11:22:17.505361] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.917 [2024-10-07 11:22:17.522103] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.917 [2024-10-07 11:22:17.522137] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.917 [2024-10-07 11:22:17.538411] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.917 [2024-10-07 11:22:17.538460] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.917 [2024-10-07 11:22:17.556097] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.917 [2024-10-07 11:22:17.556130] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.917 [2024-10-07 11:22:17.571190] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.917 [2024-10-07 11:22:17.571223] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.917 [2024-10-07 11:22:17.580991] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.918 [2024-10-07 11:22:17.581035] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.918 [2024-10-07 11:22:17.597166] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.918 [2024-10-07 11:22:17.597205] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:35.918 [2024-10-07 11:22:17.614172] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:35.918 [2024-10-07 11:22:17.614216] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.176 [2024-10-07 11:22:17.628950] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.176 [2024-10-07 11:22:17.628994] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.176 [2024-10-07 11:22:17.644888] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.176 [2024-10-07 11:22:17.644949] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.176 [2024-10-07 11:22:17.660945] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.176 [2024-10-07 11:22:17.660990] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.176 [2024-10-07 11:22:17.678392] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.176 [2024-10-07 11:22:17.678460] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.176 [2024-10-07 11:22:17.694532] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.177 [2024-10-07 11:22:17.694566] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.177 [2024-10-07 11:22:17.713005] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.177 [2024-10-07 11:22:17.713040] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.177 [2024-10-07 11:22:17.728191] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.177 [2024-10-07 11:22:17.728225] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.177 [2024-10-07 11:22:17.745338] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.177 [2024-10-07 11:22:17.745373] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.177 [2024-10-07 11:22:17.762257] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.177 [2024-10-07 11:22:17.762292] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.177 [2024-10-07 11:22:17.772281] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.177 [2024-10-07 11:22:17.772314] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.177 [2024-10-07 11:22:17.787068] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.177 [2024-10-07 11:22:17.787102] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.177 [2024-10-07 11:22:17.803161] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.177 [2024-10-07 11:22:17.803194] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.177 [2024-10-07 11:22:17.812896] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.177 [2024-10-07 11:22:17.812929] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.177 [2024-10-07 11:22:17.828974] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.177 [2024-10-07 11:22:17.829013] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.177 [2024-10-07 11:22:17.845715] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.177 [2024-10-07 11:22:17.845749] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.177 [2024-10-07 11:22:17.863687] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.177 [2024-10-07 11:22:17.863721] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.177 [2024-10-07 11:22:17.878539] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.177 [2024-10-07 11:22:17.878572] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.435 [2024-10-07 11:22:17.894913] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.435 [2024-10-07 11:22:17.894947] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.435 [2024-10-07 11:22:17.911346] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.435 [2024-10-07 11:22:17.911381] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.435 [2024-10-07 11:22:17.928361] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.435 [2024-10-07 11:22:17.928395] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.435 [2024-10-07 11:22:17.944297] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.435 [2024-10-07 11:22:17.944331] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.435 [2024-10-07 11:22:17.962528] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.435 [2024-10-07 11:22:17.962561] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.435 [2024-10-07 11:22:17.977482] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.435 [2024-10-07 11:22:17.977514] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.435 [2024-10-07 11:22:17.988004] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.435 [2024-10-07 11:22:17.988060] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.435 [2024-10-07 11:22:18.003179] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.435 [2024-10-07 11:22:18.003237] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.435 [2024-10-07 11:22:18.020201] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.435 [2024-10-07 11:22:18.020238] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.435 [2024-10-07 11:22:18.036599] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.435 [2024-10-07 11:22:18.036632] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.435 [2024-10-07 11:22:18.054133] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.435 [2024-10-07 11:22:18.054168] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.435 [2024-10-07 11:22:18.069773] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.435 [2024-10-07 11:22:18.069807] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.435 [2024-10-07 11:22:18.079240] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.435 [2024-10-07 11:22:18.079273] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.435 [2024-10-07 11:22:18.095049] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.435 [2024-10-07 11:22:18.095086] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.435 [2024-10-07 11:22:18.111982] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.435 [2024-10-07 11:22:18.112020] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.435 11421.00 IOPS, 89.23 MiB/s [2024-10-07T11:22:18.146Z] [2024-10-07 11:22:18.128716] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.435 [2024-10-07 11:22:18.128751] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.435 [2024-10-07 11:22:18.145190] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.435 [2024-10-07 11:22:18.145227] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.693 [2024-10-07 11:22:18.161088] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.693 [2024-10-07 11:22:18.161146] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.693 [2024-10-07 11:22:18.179487] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.693 [2024-10-07 11:22:18.179531] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.693 [2024-10-07 11:22:18.194645] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.693 [2024-10-07 11:22:18.194678] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.693 [2024-10-07 11:22:18.204706] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.693 [2024-10-07 11:22:18.204739] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.693 [2024-10-07 11:22:18.219681] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.693 [2024-10-07 11:22:18.219716] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.693 [2024-10-07 11:22:18.235077] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.693 [2024-10-07 11:22:18.235112] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.693 [2024-10-07 11:22:18.257459] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.693 [2024-10-07 11:22:18.257497] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.693 [2024-10-07 11:22:18.272472] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.693 [2024-10-07 11:22:18.272506] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.693 [2024-10-07 11:22:18.289100] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.693 [2024-10-07 11:22:18.289135] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.693 [2024-10-07 11:22:18.307307] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.693 [2024-10-07 11:22:18.307340] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.693 [2024-10-07 11:22:18.322122] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.693 [2024-10-07 11:22:18.322157] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.693 [2024-10-07 11:22:18.337356] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.693 [2024-10-07 11:22:18.337392] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.693 [2024-10-07 11:22:18.346768] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.693 [2024-10-07 11:22:18.346803] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.693 [2024-10-07 11:22:18.361518] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.693 [2024-10-07 11:22:18.361553] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.693 [2024-10-07 11:22:18.377509] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.693 [2024-10-07 11:22:18.377543] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.693 [2024-10-07 11:22:18.387260] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.693 [2024-10-07 11:22:18.387308] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.693 [2024-10-07 11:22:18.403124] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.693 [2024-10-07 11:22:18.403185] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.951 [2024-10-07 11:22:18.419327] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.952 [2024-10-07 11:22:18.419371] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.952 [2024-10-07 11:22:18.435573] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.952 [2024-10-07 11:22:18.435606] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.952 [2024-10-07 11:22:18.453927] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.952 [2024-10-07 11:22:18.453963] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.952 [2024-10-07 11:22:18.469463] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.952 [2024-10-07 11:22:18.469497] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.952 [2024-10-07 11:22:18.486059] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.952 [2024-10-07 11:22:18.486094] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.952 [2024-10-07 11:22:18.503007] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.952 [2024-10-07 11:22:18.503042] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.952 [2024-10-07 11:22:18.520046] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.952 [2024-10-07 11:22:18.520086] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.952 [2024-10-07 11:22:18.536985] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.952 [2024-10-07 11:22:18.537023] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.952 [2024-10-07 11:22:18.553677] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.952 [2024-10-07 11:22:18.553713] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.952 [2024-10-07 11:22:18.571112] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.952 [2024-10-07 11:22:18.571149] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.952 [2024-10-07 11:22:18.586405] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.952 [2024-10-07 11:22:18.586458] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.952 [2024-10-07 11:22:18.596495] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.952 [2024-10-07 11:22:18.596529] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.952 [2024-10-07 11:22:18.611949] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.952 [2024-10-07 11:22:18.612010] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.952 [2024-10-07 11:22:18.628835] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.952 [2024-10-07 11:22:18.628872] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.952 [2024-10-07 11:22:18.645559] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.952 [2024-10-07 11:22:18.645591] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:36.952 [2024-10-07 11:22:18.661344] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:36.952 [2024-10-07 11:22:18.661376] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.210 [2024-10-07 11:22:18.670873] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.210 [2024-10-07 11:22:18.670907] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.210 [2024-10-07 11:22:18.687121] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.210 [2024-10-07 11:22:18.687193] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.210 [2024-10-07 11:22:18.703596] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.210 [2024-10-07 11:22:18.703636] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.210 [2024-10-07 11:22:18.719969] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.210 [2024-10-07 11:22:18.720003] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.210 [2024-10-07 11:22:18.737996] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.210 [2024-10-07 11:22:18.738030] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.210 [2024-10-07 11:22:18.748612] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.210 [2024-10-07 11:22:18.748644] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.210 [2024-10-07 11:22:18.763260] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.210 [2024-10-07 11:22:18.763293] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.210 [2024-10-07 11:22:18.779977] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.210 [2024-10-07 11:22:18.780011] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.210 [2024-10-07 11:22:18.797990] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.210 [2024-10-07 11:22:18.798023] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.210 [2024-10-07 11:22:18.813032] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.210 [2024-10-07 11:22:18.813066] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.210 [2024-10-07 11:22:18.828983] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.210 [2024-10-07 11:22:18.829035] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.210 [2024-10-07 11:22:18.845610] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.210 [2024-10-07 11:22:18.845653] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.210 [2024-10-07 11:22:18.862191] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.210 [2024-10-07 11:22:18.862225] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.210 [2024-10-07 11:22:18.878576] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.210 [2024-10-07 11:22:18.878612] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.210 [2024-10-07 11:22:18.895303] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.210 [2024-10-07 11:22:18.895357] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.210 [2024-10-07 11:22:18.911708] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.210 [2024-10-07 11:22:18.911743] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.468 [2024-10-07 11:22:18.928059] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.468 [2024-10-07 11:22:18.928094] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.468 [2024-10-07 11:22:18.944670] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.468 [2024-10-07 11:22:18.944706] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.468 [2024-10-07 11:22:18.961218] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.468 [2024-10-07 11:22:18.961250] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.468 [2024-10-07 11:22:18.979557] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.468 [2024-10-07 11:22:18.979588] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.468 [2024-10-07 11:22:18.993146] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.468 [2024-10-07 11:22:18.993206] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.468 [2024-10-07 11:22:19.010716] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.468 [2024-10-07 11:22:19.010789] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.468 [2024-10-07 11:22:19.025903] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.468 [2024-10-07 11:22:19.025939] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.468 [2024-10-07 11:22:19.042871] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.468 [2024-10-07 11:22:19.042906] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.468 [2024-10-07 11:22:19.059217] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.468 [2024-10-07 11:22:19.059253] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.468 [2024-10-07 11:22:19.077464] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.468 [2024-10-07 11:22:19.077498] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.468 [2024-10-07 11:22:19.092390] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.468 [2024-10-07 11:22:19.092436] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.468 [2024-10-07 11:22:19.105557] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.468 [2024-10-07 11:22:19.105632] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.468 11391.33 IOPS, 88.99 MiB/s [2024-10-07T11:22:19.179Z] [2024-10-07 11:22:19.122458] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.468 [2024-10-07 11:22:19.122519] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.468 [2024-10-07 11:22:19.137632] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.468 [2024-10-07 11:22:19.137696] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.468 [2024-10-07 11:22:19.147889] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.468 [2024-10-07 11:22:19.147946] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.468 [2024-10-07 11:22:19.163662] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.468 [2024-10-07 11:22:19.163713] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.468 [2024-10-07 11:22:19.179252] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.468 [2024-10-07 11:22:19.179306] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.727 [2024-10-07 11:22:19.197962] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.727 [2024-10-07 11:22:19.198025] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.727 [2024-10-07 11:22:19.213386] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.727 [2024-10-07 11:22:19.213472] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.727 [2024-10-07 11:22:19.229776] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.727 [2024-10-07 11:22:19.229838] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.727 [2024-10-07 11:22:19.248183] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.727 [2024-10-07 11:22:19.248228] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.727 [2024-10-07 11:22:19.263206] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.727 [2024-10-07 11:22:19.263256] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.727 [2024-10-07 11:22:19.272529] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.727 [2024-10-07 11:22:19.272562] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.727 [2024-10-07 11:22:19.288619] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.727 [2024-10-07 11:22:19.288652] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.727 [2024-10-07 11:22:19.305514] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.727 [2024-10-07 11:22:19.305558] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.727 [2024-10-07 11:22:19.321513] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.727 [2024-10-07 11:22:19.321546] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.727 [2024-10-07 11:22:19.341393] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.727 [2024-10-07 11:22:19.341454] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.727 [2024-10-07 11:22:19.352184] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.727 [2024-10-07 11:22:19.352219] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.727 [2024-10-07 11:22:19.363861] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.727 [2024-10-07 11:22:19.363910] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.727 [2024-10-07 11:22:19.378989] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.727 [2024-10-07 11:22:19.379038] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.727 [2024-10-07 11:22:19.395627] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.727 [2024-10-07 11:22:19.395662] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.727 [2024-10-07 11:22:19.412876] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.727 [2024-10-07 11:22:19.412913] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.727 [2024-10-07 11:22:19.428838] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.727 [2024-10-07 11:22:19.428873] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.986 [2024-10-07 11:22:19.446859] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.986 [2024-10-07 11:22:19.446896] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.986 [2024-10-07 11:22:19.462472] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.986 [2024-10-07 11:22:19.462512] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.986 [2024-10-07 11:22:19.480519] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.986 [2024-10-07 11:22:19.480553] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.986 [2024-10-07 11:22:19.495801] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.986 [2024-10-07 11:22:19.495836] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.986 [2024-10-07 11:22:19.512764] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.986 [2024-10-07 11:22:19.512806] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.986 [2024-10-07 11:22:19.529120] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.986 [2024-10-07 11:22:19.529165] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.986 [2024-10-07 11:22:19.546008] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.986 [2024-10-07 11:22:19.546047] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.986 [2024-10-07 11:22:19.563034] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.986 [2024-10-07 11:22:19.563084] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.986 [2024-10-07 11:22:19.578817] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.986 [2024-10-07 11:22:19.578867] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.986 [2024-10-07 11:22:19.588272] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.986 [2024-10-07 11:22:19.588322] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.986 [2024-10-07 11:22:19.603500] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.986 [2024-10-07 11:22:19.603533] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.986 [2024-10-07 11:22:19.614695] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.986 [2024-10-07 11:22:19.614732] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.986 [2024-10-07 11:22:19.629879] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.986 [2024-10-07 11:22:19.629928] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.986 [2024-10-07 11:22:19.646331] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.986 [2024-10-07 11:22:19.646368] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.986 [2024-10-07 11:22:19.664173] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.986 [2024-10-07 11:22:19.664210] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.986 [2024-10-07 11:22:19.681025] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.986 [2024-10-07 11:22:19.681071] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:37.986 [2024-10-07 11:22:19.696722] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:37.986 [2024-10-07 11:22:19.696790] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.244 [2024-10-07 11:22:19.715154] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.244 [2024-10-07 11:22:19.715189] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.244 [2024-10-07 11:22:19.729904] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.244 [2024-10-07 11:22:19.729950] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.244 [2024-10-07 11:22:19.739819] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.244 [2024-10-07 11:22:19.739854] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.244 [2024-10-07 11:22:19.756769] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.244 [2024-10-07 11:22:19.756828] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.244 [2024-10-07 11:22:19.771800] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.244 [2024-10-07 11:22:19.771834] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.244 [2024-10-07 11:22:19.787374] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.244 [2024-10-07 11:22:19.787429] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.244 [2024-10-07 11:22:19.797862] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.244 [2024-10-07 11:22:19.797909] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.244 [2024-10-07 11:22:19.812890] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.244 [2024-10-07 11:22:19.812923] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.244 [2024-10-07 11:22:19.829534] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.244 [2024-10-07 11:22:19.829571] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.244 [2024-10-07 11:22:19.845878] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.244 [2024-10-07 11:22:19.845912] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.244 [2024-10-07 11:22:19.862027] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.244 [2024-10-07 11:22:19.862064] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.244 [2024-10-07 11:22:19.880267] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.244 [2024-10-07 11:22:19.880303] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.244 [2024-10-07 11:22:19.895231] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.244 [2024-10-07 11:22:19.895265] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.244 [2024-10-07 11:22:19.910825] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.244 [2024-10-07 11:22:19.910861] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.244 [2024-10-07 11:22:19.920056] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.244 [2024-10-07 11:22:19.920091] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.245 [2024-10-07 11:22:19.937132] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.245 [2024-10-07 11:22:19.937165] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.245 [2024-10-07 11:22:19.953481] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.245 [2024-10-07 11:22:19.953516] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.503 [2024-10-07 11:22:19.971116] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.503 [2024-10-07 11:22:19.971150] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.503 [2024-10-07 11:22:19.987308] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.503 [2024-10-07 11:22:19.987345] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.503 [2024-10-07 11:22:20.003467] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.503 [2024-10-07 11:22:20.003499] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.503 [2024-10-07 11:22:20.021619] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.503 [2024-10-07 11:22:20.021653] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.503 [2024-10-07 11:22:20.035121] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.503 [2024-10-07 11:22:20.035158] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.503 [2024-10-07 11:22:20.051580] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.503 [2024-10-07 11:22:20.051613] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.503 [2024-10-07 11:22:20.067093] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.503 [2024-10-07 11:22:20.067128] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.503 [2024-10-07 11:22:20.077343] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.503 [2024-10-07 11:22:20.077389] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.503 [2024-10-07 11:22:20.094141] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.503 [2024-10-07 11:22:20.094188] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.503 [2024-10-07 11:22:20.110193] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.503 [2024-10-07 11:22:20.110227] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.503 11350.75 IOPS, 88.68 MiB/s [2024-10-07T11:22:20.214Z] [2024-10-07 11:22:20.126649] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.503 [2024-10-07 11:22:20.126683] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.503 [2024-10-07 11:22:20.144842] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.503 [2024-10-07 11:22:20.144888] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.503 [2024-10-07 11:22:20.160539] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.503 [2024-10-07 11:22:20.160574] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.503 [2024-10-07 11:22:20.179350] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.503 [2024-10-07 11:22:20.179417] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.503 [2024-10-07 11:22:20.194545] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.503 [2024-10-07 11:22:20.194580] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.503 [2024-10-07 11:22:20.212398] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.503 [2024-10-07 11:22:20.212443] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.761 [2024-10-07 11:22:20.227488] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.761 [2024-10-07 11:22:20.227522] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.761 [2024-10-07 11:22:20.237636] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.761 [2024-10-07 11:22:20.237669] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.761 [2024-10-07 11:22:20.252871] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.761 [2024-10-07 11:22:20.252905] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.761 [2024-10-07 11:22:20.270116] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.761 [2024-10-07 11:22:20.270180] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.761 [2024-10-07 11:22:20.285958] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.761 [2024-10-07 11:22:20.286008] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.761 [2024-10-07 11:22:20.302868] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.761 [2024-10-07 11:22:20.302904] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.761 [2024-10-07 11:22:20.318647] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.761 [2024-10-07 11:22:20.318694] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.761 [2024-10-07 11:22:20.337564] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.761 [2024-10-07 11:22:20.337613] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.761 [2024-10-07 11:22:20.352912] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.761 [2024-10-07 11:22:20.352946] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.761 [2024-10-07 11:22:20.367594] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.761 [2024-10-07 11:22:20.367640] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.761 [2024-10-07 11:22:20.383719] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.761 [2024-10-07 11:22:20.383758] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.761 [2024-10-07 11:22:20.399625] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.761 [2024-10-07 11:22:20.399674] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.761 [2024-10-07 11:22:20.409236] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.761 [2024-10-07 11:22:20.409269] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.761 [2024-10-07 11:22:20.425250] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.761 [2024-10-07 11:22:20.425293] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.761 [2024-10-07 11:22:20.442151] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.761 [2024-10-07 11:22:20.442211] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:38.761 [2024-10-07 11:22:20.458953] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:38.761 [2024-10-07 11:22:20.458988] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.019 [2024-10-07 11:22:20.475520] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.019 [2024-10-07 11:22:20.475554] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.019 [2024-10-07 11:22:20.493721] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.019 [2024-10-07 11:22:20.493757] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.019 [2024-10-07 11:22:20.508891] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.019 [2024-10-07 11:22:20.508925] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.019 [2024-10-07 11:22:20.518740] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.019 [2024-10-07 11:22:20.518774] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.019 [2024-10-07 11:22:20.534730] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.019 [2024-10-07 11:22:20.534764] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.019 [2024-10-07 11:22:20.550493] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.019 [2024-10-07 11:22:20.550533] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.019 [2024-10-07 11:22:20.559918] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.019 [2024-10-07 11:22:20.559976] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.019 [2024-10-07 11:22:20.575862] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.019 [2024-10-07 11:22:20.575896] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.019 [2024-10-07 11:22:20.592280] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.019 [2024-10-07 11:22:20.592330] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.019 [2024-10-07 11:22:20.608866] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.019 [2024-10-07 11:22:20.608936] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.019 [2024-10-07 11:22:20.625852] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.019 [2024-10-07 11:22:20.625898] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.019 [2024-10-07 11:22:20.642990] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.019 [2024-10-07 11:22:20.643024] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.019 [2024-10-07 11:22:20.658175] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.019 [2024-10-07 11:22:20.658208] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.019 [2024-10-07 11:22:20.674860] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.019 [2024-10-07 11:22:20.674908] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.019 [2024-10-07 11:22:20.691252] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.019 [2024-10-07 11:22:20.691300] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.019 [2024-10-07 11:22:20.707207] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.019 [2024-10-07 11:22:20.707241] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.019 [2024-10-07 11:22:20.726002] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.019 [2024-10-07 11:22:20.726064] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.277 [2024-10-07 11:22:20.741105] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.277 [2024-10-07 11:22:20.741147] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.277 [2024-10-07 11:22:20.751300] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.277 [2024-10-07 11:22:20.751335] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.277 [2024-10-07 11:22:20.767398] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.278 [2024-10-07 11:22:20.767444] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.278 [2024-10-07 11:22:20.782922] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.278 [2024-10-07 11:22:20.782986] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.278 [2024-10-07 11:22:20.792384] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.278 [2024-10-07 11:22:20.792432] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.278 [2024-10-07 11:22:20.808621] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.278 [2024-10-07 11:22:20.808655] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.278 [2024-10-07 11:22:20.824155] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.278 [2024-10-07 11:22:20.824190] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.278 [2024-10-07 11:22:20.840549] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.278 [2024-10-07 11:22:20.840595] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.278 [2024-10-07 11:22:20.857092] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.278 [2024-10-07 11:22:20.857128] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.278 [2024-10-07 11:22:20.873685] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.278 [2024-10-07 11:22:20.873734] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.278 [2024-10-07 11:22:20.890302] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.278 [2024-10-07 11:22:20.890365] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.278 [2024-10-07 11:22:20.906800] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.278 [2024-10-07 11:22:20.906836] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.278 [2024-10-07 11:22:20.925667] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.278 [2024-10-07 11:22:20.925700] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.278 [2024-10-07 11:22:20.940520] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.278 [2024-10-07 11:22:20.940568] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.278 [2024-10-07 11:22:20.950131] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.278 [2024-10-07 11:22:20.950164] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.278 [2024-10-07 11:22:20.966451] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.278 [2024-10-07 11:22:20.966493] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.278 [2024-10-07 11:22:20.984240] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.278 [2024-10-07 11:22:20.984289] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.535 [2024-10-07 11:22:20.999640] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.535 [2024-10-07 11:22:20.999683] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.535 [2024-10-07 11:22:21.009425] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.535 [2024-10-07 11:22:21.009459] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.535 [2024-10-07 11:22:21.025644] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.535 [2024-10-07 11:22:21.025708] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.535 [2024-10-07 11:22:21.042155] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.535 [2024-10-07 11:22:21.042189] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.535 [2024-10-07 11:22:21.060276] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.535 [2024-10-07 11:22:21.060310] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.535 [2024-10-07 11:22:21.075723] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.535 [2024-10-07 11:22:21.075757] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.535 [2024-10-07 11:22:21.094115] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.535 [2024-10-07 11:22:21.094165] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.535 [2024-10-07 11:22:21.108865] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.535 [2024-10-07 11:22:21.108911] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.535 11323.00 IOPS, 88.46 MiB/s [2024-10-07T11:22:21.246Z] [2024-10-07 11:22:21.120008] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.535 [2024-10-07 11:22:21.120056] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.535 00:11:39.535 Latency(us) 00:11:39.535 [2024-10-07T11:22:21.246Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:11:39.535 Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:11:39.535 Nvme1n1 : 5.01 11332.00 88.53 0.00 0.00 11284.66 2874.65 20256.58 00:11:39.535 [2024-10-07T11:22:21.246Z] =================================================================================================================== 00:11:39.535 [2024-10-07T11:22:21.246Z] Total : 11332.00 88.53 0.00 0.00 11284.66 2874.65 20256.58 00:11:39.535 [2024-10-07 11:22:21.131962] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.535 [2024-10-07 11:22:21.132011] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.535 [2024-10-07 11:22:21.144020] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.535 [2024-10-07 11:22:21.144085] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.535 [2024-10-07 11:22:21.156017] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.535 [2024-10-07 11:22:21.156061] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.535 [2024-10-07 11:22:21.168012] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.535 [2024-10-07 11:22:21.168053] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.535 [2024-10-07 11:22:21.180018] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.535 [2024-10-07 11:22:21.180061] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.535 [2024-10-07 11:22:21.192026] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.535 [2024-10-07 11:22:21.192067] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.535 [2024-10-07 11:22:21.204012] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.535 [2024-10-07 11:22:21.204051] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.535 [2024-10-07 11:22:21.216021] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.535 [2024-10-07 11:22:21.216054] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.535 [2024-10-07 11:22:21.228032] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.536 [2024-10-07 11:22:21.228071] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.536 [2024-10-07 11:22:21.240022] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.536 [2024-10-07 11:22:21.240060] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.794 [2024-10-07 11:22:21.252068] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.794 [2024-10-07 11:22:21.252115] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.794 [2024-10-07 11:22:21.264064] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.794 [2024-10-07 11:22:21.264104] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.794 [2024-10-07 11:22:21.276033] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:11:39.794 [2024-10-07 11:22:21.276075] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:39.794 /home/vagrant/spdk_repo/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (65622) - No such process 00:11:39.794 11:22:21 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@49 -- # wait 65622 00:11:39.794 11:22:21 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:39.794 11:22:21 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:39.794 11:22:21 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:11:39.794 11:22:21 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:39.794 11:22:21 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:11:39.794 11:22:21 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:39.794 11:22:21 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:11:39.794 delay0 00:11:39.794 11:22:21 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:39.794 11:22:21 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:11:39.794 11:22:21 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:39.794 11:22:21 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:11:39.794 11:22:21 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:39.794 11:22:21 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@56 -- # /home/vagrant/spdk_repo/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 ns:1' 00:11:39.794 [2024-10-07 11:22:21.473864] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:11:46.381 Initializing NVMe Controllers 00:11:46.381 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:11:46.381 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:11:46.381 Initialization complete. Launching workers. 00:11:46.381 NS: TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 948 00:11:46.381 CTRLR: TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 1235, failed to submit 33 00:11:46.381 success 1154, unsuccessful 81, failed 0 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@60 -- # nvmftestfini 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@514 -- # nvmfcleanup 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@121 -- # sync 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@124 -- # set +e 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@125 -- # for i in {1..20} 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:11:46.381 rmmod nvme_tcp 00:11:46.381 rmmod nvme_fabrics 00:11:46.381 rmmod nvme_keyring 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@128 -- # set -e 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@129 -- # return 0 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@515 -- # '[' -n 65479 ']' 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@516 -- # killprocess 65479 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@950 -- # '[' -z 65479 ']' 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@954 -- # kill -0 65479 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@955 -- # uname 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 65479 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:11:46.381 killing process with pid 65479 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@968 -- # echo 'killing process with pid 65479' 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@969 -- # kill 65479 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@974 -- # wait 65479 00:11:46.381 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:11:46.381 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:11:46.381 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:11:46.381 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@297 -- # iptr 00:11:46.381 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@789 -- # iptables-restore 00:11:46.381 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@789 -- # iptables-save 00:11:46.381 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:11:46.381 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:11:46.381 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:11:46.381 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:11:46.381 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:11:46.381 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:11:46.381 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:11:46.381 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:11:46.381 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:11:46.381 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:11:46.639 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:11:46.639 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:11:46.639 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:11:46.639 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:11:46.639 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:46.639 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:46.639 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@246 -- # remove_spdk_ns 00:11:46.639 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:46.639 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:46.639 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:46.639 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@300 -- # return 0 00:11:46.639 00:11:46.639 real 0m24.266s 00:11:46.639 user 0m39.704s 00:11:46.639 sys 0m6.652s 00:11:46.639 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1126 -- # xtrace_disable 00:11:46.639 ************************************ 00:11:46.639 END TEST nvmf_zcopy 00:11:46.639 ************************************ 00:11:46.639 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:11:46.639 11:22:28 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@33 -- # run_test nvmf_nmic /home/vagrant/spdk_repo/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:11:46.639 11:22:28 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:11:46.639 11:22:28 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:46.639 11:22:28 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:11:46.639 ************************************ 00:11:46.639 START TEST nvmf_nmic 00:11:46.639 ************************************ 00:11:46.639 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:11:46.898 * Looking for test storage... 00:11:46.898 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1681 -- # lcov --version 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@333 -- # local ver1 ver1_l 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@334 -- # local ver2 ver2_l 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@336 -- # IFS=.-: 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@336 -- # read -ra ver1 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@337 -- # IFS=.-: 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@337 -- # read -ra ver2 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@338 -- # local 'op=<' 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@340 -- # ver1_l=2 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@341 -- # ver2_l=1 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@344 -- # case "$op" in 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@345 -- # : 1 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@364 -- # (( v = 0 )) 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@365 -- # decimal 1 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@353 -- # local d=1 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@355 -- # echo 1 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@365 -- # ver1[v]=1 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@366 -- # decimal 2 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@353 -- # local d=2 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@355 -- # echo 2 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@366 -- # ver2[v]=2 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@368 -- # return 0 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:11:46.898 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:46.898 --rc genhtml_branch_coverage=1 00:11:46.898 --rc genhtml_function_coverage=1 00:11:46.898 --rc genhtml_legend=1 00:11:46.898 --rc geninfo_all_blocks=1 00:11:46.898 --rc geninfo_unexecuted_blocks=1 00:11:46.898 00:11:46.898 ' 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:11:46.898 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:46.898 --rc genhtml_branch_coverage=1 00:11:46.898 --rc genhtml_function_coverage=1 00:11:46.898 --rc genhtml_legend=1 00:11:46.898 --rc geninfo_all_blocks=1 00:11:46.898 --rc geninfo_unexecuted_blocks=1 00:11:46.898 00:11:46.898 ' 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:11:46.898 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:46.898 --rc genhtml_branch_coverage=1 00:11:46.898 --rc genhtml_function_coverage=1 00:11:46.898 --rc genhtml_legend=1 00:11:46.898 --rc geninfo_all_blocks=1 00:11:46.898 --rc geninfo_unexecuted_blocks=1 00:11:46.898 00:11:46.898 ' 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:11:46.898 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:46.898 --rc genhtml_branch_coverage=1 00:11:46.898 --rc genhtml_function_coverage=1 00:11:46.898 --rc genhtml_legend=1 00:11:46.898 --rc geninfo_all_blocks=1 00:11:46.898 --rc geninfo_unexecuted_blocks=1 00:11:46.898 00:11:46.898 ' 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@7 -- # uname -s 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:11:46.898 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@15 -- # shopt -s extglob 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@5 -- # export PATH 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@51 -- # : 0 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:11:46.899 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@55 -- # have_pci_nics=0 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@14 -- # nvmftestinit 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@474 -- # prepare_net_devs 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@436 -- # local -g is_hw=no 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@438 -- # remove_spdk_ns 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@458 -- # nvmf_veth_init 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:11:46.899 Cannot find device "nvmf_init_br" 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@162 -- # true 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:11:46.899 Cannot find device "nvmf_init_br2" 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@163 -- # true 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:11:46.899 Cannot find device "nvmf_tgt_br" 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@164 -- # true 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:11:46.899 Cannot find device "nvmf_tgt_br2" 00:11:46.899 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@165 -- # true 00:11:46.900 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:11:46.900 Cannot find device "nvmf_init_br" 00:11:46.900 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@166 -- # true 00:11:46.900 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:11:46.900 Cannot find device "nvmf_init_br2" 00:11:46.900 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@167 -- # true 00:11:46.900 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:11:46.900 Cannot find device "nvmf_tgt_br" 00:11:46.900 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@168 -- # true 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:11:47.158 Cannot find device "nvmf_tgt_br2" 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@169 -- # true 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:11:47.158 Cannot find device "nvmf_br" 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@170 -- # true 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:11:47.158 Cannot find device "nvmf_init_if" 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@171 -- # true 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:11:47.158 Cannot find device "nvmf_init_if2" 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@172 -- # true 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:47.158 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@173 -- # true 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:47.158 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@174 -- # true 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:11:47.158 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:11:47.417 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:11:47.417 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.066 ms 00:11:47.417 00:11:47.417 --- 10.0.0.3 ping statistics --- 00:11:47.417 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:47.417 rtt min/avg/max/mdev = 0.066/0.066/0.066/0.000 ms 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:11:47.417 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:11:47.417 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.048 ms 00:11:47.417 00:11:47.417 --- 10.0.0.4 ping statistics --- 00:11:47.417 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:47.417 rtt min/avg/max/mdev = 0.048/0.048/0.048/0.000 ms 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:11:47.417 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:47.417 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.025 ms 00:11:47.417 00:11:47.417 --- 10.0.0.1 ping statistics --- 00:11:47.417 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:47.417 rtt min/avg/max/mdev = 0.025/0.025/0.025/0.000 ms 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:11:47.417 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:47.417 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.055 ms 00:11:47.417 00:11:47.417 --- 10.0.0.2 ping statistics --- 00:11:47.417 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:47.417 rtt min/avg/max/mdev = 0.055/0.055/0.055/0.000 ms 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@459 -- # return 0 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:11:47.417 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:11:47.417 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:11:47.417 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:11:47.417 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@724 -- # xtrace_disable 00:11:47.417 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:11:47.417 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@507 -- # nvmfpid=65998 00:11:47.417 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:47.417 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@508 -- # waitforlisten 65998 00:11:47.417 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@831 -- # '[' -z 65998 ']' 00:11:47.417 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:47.417 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:47.417 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:47.417 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:47.417 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:47.417 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:11:47.417 [2024-10-07 11:22:29.066462] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:11:47.418 [2024-10-07 11:22:29.066559] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:47.675 [2024-10-07 11:22:29.208932] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:47.675 [2024-10-07 11:22:29.280902] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:47.675 [2024-10-07 11:22:29.280965] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:47.676 [2024-10-07 11:22:29.280980] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:47.676 [2024-10-07 11:22:29.280990] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:47.676 [2024-10-07 11:22:29.280999] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:47.676 [2024-10-07 11:22:29.281989] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:11:47.676 [2024-10-07 11:22:29.282073] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:11:47.676 [2024-10-07 11:22:29.282175] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:11:47.676 [2024-10-07 11:22:29.282180] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:11:47.676 [2024-10-07 11:22:29.315117] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:11:47.676 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:47.676 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@864 -- # return 0 00:11:47.676 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:11:47.676 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@730 -- # xtrace_disable 00:11:47.676 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:11:47.933 [2024-10-07 11:22:29.417745] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:11:47.933 Malloc0 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:11:47.933 [2024-10-07 11:22:29.469427] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:47.933 test case1: single bdev can't be used in multiple subsystems 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.3 -s 4420 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@28 -- # nmic_status=0 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:11:47.933 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:47.934 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:11:47.934 [2024-10-07 11:22:29.497261] bdev.c:8202:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:11:47.934 [2024-10-07 11:22:29.497312] subsystem.c:2157:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:11:47.934 [2024-10-07 11:22:29.497326] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:11:47.934 request: 00:11:47.934 { 00:11:47.934 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:11:47.934 "namespace": { 00:11:47.934 "bdev_name": "Malloc0", 00:11:47.934 "no_auto_visible": false 00:11:47.934 }, 00:11:47.934 "method": "nvmf_subsystem_add_ns", 00:11:47.934 "req_id": 1 00:11:47.934 } 00:11:47.934 Got JSON-RPC error response 00:11:47.934 response: 00:11:47.934 { 00:11:47.934 "code": -32602, 00:11:47.934 "message": "Invalid parameters" 00:11:47.934 } 00:11:47.934 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:11:47.934 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@29 -- # nmic_status=1 00:11:47.934 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:11:47.934 Adding namespace failed - expected result. 00:11:47.934 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:11:47.934 test case2: host connect to nvmf target in multiple paths 00:11:47.934 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:11:47.934 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4421 00:11:47.934 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:47.934 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:11:47.934 [2024-10-07 11:22:29.509418] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4421 *** 00:11:47.934 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:47.934 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid=801d435b-e3d4-4ca3-aead-ebb283315d5b -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:11:48.191 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid=801d435b-e3d4-4ca3-aead-ebb283315d5b -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4421 00:11:48.191 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:11:48.191 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1198 -- # local i=0 00:11:48.191 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:11:48.191 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:11:48.191 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1205 -- # sleep 2 00:11:50.103 11:22:31 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:11:50.103 11:22:31 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:11:50.103 11:22:31 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:11:50.103 11:22:31 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:11:50.103 11:22:31 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:11:50.103 11:22:31 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1208 -- # return 0 00:11:50.103 11:22:31 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:11:50.103 [global] 00:11:50.103 thread=1 00:11:50.103 invalidate=1 00:11:50.103 rw=write 00:11:50.103 time_based=1 00:11:50.103 runtime=1 00:11:50.103 ioengine=libaio 00:11:50.103 direct=1 00:11:50.103 bs=4096 00:11:50.103 iodepth=1 00:11:50.103 norandommap=0 00:11:50.103 numjobs=1 00:11:50.103 00:11:50.361 verify_dump=1 00:11:50.361 verify_backlog=512 00:11:50.361 verify_state_save=0 00:11:50.361 do_verify=1 00:11:50.361 verify=crc32c-intel 00:11:50.361 [job0] 00:11:50.361 filename=/dev/nvme0n1 00:11:50.361 Could not set queue depth (nvme0n1) 00:11:50.361 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:11:50.361 fio-3.35 00:11:50.361 Starting 1 thread 00:11:51.739 00:11:51.739 job0: (groupid=0, jobs=1): err= 0: pid=66082: Mon Oct 7 11:22:33 2024 00:11:51.739 read: IOPS=2868, BW=11.2MiB/s (11.7MB/s)(11.2MiB/1001msec) 00:11:51.739 slat (nsec): min=13089, max=41941, avg=15912.52, stdev=2519.68 00:11:51.739 clat (usec): min=149, max=785, avg=184.40, stdev=18.13 00:11:51.739 lat (usec): min=164, max=802, avg=200.31, stdev=18.27 00:11:51.739 clat percentiles (usec): 00:11:51.739 | 1.00th=[ 153], 5.00th=[ 161], 10.00th=[ 165], 20.00th=[ 172], 00:11:51.739 | 30.00th=[ 176], 40.00th=[ 180], 50.00th=[ 186], 60.00th=[ 190], 00:11:51.739 | 70.00th=[ 194], 80.00th=[ 198], 90.00th=[ 202], 95.00th=[ 208], 00:11:51.739 | 99.00th=[ 217], 99.50th=[ 223], 99.90th=[ 237], 99.95th=[ 241], 00:11:51.739 | 99.99th=[ 783] 00:11:51.739 write: IOPS=3068, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec); 0 zone resets 00:11:51.739 slat (usec): min=18, max=108, avg=23.12, stdev= 4.95 00:11:51.739 clat (usec): min=90, max=236, avg=111.36, stdev=11.15 00:11:51.739 lat (usec): min=110, max=345, avg=134.48, stdev=13.22 00:11:51.739 clat percentiles (usec): 00:11:51.739 | 1.00th=[ 93], 5.00th=[ 96], 10.00th=[ 99], 20.00th=[ 102], 00:11:51.739 | 30.00th=[ 105], 40.00th=[ 109], 50.00th=[ 111], 60.00th=[ 113], 00:11:51.739 | 70.00th=[ 116], 80.00th=[ 119], 90.00th=[ 126], 95.00th=[ 131], 00:11:51.739 | 99.00th=[ 145], 99.50th=[ 153], 99.90th=[ 167], 99.95th=[ 212], 00:11:51.739 | 99.99th=[ 237] 00:11:51.739 bw ( KiB/s): min=12288, max=12288, per=100.00%, avg=12288.00, stdev= 0.00, samples=1 00:11:51.739 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=1 00:11:51.739 lat (usec) : 100=7.02%, 250=92.97%, 1000=0.02% 00:11:51.739 cpu : usr=3.10%, sys=8.80%, ctx=5943, majf=0, minf=5 00:11:51.739 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:11:51.739 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:51.739 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:11:51.739 issued rwts: total=2871,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:11:51.739 latency : target=0, window=0, percentile=100.00%, depth=1 00:11:51.739 00:11:51.739 Run status group 0 (all jobs): 00:11:51.739 READ: bw=11.2MiB/s (11.7MB/s), 11.2MiB/s-11.2MiB/s (11.7MB/s-11.7MB/s), io=11.2MiB (11.8MB), run=1001-1001msec 00:11:51.739 WRITE: bw=12.0MiB/s (12.6MB/s), 12.0MiB/s-12.0MiB/s (12.6MB/s-12.6MB/s), io=12.0MiB (12.6MB), run=1001-1001msec 00:11:51.739 00:11:51.739 Disk stats (read/write): 00:11:51.739 nvme0n1: ios=2610/2796, merge=0/0, ticks=491/336, in_queue=827, util=91.28% 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:51.740 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1219 -- # local i=0 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1231 -- # return 0 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@53 -- # nvmftestfini 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@514 -- # nvmfcleanup 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@121 -- # sync 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@124 -- # set +e 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@125 -- # for i in {1..20} 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:11:51.740 rmmod nvme_tcp 00:11:51.740 rmmod nvme_fabrics 00:11:51.740 rmmod nvme_keyring 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@128 -- # set -e 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@129 -- # return 0 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@515 -- # '[' -n 65998 ']' 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@516 -- # killprocess 65998 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@950 -- # '[' -z 65998 ']' 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@954 -- # kill -0 65998 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@955 -- # uname 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 65998 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:11:51.740 killing process with pid 65998 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@968 -- # echo 'killing process with pid 65998' 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@969 -- # kill 65998 00:11:51.740 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@974 -- # wait 65998 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@297 -- # iptr 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@789 -- # iptables-save 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@789 -- # iptables-restore 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:51.998 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:52.257 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@246 -- # remove_spdk_ns 00:11:52.257 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:52.257 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:52.257 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:52.257 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@300 -- # return 0 00:11:52.257 00:11:52.257 real 0m5.431s 00:11:52.257 user 0m15.635s 00:11:52.257 sys 0m2.243s 00:11:52.257 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1126 -- # xtrace_disable 00:11:52.257 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:11:52.257 ************************************ 00:11:52.257 END TEST nvmf_nmic 00:11:52.257 ************************************ 00:11:52.257 11:22:33 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@34 -- # run_test nvmf_fio_target /home/vagrant/spdk_repo/spdk/test/nvmf/target/fio.sh --transport=tcp 00:11:52.257 11:22:33 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:11:52.257 11:22:33 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:52.257 11:22:33 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:11:52.257 ************************************ 00:11:52.257 START TEST nvmf_fio_target 00:11:52.257 ************************************ 00:11:52.257 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/fio.sh --transport=tcp 00:11:52.257 * Looking for test storage... 00:11:52.257 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:11:52.257 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:11:52.257 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1681 -- # lcov --version 00:11:52.257 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@333 -- # local ver1 ver1_l 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@334 -- # local ver2 ver2_l 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@336 -- # IFS=.-: 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@336 -- # read -ra ver1 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@337 -- # IFS=.-: 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@337 -- # read -ra ver2 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@338 -- # local 'op=<' 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@340 -- # ver1_l=2 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@341 -- # ver2_l=1 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@344 -- # case "$op" in 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@345 -- # : 1 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@364 -- # (( v = 0 )) 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@365 -- # decimal 1 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@353 -- # local d=1 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@355 -- # echo 1 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@365 -- # ver1[v]=1 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@366 -- # decimal 2 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@353 -- # local d=2 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@355 -- # echo 2 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@366 -- # ver2[v]=2 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@368 -- # return 0 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:11:52.516 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:52.516 --rc genhtml_branch_coverage=1 00:11:52.516 --rc genhtml_function_coverage=1 00:11:52.516 --rc genhtml_legend=1 00:11:52.516 --rc geninfo_all_blocks=1 00:11:52.516 --rc geninfo_unexecuted_blocks=1 00:11:52.516 00:11:52.516 ' 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:11:52.516 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:52.516 --rc genhtml_branch_coverage=1 00:11:52.516 --rc genhtml_function_coverage=1 00:11:52.516 --rc genhtml_legend=1 00:11:52.516 --rc geninfo_all_blocks=1 00:11:52.516 --rc geninfo_unexecuted_blocks=1 00:11:52.516 00:11:52.516 ' 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:11:52.516 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:52.516 --rc genhtml_branch_coverage=1 00:11:52.516 --rc genhtml_function_coverage=1 00:11:52.516 --rc genhtml_legend=1 00:11:52.516 --rc geninfo_all_blocks=1 00:11:52.516 --rc geninfo_unexecuted_blocks=1 00:11:52.516 00:11:52.516 ' 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:11:52.516 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:52.516 --rc genhtml_branch_coverage=1 00:11:52.516 --rc genhtml_function_coverage=1 00:11:52.516 --rc genhtml_legend=1 00:11:52.516 --rc geninfo_all_blocks=1 00:11:52.516 --rc geninfo_unexecuted_blocks=1 00:11:52.516 00:11:52.516 ' 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@7 -- # uname -s 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:52.516 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:11:52.516 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:11:52.516 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:52.516 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:52.516 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:11:52.516 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:52.516 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:11:52.516 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@15 -- # shopt -s extglob 00:11:52.516 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:52.516 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:52.516 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:52.516 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:52.516 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@5 -- # export PATH 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@51 -- # : 0 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:11:52.517 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@55 -- # have_pci_nics=0 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@14 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@16 -- # nvmftestinit 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@474 -- # prepare_net_devs 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@436 -- # local -g is_hw=no 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@438 -- # remove_spdk_ns 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@458 -- # nvmf_veth_init 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:11:52.517 Cannot find device "nvmf_init_br" 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@162 -- # true 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:11:52.517 Cannot find device "nvmf_init_br2" 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@163 -- # true 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:11:52.517 Cannot find device "nvmf_tgt_br" 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@164 -- # true 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:11:52.517 Cannot find device "nvmf_tgt_br2" 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@165 -- # true 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:11:52.517 Cannot find device "nvmf_init_br" 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@166 -- # true 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:11:52.517 Cannot find device "nvmf_init_br2" 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@167 -- # true 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:11:52.517 Cannot find device "nvmf_tgt_br" 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@168 -- # true 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:11:52.517 Cannot find device "nvmf_tgt_br2" 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@169 -- # true 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:11:52.517 Cannot find device "nvmf_br" 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@170 -- # true 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:11:52.517 Cannot find device "nvmf_init_if" 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@171 -- # true 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:11:52.517 Cannot find device "nvmf_init_if2" 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@172 -- # true 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:52.517 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@173 -- # true 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:52.517 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@174 -- # true 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:11:52.517 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:11:52.776 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:11:52.776 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.092 ms 00:11:52.776 00:11:52.776 --- 10.0.0.3 ping statistics --- 00:11:52.776 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:52.776 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:11:52.776 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:11:52.776 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.065 ms 00:11:52.776 00:11:52.776 --- 10.0.0.4 ping statistics --- 00:11:52.776 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:52.776 rtt min/avg/max/mdev = 0.065/0.065/0.065/0.000 ms 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:11:52.776 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:52.776 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.025 ms 00:11:52.776 00:11:52.776 --- 10.0.0.1 ping statistics --- 00:11:52.776 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:52.776 rtt min/avg/max/mdev = 0.025/0.025/0.025/0.000 ms 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:11:52.776 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:52.776 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.046 ms 00:11:52.776 00:11:52.776 --- 10.0.0.2 ping statistics --- 00:11:52.776 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:52.776 rtt min/avg/max/mdev = 0.046/0.046/0.046/0.000 ms 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@459 -- # return 0 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@724 -- # xtrace_disable 00:11:52.776 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@10 -- # set +x 00:11:52.777 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@507 -- # nvmfpid=66311 00:11:52.777 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:52.777 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@508 -- # waitforlisten 66311 00:11:52.777 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@831 -- # '[' -z 66311 ']' 00:11:52.777 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:52.777 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:52.777 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:52.777 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:52.777 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:52.777 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@10 -- # set +x 00:11:53.034 [2024-10-07 11:22:34.499617] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:11:53.034 [2024-10-07 11:22:34.499730] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:53.034 [2024-10-07 11:22:34.636245] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:53.034 [2024-10-07 11:22:34.705874] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:53.034 [2024-10-07 11:22:34.705946] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:53.034 [2024-10-07 11:22:34.705969] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:53.035 [2024-10-07 11:22:34.705979] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:53.035 [2024-10-07 11:22:34.705989] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:53.035 [2024-10-07 11:22:34.706871] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:11:53.035 [2024-10-07 11:22:34.706989] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:11:53.035 [2024-10-07 11:22:34.707087] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:11:53.035 [2024-10-07 11:22:34.707093] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:11:53.292 [2024-10-07 11:22:34.754790] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:11:53.858 11:22:35 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:53.858 11:22:35 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@864 -- # return 0 00:11:53.858 11:22:35 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:11:53.858 11:22:35 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@730 -- # xtrace_disable 00:11:53.858 11:22:35 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@10 -- # set +x 00:11:53.858 11:22:35 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:53.858 11:22:35 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@19 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:11:54.117 [2024-10-07 11:22:35.789006] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:54.117 11:22:35 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@21 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:11:54.721 11:22:36 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:11:54.721 11:22:36 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@22 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:11:54.979 11:22:36 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:11:54.979 11:22:36 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@24 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:11:55.236 11:22:36 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:11:55.236 11:22:36 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@25 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:11:55.494 11:22:37 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:11:55.494 11:22:37 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@26 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:11:55.752 11:22:37 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@29 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:11:56.010 11:22:37 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:11:56.010 11:22:37 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@30 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:11:56.576 11:22:38 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:11:56.576 11:22:38 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:11:56.842 11:22:38 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:11:56.842 11:22:38 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@32 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:11:57.105 11:22:38 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@34 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:57.362 11:22:38 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:11:57.362 11:22:38 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@36 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:11:57.620 11:22:39 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:11:57.620 11:22:39 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@36 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:57.878 11:22:39 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@38 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:11:58.136 [2024-10-07 11:22:39.727575] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:58.136 11:22:39 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@41 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:11:58.394 11:22:40 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@44 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:11:58.653 11:22:40 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid=801d435b-e3d4-4ca3-aead-ebb283315d5b -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:11:58.912 11:22:40 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:11:58.912 11:22:40 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1198 -- # local i=0 00:11:58.912 11:22:40 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:11:58.912 11:22:40 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1200 -- # [[ -n 4 ]] 00:11:58.912 11:22:40 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1201 -- # nvme_device_counter=4 00:11:58.912 11:22:40 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1205 -- # sleep 2 00:12:00.812 11:22:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:12:00.813 11:22:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:12:00.813 11:22:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:12:00.813 11:22:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1207 -- # nvme_devices=4 00:12:00.813 11:22:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:12:00.813 11:22:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1208 -- # return 0 00:12:00.813 11:22:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:12:00.813 [global] 00:12:00.813 thread=1 00:12:00.813 invalidate=1 00:12:00.813 rw=write 00:12:00.813 time_based=1 00:12:00.813 runtime=1 00:12:00.813 ioengine=libaio 00:12:00.813 direct=1 00:12:00.813 bs=4096 00:12:00.813 iodepth=1 00:12:00.813 norandommap=0 00:12:00.813 numjobs=1 00:12:00.813 00:12:00.813 verify_dump=1 00:12:00.813 verify_backlog=512 00:12:00.813 verify_state_save=0 00:12:00.813 do_verify=1 00:12:00.813 verify=crc32c-intel 00:12:00.813 [job0] 00:12:00.813 filename=/dev/nvme0n1 00:12:01.071 [job1] 00:12:01.071 filename=/dev/nvme0n2 00:12:01.071 [job2] 00:12:01.071 filename=/dev/nvme0n3 00:12:01.071 [job3] 00:12:01.071 filename=/dev/nvme0n4 00:12:01.071 Could not set queue depth (nvme0n1) 00:12:01.071 Could not set queue depth (nvme0n2) 00:12:01.071 Could not set queue depth (nvme0n3) 00:12:01.071 Could not set queue depth (nvme0n4) 00:12:01.071 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:12:01.071 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:12:01.071 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:12:01.071 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:12:01.071 fio-3.35 00:12:01.071 Starting 4 threads 00:12:02.462 00:12:02.462 job0: (groupid=0, jobs=1): err= 0: pid=66507: Mon Oct 7 11:22:43 2024 00:12:02.462 read: IOPS=1639, BW=6557KiB/s (6715kB/s)(6564KiB/1001msec) 00:12:02.462 slat (usec): min=8, max=337, avg=15.70, stdev=10.14 00:12:02.462 clat (nsec): min=1770, max=654222, avg=292492.56, stdev=59750.53 00:12:02.462 lat (usec): min=201, max=668, avg=308.19, stdev=60.51 00:12:02.462 clat percentiles (usec): 00:12:02.462 | 1.00th=[ 223], 5.00th=[ 231], 10.00th=[ 237], 20.00th=[ 245], 00:12:02.462 | 30.00th=[ 251], 40.00th=[ 260], 50.00th=[ 265], 60.00th=[ 281], 00:12:02.462 | 70.00th=[ 334], 80.00th=[ 355], 90.00th=[ 375], 95.00th=[ 400], 00:12:02.462 | 99.00th=[ 445], 99.50th=[ 482], 99.90th=[ 603], 99.95th=[ 652], 00:12:02.462 | 99.99th=[ 652] 00:12:02.462 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:12:02.462 slat (usec): min=11, max=114, avg=23.06, stdev= 7.56 00:12:02.462 clat (usec): min=108, max=827, avg=214.72, stdev=54.21 00:12:02.462 lat (usec): min=127, max=845, avg=237.79, stdev=58.08 00:12:02.462 clat percentiles (usec): 00:12:02.462 | 1.00th=[ 128], 5.00th=[ 157], 10.00th=[ 169], 20.00th=[ 180], 00:12:02.462 | 30.00th=[ 184], 40.00th=[ 190], 50.00th=[ 198], 60.00th=[ 206], 00:12:02.462 | 70.00th=[ 221], 80.00th=[ 260], 90.00th=[ 297], 95.00th=[ 318], 00:12:02.462 | 99.00th=[ 379], 99.50th=[ 416], 99.90th=[ 486], 99.95th=[ 506], 00:12:02.462 | 99.99th=[ 824] 00:12:02.462 bw ( KiB/s): min= 8192, max= 8192, per=23.91%, avg=8192.00, stdev= 0.00, samples=1 00:12:02.462 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:12:02.462 lat (usec) : 2=0.03%, 250=56.19%, 500=43.51%, 750=0.24%, 1000=0.03% 00:12:02.462 cpu : usr=1.30%, sys=6.40%, ctx=3700, majf=0, minf=17 00:12:02.462 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:12:02.462 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:02.462 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:02.462 issued rwts: total=1641,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:02.462 latency : target=0, window=0, percentile=100.00%, depth=1 00:12:02.462 job1: (groupid=0, jobs=1): err= 0: pid=66508: Mon Oct 7 11:22:43 2024 00:12:02.462 read: IOPS=1586, BW=6346KiB/s (6498kB/s)(6352KiB/1001msec) 00:12:02.462 slat (usec): min=11, max=3918, avg=24.52, stdev=98.09 00:12:02.462 clat (usec): min=163, max=972, avg=297.55, stdev=97.03 00:12:02.462 lat (usec): min=184, max=4238, avg=322.07, stdev=141.72 00:12:02.462 clat percentiles (usec): 00:12:02.462 | 1.00th=[ 215], 5.00th=[ 223], 10.00th=[ 229], 20.00th=[ 237], 00:12:02.462 | 30.00th=[ 243], 40.00th=[ 251], 50.00th=[ 258], 60.00th=[ 269], 00:12:02.462 | 70.00th=[ 318], 80.00th=[ 343], 90.00th=[ 383], 95.00th=[ 553], 00:12:02.462 | 99.00th=[ 627], 99.50th=[ 652], 99.90th=[ 848], 99.95th=[ 971], 00:12:02.462 | 99.99th=[ 971] 00:12:02.462 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:12:02.462 slat (usec): min=15, max=111, avg=27.47, stdev= 9.59 00:12:02.462 clat (usec): min=102, max=511, avg=206.55, stdev=50.38 00:12:02.462 lat (usec): min=127, max=542, avg=234.03, stdev=54.90 00:12:02.462 clat percentiles (usec): 00:12:02.462 | 1.00th=[ 124], 5.00th=[ 151], 10.00th=[ 165], 20.00th=[ 174], 00:12:02.462 | 30.00th=[ 180], 40.00th=[ 184], 50.00th=[ 190], 60.00th=[ 198], 00:12:02.462 | 70.00th=[ 208], 80.00th=[ 249], 90.00th=[ 281], 95.00th=[ 306], 00:12:02.462 | 99.00th=[ 363], 99.50th=[ 388], 99.90th=[ 465], 99.95th=[ 494], 00:12:02.462 | 99.99th=[ 510] 00:12:02.462 bw ( KiB/s): min= 8192, max= 8192, per=23.91%, avg=8192.00, stdev= 0.00, samples=1 00:12:02.462 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:12:02.462 lat (usec) : 250=62.87%, 500=33.75%, 750=3.33%, 1000=0.06% 00:12:02.462 cpu : usr=2.50%, sys=6.90%, ctx=3637, majf=0, minf=7 00:12:02.462 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:12:02.462 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:02.462 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:02.462 issued rwts: total=1588,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:02.462 latency : target=0, window=0, percentile=100.00%, depth=1 00:12:02.462 job2: (groupid=0, jobs=1): err= 0: pid=66509: Mon Oct 7 11:22:43 2024 00:12:02.462 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:12:02.462 slat (usec): min=8, max=199, avg=17.42, stdev= 8.94 00:12:02.462 clat (usec): min=52, max=7106, avg=320.12, stdev=250.72 00:12:02.462 lat (usec): min=186, max=7133, avg=337.54, stdev=251.01 00:12:02.462 clat percentiles (usec): 00:12:02.462 | 1.00th=[ 194], 5.00th=[ 237], 10.00th=[ 249], 20.00th=[ 262], 00:12:02.462 | 30.00th=[ 269], 40.00th=[ 277], 50.00th=[ 293], 60.00th=[ 314], 00:12:02.462 | 70.00th=[ 334], 80.00th=[ 355], 90.00th=[ 379], 95.00th=[ 437], 00:12:02.462 | 99.00th=[ 529], 99.50th=[ 570], 99.90th=[ 4817], 99.95th=[ 7111], 00:12:02.462 | 99.99th=[ 7111] 00:12:02.462 write: IOPS=1982, BW=7928KiB/s (8118kB/s)(7936KiB/1001msec); 0 zone resets 00:12:02.462 slat (nsec): min=11991, max=86781, avg=23131.21, stdev=8036.92 00:12:02.462 clat (usec): min=103, max=1892, avg=215.99, stdev=62.72 00:12:02.462 lat (usec): min=129, max=1979, avg=239.12, stdev=66.30 00:12:02.462 clat percentiles (usec): 00:12:02.462 | 1.00th=[ 128], 5.00th=[ 151], 10.00th=[ 167], 20.00th=[ 184], 00:12:02.462 | 30.00th=[ 194], 40.00th=[ 202], 50.00th=[ 208], 60.00th=[ 217], 00:12:02.462 | 70.00th=[ 225], 80.00th=[ 237], 90.00th=[ 273], 95.00th=[ 302], 00:12:02.462 | 99.00th=[ 363], 99.50th=[ 379], 99.90th=[ 865], 99.95th=[ 1893], 00:12:02.462 | 99.99th=[ 1893] 00:12:02.462 bw ( KiB/s): min= 8192, max= 8192, per=23.91%, avg=8192.00, stdev= 0.00, samples=1 00:12:02.462 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:12:02.462 lat (usec) : 100=0.03%, 250=52.27%, 500=46.62%, 750=0.85%, 1000=0.09% 00:12:02.462 lat (msec) : 2=0.03%, 4=0.06%, 10=0.06% 00:12:02.462 cpu : usr=1.50%, sys=6.00%, ctx=3538, majf=0, minf=9 00:12:02.462 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:12:02.462 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:02.462 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:02.462 issued rwts: total=1536,1984,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:02.462 latency : target=0, window=0, percentile=100.00%, depth=1 00:12:02.462 job3: (groupid=0, jobs=1): err= 0: pid=66510: Mon Oct 7 11:22:43 2024 00:12:02.462 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:12:02.462 slat (usec): min=8, max=286, avg=19.06, stdev= 8.73 00:12:02.462 clat (usec): min=146, max=2250, avg=224.78, stdev=74.10 00:12:02.462 lat (usec): min=159, max=2268, avg=243.85, stdev=76.50 00:12:02.462 clat percentiles (usec): 00:12:02.462 | 1.00th=[ 155], 5.00th=[ 161], 10.00th=[ 165], 20.00th=[ 174], 00:12:02.462 | 30.00th=[ 180], 40.00th=[ 188], 50.00th=[ 204], 60.00th=[ 245], 00:12:02.462 | 70.00th=[ 258], 80.00th=[ 269], 90.00th=[ 289], 95.00th=[ 310], 00:12:02.462 | 99.00th=[ 416], 99.50th=[ 490], 99.90th=[ 519], 99.95th=[ 1074], 00:12:02.462 | 99.99th=[ 2245] 00:12:02.462 write: IOPS=2491, BW=9966KiB/s (10.2MB/s)(9976KiB/1001msec); 0 zone resets 00:12:02.462 slat (usec): min=11, max=135, avg=24.65, stdev= 7.99 00:12:02.462 clat (usec): min=102, max=338, avg=172.13, stdev=41.04 00:12:02.462 lat (usec): min=121, max=392, avg=196.78, stdev=44.52 00:12:02.462 clat percentiles (usec): 00:12:02.462 | 1.00th=[ 108], 5.00th=[ 115], 10.00th=[ 121], 20.00th=[ 131], 00:12:02.462 | 30.00th=[ 137], 40.00th=[ 149], 50.00th=[ 182], 60.00th=[ 192], 00:12:02.462 | 70.00th=[ 200], 80.00th=[ 210], 90.00th=[ 225], 95.00th=[ 237], 00:12:02.462 | 99.00th=[ 255], 99.50th=[ 260], 99.90th=[ 281], 99.95th=[ 293], 00:12:02.462 | 99.99th=[ 338] 00:12:02.462 bw ( KiB/s): min= 8192, max= 8192, per=23.91%, avg=8192.00, stdev= 0.00, samples=1 00:12:02.462 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:12:02.462 lat (usec) : 250=82.89%, 500=17.00%, 750=0.07% 00:12:02.462 lat (msec) : 2=0.02%, 4=0.02% 00:12:02.462 cpu : usr=2.70%, sys=7.60%, ctx=4542, majf=0, minf=5 00:12:02.463 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:12:02.463 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:02.463 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:02.463 issued rwts: total=2048,2494,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:02.463 latency : target=0, window=0, percentile=100.00%, depth=1 00:12:02.463 00:12:02.463 Run status group 0 (all jobs): 00:12:02.463 READ: bw=26.6MiB/s (27.9MB/s), 6138KiB/s-8184KiB/s (6285kB/s-8380kB/s), io=26.6MiB (27.9MB), run=1001-1001msec 00:12:02.463 WRITE: bw=33.5MiB/s (35.1MB/s), 7928KiB/s-9966KiB/s (8118kB/s-10.2MB/s), io=33.5MiB (35.1MB), run=1001-1001msec 00:12:02.463 00:12:02.463 Disk stats (read/write): 00:12:02.463 nvme0n1: ios=1562/1536, merge=0/0, ticks=473/358, in_queue=831, util=87.17% 00:12:02.463 nvme0n2: ios=1455/1536, merge=0/0, ticks=447/342, in_queue=789, util=86.97% 00:12:02.463 nvme0n3: ios=1356/1536, merge=0/0, ticks=426/355, in_queue=781, util=88.41% 00:12:02.463 nvme0n4: ios=1858/2048, merge=0/0, ticks=426/364, in_queue=790, util=89.72% 00:12:02.463 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@51 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:12:02.463 [global] 00:12:02.463 thread=1 00:12:02.463 invalidate=1 00:12:02.463 rw=randwrite 00:12:02.463 time_based=1 00:12:02.463 runtime=1 00:12:02.463 ioengine=libaio 00:12:02.463 direct=1 00:12:02.463 bs=4096 00:12:02.463 iodepth=1 00:12:02.463 norandommap=0 00:12:02.463 numjobs=1 00:12:02.463 00:12:02.463 verify_dump=1 00:12:02.463 verify_backlog=512 00:12:02.463 verify_state_save=0 00:12:02.463 do_verify=1 00:12:02.463 verify=crc32c-intel 00:12:02.463 [job0] 00:12:02.463 filename=/dev/nvme0n1 00:12:02.463 [job1] 00:12:02.463 filename=/dev/nvme0n2 00:12:02.463 [job2] 00:12:02.463 filename=/dev/nvme0n3 00:12:02.463 [job3] 00:12:02.463 filename=/dev/nvme0n4 00:12:02.463 Could not set queue depth (nvme0n1) 00:12:02.463 Could not set queue depth (nvme0n2) 00:12:02.463 Could not set queue depth (nvme0n3) 00:12:02.463 Could not set queue depth (nvme0n4) 00:12:02.463 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:12:02.463 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:12:02.463 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:12:02.463 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:12:02.463 fio-3.35 00:12:02.463 Starting 4 threads 00:12:03.837 00:12:03.837 job0: (groupid=0, jobs=1): err= 0: pid=66569: Mon Oct 7 11:22:45 2024 00:12:03.837 read: IOPS=2010, BW=8044KiB/s (8237kB/s)(8052KiB/1001msec) 00:12:03.837 slat (nsec): min=8317, max=38936, avg=12196.90, stdev=3781.32 00:12:03.837 clat (usec): min=210, max=871, avg=253.49, stdev=31.05 00:12:03.837 lat (usec): min=222, max=880, avg=265.69, stdev=31.42 00:12:03.837 clat percentiles (usec): 00:12:03.837 | 1.00th=[ 221], 5.00th=[ 229], 10.00th=[ 233], 20.00th=[ 239], 00:12:03.837 | 30.00th=[ 243], 40.00th=[ 245], 50.00th=[ 249], 60.00th=[ 253], 00:12:03.837 | 70.00th=[ 258], 80.00th=[ 265], 90.00th=[ 269], 95.00th=[ 281], 00:12:03.837 | 99.00th=[ 379], 99.50th=[ 449], 99.90th=[ 545], 99.95th=[ 668], 00:12:03.837 | 99.99th=[ 873] 00:12:03.837 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:12:03.837 slat (nsec): min=11338, max=79191, avg=21049.18, stdev=5330.47 00:12:03.837 clat (usec): min=155, max=433, avg=202.84, stdev=28.10 00:12:03.837 lat (usec): min=170, max=453, avg=223.89, stdev=29.54 00:12:03.837 clat percentiles (usec): 00:12:03.837 | 1.00th=[ 165], 5.00th=[ 172], 10.00th=[ 178], 20.00th=[ 184], 00:12:03.837 | 30.00th=[ 190], 40.00th=[ 194], 50.00th=[ 198], 60.00th=[ 202], 00:12:03.837 | 70.00th=[ 208], 80.00th=[ 217], 90.00th=[ 229], 95.00th=[ 255], 00:12:03.837 | 99.00th=[ 322], 99.50th=[ 338], 99.90th=[ 375], 99.95th=[ 375], 00:12:03.837 | 99.99th=[ 433] 00:12:03.837 bw ( KiB/s): min= 8175, max= 8175, per=20.02%, avg=8175.00, stdev= 0.00, samples=1 00:12:03.837 iops : min= 2043, max= 2043, avg=2043.00, stdev= 0.00, samples=1 00:12:03.837 lat (usec) : 250=73.43%, 500=26.47%, 750=0.07%, 1000=0.02% 00:12:03.837 cpu : usr=1.50%, sys=5.90%, ctx=4062, majf=0, minf=9 00:12:03.837 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:12:03.837 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:03.837 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:03.837 issued rwts: total=2013,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:03.837 latency : target=0, window=0, percentile=100.00%, depth=1 00:12:03.837 job1: (groupid=0, jobs=1): err= 0: pid=66570: Mon Oct 7 11:22:45 2024 00:12:03.837 read: IOPS=2010, BW=8044KiB/s (8237kB/s)(8052KiB/1001msec) 00:12:03.837 slat (usec): min=8, max=108, avg=12.96, stdev= 4.79 00:12:03.837 clat (usec): min=208, max=857, avg=252.50, stdev=30.72 00:12:03.837 lat (usec): min=223, max=873, avg=265.46, stdev=30.95 00:12:03.837 clat percentiles (usec): 00:12:03.837 | 1.00th=[ 219], 5.00th=[ 227], 10.00th=[ 233], 20.00th=[ 237], 00:12:03.837 | 30.00th=[ 241], 40.00th=[ 245], 50.00th=[ 249], 60.00th=[ 253], 00:12:03.837 | 70.00th=[ 258], 80.00th=[ 262], 90.00th=[ 269], 95.00th=[ 277], 00:12:03.837 | 99.00th=[ 383], 99.50th=[ 441], 99.90th=[ 498], 99.95th=[ 676], 00:12:03.837 | 99.99th=[ 857] 00:12:03.837 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:12:03.837 slat (nsec): min=11313, max=61237, avg=21473.63, stdev=7929.45 00:12:03.837 clat (usec): min=150, max=445, avg=202.40, stdev=26.99 00:12:03.837 lat (usec): min=171, max=457, avg=223.88, stdev=29.43 00:12:03.837 clat percentiles (usec): 00:12:03.837 | 1.00th=[ 165], 5.00th=[ 174], 10.00th=[ 178], 20.00th=[ 186], 00:12:03.837 | 30.00th=[ 190], 40.00th=[ 194], 50.00th=[ 198], 60.00th=[ 202], 00:12:03.837 | 70.00th=[ 208], 80.00th=[ 215], 90.00th=[ 229], 95.00th=[ 255], 00:12:03.837 | 99.00th=[ 314], 99.50th=[ 330], 99.90th=[ 375], 99.95th=[ 383], 00:12:03.837 | 99.99th=[ 445] 00:12:03.837 bw ( KiB/s): min= 8192, max= 8192, per=20.07%, avg=8192.00, stdev= 0.00, samples=1 00:12:03.837 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:12:03.837 lat (usec) : 250=74.46%, 500=25.49%, 750=0.02%, 1000=0.02% 00:12:03.837 cpu : usr=1.50%, sys=6.30%, ctx=4062, majf=0, minf=13 00:12:03.837 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:12:03.837 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:03.837 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:03.837 issued rwts: total=2013,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:03.837 latency : target=0, window=0, percentile=100.00%, depth=1 00:12:03.837 job2: (groupid=0, jobs=1): err= 0: pid=66571: Mon Oct 7 11:22:45 2024 00:12:03.837 read: IOPS=2666, BW=10.4MiB/s (10.9MB/s)(10.4MiB/1001msec) 00:12:03.837 slat (nsec): min=11434, max=30878, avg=13325.46, stdev=1653.04 00:12:03.837 clat (usec): min=146, max=449, avg=177.41, stdev=14.84 00:12:03.837 lat (usec): min=162, max=470, avg=190.74, stdev=15.05 00:12:03.837 clat percentiles (usec): 00:12:03.837 | 1.00th=[ 155], 5.00th=[ 159], 10.00th=[ 163], 20.00th=[ 167], 00:12:03.837 | 30.00th=[ 169], 40.00th=[ 174], 50.00th=[ 176], 60.00th=[ 178], 00:12:03.837 | 70.00th=[ 182], 80.00th=[ 188], 90.00th=[ 194], 95.00th=[ 200], 00:12:03.837 | 99.00th=[ 229], 99.50th=[ 241], 99.90th=[ 265], 99.95th=[ 285], 00:12:03.837 | 99.99th=[ 449] 00:12:03.837 write: IOPS=3068, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec); 0 zone resets 00:12:03.837 slat (nsec): min=14474, max=96378, avg=20436.32, stdev=5035.20 00:12:03.837 clat (usec): min=103, max=1727, avg=136.09, stdev=33.06 00:12:03.837 lat (usec): min=122, max=1747, avg=156.52, stdev=33.56 00:12:03.837 clat percentiles (usec): 00:12:03.837 | 1.00th=[ 112], 5.00th=[ 118], 10.00th=[ 121], 20.00th=[ 126], 00:12:03.837 | 30.00th=[ 129], 40.00th=[ 133], 50.00th=[ 135], 60.00th=[ 139], 00:12:03.837 | 70.00th=[ 141], 80.00th=[ 145], 90.00th=[ 151], 95.00th=[ 157], 00:12:03.837 | 99.00th=[ 167], 99.50th=[ 176], 99.90th=[ 258], 99.95th=[ 635], 00:12:03.837 | 99.99th=[ 1729] 00:12:03.837 bw ( KiB/s): min=12288, max=12288, per=30.10%, avg=12288.00, stdev= 0.00, samples=1 00:12:03.837 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=1 00:12:03.837 lat (usec) : 250=99.76%, 500=0.21%, 750=0.02% 00:12:03.837 lat (msec) : 2=0.02% 00:12:03.837 cpu : usr=2.50%, sys=7.60%, ctx=5745, majf=0, minf=17 00:12:03.837 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:12:03.837 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:03.837 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:03.837 issued rwts: total=2669,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:03.837 latency : target=0, window=0, percentile=100.00%, depth=1 00:12:03.837 job3: (groupid=0, jobs=1): err= 0: pid=66572: Mon Oct 7 11:22:45 2024 00:12:03.837 read: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec) 00:12:03.837 slat (nsec): min=12120, max=41577, avg=15079.65, stdev=3311.12 00:12:03.837 clat (usec): min=148, max=1709, avg=182.00, stdev=35.53 00:12:03.837 lat (usec): min=161, max=1722, avg=197.08, stdev=35.74 00:12:03.837 clat percentiles (usec): 00:12:03.837 | 1.00th=[ 155], 5.00th=[ 163], 10.00th=[ 167], 20.00th=[ 172], 00:12:03.837 | 30.00th=[ 176], 40.00th=[ 178], 50.00th=[ 180], 60.00th=[ 184], 00:12:03.837 | 70.00th=[ 188], 80.00th=[ 192], 90.00th=[ 198], 95.00th=[ 202], 00:12:03.837 | 99.00th=[ 217], 99.50th=[ 223], 99.90th=[ 586], 99.95th=[ 635], 00:12:03.837 | 99.99th=[ 1713] 00:12:03.837 write: IOPS=3045, BW=11.9MiB/s (12.5MB/s)(11.9MiB/1001msec); 0 zone resets 00:12:03.837 slat (nsec): min=18068, max=98876, avg=22728.89, stdev=6969.91 00:12:03.837 clat (usec): min=107, max=543, avg=136.22, stdev=15.44 00:12:03.837 lat (usec): min=130, max=569, avg=158.95, stdev=17.66 00:12:03.837 clat percentiles (usec): 00:12:03.837 | 1.00th=[ 115], 5.00th=[ 121], 10.00th=[ 124], 20.00th=[ 127], 00:12:03.837 | 30.00th=[ 130], 40.00th=[ 133], 50.00th=[ 135], 60.00th=[ 137], 00:12:03.837 | 70.00th=[ 141], 80.00th=[ 145], 90.00th=[ 151], 95.00th=[ 155], 00:12:03.837 | 99.00th=[ 176], 99.50th=[ 184], 99.90th=[ 262], 99.95th=[ 445], 00:12:03.837 | 99.99th=[ 545] 00:12:03.837 bw ( KiB/s): min=12288, max=12288, per=30.10%, avg=12288.00, stdev= 0.00, samples=1 00:12:03.837 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=1 00:12:03.837 lat (usec) : 250=99.82%, 500=0.11%, 750=0.05% 00:12:03.837 lat (msec) : 2=0.02% 00:12:03.837 cpu : usr=2.30%, sys=8.60%, ctx=5609, majf=0, minf=7 00:12:03.837 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:12:03.837 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:03.837 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:03.837 issued rwts: total=2560,3049,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:03.837 latency : target=0, window=0, percentile=100.00%, depth=1 00:12:03.837 00:12:03.837 Run status group 0 (all jobs): 00:12:03.837 READ: bw=36.1MiB/s (37.9MB/s), 8044KiB/s-10.4MiB/s (8237kB/s-10.9MB/s), io=36.2MiB (37.9MB), run=1001-1001msec 00:12:03.837 WRITE: bw=39.9MiB/s (41.8MB/s), 8184KiB/s-12.0MiB/s (8380kB/s-12.6MB/s), io=39.9MiB (41.8MB), run=1001-1001msec 00:12:03.837 00:12:03.837 Disk stats (read/write): 00:12:03.837 nvme0n1: ios=1586/2028, merge=0/0, ticks=383/387, in_queue=770, util=88.78% 00:12:03.837 nvme0n2: ios=1585/2028, merge=0/0, ticks=384/388, in_queue=772, util=89.61% 00:12:03.837 nvme0n3: ios=2434/2560, merge=0/0, ticks=454/370, in_queue=824, util=89.96% 00:12:03.837 nvme0n4: ios=2295/2560, merge=0/0, ticks=425/372, in_queue=797, util=89.91% 00:12:03.837 11:22:45 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:12:03.837 [global] 00:12:03.837 thread=1 00:12:03.837 invalidate=1 00:12:03.837 rw=write 00:12:03.837 time_based=1 00:12:03.837 runtime=1 00:12:03.837 ioengine=libaio 00:12:03.837 direct=1 00:12:03.837 bs=4096 00:12:03.837 iodepth=128 00:12:03.837 norandommap=0 00:12:03.837 numjobs=1 00:12:03.837 00:12:03.837 verify_dump=1 00:12:03.837 verify_backlog=512 00:12:03.837 verify_state_save=0 00:12:03.837 do_verify=1 00:12:03.837 verify=crc32c-intel 00:12:03.837 [job0] 00:12:03.837 filename=/dev/nvme0n1 00:12:03.837 [job1] 00:12:03.837 filename=/dev/nvme0n2 00:12:03.837 [job2] 00:12:03.837 filename=/dev/nvme0n3 00:12:03.837 [job3] 00:12:03.837 filename=/dev/nvme0n4 00:12:03.837 Could not set queue depth (nvme0n1) 00:12:03.837 Could not set queue depth (nvme0n2) 00:12:03.837 Could not set queue depth (nvme0n3) 00:12:03.837 Could not set queue depth (nvme0n4) 00:12:03.838 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:12:03.838 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:12:03.838 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:12:03.838 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:12:03.838 fio-3.35 00:12:03.838 Starting 4 threads 00:12:05.211 00:12:05.211 job0: (groupid=0, jobs=1): err= 0: pid=66627: Mon Oct 7 11:22:46 2024 00:12:05.211 read: IOPS=3056, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1005msec) 00:12:05.211 slat (usec): min=5, max=12300, avg=172.33, stdev=910.28 00:12:05.211 clat (usec): min=9907, max=43036, avg=21443.03, stdev=5688.57 00:12:05.212 lat (usec): min=11854, max=43067, avg=21615.35, stdev=5747.46 00:12:05.212 clat percentiles (usec): 00:12:05.212 | 1.00th=[12780], 5.00th=[13960], 10.00th=[15664], 20.00th=[16057], 00:12:05.212 | 30.00th=[16188], 40.00th=[19006], 50.00th=[21365], 60.00th=[22152], 00:12:05.212 | 70.00th=[24773], 80.00th=[26346], 90.00th=[29230], 95.00th=[30802], 00:12:05.212 | 99.00th=[37487], 99.50th=[40109], 99.90th=[43254], 99.95th=[43254], 00:12:05.212 | 99.99th=[43254] 00:12:05.212 write: IOPS=3135, BW=12.2MiB/s (12.8MB/s)(12.3MiB/1005msec); 0 zone resets 00:12:05.212 slat (usec): min=9, max=10295, avg=140.78, stdev=666.34 00:12:05.212 clat (usec): min=3822, max=42971, avg=19300.09, stdev=6981.00 00:12:05.212 lat (usec): min=4806, max=44308, avg=19440.87, stdev=7033.83 00:12:05.212 clat percentiles (usec): 00:12:05.212 | 1.00th=[ 9896], 5.00th=[11731], 10.00th=[12256], 20.00th=[12780], 00:12:05.212 | 30.00th=[13173], 40.00th=[15270], 50.00th=[18220], 60.00th=[18744], 00:12:05.212 | 70.00th=[24773], 80.00th=[26608], 90.00th=[27395], 95.00th=[31327], 00:12:05.212 | 99.00th=[39584], 99.50th=[41157], 99.90th=[42730], 99.95th=[42730], 00:12:05.212 | 99.99th=[42730] 00:12:05.212 bw ( KiB/s): min= 8192, max=16384, per=19.75%, avg=12288.00, stdev=5792.62, samples=2 00:12:05.212 iops : min= 2048, max= 4096, avg=3072.00, stdev=1448.15, samples=2 00:12:05.212 lat (msec) : 4=0.02%, 10=0.53%, 20=52.31%, 50=47.15% 00:12:05.212 cpu : usr=2.99%, sys=9.46%, ctx=278, majf=0, minf=14 00:12:05.212 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:12:05.212 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:05.212 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:12:05.212 issued rwts: total=3072,3151,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:05.212 latency : target=0, window=0, percentile=100.00%, depth=128 00:12:05.212 job1: (groupid=0, jobs=1): err= 0: pid=66628: Mon Oct 7 11:22:46 2024 00:12:05.212 read: IOPS=2043, BW=8176KiB/s (8372kB/s)(8192KiB/1002msec) 00:12:05.212 slat (usec): min=4, max=13951, avg=219.09, stdev=1002.96 00:12:05.212 clat (usec): min=15645, max=70807, avg=27409.59, stdev=9033.17 00:12:05.212 lat (usec): min=15667, max=70825, avg=27628.69, stdev=9137.35 00:12:05.212 clat percentiles (usec): 00:12:05.212 | 1.00th=[17433], 5.00th=[20841], 10.00th=[21365], 20.00th=[21627], 00:12:05.212 | 30.00th=[22152], 40.00th=[23987], 50.00th=[25035], 60.00th=[26346], 00:12:05.212 | 70.00th=[27132], 80.00th=[29754], 90.00th=[35390], 95.00th=[51643], 00:12:05.212 | 99.00th=[65799], 99.50th=[68682], 99.90th=[70779], 99.95th=[70779], 00:12:05.212 | 99.99th=[70779] 00:12:05.212 write: IOPS=2303, BW=9214KiB/s (9435kB/s)(9232KiB/1002msec); 0 zone resets 00:12:05.212 slat (usec): min=10, max=8598, avg=229.65, stdev=851.32 00:12:05.212 clat (usec): min=1207, max=72176, avg=30424.88, stdev=14250.03 00:12:05.212 lat (usec): min=1230, max=72204, avg=30654.54, stdev=14335.26 00:12:05.212 clat percentiles (usec): 00:12:05.212 | 1.00th=[ 4817], 5.00th=[12911], 10.00th=[15401], 20.00th=[21627], 00:12:05.212 | 30.00th=[25822], 40.00th=[26608], 50.00th=[26870], 60.00th=[27132], 00:12:05.212 | 70.00th=[27657], 80.00th=[41681], 90.00th=[54264], 95.00th=[61604], 00:12:05.212 | 99.00th=[71828], 99.50th=[71828], 99.90th=[71828], 99.95th=[71828], 00:12:05.212 | 99.99th=[71828] 00:12:05.212 bw ( KiB/s): min= 8192, max= 8192, per=13.16%, avg=8192.00, stdev= 0.00, samples=1 00:12:05.212 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:12:05.212 lat (msec) : 2=0.09%, 10=1.77%, 20=7.46%, 50=81.34%, 100=9.34% 00:12:05.212 cpu : usr=2.50%, sys=7.49%, ctx=307, majf=0, minf=9 00:12:05.212 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:12:05.212 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:05.212 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:12:05.212 issued rwts: total=2048,2308,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:05.212 latency : target=0, window=0, percentile=100.00%, depth=128 00:12:05.212 job2: (groupid=0, jobs=1): err= 0: pid=66629: Mon Oct 7 11:22:46 2024 00:12:05.212 read: IOPS=4598, BW=18.0MiB/s (18.8MB/s)(18.0MiB/1002msec) 00:12:05.212 slat (usec): min=6, max=3505, avg=100.81, stdev=482.61 00:12:05.212 clat (usec): min=9692, max=14721, avg=13481.74, stdev=735.12 00:12:05.212 lat (usec): min=12149, max=14733, avg=13582.54, stdev=562.75 00:12:05.212 clat percentiles (usec): 00:12:05.212 | 1.00th=[10552], 5.00th=[12518], 10.00th=[12780], 20.00th=[12911], 00:12:05.212 | 30.00th=[13173], 40.00th=[13435], 50.00th=[13566], 60.00th=[13698], 00:12:05.212 | 70.00th=[13960], 80.00th=[14091], 90.00th=[14222], 95.00th=[14484], 00:12:05.212 | 99.00th=[14615], 99.50th=[14615], 99.90th=[14746], 99.95th=[14746], 00:12:05.212 | 99.99th=[14746] 00:12:05.212 write: IOPS=5046, BW=19.7MiB/s (20.7MB/s)(19.8MiB/1002msec); 0 zone resets 00:12:05.212 slat (usec): min=10, max=2974, avg=98.60, stdev=424.30 00:12:05.212 clat (usec): min=281, max=14003, avg=12733.26, stdev=1123.32 00:12:05.212 lat (usec): min=2915, max=14402, avg=12831.86, stdev=1039.66 00:12:05.212 clat percentiles (usec): 00:12:05.212 | 1.00th=[ 6915], 5.00th=[11731], 10.00th=[12125], 20.00th=[12387], 00:12:05.212 | 30.00th=[12649], 40.00th=[12780], 50.00th=[12911], 60.00th=[13042], 00:12:05.212 | 70.00th=[13173], 80.00th=[13304], 90.00th=[13566], 95.00th=[13698], 00:12:05.212 | 99.00th=[13829], 99.50th=[13960], 99.90th=[13960], 99.95th=[13960], 00:12:05.212 | 99.99th=[13960] 00:12:05.212 bw ( KiB/s): min=20480, max=20480, per=32.91%, avg=20480.00, stdev= 0.00, samples=1 00:12:05.212 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=1 00:12:05.212 lat (usec) : 500=0.01% 00:12:05.212 lat (msec) : 4=0.33%, 10=0.67%, 20=98.99% 00:12:05.212 cpu : usr=3.90%, sys=13.89%, ctx=335, majf=0, minf=10 00:12:05.212 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:12:05.212 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:05.212 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:12:05.212 issued rwts: total=4608,5057,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:05.212 latency : target=0, window=0, percentile=100.00%, depth=128 00:12:05.212 job3: (groupid=0, jobs=1): err= 0: pid=66630: Mon Oct 7 11:22:46 2024 00:12:05.212 read: IOPS=4668, BW=18.2MiB/s (19.1MB/s)(18.3MiB/1001msec) 00:12:05.212 slat (usec): min=4, max=3146, avg=99.62, stdev=472.90 00:12:05.212 clat (usec): min=361, max=14644, avg=13157.16, stdev=1230.68 00:12:05.212 lat (usec): min=3219, max=14697, avg=13256.78, stdev=1137.25 00:12:05.212 clat percentiles (usec): 00:12:05.212 | 1.00th=[ 6783], 5.00th=[12125], 10.00th=[12518], 20.00th=[12649], 00:12:05.212 | 30.00th=[12780], 40.00th=[13173], 50.00th=[13304], 60.00th=[13566], 00:12:05.212 | 70.00th=[13698], 80.00th=[13960], 90.00th=[14091], 95.00th=[14222], 00:12:05.212 | 99.00th=[14484], 99.50th=[14484], 99.90th=[14615], 99.95th=[14615], 00:12:05.212 | 99.99th=[14615] 00:12:05.212 write: IOPS=5114, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1001msec); 0 zone resets 00:12:05.212 slat (usec): min=10, max=2954, avg=96.73, stdev=412.09 00:12:05.212 clat (usec): min=9437, max=14071, avg=12686.30, stdev=675.12 00:12:05.212 lat (usec): min=9748, max=14225, avg=12783.02, stdev=540.27 00:12:05.212 clat percentiles (usec): 00:12:05.212 | 1.00th=[10028], 5.00th=[11731], 10.00th=[11994], 20.00th=[12256], 00:12:05.212 | 30.00th=[12387], 40.00th=[12518], 50.00th=[12649], 60.00th=[12911], 00:12:05.212 | 70.00th=[13042], 80.00th=[13173], 90.00th=[13435], 95.00th=[13566], 00:12:05.212 | 99.00th=[13829], 99.50th=[13960], 99.90th=[14091], 99.95th=[14091], 00:12:05.212 | 99.99th=[14091] 00:12:05.212 bw ( KiB/s): min=20480, max=20480, per=32.91%, avg=20480.00, stdev= 0.00, samples=1 00:12:05.212 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=1 00:12:05.212 lat (usec) : 500=0.01% 00:12:05.212 lat (msec) : 4=0.33%, 10=0.84%, 20=98.83% 00:12:05.212 cpu : usr=4.90%, sys=13.60%, ctx=308, majf=0, minf=3 00:12:05.212 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:12:05.212 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:05.212 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:12:05.212 issued rwts: total=4673,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:05.212 latency : target=0, window=0, percentile=100.00%, depth=128 00:12:05.212 00:12:05.212 Run status group 0 (all jobs): 00:12:05.212 READ: bw=56.0MiB/s (58.7MB/s), 8176KiB/s-18.2MiB/s (8372kB/s-19.1MB/s), io=56.3MiB (59.0MB), run=1001-1005msec 00:12:05.212 WRITE: bw=60.8MiB/s (63.7MB/s), 9214KiB/s-20.0MiB/s (9435kB/s-20.9MB/s), io=61.1MiB (64.0MB), run=1001-1005msec 00:12:05.212 00:12:05.212 Disk stats (read/write): 00:12:05.212 nvme0n1: ios=2610/2911, merge=0/0, ticks=26393/23915, in_queue=50308, util=87.58% 00:12:05.212 nvme0n2: ios=1569/1927, merge=0/0, ticks=14730/20145, in_queue=34875, util=88.15% 00:12:05.212 nvme0n3: ios=4096/4192, merge=0/0, ticks=12316/11524, in_queue=23840, util=89.11% 00:12:05.212 nvme0n4: ios=4096/4288, merge=0/0, ticks=12104/11731, in_queue=23835, util=89.67% 00:12:05.212 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:12:05.212 [global] 00:12:05.212 thread=1 00:12:05.212 invalidate=1 00:12:05.212 rw=randwrite 00:12:05.212 time_based=1 00:12:05.212 runtime=1 00:12:05.212 ioengine=libaio 00:12:05.212 direct=1 00:12:05.212 bs=4096 00:12:05.212 iodepth=128 00:12:05.212 norandommap=0 00:12:05.212 numjobs=1 00:12:05.212 00:12:05.212 verify_dump=1 00:12:05.212 verify_backlog=512 00:12:05.212 verify_state_save=0 00:12:05.212 do_verify=1 00:12:05.212 verify=crc32c-intel 00:12:05.212 [job0] 00:12:05.212 filename=/dev/nvme0n1 00:12:05.212 [job1] 00:12:05.212 filename=/dev/nvme0n2 00:12:05.212 [job2] 00:12:05.212 filename=/dev/nvme0n3 00:12:05.212 [job3] 00:12:05.212 filename=/dev/nvme0n4 00:12:05.212 Could not set queue depth (nvme0n1) 00:12:05.212 Could not set queue depth (nvme0n2) 00:12:05.212 Could not set queue depth (nvme0n3) 00:12:05.212 Could not set queue depth (nvme0n4) 00:12:05.212 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:12:05.212 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:12:05.212 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:12:05.212 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:12:05.212 fio-3.35 00:12:05.212 Starting 4 threads 00:12:06.587 00:12:06.587 job0: (groupid=0, jobs=1): err= 0: pid=66688: Mon Oct 7 11:22:47 2024 00:12:06.587 read: IOPS=5609, BW=21.9MiB/s (23.0MB/s)(22.0MiB/1004msec) 00:12:06.587 slat (usec): min=7, max=5912, avg=83.84, stdev=522.28 00:12:06.587 clat (usec): min=7143, max=18395, avg=11780.96, stdev=1225.76 00:12:06.587 lat (usec): min=7156, max=21789, avg=11864.80, stdev=1250.87 00:12:06.587 clat percentiles (usec): 00:12:06.587 | 1.00th=[ 7570], 5.00th=[10552], 10.00th=[11076], 20.00th=[11338], 00:12:06.587 | 30.00th=[11469], 40.00th=[11600], 50.00th=[11731], 60.00th=[11994], 00:12:06.587 | 70.00th=[12125], 80.00th=[12256], 90.00th=[12649], 95.00th=[12780], 00:12:06.587 | 99.00th=[17957], 99.50th=[17957], 99.90th=[18220], 99.95th=[18220], 00:12:06.587 | 99.99th=[18482] 00:12:06.587 write: IOPS=5736, BW=22.4MiB/s (23.5MB/s)(22.5MiB/1004msec); 0 zone resets 00:12:06.587 slat (usec): min=8, max=7545, avg=84.60, stdev=486.14 00:12:06.587 clat (usec): min=976, max=14796, avg=10561.78, stdev=1051.62 00:12:06.587 lat (usec): min=5103, max=14818, avg=10646.38, stdev=953.66 00:12:06.587 clat percentiles (usec): 00:12:06.587 | 1.00th=[ 6063], 5.00th=[ 9372], 10.00th=[ 9765], 20.00th=[10028], 00:12:06.587 | 30.00th=[10290], 40.00th=[10552], 50.00th=[10683], 60.00th=[10814], 00:12:06.587 | 70.00th=[10945], 80.00th=[11076], 90.00th=[11338], 95.00th=[11600], 00:12:06.587 | 99.00th=[14746], 99.50th=[14746], 99.90th=[14746], 99.95th=[14746], 00:12:06.587 | 99.99th=[14746] 00:12:06.587 bw ( KiB/s): min=20544, max=24568, per=35.05%, avg=22556.00, stdev=2845.40, samples=2 00:12:06.587 iops : min= 5136, max= 6142, avg=5639.00, stdev=711.35, samples=2 00:12:06.587 lat (usec) : 1000=0.01% 00:12:06.587 lat (msec) : 10=10.62%, 20=89.37% 00:12:06.587 cpu : usr=6.38%, sys=12.86%, ctx=291, majf=0, minf=5 00:12:06.587 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:12:06.587 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:06.587 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:12:06.587 issued rwts: total=5632,5759,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:06.587 latency : target=0, window=0, percentile=100.00%, depth=128 00:12:06.587 job1: (groupid=0, jobs=1): err= 0: pid=66689: Mon Oct 7 11:22:47 2024 00:12:06.587 read: IOPS=2534, BW=9.90MiB/s (10.4MB/s)(10.0MiB/1010msec) 00:12:06.587 slat (usec): min=4, max=9885, avg=205.06, stdev=766.03 00:12:06.587 clat (usec): min=16486, max=36356, avg=25744.96, stdev=3846.71 00:12:06.587 lat (usec): min=16503, max=37141, avg=25950.02, stdev=3864.82 00:12:06.587 clat percentiles (usec): 00:12:06.587 | 1.00th=[18220], 5.00th=[19792], 10.00th=[21627], 20.00th=[23462], 00:12:06.587 | 30.00th=[24249], 40.00th=[24773], 50.00th=[24773], 60.00th=[25035], 00:12:06.587 | 70.00th=[25822], 80.00th=[29230], 90.00th=[32113], 95.00th=[33817], 00:12:06.587 | 99.00th=[34866], 99.50th=[35390], 99.90th=[36439], 99.95th=[36439], 00:12:06.587 | 99.99th=[36439] 00:12:06.587 write: IOPS=2782, BW=10.9MiB/s (11.4MB/s)(11.0MiB/1010msec); 0 zone resets 00:12:06.587 slat (usec): min=5, max=7058, avg=162.21, stdev=641.85 00:12:06.587 clat (usec): min=7475, max=32983, avg=22073.50, stdev=5155.21 00:12:06.587 lat (usec): min=8770, max=33002, avg=22235.71, stdev=5171.78 00:12:06.587 clat percentiles (usec): 00:12:06.587 | 1.00th=[10290], 5.00th=[12125], 10.00th=[13829], 20.00th=[16319], 00:12:06.587 | 30.00th=[20317], 40.00th=[22676], 50.00th=[23725], 60.00th=[24511], 00:12:06.587 | 70.00th=[25560], 80.00th=[26084], 90.00th=[27132], 95.00th=[28705], 00:12:06.587 | 99.00th=[30802], 99.50th=[31589], 99.90th=[32375], 99.95th=[32375], 00:12:06.587 | 99.99th=[32900] 00:12:06.587 bw ( KiB/s): min= 9168, max=12288, per=16.67%, avg=10728.00, stdev=2206.17, samples=2 00:12:06.587 iops : min= 2292, max= 3072, avg=2682.00, stdev=551.54, samples=2 00:12:06.587 lat (msec) : 10=0.43%, 20=17.95%, 50=81.62% 00:12:06.587 cpu : usr=2.48%, sys=7.83%, ctx=854, majf=0, minf=9 00:12:06.587 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:12:06.587 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:06.587 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:12:06.587 issued rwts: total=2560,2810,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:06.587 latency : target=0, window=0, percentile=100.00%, depth=128 00:12:06.587 job2: (groupid=0, jobs=1): err= 0: pid=66690: Mon Oct 7 11:22:47 2024 00:12:06.587 read: IOPS=4645, BW=18.1MiB/s (19.0MB/s)(18.2MiB/1005msec) 00:12:06.587 slat (usec): min=7, max=7595, avg=97.88, stdev=624.10 00:12:06.587 clat (usec): min=1066, max=22031, avg=13544.80, stdev=1708.41 00:12:06.587 lat (usec): min=5844, max=26630, avg=13642.68, stdev=1724.61 00:12:06.587 clat percentiles (usec): 00:12:06.587 | 1.00th=[ 6652], 5.00th=[10028], 10.00th=[12649], 20.00th=[13042], 00:12:06.587 | 30.00th=[13304], 40.00th=[13435], 50.00th=[13698], 60.00th=[13829], 00:12:06.587 | 70.00th=[13960], 80.00th=[14091], 90.00th=[14353], 95.00th=[15008], 00:12:06.587 | 99.00th=[20317], 99.50th=[20841], 99.90th=[21890], 99.95th=[21890], 00:12:06.587 | 99.99th=[22152] 00:12:06.587 write: IOPS=5094, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1005msec); 0 zone resets 00:12:06.587 slat (usec): min=6, max=11629, avg=99.15, stdev=600.15 00:12:06.587 clat (usec): min=6442, max=21867, avg=12522.85, stdev=1578.01 00:12:06.587 lat (usec): min=6963, max=21904, avg=12621.99, stdev=1500.58 00:12:06.587 clat percentiles (usec): 00:12:06.587 | 1.00th=[ 8225], 5.00th=[10683], 10.00th=[11207], 20.00th=[11600], 00:12:06.587 | 30.00th=[11863], 40.00th=[12125], 50.00th=[12387], 60.00th=[12649], 00:12:06.587 | 70.00th=[12911], 80.00th=[13304], 90.00th=[14353], 95.00th=[15008], 00:12:06.587 | 99.00th=[20055], 99.50th=[20055], 99.90th=[20055], 99.95th=[20055], 00:12:06.587 | 99.99th=[21890] 00:12:06.587 bw ( KiB/s): min=19944, max=20480, per=31.41%, avg=20212.00, stdev=379.01, samples=2 00:12:06.587 iops : min= 4986, max= 5120, avg=5053.00, stdev=94.75, samples=2 00:12:06.587 lat (msec) : 2=0.01%, 10=3.78%, 20=95.07%, 50=1.14% 00:12:06.587 cpu : usr=4.98%, sys=12.85%, ctx=207, majf=0, minf=11 00:12:06.587 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:12:06.587 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:06.587 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:12:06.587 issued rwts: total=4669,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:06.587 latency : target=0, window=0, percentile=100.00%, depth=128 00:12:06.587 job3: (groupid=0, jobs=1): err= 0: pid=66691: Mon Oct 7 11:22:47 2024 00:12:06.587 read: IOPS=2542, BW=9.93MiB/s (10.4MB/s)(9.99MiB/1006msec) 00:12:06.587 slat (usec): min=6, max=10275, avg=198.15, stdev=790.56 00:12:06.587 clat (usec): min=3757, max=35548, avg=24791.03, stdev=3996.77 00:12:06.587 lat (usec): min=9942, max=37426, avg=24989.18, stdev=4025.90 00:12:06.587 clat percentiles (usec): 00:12:06.587 | 1.00th=[11600], 5.00th=[17695], 10.00th=[20317], 20.00th=[22938], 00:12:06.587 | 30.00th=[24249], 40.00th=[24511], 50.00th=[25035], 60.00th=[25297], 00:12:06.587 | 70.00th=[25560], 80.00th=[26608], 90.00th=[29754], 95.00th=[32637], 00:12:06.587 | 99.00th=[34866], 99.50th=[35390], 99.90th=[35390], 99.95th=[35390], 00:12:06.587 | 99.99th=[35390] 00:12:06.587 write: IOPS=2544, BW=9.94MiB/s (10.4MB/s)(10.0MiB/1006msec); 0 zone resets 00:12:06.587 slat (usec): min=5, max=7755, avg=185.36, stdev=663.43 00:12:06.587 clat (usec): min=9596, max=35047, avg=24459.17, stdev=3292.42 00:12:06.587 lat (usec): min=9620, max=35072, avg=24644.53, stdev=3286.59 00:12:06.587 clat percentiles (usec): 00:12:06.587 | 1.00th=[17171], 5.00th=[18220], 10.00th=[20579], 20.00th=[22414], 00:12:06.587 | 30.00th=[23200], 40.00th=[23725], 50.00th=[24773], 60.00th=[25297], 00:12:06.587 | 70.00th=[25822], 80.00th=[26084], 90.00th=[27395], 95.00th=[31065], 00:12:06.587 | 99.00th=[33817], 99.50th=[34866], 99.90th=[34866], 99.95th=[34866], 00:12:06.587 | 99.99th=[34866] 00:12:06.587 bw ( KiB/s): min= 8704, max=11776, per=15.91%, avg=10240.00, stdev=2172.23, samples=2 00:12:06.587 iops : min= 2176, max= 2944, avg=2560.00, stdev=543.06, samples=2 00:12:06.587 lat (msec) : 4=0.02%, 10=0.12%, 20=8.68%, 50=91.19% 00:12:06.587 cpu : usr=2.19%, sys=7.16%, ctx=985, majf=0, minf=17 00:12:06.587 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:12:06.587 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:06.587 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:12:06.587 issued rwts: total=2558,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:06.587 latency : target=0, window=0, percentile=100.00%, depth=128 00:12:06.587 00:12:06.587 Run status group 0 (all jobs): 00:12:06.587 READ: bw=59.6MiB/s (62.5MB/s), 9.90MiB/s-21.9MiB/s (10.4MB/s-23.0MB/s), io=60.2MiB (63.2MB), run=1004-1010msec 00:12:06.587 WRITE: bw=62.8MiB/s (65.9MB/s), 9.94MiB/s-22.4MiB/s (10.4MB/s-23.5MB/s), io=63.5MiB (66.6MB), run=1004-1010msec 00:12:06.587 00:12:06.587 Disk stats (read/write): 00:12:06.587 nvme0n1: ios=4658/4992, merge=0/0, ticks=51265/48546, in_queue=99811, util=86.86% 00:12:06.587 nvme0n2: ios=2084/2462, merge=0/0, ticks=26104/25606, in_queue=51710, util=87.21% 00:12:06.587 nvme0n3: ios=4088/4166, merge=0/0, ticks=52698/47245, in_queue=99943, util=89.04% 00:12:06.587 nvme0n4: ios=2048/2279, merge=0/0, ticks=25151/25338, in_queue=50489, util=88.03% 00:12:06.587 11:22:47 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@55 -- # sync 00:12:06.587 11:22:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@59 -- # fio_pid=66710 00:12:06.587 11:22:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:12:06.587 11:22:48 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@61 -- # sleep 3 00:12:06.587 [global] 00:12:06.587 thread=1 00:12:06.587 invalidate=1 00:12:06.587 rw=read 00:12:06.587 time_based=1 00:12:06.587 runtime=10 00:12:06.587 ioengine=libaio 00:12:06.587 direct=1 00:12:06.588 bs=4096 00:12:06.588 iodepth=1 00:12:06.588 norandommap=1 00:12:06.588 numjobs=1 00:12:06.588 00:12:06.588 [job0] 00:12:06.588 filename=/dev/nvme0n1 00:12:06.588 [job1] 00:12:06.588 filename=/dev/nvme0n2 00:12:06.588 [job2] 00:12:06.588 filename=/dev/nvme0n3 00:12:06.588 [job3] 00:12:06.588 filename=/dev/nvme0n4 00:12:06.588 Could not set queue depth (nvme0n1) 00:12:06.588 Could not set queue depth (nvme0n2) 00:12:06.588 Could not set queue depth (nvme0n3) 00:12:06.588 Could not set queue depth (nvme0n4) 00:12:06.588 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:12:06.588 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:12:06.588 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:12:06.588 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:12:06.588 fio-3.35 00:12:06.588 Starting 4 threads 00:12:09.885 11:22:51 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_raid_delete concat0 00:12:09.885 fio: pid=66753, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:12:09.885 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=61165568, buflen=4096 00:12:09.885 11:22:51 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@64 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_raid_delete raid0 00:12:09.885 fio: pid=66752, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:12:09.885 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=42799104, buflen=4096 00:12:09.885 11:22:51 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:12:09.885 11:22:51 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:12:10.143 fio: pid=66750, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:12:10.143 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=46391296, buflen=4096 00:12:10.143 11:22:51 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:12:10.143 11:22:51 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:12:10.401 fio: pid=66751, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:12:10.401 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=10027008, buflen=4096 00:12:10.659 11:22:52 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:12:10.659 11:22:52 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:12:10.659 00:12:10.659 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=66750: Mon Oct 7 11:22:52 2024 00:12:10.659 read: IOPS=3291, BW=12.9MiB/s (13.5MB/s)(44.2MiB/3441msec) 00:12:10.659 slat (usec): min=8, max=13717, avg=20.83, stdev=191.13 00:12:10.659 clat (usec): min=129, max=7754, avg=280.94, stdev=110.39 00:12:10.659 lat (usec): min=141, max=13978, avg=301.76, stdev=220.76 00:12:10.659 clat percentiles (usec): 00:12:10.659 | 1.00th=[ 172], 5.00th=[ 208], 10.00th=[ 225], 20.00th=[ 249], 00:12:10.659 | 30.00th=[ 258], 40.00th=[ 265], 50.00th=[ 273], 60.00th=[ 277], 00:12:10.659 | 70.00th=[ 289], 80.00th=[ 310], 90.00th=[ 334], 95.00th=[ 363], 00:12:10.659 | 99.00th=[ 441], 99.50th=[ 498], 99.90th=[ 1090], 99.95th=[ 1500], 00:12:10.659 | 99.99th=[ 5145] 00:12:10.659 bw ( KiB/s): min=11314, max=13800, per=21.73%, avg=12951.00, stdev=910.75, samples=6 00:12:10.659 iops : min= 2828, max= 3450, avg=3237.67, stdev=227.87, samples=6 00:12:10.659 lat (usec) : 250=21.11%, 500=78.39%, 750=0.34%, 1000=0.04% 00:12:10.659 lat (msec) : 2=0.07%, 4=0.03%, 10=0.02% 00:12:10.659 cpu : usr=1.31%, sys=5.26%, ctx=11336, majf=0, minf=1 00:12:10.659 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:12:10.659 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:10.659 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:10.659 issued rwts: total=11327,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:10.659 latency : target=0, window=0, percentile=100.00%, depth=1 00:12:10.659 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=66751: Mon Oct 7 11:22:52 2024 00:12:10.659 read: IOPS=5051, BW=19.7MiB/s (20.7MB/s)(73.6MiB/3728msec) 00:12:10.659 slat (usec): min=7, max=15364, avg=18.14, stdev=189.60 00:12:10.659 clat (usec): min=128, max=3623, avg=178.33, stdev=65.34 00:12:10.659 lat (usec): min=143, max=15784, avg=196.47, stdev=204.79 00:12:10.659 clat percentiles (usec): 00:12:10.659 | 1.00th=[ 139], 5.00th=[ 145], 10.00th=[ 149], 20.00th=[ 155], 00:12:10.659 | 30.00th=[ 159], 40.00th=[ 163], 50.00th=[ 167], 60.00th=[ 172], 00:12:10.659 | 70.00th=[ 178], 80.00th=[ 194], 90.00th=[ 227], 95.00th=[ 249], 00:12:10.659 | 99.00th=[ 293], 99.50th=[ 306], 99.90th=[ 635], 99.95th=[ 1483], 00:12:10.659 | 99.99th=[ 3359] 00:12:10.659 bw ( KiB/s): min=16498, max=22696, per=34.04%, avg=20286.57, stdev=2348.26, samples=7 00:12:10.659 iops : min= 4124, max= 5674, avg=5071.57, stdev=587.20, samples=7 00:12:10.659 lat (usec) : 250=95.28%, 500=4.60%, 750=0.03% 00:12:10.659 lat (msec) : 2=0.05%, 4=0.03% 00:12:10.659 cpu : usr=1.31%, sys=6.90%, ctx=18847, majf=0, minf=1 00:12:10.659 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:12:10.659 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:10.659 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:10.659 issued rwts: total=18833,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:10.659 latency : target=0, window=0, percentile=100.00%, depth=1 00:12:10.659 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=66752: Mon Oct 7 11:22:52 2024 00:12:10.659 read: IOPS=3282, BW=12.8MiB/s (13.4MB/s)(40.8MiB/3184msec) 00:12:10.659 slat (usec): min=7, max=15825, avg=21.71, stdev=190.62 00:12:10.659 clat (usec): min=3, max=3336, avg=280.85, stdev=75.02 00:12:10.659 lat (usec): min=163, max=16091, avg=302.56, stdev=204.73 00:12:10.659 clat percentiles (usec): 00:12:10.659 | 1.00th=[ 176], 5.00th=[ 229], 10.00th=[ 241], 20.00th=[ 251], 00:12:10.659 | 30.00th=[ 258], 40.00th=[ 265], 50.00th=[ 273], 60.00th=[ 281], 00:12:10.659 | 70.00th=[ 289], 80.00th=[ 310], 90.00th=[ 330], 95.00th=[ 347], 00:12:10.659 | 99.00th=[ 433], 99.50th=[ 494], 99.90th=[ 1139], 99.95th=[ 1500], 00:12:10.659 | 99.99th=[ 3064] 00:12:10.659 bw ( KiB/s): min=11235, max=14136, per=22.09%, avg=13164.50, stdev=1050.17, samples=6 00:12:10.659 iops : min= 2808, max= 3534, avg=3291.00, stdev=262.82, samples=6 00:12:10.659 lat (usec) : 4=0.01%, 250=18.95%, 500=80.54%, 750=0.34%, 1000=0.04% 00:12:10.659 lat (msec) : 2=0.08%, 4=0.04% 00:12:10.660 cpu : usr=1.51%, sys=5.66%, ctx=10456, majf=0, minf=2 00:12:10.660 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:12:10.660 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:10.660 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:10.660 issued rwts: total=10450,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:10.660 latency : target=0, window=0, percentile=100.00%, depth=1 00:12:10.660 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=66753: Mon Oct 7 11:22:52 2024 00:12:10.660 read: IOPS=5112, BW=20.0MiB/s (20.9MB/s)(58.3MiB/2921msec) 00:12:10.660 slat (nsec): min=11487, max=89045, avg=15389.40, stdev=5005.97 00:12:10.660 clat (usec): min=144, max=2130, avg=178.61, stdev=32.82 00:12:10.660 lat (usec): min=157, max=2156, avg=194.00, stdev=33.72 00:12:10.660 clat percentiles (usec): 00:12:10.660 | 1.00th=[ 151], 5.00th=[ 155], 10.00th=[ 159], 20.00th=[ 165], 00:12:10.660 | 30.00th=[ 169], 40.00th=[ 172], 50.00th=[ 176], 60.00th=[ 180], 00:12:10.660 | 70.00th=[ 184], 80.00th=[ 190], 90.00th=[ 198], 95.00th=[ 208], 00:12:10.660 | 99.00th=[ 249], 99.50th=[ 265], 99.90th=[ 334], 99.95th=[ 515], 00:12:10.660 | 99.99th=[ 1762] 00:12:10.660 bw ( KiB/s): min=19752, max=21024, per=34.24%, avg=20404.00, stdev=531.05, samples=5 00:12:10.660 iops : min= 4938, max= 5256, avg=5101.00, stdev=132.76, samples=5 00:12:10.660 lat (usec) : 250=99.04%, 500=0.90%, 750=0.03% 00:12:10.660 lat (msec) : 2=0.03%, 4=0.01% 00:12:10.660 cpu : usr=1.23%, sys=7.74%, ctx=14945, majf=0, minf=2 00:12:10.660 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:12:10.660 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:10.660 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:10.660 issued rwts: total=14934,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:10.660 latency : target=0, window=0, percentile=100.00%, depth=1 00:12:10.660 00:12:10.660 Run status group 0 (all jobs): 00:12:10.660 READ: bw=58.2MiB/s (61.0MB/s), 12.8MiB/s-20.0MiB/s (13.4MB/s-20.9MB/s), io=217MiB (227MB), run=2921-3728msec 00:12:10.660 00:12:10.660 Disk stats (read/write): 00:12:10.660 nvme0n1: ios=11017/0, merge=0/0, ticks=3094/0, in_queue=3094, util=95.08% 00:12:10.660 nvme0n2: ios=18215/0, merge=0/0, ticks=3291/0, in_queue=3291, util=95.13% 00:12:10.660 nvme0n3: ios=10224/0, merge=0/0, ticks=2883/0, in_queue=2883, util=95.96% 00:12:10.660 nvme0n4: ios=14652/0, merge=0/0, ticks=2634/0, in_queue=2634, util=96.73% 00:12:10.918 11:22:52 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:12:10.918 11:22:52 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:12:11.176 11:22:52 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:12:11.176 11:22:52 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:12:11.434 11:22:52 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:12:11.434 11:22:52 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:12:11.693 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:12:11.693 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:12:11.950 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@69 -- # fio_status=0 00:12:11.950 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@70 -- # wait 66710 00:12:11.950 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@70 -- # fio_status=4 00:12:11.950 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:11.950 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:11.950 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:11.950 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1219 -- # local i=0 00:12:11.950 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:11.950 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:12:11.950 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:12:11.950 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:11.950 nvmf hotplug test: fio failed as expected 00:12:11.950 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1231 -- # return 0 00:12:11.950 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:12:11.950 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:12:11.950 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@83 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:12.518 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:12:12.518 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:12:12.518 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:12:12.518 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:12:12.518 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@91 -- # nvmftestfini 00:12:12.518 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@514 -- # nvmfcleanup 00:12:12.518 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@121 -- # sync 00:12:12.518 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:12:12.518 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@124 -- # set +e 00:12:12.518 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@125 -- # for i in {1..20} 00:12:12.518 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:12:12.518 rmmod nvme_tcp 00:12:12.518 rmmod nvme_fabrics 00:12:12.518 rmmod nvme_keyring 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@128 -- # set -e 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@129 -- # return 0 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@515 -- # '[' -n 66311 ']' 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@516 -- # killprocess 66311 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@950 -- # '[' -z 66311 ']' 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@954 -- # kill -0 66311 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@955 -- # uname 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 66311 00:12:12.518 killing process with pid 66311 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@968 -- # echo 'killing process with pid 66311' 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@969 -- # kill 66311 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@974 -- # wait 66311 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@297 -- # iptr 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@789 -- # iptables-save 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@789 -- # iptables-restore 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:12:12.518 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:12:12.776 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:12:12.776 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:12:12.776 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:12:12.776 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:12:12.776 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:12:12.777 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:12:12.777 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:12:12.777 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:12:12.777 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:12:12.777 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:12:12.777 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:12:12.777 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:12:12.777 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@246 -- # remove_spdk_ns 00:12:12.777 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:12.777 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:12.777 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:13.034 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@300 -- # return 0 00:12:13.034 00:12:13.034 real 0m20.708s 00:12:13.034 user 1m18.423s 00:12:13.034 sys 0m10.257s 00:12:13.034 ************************************ 00:12:13.034 END TEST nvmf_fio_target 00:12:13.034 ************************************ 00:12:13.034 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1126 -- # xtrace_disable 00:12:13.034 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@10 -- # set +x 00:12:13.035 11:22:54 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@35 -- # run_test nvmf_bdevio /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:12:13.035 11:22:54 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:12:13.035 11:22:54 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:12:13.035 11:22:54 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:12:13.035 ************************************ 00:12:13.035 START TEST nvmf_bdevio 00:12:13.035 ************************************ 00:12:13.035 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:12:13.035 * Looking for test storage... 00:12:13.035 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:12:13.035 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:12:13.035 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1681 -- # lcov --version 00:12:13.035 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@333 -- # local ver1 ver1_l 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@334 -- # local ver2 ver2_l 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@336 -- # IFS=.-: 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@336 -- # read -ra ver1 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@337 -- # IFS=.-: 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@337 -- # read -ra ver2 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@338 -- # local 'op=<' 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@340 -- # ver1_l=2 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@341 -- # ver2_l=1 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@344 -- # case "$op" in 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@345 -- # : 1 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@364 -- # (( v = 0 )) 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@365 -- # decimal 1 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@353 -- # local d=1 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@355 -- # echo 1 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@365 -- # ver1[v]=1 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@366 -- # decimal 2 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@353 -- # local d=2 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@355 -- # echo 2 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@366 -- # ver2[v]=2 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@368 -- # return 0 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:12:13.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:13.293 --rc genhtml_branch_coverage=1 00:12:13.293 --rc genhtml_function_coverage=1 00:12:13.293 --rc genhtml_legend=1 00:12:13.293 --rc geninfo_all_blocks=1 00:12:13.293 --rc geninfo_unexecuted_blocks=1 00:12:13.293 00:12:13.293 ' 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:12:13.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:13.293 --rc genhtml_branch_coverage=1 00:12:13.293 --rc genhtml_function_coverage=1 00:12:13.293 --rc genhtml_legend=1 00:12:13.293 --rc geninfo_all_blocks=1 00:12:13.293 --rc geninfo_unexecuted_blocks=1 00:12:13.293 00:12:13.293 ' 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:12:13.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:13.293 --rc genhtml_branch_coverage=1 00:12:13.293 --rc genhtml_function_coverage=1 00:12:13.293 --rc genhtml_legend=1 00:12:13.293 --rc geninfo_all_blocks=1 00:12:13.293 --rc geninfo_unexecuted_blocks=1 00:12:13.293 00:12:13.293 ' 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:12:13.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:13.293 --rc genhtml_branch_coverage=1 00:12:13.293 --rc genhtml_function_coverage=1 00:12:13.293 --rc genhtml_legend=1 00:12:13.293 --rc geninfo_all_blocks=1 00:12:13.293 --rc geninfo_unexecuted_blocks=1 00:12:13.293 00:12:13.293 ' 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@7 -- # uname -s 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@15 -- # shopt -s extglob 00:12:13.293 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@5 -- # export PATH 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@51 -- # : 0 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:12:13.294 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@55 -- # have_pci_nics=0 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@14 -- # nvmftestinit 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@474 -- # prepare_net_devs 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@436 -- # local -g is_hw=no 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@438 -- # remove_spdk_ns 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@458 -- # nvmf_veth_init 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:12:13.294 Cannot find device "nvmf_init_br" 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@162 -- # true 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:12:13.294 Cannot find device "nvmf_init_br2" 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@163 -- # true 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:12:13.294 Cannot find device "nvmf_tgt_br" 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@164 -- # true 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:12:13.294 Cannot find device "nvmf_tgt_br2" 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@165 -- # true 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:12:13.294 Cannot find device "nvmf_init_br" 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@166 -- # true 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:12:13.294 Cannot find device "nvmf_init_br2" 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@167 -- # true 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:12:13.294 Cannot find device "nvmf_tgt_br" 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@168 -- # true 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:12:13.294 Cannot find device "nvmf_tgt_br2" 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@169 -- # true 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:12:13.294 Cannot find device "nvmf_br" 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@170 -- # true 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:12:13.294 Cannot find device "nvmf_init_if" 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@171 -- # true 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:12:13.294 Cannot find device "nvmf_init_if2" 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@172 -- # true 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:12:13.294 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@173 -- # true 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:12:13.294 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@174 -- # true 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:12:13.294 11:22:54 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:12:13.294 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:12:13.553 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:12:13.553 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.095 ms 00:12:13.553 00:12:13.553 --- 10.0.0.3 ping statistics --- 00:12:13.553 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:13.553 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:12:13.553 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:12:13.553 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.056 ms 00:12:13.553 00:12:13.553 --- 10.0.0.4 ping statistics --- 00:12:13.553 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:13.553 rtt min/avg/max/mdev = 0.056/0.056/0.056/0.000 ms 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:12:13.553 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:13.553 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.021 ms 00:12:13.553 00:12:13.553 --- 10.0.0.1 ping statistics --- 00:12:13.553 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:13.553 rtt min/avg/max/mdev = 0.021/0.021/0.021/0.000 ms 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:12:13.553 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:13.553 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.055 ms 00:12:13.553 00:12:13.553 --- 10.0.0.2 ping statistics --- 00:12:13.553 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:13.553 rtt min/avg/max/mdev = 0.055/0.055/0.055/0.000 ms 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@459 -- # return 0 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:12:13.553 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:12:13.554 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:12:13.554 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@724 -- # xtrace_disable 00:12:13.554 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:12:13.554 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@507 -- # nvmfpid=67083 00:12:13.554 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:12:13.554 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@508 -- # waitforlisten 67083 00:12:13.554 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@831 -- # '[' -z 67083 ']' 00:12:13.554 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:13.554 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:13.554 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@836 -- # local max_retries=100 00:12:13.554 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:13.554 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@840 -- # xtrace_disable 00:12:13.554 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:12:13.554 [2024-10-07 11:22:55.237152] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:12:13.554 [2024-10-07 11:22:55.237558] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:13.811 [2024-10-07 11:22:55.380311] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:13.811 [2024-10-07 11:22:55.452550] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:13.811 [2024-10-07 11:22:55.452641] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:13.811 [2024-10-07 11:22:55.452679] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:13.811 [2024-10-07 11:22:55.452697] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:13.811 [2024-10-07 11:22:55.452711] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:13.811 [2024-10-07 11:22:55.454434] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:12:13.811 [2024-10-07 11:22:55.454588] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 5 00:12:13.811 [2024-10-07 11:22:55.454697] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 6 00:12:13.811 [2024-10-07 11:22:55.454709] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:12:13.811 [2024-10-07 11:22:55.488605] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:12:14.069 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:12:14.069 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@864 -- # return 0 00:12:14.069 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:12:14.069 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@730 -- # xtrace_disable 00:12:14.069 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:12:14.069 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:14.069 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:14.069 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.069 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:12:14.069 [2024-10-07 11:22:55.595952] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:12:14.070 Malloc0 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:12:14.070 [2024-10-07 11:22:55.648362] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@24 -- # /home/vagrant/spdk_repo/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@558 -- # config=() 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@558 -- # local subsystem config 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:12:14.070 { 00:12:14.070 "params": { 00:12:14.070 "name": "Nvme$subsystem", 00:12:14.070 "trtype": "$TEST_TRANSPORT", 00:12:14.070 "traddr": "$NVMF_FIRST_TARGET_IP", 00:12:14.070 "adrfam": "ipv4", 00:12:14.070 "trsvcid": "$NVMF_PORT", 00:12:14.070 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:12:14.070 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:12:14.070 "hdgst": ${hdgst:-false}, 00:12:14.070 "ddgst": ${ddgst:-false} 00:12:14.070 }, 00:12:14.070 "method": "bdev_nvme_attach_controller" 00:12:14.070 } 00:12:14.070 EOF 00:12:14.070 )") 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@580 -- # cat 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@582 -- # jq . 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@583 -- # IFS=, 00:12:14.070 11:22:55 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:12:14.070 "params": { 00:12:14.070 "name": "Nvme1", 00:12:14.070 "trtype": "tcp", 00:12:14.070 "traddr": "10.0.0.3", 00:12:14.070 "adrfam": "ipv4", 00:12:14.070 "trsvcid": "4420", 00:12:14.070 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:12:14.070 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:12:14.070 "hdgst": false, 00:12:14.070 "ddgst": false 00:12:14.070 }, 00:12:14.070 "method": "bdev_nvme_attach_controller" 00:12:14.070 }' 00:12:14.070 [2024-10-07 11:22:55.708972] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:12:14.070 [2024-10-07 11:22:55.709071] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid67111 ] 00:12:14.328 [2024-10-07 11:22:55.848149] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:14.328 [2024-10-07 11:22:55.946568] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:12:14.328 [2024-10-07 11:22:55.946687] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:12:14.328 [2024-10-07 11:22:55.946717] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:12:14.328 [2024-10-07 11:22:55.996018] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:12:14.586 I/O targets: 00:12:14.586 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:12:14.586 00:12:14.586 00:12:14.586 CUnit - A unit testing framework for C - Version 2.1-3 00:12:14.586 http://cunit.sourceforge.net/ 00:12:14.586 00:12:14.586 00:12:14.586 Suite: bdevio tests on: Nvme1n1 00:12:14.586 Test: blockdev write read block ...passed 00:12:14.586 Test: blockdev write zeroes read block ...passed 00:12:14.586 Test: blockdev write zeroes read no split ...passed 00:12:14.586 Test: blockdev write zeroes read split ...passed 00:12:14.586 Test: blockdev write zeroes read split partial ...passed 00:12:14.586 Test: blockdev reset ...[2024-10-07 11:22:56.137444] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:12:14.586 [2024-10-07 11:22:56.137590] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1744040 (9): Bad file descriptor 00:12:14.586 [2024-10-07 11:22:56.150847] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:12:14.586 passed 00:12:14.586 Test: blockdev write read 8 blocks ...passed 00:12:14.586 Test: blockdev write read size > 128k ...passed 00:12:14.586 Test: blockdev write read invalid size ...passed 00:12:14.586 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:12:14.586 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:12:14.586 Test: blockdev write read max offset ...passed 00:12:14.586 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:12:14.586 Test: blockdev writev readv 8 blocks ...passed 00:12:14.586 Test: blockdev writev readv 30 x 1block ...passed 00:12:14.586 Test: blockdev writev readv block ...passed 00:12:14.586 Test: blockdev writev readv size > 128k ...passed 00:12:14.586 Test: blockdev writev readv size > 128k in two iovs ...passed 00:12:14.586 Test: blockdev comparev and writev ...[2024-10-07 11:22:56.163081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:12:14.586 [2024-10-07 11:22:56.163165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:12:14.586 [2024-10-07 11:22:56.163201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:12:14.586 [2024-10-07 11:22:56.163222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:12:14.586 [2024-10-07 11:22:56.164083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:12:14.586 [2024-10-07 11:22:56.164134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:12:14.586 [2024-10-07 11:22:56.164169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:12:14.586 [2024-10-07 11:22:56.164189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:12:14.586 [2024-10-07 11:22:56.164635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:12:14.586 [2024-10-07 11:22:56.164876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:12:14.586 [2024-10-07 11:22:56.164930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:12:14.586 [2024-10-07 11:22:56.164953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:12:14.586 [2024-10-07 11:22:56.165347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:12:14.586 [2024-10-07 11:22:56.165388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:12:14.586 [2024-10-07 11:22:56.165444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:12:14.586 [2024-10-07 11:22:56.165467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:12:14.586 passed 00:12:14.586 Test: blockdev nvme passthru rw ...passed 00:12:14.586 Test: blockdev nvme passthru vendor specific ...passed 00:12:14.586 Test: blockdev nvme admin passthru ...[2024-10-07 11:22:56.166491] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:12:14.586 [2024-10-07 11:22:56.166541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:12:14.586 [2024-10-07 11:22:56.166774] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:12:14.586 [2024-10-07 11:22:56.166811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:12:14.586 [2024-10-07 11:22:56.167006] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:12:14.586 [2024-10-07 11:22:56.167041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:12:14.586 [2024-10-07 11:22:56.167214] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:12:14.586 [2024-10-07 11:22:56.167247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:12:14.586 passed 00:12:14.586 Test: blockdev copy ...passed 00:12:14.586 00:12:14.587 Run Summary: Type Total Ran Passed Failed Inactive 00:12:14.587 suites 1 1 n/a 0 0 00:12:14.587 tests 23 23 23 0 0 00:12:14.587 asserts 152 152 152 0 n/a 00:12:14.587 00:12:14.587 Elapsed time = 0.155 seconds 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@30 -- # nvmftestfini 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@514 -- # nvmfcleanup 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@121 -- # sync 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@124 -- # set +e 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@125 -- # for i in {1..20} 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:12:14.844 rmmod nvme_tcp 00:12:14.844 rmmod nvme_fabrics 00:12:14.844 rmmod nvme_keyring 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@128 -- # set -e 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@129 -- # return 0 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@515 -- # '[' -n 67083 ']' 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@516 -- # killprocess 67083 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@950 -- # '[' -z 67083 ']' 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@954 -- # kill -0 67083 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@955 -- # uname 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 67083 00:12:14.844 killing process with pid 67083 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@956 -- # process_name=reactor_3 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@960 -- # '[' reactor_3 = sudo ']' 00:12:14.844 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@968 -- # echo 'killing process with pid 67083' 00:12:14.845 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@969 -- # kill 67083 00:12:14.845 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@974 -- # wait 67083 00:12:15.102 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:12:15.102 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:12:15.102 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:12:15.102 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@297 -- # iptr 00:12:15.102 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@789 -- # iptables-save 00:12:15.102 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:12:15.102 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@789 -- # iptables-restore 00:12:15.102 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:12:15.102 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:12:15.102 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:12:15.102 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:12:15.102 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:12:15.102 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:12:15.102 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:12:15.102 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:12:15.102 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:12:15.102 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:12:15.102 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:12:15.360 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:12:15.360 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:12:15.360 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:12:15.360 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:12:15.360 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@246 -- # remove_spdk_ns 00:12:15.360 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:15.360 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:15.360 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:15.360 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@300 -- # return 0 00:12:15.360 00:12:15.360 real 0m2.398s 00:12:15.360 user 0m6.101s 00:12:15.360 sys 0m0.796s 00:12:15.360 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1126 -- # xtrace_disable 00:12:15.360 ************************************ 00:12:15.360 END TEST nvmf_bdevio 00:12:15.360 ************************************ 00:12:15.360 11:22:56 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:12:15.360 11:22:56 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:12:15.360 00:12:15.360 real 2m35.865s 00:12:15.360 user 6m50.162s 00:12:15.360 sys 0m51.975s 00:12:15.360 ************************************ 00:12:15.360 END TEST nvmf_target_core 00:12:15.360 ************************************ 00:12:15.360 11:22:56 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1126 -- # xtrace_disable 00:12:15.360 11:22:56 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:12:15.360 11:22:57 nvmf_tcp -- nvmf/nvmf.sh@15 -- # run_test nvmf_target_extra /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_target_extra.sh --transport=tcp 00:12:15.360 11:22:57 nvmf_tcp -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:12:15.360 11:22:57 nvmf_tcp -- common/autotest_common.sh@1107 -- # xtrace_disable 00:12:15.360 11:22:57 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:12:15.360 ************************************ 00:12:15.360 START TEST nvmf_target_extra 00:12:15.360 ************************************ 00:12:15.360 11:22:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_target_extra.sh --transport=tcp 00:12:15.618 * Looking for test storage... 00:12:15.618 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1681 -- # lcov --version 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@333 -- # local ver1 ver1_l 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@334 -- # local ver2 ver2_l 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@336 -- # IFS=.-: 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@336 -- # read -ra ver1 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@337 -- # IFS=.-: 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@337 -- # read -ra ver2 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@338 -- # local 'op=<' 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@340 -- # ver1_l=2 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@341 -- # ver2_l=1 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@344 -- # case "$op" in 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@345 -- # : 1 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@364 -- # (( v = 0 )) 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@365 -- # decimal 1 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@353 -- # local d=1 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@355 -- # echo 1 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@365 -- # ver1[v]=1 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@366 -- # decimal 2 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@353 -- # local d=2 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@355 -- # echo 2 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@366 -- # ver2[v]=2 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@368 -- # return 0 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:12:15.618 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:15.618 --rc genhtml_branch_coverage=1 00:12:15.618 --rc genhtml_function_coverage=1 00:12:15.618 --rc genhtml_legend=1 00:12:15.618 --rc geninfo_all_blocks=1 00:12:15.618 --rc geninfo_unexecuted_blocks=1 00:12:15.618 00:12:15.618 ' 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:12:15.618 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:15.618 --rc genhtml_branch_coverage=1 00:12:15.618 --rc genhtml_function_coverage=1 00:12:15.618 --rc genhtml_legend=1 00:12:15.618 --rc geninfo_all_blocks=1 00:12:15.618 --rc geninfo_unexecuted_blocks=1 00:12:15.618 00:12:15.618 ' 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:12:15.618 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:15.618 --rc genhtml_branch_coverage=1 00:12:15.618 --rc genhtml_function_coverage=1 00:12:15.618 --rc genhtml_legend=1 00:12:15.618 --rc geninfo_all_blocks=1 00:12:15.618 --rc geninfo_unexecuted_blocks=1 00:12:15.618 00:12:15.618 ' 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:12:15.618 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:15.618 --rc genhtml_branch_coverage=1 00:12:15.618 --rc genhtml_function_coverage=1 00:12:15.618 --rc genhtml_legend=1 00:12:15.618 --rc geninfo_all_blocks=1 00:12:15.618 --rc geninfo_unexecuted_blocks=1 00:12:15.618 00:12:15.618 ' 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@7 -- # uname -s 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:15.618 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@15 -- # shopt -s extglob 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- paths/export.sh@5 -- # export PATH 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@51 -- # : 0 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:12:15.619 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@55 -- # have_pci_nics=0 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@11 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@13 -- # TEST_ARGS=("$@") 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@15 -- # [[ 1 -eq 0 ]] 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@37 -- # run_test nvmf_auth_target /home/vagrant/spdk_repo/spdk/test/nvmf/target/auth.sh --transport=tcp 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:12:15.619 ************************************ 00:12:15.619 START TEST nvmf_auth_target 00:12:15.619 ************************************ 00:12:15.619 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/auth.sh --transport=tcp 00:12:15.877 * Looking for test storage... 00:12:15.877 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:12:15.877 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:12:15.877 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1681 -- # lcov --version 00:12:15.877 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:12:15.877 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:12:15.877 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:12:15.877 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@333 -- # local ver1 ver1_l 00:12:15.877 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@334 -- # local ver2 ver2_l 00:12:15.877 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@336 -- # IFS=.-: 00:12:15.877 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@336 -- # read -ra ver1 00:12:15.877 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@337 -- # IFS=.-: 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@337 -- # read -ra ver2 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@338 -- # local 'op=<' 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@340 -- # ver1_l=2 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@341 -- # ver2_l=1 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@344 -- # case "$op" in 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@345 -- # : 1 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@364 -- # (( v = 0 )) 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@365 -- # decimal 1 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@353 -- # local d=1 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@355 -- # echo 1 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@365 -- # ver1[v]=1 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@366 -- # decimal 2 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@353 -- # local d=2 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@355 -- # echo 2 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@366 -- # ver2[v]=2 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@368 -- # return 0 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:12:15.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:15.878 --rc genhtml_branch_coverage=1 00:12:15.878 --rc genhtml_function_coverage=1 00:12:15.878 --rc genhtml_legend=1 00:12:15.878 --rc geninfo_all_blocks=1 00:12:15.878 --rc geninfo_unexecuted_blocks=1 00:12:15.878 00:12:15.878 ' 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:12:15.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:15.878 --rc genhtml_branch_coverage=1 00:12:15.878 --rc genhtml_function_coverage=1 00:12:15.878 --rc genhtml_legend=1 00:12:15.878 --rc geninfo_all_blocks=1 00:12:15.878 --rc geninfo_unexecuted_blocks=1 00:12:15.878 00:12:15.878 ' 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:12:15.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:15.878 --rc genhtml_branch_coverage=1 00:12:15.878 --rc genhtml_function_coverage=1 00:12:15.878 --rc genhtml_legend=1 00:12:15.878 --rc geninfo_all_blocks=1 00:12:15.878 --rc geninfo_unexecuted_blocks=1 00:12:15.878 00:12:15.878 ' 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:12:15.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:15.878 --rc genhtml_branch_coverage=1 00:12:15.878 --rc genhtml_function_coverage=1 00:12:15.878 --rc genhtml_legend=1 00:12:15.878 --rc geninfo_all_blocks=1 00:12:15.878 --rc geninfo_unexecuted_blocks=1 00:12:15.878 00:12:15.878 ' 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@7 -- # uname -s 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@15 -- # shopt -s extglob 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@5 -- # export PATH 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@51 -- # : 0 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:12:15.878 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@55 -- # have_pci_nics=0 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@13 -- # digests=("sha256" "sha384" "sha512") 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@14 -- # dhgroups=("null" "ffdhe2048" "ffdhe3072" "ffdhe4096" "ffdhe6144" "ffdhe8192") 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@15 -- # subnqn=nqn.2024-03.io.spdk:cnode0 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@16 -- # hostnqn=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@17 -- # hostsock=/var/tmp/host.sock 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@18 -- # keys=() 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@18 -- # ckeys=() 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@86 -- # nvmftestinit 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:15.878 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@474 -- # prepare_net_devs 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@436 -- # local -g is_hw=no 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@438 -- # remove_spdk_ns 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@458 -- # nvmf_veth_init 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:12:15.879 Cannot find device "nvmf_init_br" 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@162 -- # true 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:12:15.879 Cannot find device "nvmf_init_br2" 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@163 -- # true 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:12:15.879 Cannot find device "nvmf_tgt_br" 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@164 -- # true 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:12:15.879 Cannot find device "nvmf_tgt_br2" 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@165 -- # true 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:12:15.879 Cannot find device "nvmf_init_br" 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@166 -- # true 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:12:15.879 Cannot find device "nvmf_init_br2" 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@167 -- # true 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:12:15.879 Cannot find device "nvmf_tgt_br" 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@168 -- # true 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:12:15.879 Cannot find device "nvmf_tgt_br2" 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@169 -- # true 00:12:15.879 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:12:16.137 Cannot find device "nvmf_br" 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@170 -- # true 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:12:16.137 Cannot find device "nvmf_init_if" 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@171 -- # true 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:12:16.137 Cannot find device "nvmf_init_if2" 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@172 -- # true 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:12:16.137 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@173 -- # true 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:12:16.137 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@174 -- # true 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:12:16.137 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:12:16.399 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:12:16.399 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.092 ms 00:12:16.399 00:12:16.399 --- 10.0.0.3 ping statistics --- 00:12:16.399 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:16.399 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:12:16.399 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:12:16.399 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.047 ms 00:12:16.399 00:12:16.399 --- 10.0.0.4 ping statistics --- 00:12:16.399 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:16.399 rtt min/avg/max/mdev = 0.047/0.047/0.047/0.000 ms 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:12:16.399 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:16.399 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.023 ms 00:12:16.399 00:12:16.399 --- 10.0.0.1 ping statistics --- 00:12:16.399 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:16.399 rtt min/avg/max/mdev = 0.023/0.023/0.023/0.000 ms 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:12:16.399 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:16.399 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.067 ms 00:12:16.399 00:12:16.399 --- 10.0.0.2 ping statistics --- 00:12:16.399 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:16.399 rtt min/avg/max/mdev = 0.067/0.067/0.067/0.000 ms 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@459 -- # return 0 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@87 -- # nvmfappstart -L nvmf_auth 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@724 -- # xtrace_disable 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@507 -- # nvmfpid=67395 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -L nvmf_auth 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@508 -- # waitforlisten 67395 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 67395 ']' 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:12:16.399 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@730 -- # xtrace_disable 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@89 -- # hostpid=67427 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@91 -- # trap 'dumplogs; cleanup' SIGINT SIGTERM EXIT 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@88 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 2 -r /var/tmp/host.sock -L nvme_auth 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@94 -- # gen_dhchap_key null 48 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=null 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=48 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 24 /dev/urandom 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=16417e1b9b20f379cd43ac516a8fa2228163c976c1a96b61 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-null.XXX 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-null.JHQ 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key 16417e1b9b20f379cd43ac516a8fa2228163c976c1a96b61 0 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 16417e1b9b20f379cd43ac516a8fa2228163c976c1a96b61 0 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=16417e1b9b20f379cd43ac516a8fa2228163c976c1a96b61 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=0 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-null.JHQ 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-null.JHQ 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@94 -- # keys[0]=/tmp/spdk.key-null.JHQ 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@94 -- # gen_dhchap_key sha512 64 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha512 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=64 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 32 /dev/urandom 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=25bd499fc993038780752a86bfbb4bbed538fddaff62cfba3b3b8e65c84277c7 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha512.XXX 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha512.iVq 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key 25bd499fc993038780752a86bfbb4bbed538fddaff62cfba3b3b8e65c84277c7 3 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 25bd499fc993038780752a86bfbb4bbed538fddaff62cfba3b3b8e65c84277c7 3 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=25bd499fc993038780752a86bfbb4bbed538fddaff62cfba3b3b8e65c84277c7 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=3 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha512.iVq 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha512.iVq 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@94 -- # ckeys[0]=/tmp/spdk.key-sha512.iVq 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@95 -- # gen_dhchap_key sha256 32 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha256 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=32 00:12:17.782 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 16 /dev/urandom 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=761d05795b73db5cc59000031c1ce2d5 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha256.XXX 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha256.VHY 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key 761d05795b73db5cc59000031c1ce2d5 1 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 761d05795b73db5cc59000031c1ce2d5 1 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=761d05795b73db5cc59000031c1ce2d5 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=1 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha256.VHY 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha256.VHY 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@95 -- # keys[1]=/tmp/spdk.key-sha256.VHY 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@95 -- # gen_dhchap_key sha384 48 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha384 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=48 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 24 /dev/urandom 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=c1bbd170209b0613b9d17690d329d9cad5a5930b17fb6aec 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha384.XXX 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha384.4wT 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key c1bbd170209b0613b9d17690d329d9cad5a5930b17fb6aec 2 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 c1bbd170209b0613b9d17690d329d9cad5a5930b17fb6aec 2 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=c1bbd170209b0613b9d17690d329d9cad5a5930b17fb6aec 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=2 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha384.4wT 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha384.4wT 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@95 -- # ckeys[1]=/tmp/spdk.key-sha384.4wT 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@96 -- # gen_dhchap_key sha384 48 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha384 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=48 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 24 /dev/urandom 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=dd04ac3578ebc31821b08c65207c9f6bacd068f8f02c9da3 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha384.XXX 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha384.Sgg 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key dd04ac3578ebc31821b08c65207c9f6bacd068f8f02c9da3 2 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 dd04ac3578ebc31821b08c65207c9f6bacd068f8f02c9da3 2 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=dd04ac3578ebc31821b08c65207c9f6bacd068f8f02c9da3 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=2 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha384.Sgg 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha384.Sgg 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@96 -- # keys[2]=/tmp/spdk.key-sha384.Sgg 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@96 -- # gen_dhchap_key sha256 32 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha256 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=32 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 16 /dev/urandom 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=dca3950c8dc3f9183c9b68910f43b860 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha256.XXX 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha256.9EA 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key dca3950c8dc3f9183c9b68910f43b860 1 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 dca3950c8dc3f9183c9b68910f43b860 1 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=dca3950c8dc3f9183c9b68910f43b860 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=1 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:12:17.783 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha256.9EA 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha256.9EA 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@96 -- # ckeys[2]=/tmp/spdk.key-sha256.9EA 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@97 -- # gen_dhchap_key sha512 64 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha512 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=64 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 32 /dev/urandom 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=0db6b337bcfb0bc2b7bd421ee78389a33a45fe98884604dc0fad9d279e9bafff 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha512.XXX 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha512.i1O 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key 0db6b337bcfb0bc2b7bd421ee78389a33a45fe98884604dc0fad9d279e9bafff 3 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 0db6b337bcfb0bc2b7bd421ee78389a33a45fe98884604dc0fad9d279e9bafff 3 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=0db6b337bcfb0bc2b7bd421ee78389a33a45fe98884604dc0fad9d279e9bafff 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=3 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha512.i1O 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha512.i1O 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@97 -- # keys[3]=/tmp/spdk.key-sha512.i1O 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@97 -- # ckeys[3]= 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@99 -- # waitforlisten 67395 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 67395 ']' 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:12:18.042 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:12:18.042 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:18.300 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:12:18.300 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:12:18.300 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@100 -- # waitforlisten 67427 /var/tmp/host.sock 00:12:18.300 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 67427 ']' 00:12:18.300 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/host.sock 00:12:18.300 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:12:18.300 Waiting for process to start up and listen on UNIX domain socket /var/tmp/host.sock... 00:12:18.300 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/host.sock...' 00:12:18.300 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:12:18.300 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:18.557 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:12:18.557 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:12:18.557 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@101 -- # rpc_cmd 00:12:18.557 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.557 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:18.557 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.557 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@108 -- # for i in "${!keys[@]}" 00:12:18.557 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@109 -- # rpc_cmd keyring_file_add_key key0 /tmp/spdk.key-null.JHQ 00:12:18.557 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.557 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:18.557 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.557 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@110 -- # hostrpc keyring_file_add_key key0 /tmp/spdk.key-null.JHQ 00:12:18.557 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key key0 /tmp/spdk.key-null.JHQ 00:12:18.815 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@111 -- # [[ -n /tmp/spdk.key-sha512.iVq ]] 00:12:18.815 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@112 -- # rpc_cmd keyring_file_add_key ckey0 /tmp/spdk.key-sha512.iVq 00:12:18.815 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.815 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:19.073 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.073 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@113 -- # hostrpc keyring_file_add_key ckey0 /tmp/spdk.key-sha512.iVq 00:12:19.073 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key ckey0 /tmp/spdk.key-sha512.iVq 00:12:19.331 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@108 -- # for i in "${!keys[@]}" 00:12:19.331 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@109 -- # rpc_cmd keyring_file_add_key key1 /tmp/spdk.key-sha256.VHY 00:12:19.331 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.331 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:19.331 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.331 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@110 -- # hostrpc keyring_file_add_key key1 /tmp/spdk.key-sha256.VHY 00:12:19.331 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key key1 /tmp/spdk.key-sha256.VHY 00:12:19.589 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@111 -- # [[ -n /tmp/spdk.key-sha384.4wT ]] 00:12:19.589 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@112 -- # rpc_cmd keyring_file_add_key ckey1 /tmp/spdk.key-sha384.4wT 00:12:19.589 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.589 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:19.589 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.589 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@113 -- # hostrpc keyring_file_add_key ckey1 /tmp/spdk.key-sha384.4wT 00:12:19.589 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key ckey1 /tmp/spdk.key-sha384.4wT 00:12:19.847 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@108 -- # for i in "${!keys[@]}" 00:12:19.847 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@109 -- # rpc_cmd keyring_file_add_key key2 /tmp/spdk.key-sha384.Sgg 00:12:19.847 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.847 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:19.847 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.847 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@110 -- # hostrpc keyring_file_add_key key2 /tmp/spdk.key-sha384.Sgg 00:12:19.847 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key key2 /tmp/spdk.key-sha384.Sgg 00:12:20.106 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@111 -- # [[ -n /tmp/spdk.key-sha256.9EA ]] 00:12:20.106 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@112 -- # rpc_cmd keyring_file_add_key ckey2 /tmp/spdk.key-sha256.9EA 00:12:20.106 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:20.106 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:20.106 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:20.106 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@113 -- # hostrpc keyring_file_add_key ckey2 /tmp/spdk.key-sha256.9EA 00:12:20.106 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key ckey2 /tmp/spdk.key-sha256.9EA 00:12:20.363 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@108 -- # for i in "${!keys[@]}" 00:12:20.363 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@109 -- # rpc_cmd keyring_file_add_key key3 /tmp/spdk.key-sha512.i1O 00:12:20.363 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:20.363 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:20.363 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:20.363 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@110 -- # hostrpc keyring_file_add_key key3 /tmp/spdk.key-sha512.i1O 00:12:20.363 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key key3 /tmp/spdk.key-sha512.i1O 00:12:20.621 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@111 -- # [[ -n '' ]] 00:12:20.621 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@118 -- # for digest in "${digests[@]}" 00:12:20.621 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:12:20.621 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:20.621 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:12:20.621 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:12:20.880 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 null 0 00:12:20.880 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:20.880 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:20.880 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:12:20.880 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:12:20.880 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:20.880 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:20.880 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:20.880 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:20.880 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:20.880 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:20.880 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:20.880 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:21.446 00:12:21.446 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:21.446 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:21.446 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:21.705 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:21.705 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:21.705 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.705 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:21.705 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.705 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:21.705 { 00:12:21.705 "cntlid": 1, 00:12:21.705 "qid": 0, 00:12:21.705 "state": "enabled", 00:12:21.705 "thread": "nvmf_tgt_poll_group_000", 00:12:21.705 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:12:21.705 "listen_address": { 00:12:21.705 "trtype": "TCP", 00:12:21.705 "adrfam": "IPv4", 00:12:21.705 "traddr": "10.0.0.3", 00:12:21.705 "trsvcid": "4420" 00:12:21.705 }, 00:12:21.705 "peer_address": { 00:12:21.705 "trtype": "TCP", 00:12:21.705 "adrfam": "IPv4", 00:12:21.705 "traddr": "10.0.0.1", 00:12:21.705 "trsvcid": "60566" 00:12:21.705 }, 00:12:21.705 "auth": { 00:12:21.705 "state": "completed", 00:12:21.705 "digest": "sha256", 00:12:21.705 "dhgroup": "null" 00:12:21.705 } 00:12:21.705 } 00:12:21.705 ]' 00:12:21.705 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:21.705 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:21.705 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:21.705 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:12:21.705 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:21.705 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:21.705 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:21.705 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:21.963 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:12:21.963 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:27.271 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 null 1 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:27.271 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:27.271 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:27.528 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:27.528 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:27.528 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:27.528 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:27.528 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:27.528 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:27.528 { 00:12:27.528 "cntlid": 3, 00:12:27.528 "qid": 0, 00:12:27.528 "state": "enabled", 00:12:27.528 "thread": "nvmf_tgt_poll_group_000", 00:12:27.528 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:12:27.528 "listen_address": { 00:12:27.528 "trtype": "TCP", 00:12:27.528 "adrfam": "IPv4", 00:12:27.528 "traddr": "10.0.0.3", 00:12:27.528 "trsvcid": "4420" 00:12:27.528 }, 00:12:27.528 "peer_address": { 00:12:27.528 "trtype": "TCP", 00:12:27.528 "adrfam": "IPv4", 00:12:27.528 "traddr": "10.0.0.1", 00:12:27.528 "trsvcid": "43270" 00:12:27.528 }, 00:12:27.528 "auth": { 00:12:27.528 "state": "completed", 00:12:27.528 "digest": "sha256", 00:12:27.528 "dhgroup": "null" 00:12:27.528 } 00:12:27.528 } 00:12:27.528 ]' 00:12:27.528 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:27.528 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:27.528 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:27.786 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:12:27.786 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:27.786 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:27.786 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:27.786 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:28.042 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:12:28.043 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:12:28.974 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:28.974 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:28.974 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:28.974 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:28.974 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:28.974 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:28.974 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:28.974 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:12:28.974 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:12:29.233 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 null 2 00:12:29.233 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:29.233 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:29.233 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:12:29.233 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:12:29.233 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:29.233 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:29.233 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:29.233 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:29.233 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:29.233 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:29.233 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:29.233 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:29.491 00:12:29.491 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:29.491 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:29.491 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:30.057 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:30.057 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:30.057 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.057 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:30.057 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.057 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:30.057 { 00:12:30.057 "cntlid": 5, 00:12:30.057 "qid": 0, 00:12:30.057 "state": "enabled", 00:12:30.057 "thread": "nvmf_tgt_poll_group_000", 00:12:30.057 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:12:30.057 "listen_address": { 00:12:30.057 "trtype": "TCP", 00:12:30.057 "adrfam": "IPv4", 00:12:30.057 "traddr": "10.0.0.3", 00:12:30.057 "trsvcid": "4420" 00:12:30.057 }, 00:12:30.057 "peer_address": { 00:12:30.057 "trtype": "TCP", 00:12:30.057 "adrfam": "IPv4", 00:12:30.057 "traddr": "10.0.0.1", 00:12:30.057 "trsvcid": "43288" 00:12:30.057 }, 00:12:30.057 "auth": { 00:12:30.057 "state": "completed", 00:12:30.057 "digest": "sha256", 00:12:30.057 "dhgroup": "null" 00:12:30.057 } 00:12:30.057 } 00:12:30.057 ]' 00:12:30.057 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:30.057 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:30.057 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:30.057 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:12:30.057 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:30.057 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:30.057 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:30.057 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:30.315 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:12:30.315 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:12:30.881 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:31.139 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:31.139 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:31.139 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:31.139 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:31.139 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:31.139 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:31.139 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:12:31.139 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:12:31.414 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 null 3 00:12:31.414 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:31.414 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:31.414 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:12:31.414 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:12:31.414 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:31.414 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:12:31.414 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:31.414 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:31.414 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:31.414 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:12:31.414 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:31.414 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:31.695 00:12:31.695 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:31.695 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:31.695 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:31.952 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:31.952 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:31.952 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:31.952 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:31.952 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:31.952 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:31.952 { 00:12:31.952 "cntlid": 7, 00:12:31.952 "qid": 0, 00:12:31.952 "state": "enabled", 00:12:31.952 "thread": "nvmf_tgt_poll_group_000", 00:12:31.952 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:12:31.952 "listen_address": { 00:12:31.952 "trtype": "TCP", 00:12:31.952 "adrfam": "IPv4", 00:12:31.952 "traddr": "10.0.0.3", 00:12:31.952 "trsvcid": "4420" 00:12:31.952 }, 00:12:31.952 "peer_address": { 00:12:31.952 "trtype": "TCP", 00:12:31.952 "adrfam": "IPv4", 00:12:31.952 "traddr": "10.0.0.1", 00:12:31.952 "trsvcid": "43318" 00:12:31.952 }, 00:12:31.952 "auth": { 00:12:31.952 "state": "completed", 00:12:31.952 "digest": "sha256", 00:12:31.952 "dhgroup": "null" 00:12:31.952 } 00:12:31.952 } 00:12:31.952 ]' 00:12:31.952 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:31.952 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:31.952 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:31.952 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:12:31.952 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:32.210 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:32.210 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:32.210 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:32.497 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:12:32.497 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:12:33.063 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:33.063 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:33.063 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:33.063 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:33.063 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:33.063 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:33.063 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:12:33.063 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:33.063 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:12:33.063 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:12:33.321 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe2048 0 00:12:33.321 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:33.321 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:33.321 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:12:33.321 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:12:33.321 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:33.321 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:33.321 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:33.321 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:33.579 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:33.579 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:33.579 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:33.579 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:33.837 00:12:33.837 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:33.837 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:33.837 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:34.096 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:34.096 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:34.096 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:34.096 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:34.096 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:34.096 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:34.096 { 00:12:34.096 "cntlid": 9, 00:12:34.096 "qid": 0, 00:12:34.096 "state": "enabled", 00:12:34.096 "thread": "nvmf_tgt_poll_group_000", 00:12:34.096 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:12:34.096 "listen_address": { 00:12:34.096 "trtype": "TCP", 00:12:34.096 "adrfam": "IPv4", 00:12:34.096 "traddr": "10.0.0.3", 00:12:34.096 "trsvcid": "4420" 00:12:34.096 }, 00:12:34.096 "peer_address": { 00:12:34.096 "trtype": "TCP", 00:12:34.096 "adrfam": "IPv4", 00:12:34.096 "traddr": "10.0.0.1", 00:12:34.096 "trsvcid": "43346" 00:12:34.096 }, 00:12:34.096 "auth": { 00:12:34.096 "state": "completed", 00:12:34.096 "digest": "sha256", 00:12:34.096 "dhgroup": "ffdhe2048" 00:12:34.096 } 00:12:34.096 } 00:12:34.096 ]' 00:12:34.096 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:34.096 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:34.096 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:34.355 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:12:34.355 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:34.355 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:34.355 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:34.355 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:34.614 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:12:34.614 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:12:35.547 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:35.547 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:35.547 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:35.547 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:35.547 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:35.547 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:35.547 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:35.547 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:12:35.547 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:12:35.547 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe2048 1 00:12:35.547 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:35.547 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:35.547 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:12:35.547 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:12:35.547 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:35.547 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:35.547 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:35.547 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:35.547 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:35.547 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:35.547 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:35.547 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:36.115 00:12:36.115 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:36.115 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:36.115 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:36.374 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:36.374 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:36.374 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:36.374 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:36.374 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:36.374 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:36.374 { 00:12:36.374 "cntlid": 11, 00:12:36.374 "qid": 0, 00:12:36.374 "state": "enabled", 00:12:36.374 "thread": "nvmf_tgt_poll_group_000", 00:12:36.374 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:12:36.374 "listen_address": { 00:12:36.374 "trtype": "TCP", 00:12:36.374 "adrfam": "IPv4", 00:12:36.374 "traddr": "10.0.0.3", 00:12:36.374 "trsvcid": "4420" 00:12:36.374 }, 00:12:36.374 "peer_address": { 00:12:36.374 "trtype": "TCP", 00:12:36.374 "adrfam": "IPv4", 00:12:36.374 "traddr": "10.0.0.1", 00:12:36.374 "trsvcid": "37774" 00:12:36.374 }, 00:12:36.374 "auth": { 00:12:36.374 "state": "completed", 00:12:36.374 "digest": "sha256", 00:12:36.374 "dhgroup": "ffdhe2048" 00:12:36.374 } 00:12:36.374 } 00:12:36.374 ]' 00:12:36.374 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:36.374 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:36.374 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:36.374 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:12:36.374 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:36.633 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:36.633 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:36.633 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:36.895 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:12:36.895 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:12:37.468 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:37.468 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:37.468 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:37.468 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:37.468 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:37.468 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:37.468 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:37.468 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:12:37.468 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:12:37.727 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe2048 2 00:12:37.727 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:37.727 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:37.727 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:12:37.727 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:12:37.727 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:37.727 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:37.727 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:37.727 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:37.727 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:37.727 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:37.727 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:37.727 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:38.294 00:12:38.294 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:38.294 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:38.294 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:38.552 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:38.552 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:38.552 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:38.552 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:38.552 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:38.552 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:38.552 { 00:12:38.552 "cntlid": 13, 00:12:38.552 "qid": 0, 00:12:38.552 "state": "enabled", 00:12:38.552 "thread": "nvmf_tgt_poll_group_000", 00:12:38.552 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:12:38.552 "listen_address": { 00:12:38.552 "trtype": "TCP", 00:12:38.552 "adrfam": "IPv4", 00:12:38.552 "traddr": "10.0.0.3", 00:12:38.552 "trsvcid": "4420" 00:12:38.552 }, 00:12:38.552 "peer_address": { 00:12:38.552 "trtype": "TCP", 00:12:38.552 "adrfam": "IPv4", 00:12:38.552 "traddr": "10.0.0.1", 00:12:38.552 "trsvcid": "37792" 00:12:38.552 }, 00:12:38.552 "auth": { 00:12:38.552 "state": "completed", 00:12:38.552 "digest": "sha256", 00:12:38.552 "dhgroup": "ffdhe2048" 00:12:38.552 } 00:12:38.552 } 00:12:38.552 ]' 00:12:38.552 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:38.552 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:38.552 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:38.552 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:12:38.552 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:38.552 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:38.552 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:38.552 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:38.810 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:12:38.810 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:12:39.744 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:39.744 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:39.744 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:39.744 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:39.744 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:39.744 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:39.744 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:39.744 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:12:39.744 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:12:40.002 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe2048 3 00:12:40.002 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:40.002 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:40.002 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:12:40.002 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:12:40.002 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:40.002 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:12:40.002 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:40.002 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:40.002 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:40.002 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:12:40.003 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:40.003 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:40.261 00:12:40.261 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:40.261 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:40.261 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:40.519 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:40.519 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:40.519 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:40.519 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:40.519 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:40.519 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:40.519 { 00:12:40.519 "cntlid": 15, 00:12:40.519 "qid": 0, 00:12:40.519 "state": "enabled", 00:12:40.519 "thread": "nvmf_tgt_poll_group_000", 00:12:40.519 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:12:40.519 "listen_address": { 00:12:40.519 "trtype": "TCP", 00:12:40.519 "adrfam": "IPv4", 00:12:40.519 "traddr": "10.0.0.3", 00:12:40.519 "trsvcid": "4420" 00:12:40.519 }, 00:12:40.519 "peer_address": { 00:12:40.519 "trtype": "TCP", 00:12:40.519 "adrfam": "IPv4", 00:12:40.519 "traddr": "10.0.0.1", 00:12:40.519 "trsvcid": "37818" 00:12:40.519 }, 00:12:40.519 "auth": { 00:12:40.519 "state": "completed", 00:12:40.519 "digest": "sha256", 00:12:40.519 "dhgroup": "ffdhe2048" 00:12:40.519 } 00:12:40.519 } 00:12:40.519 ]' 00:12:40.519 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:40.777 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:40.777 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:40.777 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:12:40.778 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:40.778 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:40.778 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:40.778 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:41.036 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:12:41.036 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:12:41.969 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:41.969 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:41.969 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:41.969 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:41.969 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:41.969 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:41.969 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:12:41.969 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:41.969 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:12:41.969 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:12:42.238 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe3072 0 00:12:42.238 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:42.238 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:42.238 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:12:42.238 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:12:42.238 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:42.238 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:42.238 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:42.238 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:42.238 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:42.238 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:42.238 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:42.238 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:42.496 00:12:42.496 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:42.496 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:42.496 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:43.063 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:43.063 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:43.063 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.063 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:43.063 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.063 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:43.063 { 00:12:43.063 "cntlid": 17, 00:12:43.063 "qid": 0, 00:12:43.063 "state": "enabled", 00:12:43.063 "thread": "nvmf_tgt_poll_group_000", 00:12:43.063 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:12:43.063 "listen_address": { 00:12:43.063 "trtype": "TCP", 00:12:43.063 "adrfam": "IPv4", 00:12:43.063 "traddr": "10.0.0.3", 00:12:43.063 "trsvcid": "4420" 00:12:43.063 }, 00:12:43.063 "peer_address": { 00:12:43.063 "trtype": "TCP", 00:12:43.063 "adrfam": "IPv4", 00:12:43.063 "traddr": "10.0.0.1", 00:12:43.063 "trsvcid": "37840" 00:12:43.063 }, 00:12:43.063 "auth": { 00:12:43.063 "state": "completed", 00:12:43.063 "digest": "sha256", 00:12:43.063 "dhgroup": "ffdhe3072" 00:12:43.063 } 00:12:43.063 } 00:12:43.063 ]' 00:12:43.063 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:43.063 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:43.063 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:43.063 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:12:43.063 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:43.063 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:43.063 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:43.063 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:43.322 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:12:43.322 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:12:44.257 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:44.257 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:44.257 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:44.257 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:44.257 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:44.257 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:44.257 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:44.257 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:12:44.257 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:12:44.516 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe3072 1 00:12:44.516 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:44.516 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:44.516 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:12:44.516 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:12:44.516 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:44.516 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:44.516 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:44.516 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:44.516 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:44.516 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:44.516 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:44.516 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:44.774 00:12:44.774 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:44.774 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:44.774 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:45.032 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:45.032 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:45.032 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:45.032 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:45.032 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:45.032 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:45.032 { 00:12:45.032 "cntlid": 19, 00:12:45.032 "qid": 0, 00:12:45.032 "state": "enabled", 00:12:45.032 "thread": "nvmf_tgt_poll_group_000", 00:12:45.032 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:12:45.032 "listen_address": { 00:12:45.032 "trtype": "TCP", 00:12:45.032 "adrfam": "IPv4", 00:12:45.032 "traddr": "10.0.0.3", 00:12:45.032 "trsvcid": "4420" 00:12:45.032 }, 00:12:45.032 "peer_address": { 00:12:45.032 "trtype": "TCP", 00:12:45.032 "adrfam": "IPv4", 00:12:45.032 "traddr": "10.0.0.1", 00:12:45.032 "trsvcid": "37870" 00:12:45.032 }, 00:12:45.032 "auth": { 00:12:45.032 "state": "completed", 00:12:45.032 "digest": "sha256", 00:12:45.032 "dhgroup": "ffdhe3072" 00:12:45.032 } 00:12:45.032 } 00:12:45.032 ]' 00:12:45.032 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:45.290 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:45.290 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:45.290 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:12:45.290 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:45.290 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:45.290 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:45.290 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:45.548 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:12:45.548 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:12:46.482 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:46.482 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:46.482 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:46.482 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:46.482 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:46.482 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:46.482 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:46.482 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:12:46.482 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:12:46.482 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe3072 2 00:12:46.482 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:46.482 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:46.482 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:12:46.482 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:12:46.483 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:46.483 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:46.483 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:46.483 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:46.483 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:46.483 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:46.483 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:46.483 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:47.048 00:12:47.048 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:47.048 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:47.048 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:47.306 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:47.306 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:47.306 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:47.306 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:47.306 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:47.306 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:47.306 { 00:12:47.306 "cntlid": 21, 00:12:47.306 "qid": 0, 00:12:47.306 "state": "enabled", 00:12:47.306 "thread": "nvmf_tgt_poll_group_000", 00:12:47.306 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:12:47.306 "listen_address": { 00:12:47.306 "trtype": "TCP", 00:12:47.306 "adrfam": "IPv4", 00:12:47.306 "traddr": "10.0.0.3", 00:12:47.306 "trsvcid": "4420" 00:12:47.306 }, 00:12:47.306 "peer_address": { 00:12:47.306 "trtype": "TCP", 00:12:47.306 "adrfam": "IPv4", 00:12:47.306 "traddr": "10.0.0.1", 00:12:47.306 "trsvcid": "41722" 00:12:47.306 }, 00:12:47.306 "auth": { 00:12:47.306 "state": "completed", 00:12:47.307 "digest": "sha256", 00:12:47.307 "dhgroup": "ffdhe3072" 00:12:47.307 } 00:12:47.307 } 00:12:47.307 ]' 00:12:47.307 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:47.307 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:47.307 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:47.307 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:12:47.307 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:47.307 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:47.307 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:47.307 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:47.873 11:23:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:12:47.873 11:23:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:12:48.439 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:48.439 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:48.439 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:48.439 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:48.439 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:48.439 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:48.439 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:48.439 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:12:48.439 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:12:48.698 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe3072 3 00:12:48.698 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:48.698 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:48.698 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:12:48.698 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:12:48.698 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:48.698 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:12:48.698 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:48.698 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:48.698 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:48.698 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:12:48.698 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:48.698 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:49.265 00:12:49.265 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:49.265 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:49.265 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:49.524 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:49.524 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:49.524 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:49.524 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:49.524 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:49.524 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:49.524 { 00:12:49.524 "cntlid": 23, 00:12:49.524 "qid": 0, 00:12:49.524 "state": "enabled", 00:12:49.524 "thread": "nvmf_tgt_poll_group_000", 00:12:49.524 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:12:49.524 "listen_address": { 00:12:49.524 "trtype": "TCP", 00:12:49.524 "adrfam": "IPv4", 00:12:49.524 "traddr": "10.0.0.3", 00:12:49.524 "trsvcid": "4420" 00:12:49.524 }, 00:12:49.524 "peer_address": { 00:12:49.524 "trtype": "TCP", 00:12:49.524 "adrfam": "IPv4", 00:12:49.524 "traddr": "10.0.0.1", 00:12:49.524 "trsvcid": "41760" 00:12:49.524 }, 00:12:49.524 "auth": { 00:12:49.524 "state": "completed", 00:12:49.524 "digest": "sha256", 00:12:49.524 "dhgroup": "ffdhe3072" 00:12:49.524 } 00:12:49.524 } 00:12:49.524 ]' 00:12:49.524 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:49.524 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:49.524 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:49.782 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:12:49.782 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:49.782 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:49.782 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:49.782 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:50.040 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:12:50.040 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:12:50.972 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:50.972 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:50.972 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:50.972 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:50.972 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:50.972 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:50.972 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:12:50.972 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:50.972 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:12:50.972 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:12:50.972 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe4096 0 00:12:50.972 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:50.972 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:50.972 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:12:50.972 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:12:50.972 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:50.972 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:50.972 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:50.972 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:51.231 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:51.231 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:51.231 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:51.231 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:51.489 00:12:51.489 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:51.489 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:51.489 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:51.747 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:51.747 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:51.747 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:51.747 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:52.005 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:52.005 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:52.005 { 00:12:52.005 "cntlid": 25, 00:12:52.005 "qid": 0, 00:12:52.005 "state": "enabled", 00:12:52.005 "thread": "nvmf_tgt_poll_group_000", 00:12:52.005 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:12:52.005 "listen_address": { 00:12:52.005 "trtype": "TCP", 00:12:52.005 "adrfam": "IPv4", 00:12:52.005 "traddr": "10.0.0.3", 00:12:52.005 "trsvcid": "4420" 00:12:52.005 }, 00:12:52.005 "peer_address": { 00:12:52.005 "trtype": "TCP", 00:12:52.005 "adrfam": "IPv4", 00:12:52.005 "traddr": "10.0.0.1", 00:12:52.005 "trsvcid": "41802" 00:12:52.005 }, 00:12:52.005 "auth": { 00:12:52.005 "state": "completed", 00:12:52.005 "digest": "sha256", 00:12:52.005 "dhgroup": "ffdhe4096" 00:12:52.005 } 00:12:52.005 } 00:12:52.005 ]' 00:12:52.005 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:52.005 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:52.005 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:52.005 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:12:52.005 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:52.005 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:52.005 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:52.005 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:52.263 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:12:52.263 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:12:53.197 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:53.197 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:53.197 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:53.197 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:53.197 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:53.197 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:53.197 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:53.197 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:12:53.197 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:12:53.455 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe4096 1 00:12:53.455 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:53.455 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:53.455 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:12:53.455 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:12:53.455 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:53.455 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:53.455 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:53.455 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:53.455 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:53.455 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:53.455 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:53.455 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:53.714 00:12:53.714 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:53.714 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:53.714 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:53.973 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:53.973 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:53.973 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:53.973 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:53.973 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:53.973 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:53.973 { 00:12:53.973 "cntlid": 27, 00:12:53.973 "qid": 0, 00:12:53.973 "state": "enabled", 00:12:53.973 "thread": "nvmf_tgt_poll_group_000", 00:12:53.973 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:12:53.973 "listen_address": { 00:12:53.973 "trtype": "TCP", 00:12:53.973 "adrfam": "IPv4", 00:12:53.973 "traddr": "10.0.0.3", 00:12:53.973 "trsvcid": "4420" 00:12:53.973 }, 00:12:53.973 "peer_address": { 00:12:53.973 "trtype": "TCP", 00:12:53.973 "adrfam": "IPv4", 00:12:53.973 "traddr": "10.0.0.1", 00:12:53.973 "trsvcid": "41838" 00:12:53.973 }, 00:12:53.973 "auth": { 00:12:53.973 "state": "completed", 00:12:53.973 "digest": "sha256", 00:12:53.973 "dhgroup": "ffdhe4096" 00:12:53.973 } 00:12:53.973 } 00:12:53.973 ]' 00:12:53.973 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:53.973 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:53.973 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:54.231 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:12:54.231 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:54.231 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:54.231 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:54.231 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:54.489 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:12:54.489 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:12:55.422 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:55.422 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:55.422 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:55.422 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:55.422 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:55.422 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:55.422 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:55.422 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:12:55.422 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:12:55.680 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe4096 2 00:12:55.680 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:55.680 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:55.680 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:12:55.680 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:12:55.680 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:55.680 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:55.680 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:55.680 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:55.680 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:55.680 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:55.680 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:55.680 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:55.938 00:12:55.938 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:55.938 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:55.938 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:56.196 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:56.196 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:56.196 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.196 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:56.196 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.196 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:56.196 { 00:12:56.196 "cntlid": 29, 00:12:56.196 "qid": 0, 00:12:56.196 "state": "enabled", 00:12:56.196 "thread": "nvmf_tgt_poll_group_000", 00:12:56.196 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:12:56.196 "listen_address": { 00:12:56.196 "trtype": "TCP", 00:12:56.196 "adrfam": "IPv4", 00:12:56.196 "traddr": "10.0.0.3", 00:12:56.196 "trsvcid": "4420" 00:12:56.196 }, 00:12:56.196 "peer_address": { 00:12:56.196 "trtype": "TCP", 00:12:56.196 "adrfam": "IPv4", 00:12:56.196 "traddr": "10.0.0.1", 00:12:56.196 "trsvcid": "50924" 00:12:56.196 }, 00:12:56.196 "auth": { 00:12:56.196 "state": "completed", 00:12:56.196 "digest": "sha256", 00:12:56.196 "dhgroup": "ffdhe4096" 00:12:56.196 } 00:12:56.196 } 00:12:56.196 ]' 00:12:56.196 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:56.453 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:56.453 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:56.453 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:12:56.453 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:56.453 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:56.453 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:56.454 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:56.711 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:12:56.711 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:12:57.643 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:57.643 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:57.643 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:12:57.643 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.643 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:57.643 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.643 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:57.643 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:12:57.643 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:12:57.901 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe4096 3 00:12:57.901 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:57.901 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:57.901 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:12:57.901 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:12:57.901 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:57.902 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:12:57.902 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.902 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:57.902 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.902 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:12:57.902 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:57.902 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:58.467 00:12:58.467 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:58.467 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:58.467 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:58.725 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:58.725 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:58.725 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:58.725 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:58.725 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:58.725 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:58.725 { 00:12:58.725 "cntlid": 31, 00:12:58.725 "qid": 0, 00:12:58.725 "state": "enabled", 00:12:58.725 "thread": "nvmf_tgt_poll_group_000", 00:12:58.725 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:12:58.725 "listen_address": { 00:12:58.725 "trtype": "TCP", 00:12:58.725 "adrfam": "IPv4", 00:12:58.725 "traddr": "10.0.0.3", 00:12:58.725 "trsvcid": "4420" 00:12:58.725 }, 00:12:58.725 "peer_address": { 00:12:58.725 "trtype": "TCP", 00:12:58.725 "adrfam": "IPv4", 00:12:58.725 "traddr": "10.0.0.1", 00:12:58.725 "trsvcid": "50948" 00:12:58.725 }, 00:12:58.725 "auth": { 00:12:58.725 "state": "completed", 00:12:58.725 "digest": "sha256", 00:12:58.725 "dhgroup": "ffdhe4096" 00:12:58.725 } 00:12:58.725 } 00:12:58.725 ]' 00:12:58.725 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:58.725 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:58.725 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:58.725 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:12:58.725 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:58.983 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:58.983 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:58.983 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:59.240 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:12:59.240 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:00.174 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe6144 0 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:00.174 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:00.794 00:13:00.794 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:00.794 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:00.794 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:01.374 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:01.374 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:01.374 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.374 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:01.374 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.374 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:01.374 { 00:13:01.375 "cntlid": 33, 00:13:01.375 "qid": 0, 00:13:01.375 "state": "enabled", 00:13:01.375 "thread": "nvmf_tgt_poll_group_000", 00:13:01.375 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:01.375 "listen_address": { 00:13:01.375 "trtype": "TCP", 00:13:01.375 "adrfam": "IPv4", 00:13:01.375 "traddr": "10.0.0.3", 00:13:01.375 "trsvcid": "4420" 00:13:01.375 }, 00:13:01.375 "peer_address": { 00:13:01.375 "trtype": "TCP", 00:13:01.375 "adrfam": "IPv4", 00:13:01.375 "traddr": "10.0.0.1", 00:13:01.375 "trsvcid": "50964" 00:13:01.375 }, 00:13:01.375 "auth": { 00:13:01.375 "state": "completed", 00:13:01.375 "digest": "sha256", 00:13:01.375 "dhgroup": "ffdhe6144" 00:13:01.375 } 00:13:01.375 } 00:13:01.375 ]' 00:13:01.375 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:01.375 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:13:01.375 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:01.375 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:13:01.375 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:01.375 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:01.375 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:01.375 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:01.633 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:13:01.633 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:13:02.565 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:02.565 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:02.565 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:02.565 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.565 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:02.565 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.565 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:02.566 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:13:02.566 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:13:02.566 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe6144 1 00:13:02.566 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:02.566 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:13:02.566 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:13:02.566 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:13:02.566 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:02.566 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:02.566 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.566 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:02.823 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.823 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:02.823 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:02.823 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:03.389 00:13:03.389 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:03.389 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:03.389 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:03.647 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:03.647 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:03.647 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.647 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:03.647 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.647 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:03.647 { 00:13:03.647 "cntlid": 35, 00:13:03.647 "qid": 0, 00:13:03.647 "state": "enabled", 00:13:03.647 "thread": "nvmf_tgt_poll_group_000", 00:13:03.647 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:03.647 "listen_address": { 00:13:03.647 "trtype": "TCP", 00:13:03.647 "adrfam": "IPv4", 00:13:03.647 "traddr": "10.0.0.3", 00:13:03.647 "trsvcid": "4420" 00:13:03.647 }, 00:13:03.647 "peer_address": { 00:13:03.647 "trtype": "TCP", 00:13:03.647 "adrfam": "IPv4", 00:13:03.647 "traddr": "10.0.0.1", 00:13:03.647 "trsvcid": "50994" 00:13:03.647 }, 00:13:03.647 "auth": { 00:13:03.647 "state": "completed", 00:13:03.647 "digest": "sha256", 00:13:03.647 "dhgroup": "ffdhe6144" 00:13:03.647 } 00:13:03.647 } 00:13:03.647 ]' 00:13:03.647 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:03.647 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:13:03.647 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:03.647 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:13:03.647 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:03.647 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:03.647 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:03.647 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:03.905 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:13:03.905 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:13:04.838 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:04.838 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:04.838 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:04.838 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.838 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:04.838 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.838 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:04.838 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:13:04.838 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:13:05.096 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe6144 2 00:13:05.096 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:05.096 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:13:05.096 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:13:05.096 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:13:05.096 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:05.096 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:05.096 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.096 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:05.096 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.096 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:05.096 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:05.096 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:05.661 00:13:05.661 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:05.661 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:05.661 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:05.919 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:05.919 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:05.919 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.919 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:05.919 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.919 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:05.919 { 00:13:05.919 "cntlid": 37, 00:13:05.919 "qid": 0, 00:13:05.919 "state": "enabled", 00:13:05.919 "thread": "nvmf_tgt_poll_group_000", 00:13:05.919 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:05.919 "listen_address": { 00:13:05.919 "trtype": "TCP", 00:13:05.919 "adrfam": "IPv4", 00:13:05.919 "traddr": "10.0.0.3", 00:13:05.919 "trsvcid": "4420" 00:13:05.919 }, 00:13:05.919 "peer_address": { 00:13:05.919 "trtype": "TCP", 00:13:05.919 "adrfam": "IPv4", 00:13:05.919 "traddr": "10.0.0.1", 00:13:05.919 "trsvcid": "41498" 00:13:05.919 }, 00:13:05.919 "auth": { 00:13:05.919 "state": "completed", 00:13:05.919 "digest": "sha256", 00:13:05.919 "dhgroup": "ffdhe6144" 00:13:05.919 } 00:13:05.919 } 00:13:05.919 ]' 00:13:05.919 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:05.919 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:13:05.919 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:05.919 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:13:05.919 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:05.919 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:05.919 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:05.919 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:06.483 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:13:06.483 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:13:07.048 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:07.306 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:07.306 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:07.306 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.306 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:07.306 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.306 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:07.306 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:13:07.306 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:13:07.564 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe6144 3 00:13:07.564 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:07.564 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:13:07.564 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:13:07.564 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:13:07.564 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:07.564 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:13:07.564 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.564 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:07.564 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.564 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:13:07.564 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:07.564 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:08.167 00:13:08.167 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:08.167 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:08.167 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:08.167 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:08.167 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:08.167 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.167 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:08.167 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.167 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:08.167 { 00:13:08.167 "cntlid": 39, 00:13:08.167 "qid": 0, 00:13:08.167 "state": "enabled", 00:13:08.167 "thread": "nvmf_tgt_poll_group_000", 00:13:08.167 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:08.167 "listen_address": { 00:13:08.167 "trtype": "TCP", 00:13:08.167 "adrfam": "IPv4", 00:13:08.167 "traddr": "10.0.0.3", 00:13:08.167 "trsvcid": "4420" 00:13:08.167 }, 00:13:08.167 "peer_address": { 00:13:08.167 "trtype": "TCP", 00:13:08.167 "adrfam": "IPv4", 00:13:08.167 "traddr": "10.0.0.1", 00:13:08.167 "trsvcid": "41512" 00:13:08.167 }, 00:13:08.167 "auth": { 00:13:08.167 "state": "completed", 00:13:08.167 "digest": "sha256", 00:13:08.167 "dhgroup": "ffdhe6144" 00:13:08.167 } 00:13:08.167 } 00:13:08.167 ]' 00:13:08.167 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:08.425 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:13:08.425 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:08.425 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:13:08.425 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:08.425 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:08.425 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:08.425 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:08.684 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:13:08.684 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:13:09.617 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:09.617 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:09.617 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:09.617 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:09.617 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:09.617 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:09.617 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:13:09.617 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:09.617 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:13:09.617 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:13:09.875 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe8192 0 00:13:09.875 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:09.875 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:13:09.875 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:13:09.875 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:13:09.875 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:09.875 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:09.875 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:09.875 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:09.875 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:09.875 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:09.875 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:09.875 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:10.438 00:13:10.438 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:10.438 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:10.438 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:10.695 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:10.696 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:10.696 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:10.696 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:10.696 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:10.696 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:10.696 { 00:13:10.696 "cntlid": 41, 00:13:10.696 "qid": 0, 00:13:10.696 "state": "enabled", 00:13:10.696 "thread": "nvmf_tgt_poll_group_000", 00:13:10.696 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:10.696 "listen_address": { 00:13:10.696 "trtype": "TCP", 00:13:10.696 "adrfam": "IPv4", 00:13:10.696 "traddr": "10.0.0.3", 00:13:10.696 "trsvcid": "4420" 00:13:10.696 }, 00:13:10.696 "peer_address": { 00:13:10.696 "trtype": "TCP", 00:13:10.696 "adrfam": "IPv4", 00:13:10.696 "traddr": "10.0.0.1", 00:13:10.696 "trsvcid": "41552" 00:13:10.696 }, 00:13:10.696 "auth": { 00:13:10.696 "state": "completed", 00:13:10.696 "digest": "sha256", 00:13:10.696 "dhgroup": "ffdhe8192" 00:13:10.696 } 00:13:10.696 } 00:13:10.696 ]' 00:13:10.696 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:10.953 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:13:10.953 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:10.953 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:13:10.953 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:10.953 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:10.953 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:10.953 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:11.211 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:13:11.211 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:12.145 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe8192 1 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:12.145 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:13.078 00:13:13.078 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:13.078 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:13.078 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:13.078 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:13.078 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:13.078 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.078 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:13.078 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.078 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:13.078 { 00:13:13.078 "cntlid": 43, 00:13:13.078 "qid": 0, 00:13:13.078 "state": "enabled", 00:13:13.078 "thread": "nvmf_tgt_poll_group_000", 00:13:13.078 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:13.078 "listen_address": { 00:13:13.078 "trtype": "TCP", 00:13:13.078 "adrfam": "IPv4", 00:13:13.078 "traddr": "10.0.0.3", 00:13:13.078 "trsvcid": "4420" 00:13:13.078 }, 00:13:13.078 "peer_address": { 00:13:13.078 "trtype": "TCP", 00:13:13.078 "adrfam": "IPv4", 00:13:13.078 "traddr": "10.0.0.1", 00:13:13.078 "trsvcid": "41588" 00:13:13.078 }, 00:13:13.078 "auth": { 00:13:13.078 "state": "completed", 00:13:13.078 "digest": "sha256", 00:13:13.078 "dhgroup": "ffdhe8192" 00:13:13.078 } 00:13:13.078 } 00:13:13.078 ]' 00:13:13.078 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:13.335 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:13:13.335 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:13.335 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:13:13.335 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:13.335 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:13.335 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:13.335 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:13.593 11:23:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:13:13.593 11:23:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:13:14.526 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:14.526 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:14.526 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:14.526 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.526 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:14.526 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.526 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:14.526 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:13:14.526 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:13:14.784 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe8192 2 00:13:14.784 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:14.784 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:13:14.784 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:13:14.784 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:13:14.784 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:14.784 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:14.784 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.784 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:14.784 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.784 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:14.784 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:14.784 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:15.350 00:13:15.350 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:15.350 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:15.350 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:15.608 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:15.608 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:15.608 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:15.608 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:15.608 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:15.608 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:15.608 { 00:13:15.608 "cntlid": 45, 00:13:15.608 "qid": 0, 00:13:15.608 "state": "enabled", 00:13:15.608 "thread": "nvmf_tgt_poll_group_000", 00:13:15.608 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:15.608 "listen_address": { 00:13:15.608 "trtype": "TCP", 00:13:15.608 "adrfam": "IPv4", 00:13:15.608 "traddr": "10.0.0.3", 00:13:15.608 "trsvcid": "4420" 00:13:15.608 }, 00:13:15.608 "peer_address": { 00:13:15.608 "trtype": "TCP", 00:13:15.608 "adrfam": "IPv4", 00:13:15.608 "traddr": "10.0.0.1", 00:13:15.608 "trsvcid": "41624" 00:13:15.608 }, 00:13:15.608 "auth": { 00:13:15.608 "state": "completed", 00:13:15.608 "digest": "sha256", 00:13:15.608 "dhgroup": "ffdhe8192" 00:13:15.608 } 00:13:15.608 } 00:13:15.608 ]' 00:13:15.608 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:15.866 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:13:15.866 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:15.866 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:13:15.866 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:15.866 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:15.866 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:15.866 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:16.124 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:13:16.124 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:13:17.063 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:17.063 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:17.063 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:17.063 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.063 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:17.063 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.063 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:17.063 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:13:17.063 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:13:17.320 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe8192 3 00:13:17.320 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:17.320 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:13:17.320 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:13:17.320 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:13:17.320 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:17.320 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:13:17.320 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.320 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:17.320 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.320 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:13:17.320 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:17.320 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:17.885 00:13:17.885 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:17.885 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:17.885 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:18.142 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:18.142 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:18.142 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.142 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:18.142 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.142 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:18.142 { 00:13:18.142 "cntlid": 47, 00:13:18.142 "qid": 0, 00:13:18.142 "state": "enabled", 00:13:18.142 "thread": "nvmf_tgt_poll_group_000", 00:13:18.142 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:18.142 "listen_address": { 00:13:18.142 "trtype": "TCP", 00:13:18.142 "adrfam": "IPv4", 00:13:18.142 "traddr": "10.0.0.3", 00:13:18.142 "trsvcid": "4420" 00:13:18.142 }, 00:13:18.142 "peer_address": { 00:13:18.142 "trtype": "TCP", 00:13:18.142 "adrfam": "IPv4", 00:13:18.142 "traddr": "10.0.0.1", 00:13:18.142 "trsvcid": "33818" 00:13:18.142 }, 00:13:18.142 "auth": { 00:13:18.142 "state": "completed", 00:13:18.142 "digest": "sha256", 00:13:18.142 "dhgroup": "ffdhe8192" 00:13:18.142 } 00:13:18.142 } 00:13:18.142 ]' 00:13:18.142 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:18.400 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:13:18.400 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:18.400 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:13:18.400 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:18.400 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:18.400 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:18.400 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:18.659 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:13:18.659 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:13:19.593 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:19.593 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:19.593 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:19.593 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.593 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:19.593 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.593 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@118 -- # for digest in "${digests[@]}" 00:13:19.593 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:13:19.593 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:19.593 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:13:19.593 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:13:19.593 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 null 0 00:13:19.593 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:19.593 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:19.593 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:13:19.593 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:13:19.593 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:19.593 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:19.593 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.593 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:19.851 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.851 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:19.851 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:19.851 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:20.110 00:13:20.110 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:20.110 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:20.110 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:20.369 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:20.369 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:20.369 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.369 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:20.369 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.369 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:20.369 { 00:13:20.369 "cntlid": 49, 00:13:20.369 "qid": 0, 00:13:20.369 "state": "enabled", 00:13:20.369 "thread": "nvmf_tgt_poll_group_000", 00:13:20.369 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:20.369 "listen_address": { 00:13:20.369 "trtype": "TCP", 00:13:20.369 "adrfam": "IPv4", 00:13:20.369 "traddr": "10.0.0.3", 00:13:20.369 "trsvcid": "4420" 00:13:20.369 }, 00:13:20.369 "peer_address": { 00:13:20.369 "trtype": "TCP", 00:13:20.369 "adrfam": "IPv4", 00:13:20.369 "traddr": "10.0.0.1", 00:13:20.369 "trsvcid": "33854" 00:13:20.369 }, 00:13:20.369 "auth": { 00:13:20.369 "state": "completed", 00:13:20.369 "digest": "sha384", 00:13:20.369 "dhgroup": "null" 00:13:20.369 } 00:13:20.369 } 00:13:20.369 ]' 00:13:20.369 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:20.369 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:20.369 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:20.627 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:13:20.627 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:20.628 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:20.628 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:20.628 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:20.886 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:13:20.886 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:21.820 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 null 1 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:21.820 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:22.387 00:13:22.387 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:22.387 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:22.387 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:22.645 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:22.645 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:22.645 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.645 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:22.645 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.645 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:22.645 { 00:13:22.645 "cntlid": 51, 00:13:22.645 "qid": 0, 00:13:22.645 "state": "enabled", 00:13:22.645 "thread": "nvmf_tgt_poll_group_000", 00:13:22.645 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:22.645 "listen_address": { 00:13:22.645 "trtype": "TCP", 00:13:22.645 "adrfam": "IPv4", 00:13:22.645 "traddr": "10.0.0.3", 00:13:22.645 "trsvcid": "4420" 00:13:22.645 }, 00:13:22.645 "peer_address": { 00:13:22.645 "trtype": "TCP", 00:13:22.645 "adrfam": "IPv4", 00:13:22.645 "traddr": "10.0.0.1", 00:13:22.645 "trsvcid": "33868" 00:13:22.645 }, 00:13:22.645 "auth": { 00:13:22.645 "state": "completed", 00:13:22.645 "digest": "sha384", 00:13:22.645 "dhgroup": "null" 00:13:22.645 } 00:13:22.645 } 00:13:22.645 ]' 00:13:22.645 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:22.645 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:22.645 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:22.903 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:13:22.903 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:22.903 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:22.903 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:22.903 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:23.162 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:13:23.162 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:24.097 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 null 2 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:24.097 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:24.670 00:13:24.670 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:24.670 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:24.670 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:24.928 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:24.928 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:24.928 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.928 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:24.928 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.928 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:24.928 { 00:13:24.928 "cntlid": 53, 00:13:24.928 "qid": 0, 00:13:24.928 "state": "enabled", 00:13:24.928 "thread": "nvmf_tgt_poll_group_000", 00:13:24.928 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:24.928 "listen_address": { 00:13:24.928 "trtype": "TCP", 00:13:24.928 "adrfam": "IPv4", 00:13:24.928 "traddr": "10.0.0.3", 00:13:24.928 "trsvcid": "4420" 00:13:24.928 }, 00:13:24.928 "peer_address": { 00:13:24.928 "trtype": "TCP", 00:13:24.928 "adrfam": "IPv4", 00:13:24.928 "traddr": "10.0.0.1", 00:13:24.928 "trsvcid": "33900" 00:13:24.928 }, 00:13:24.928 "auth": { 00:13:24.928 "state": "completed", 00:13:24.928 "digest": "sha384", 00:13:24.928 "dhgroup": "null" 00:13:24.928 } 00:13:24.928 } 00:13:24.928 ]' 00:13:24.928 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:24.928 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:24.928 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:24.928 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:13:24.928 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:24.928 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:24.928 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:24.928 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:25.494 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:13:25.494 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:13:26.061 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:26.061 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:26.061 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:26.061 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.061 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:26.061 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.061 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:26.061 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:13:26.061 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:13:26.318 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 null 3 00:13:26.318 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:26.318 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:26.318 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:13:26.318 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:13:26.318 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:26.318 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:13:26.318 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.318 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:26.318 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.318 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:13:26.318 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:26.318 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:26.884 00:13:26.884 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:26.884 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:26.884 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:27.142 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:27.142 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:27.142 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.142 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:27.142 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.142 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:27.142 { 00:13:27.142 "cntlid": 55, 00:13:27.142 "qid": 0, 00:13:27.142 "state": "enabled", 00:13:27.142 "thread": "nvmf_tgt_poll_group_000", 00:13:27.142 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:27.142 "listen_address": { 00:13:27.142 "trtype": "TCP", 00:13:27.142 "adrfam": "IPv4", 00:13:27.142 "traddr": "10.0.0.3", 00:13:27.142 "trsvcid": "4420" 00:13:27.142 }, 00:13:27.142 "peer_address": { 00:13:27.142 "trtype": "TCP", 00:13:27.142 "adrfam": "IPv4", 00:13:27.142 "traddr": "10.0.0.1", 00:13:27.142 "trsvcid": "42736" 00:13:27.142 }, 00:13:27.142 "auth": { 00:13:27.142 "state": "completed", 00:13:27.142 "digest": "sha384", 00:13:27.142 "dhgroup": "null" 00:13:27.142 } 00:13:27.142 } 00:13:27.142 ]' 00:13:27.142 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:27.142 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:27.142 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:27.400 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:13:27.400 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:27.400 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:27.400 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:27.400 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:27.657 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:13:27.657 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:13:28.223 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:28.223 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:28.223 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:28.223 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.223 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:28.481 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.481 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:13:28.481 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:28.481 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:13:28.481 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:13:28.739 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe2048 0 00:13:28.739 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:28.739 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:28.739 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:13:28.739 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:13:28.739 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:28.739 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:28.739 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.739 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:28.739 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.739 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:28.739 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:28.739 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:28.997 00:13:28.997 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:28.997 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:28.997 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:29.256 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:29.256 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:29.256 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.256 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:29.256 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.256 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:29.256 { 00:13:29.256 "cntlid": 57, 00:13:29.256 "qid": 0, 00:13:29.256 "state": "enabled", 00:13:29.256 "thread": "nvmf_tgt_poll_group_000", 00:13:29.256 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:29.256 "listen_address": { 00:13:29.256 "trtype": "TCP", 00:13:29.256 "adrfam": "IPv4", 00:13:29.256 "traddr": "10.0.0.3", 00:13:29.256 "trsvcid": "4420" 00:13:29.256 }, 00:13:29.256 "peer_address": { 00:13:29.256 "trtype": "TCP", 00:13:29.256 "adrfam": "IPv4", 00:13:29.256 "traddr": "10.0.0.1", 00:13:29.256 "trsvcid": "42750" 00:13:29.256 }, 00:13:29.256 "auth": { 00:13:29.256 "state": "completed", 00:13:29.256 "digest": "sha384", 00:13:29.256 "dhgroup": "ffdhe2048" 00:13:29.256 } 00:13:29.256 } 00:13:29.256 ]' 00:13:29.256 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:29.514 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:29.514 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:29.514 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:13:29.514 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:29.514 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:29.514 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:29.514 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:29.773 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:13:29.773 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:13:30.708 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:30.708 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:30.708 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:30.708 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.708 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:30.708 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.708 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:30.708 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:13:30.708 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:13:31.005 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe2048 1 00:13:31.005 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:31.005 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:31.005 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:13:31.005 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:13:31.005 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:31.005 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:31.005 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.005 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:31.005 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.005 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:31.005 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:31.005 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:31.263 00:13:31.263 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:31.263 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:31.263 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:31.522 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:31.522 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:31.522 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.522 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:31.522 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.522 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:31.522 { 00:13:31.522 "cntlid": 59, 00:13:31.522 "qid": 0, 00:13:31.522 "state": "enabled", 00:13:31.522 "thread": "nvmf_tgt_poll_group_000", 00:13:31.522 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:31.522 "listen_address": { 00:13:31.522 "trtype": "TCP", 00:13:31.522 "adrfam": "IPv4", 00:13:31.522 "traddr": "10.0.0.3", 00:13:31.522 "trsvcid": "4420" 00:13:31.522 }, 00:13:31.522 "peer_address": { 00:13:31.522 "trtype": "TCP", 00:13:31.522 "adrfam": "IPv4", 00:13:31.522 "traddr": "10.0.0.1", 00:13:31.522 "trsvcid": "42778" 00:13:31.522 }, 00:13:31.522 "auth": { 00:13:31.522 "state": "completed", 00:13:31.522 "digest": "sha384", 00:13:31.522 "dhgroup": "ffdhe2048" 00:13:31.522 } 00:13:31.522 } 00:13:31.522 ]' 00:13:31.522 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:31.522 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:31.522 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:31.781 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:13:31.781 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:31.781 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:31.781 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:31.781 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:32.039 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:13:32.039 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:13:32.974 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:32.974 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:32.974 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:32.974 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.974 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:32.974 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.974 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:32.974 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:13:32.974 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:13:33.232 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe2048 2 00:13:33.232 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:33.232 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:33.232 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:13:33.232 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:13:33.232 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:33.232 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:33.232 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.232 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:33.232 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.232 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:33.232 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:33.232 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:33.797 00:13:33.797 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:33.797 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:33.797 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:34.056 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:34.056 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:34.056 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.056 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:34.056 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.056 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:34.056 { 00:13:34.056 "cntlid": 61, 00:13:34.056 "qid": 0, 00:13:34.056 "state": "enabled", 00:13:34.056 "thread": "nvmf_tgt_poll_group_000", 00:13:34.056 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:34.056 "listen_address": { 00:13:34.056 "trtype": "TCP", 00:13:34.056 "adrfam": "IPv4", 00:13:34.056 "traddr": "10.0.0.3", 00:13:34.056 "trsvcid": "4420" 00:13:34.056 }, 00:13:34.056 "peer_address": { 00:13:34.056 "trtype": "TCP", 00:13:34.056 "adrfam": "IPv4", 00:13:34.056 "traddr": "10.0.0.1", 00:13:34.056 "trsvcid": "42808" 00:13:34.056 }, 00:13:34.056 "auth": { 00:13:34.056 "state": "completed", 00:13:34.056 "digest": "sha384", 00:13:34.056 "dhgroup": "ffdhe2048" 00:13:34.056 } 00:13:34.056 } 00:13:34.056 ]' 00:13:34.056 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:34.056 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:34.056 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:34.314 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:13:34.314 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:34.314 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:34.314 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:34.314 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:34.572 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:13:34.572 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:13:35.546 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:35.546 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:35.546 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:35.546 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.546 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:35.546 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.546 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:35.546 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:13:35.546 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:13:35.546 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe2048 3 00:13:35.546 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:35.546 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:35.546 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:13:35.546 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:13:35.546 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:35.546 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:13:35.546 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.546 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:35.546 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.546 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:13:35.546 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:35.546 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:36.113 00:13:36.113 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:36.113 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:36.113 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:36.371 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:36.371 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:36.371 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.371 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:36.371 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.371 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:36.371 { 00:13:36.371 "cntlid": 63, 00:13:36.371 "qid": 0, 00:13:36.371 "state": "enabled", 00:13:36.371 "thread": "nvmf_tgt_poll_group_000", 00:13:36.371 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:36.371 "listen_address": { 00:13:36.371 "trtype": "TCP", 00:13:36.371 "adrfam": "IPv4", 00:13:36.371 "traddr": "10.0.0.3", 00:13:36.371 "trsvcid": "4420" 00:13:36.371 }, 00:13:36.371 "peer_address": { 00:13:36.371 "trtype": "TCP", 00:13:36.371 "adrfam": "IPv4", 00:13:36.371 "traddr": "10.0.0.1", 00:13:36.371 "trsvcid": "51840" 00:13:36.371 }, 00:13:36.371 "auth": { 00:13:36.371 "state": "completed", 00:13:36.371 "digest": "sha384", 00:13:36.371 "dhgroup": "ffdhe2048" 00:13:36.371 } 00:13:36.371 } 00:13:36.371 ]' 00:13:36.371 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:36.371 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:36.371 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:36.371 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:13:36.371 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:36.631 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:36.631 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:36.631 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:36.889 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:13:36.889 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:13:37.457 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:37.457 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:37.457 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:37.457 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.457 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:37.713 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.713 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:13:37.713 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:37.713 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:13:37.713 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:13:37.971 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe3072 0 00:13:37.971 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:37.971 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:37.971 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:13:37.971 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:13:37.971 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:37.971 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:37.971 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.971 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:37.971 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.971 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:37.971 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:37.971 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:38.230 00:13:38.230 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:38.230 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:38.230 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:38.796 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:38.796 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:38.796 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.796 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:38.796 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.796 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:38.796 { 00:13:38.796 "cntlid": 65, 00:13:38.796 "qid": 0, 00:13:38.796 "state": "enabled", 00:13:38.796 "thread": "nvmf_tgt_poll_group_000", 00:13:38.796 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:38.796 "listen_address": { 00:13:38.796 "trtype": "TCP", 00:13:38.796 "adrfam": "IPv4", 00:13:38.796 "traddr": "10.0.0.3", 00:13:38.796 "trsvcid": "4420" 00:13:38.796 }, 00:13:38.796 "peer_address": { 00:13:38.796 "trtype": "TCP", 00:13:38.796 "adrfam": "IPv4", 00:13:38.796 "traddr": "10.0.0.1", 00:13:38.796 "trsvcid": "51866" 00:13:38.796 }, 00:13:38.796 "auth": { 00:13:38.796 "state": "completed", 00:13:38.796 "digest": "sha384", 00:13:38.796 "dhgroup": "ffdhe3072" 00:13:38.796 } 00:13:38.796 } 00:13:38.796 ]' 00:13:38.796 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:38.796 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:38.796 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:38.796 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:13:38.796 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:38.796 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:38.796 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:38.796 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:39.055 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:13:39.055 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:13:39.987 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:39.987 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:39.987 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:39.987 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.987 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:39.987 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.987 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:39.987 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:13:39.987 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:13:40.245 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe3072 1 00:13:40.245 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:40.245 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:40.245 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:13:40.245 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:13:40.245 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:40.245 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:40.245 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.245 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:40.245 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.245 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:40.245 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:40.245 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:40.809 00:13:40.809 11:24:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:40.809 11:24:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:40.809 11:24:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:41.067 11:24:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:41.067 11:24:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:41.067 11:24:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.067 11:24:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:41.067 11:24:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.067 11:24:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:41.067 { 00:13:41.067 "cntlid": 67, 00:13:41.067 "qid": 0, 00:13:41.067 "state": "enabled", 00:13:41.067 "thread": "nvmf_tgt_poll_group_000", 00:13:41.067 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:41.067 "listen_address": { 00:13:41.067 "trtype": "TCP", 00:13:41.067 "adrfam": "IPv4", 00:13:41.067 "traddr": "10.0.0.3", 00:13:41.067 "trsvcid": "4420" 00:13:41.067 }, 00:13:41.067 "peer_address": { 00:13:41.067 "trtype": "TCP", 00:13:41.067 "adrfam": "IPv4", 00:13:41.067 "traddr": "10.0.0.1", 00:13:41.067 "trsvcid": "51898" 00:13:41.067 }, 00:13:41.067 "auth": { 00:13:41.067 "state": "completed", 00:13:41.067 "digest": "sha384", 00:13:41.067 "dhgroup": "ffdhe3072" 00:13:41.067 } 00:13:41.067 } 00:13:41.067 ]' 00:13:41.067 11:24:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:41.067 11:24:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:41.067 11:24:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:41.324 11:24:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:13:41.324 11:24:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:41.324 11:24:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:41.324 11:24:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:41.324 11:24:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:41.583 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:13:41.583 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:13:42.150 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:42.150 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:42.150 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:42.150 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.150 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:42.150 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.150 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:42.150 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:13:42.150 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:13:42.715 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe3072 2 00:13:42.715 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:42.716 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:42.716 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:13:42.716 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:13:42.716 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:42.716 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:42.716 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.716 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:42.716 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.716 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:42.716 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:42.716 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:42.974 00:13:42.974 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:42.974 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:42.974 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:43.232 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:43.232 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:43.232 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.232 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:43.232 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.232 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:43.232 { 00:13:43.232 "cntlid": 69, 00:13:43.232 "qid": 0, 00:13:43.232 "state": "enabled", 00:13:43.232 "thread": "nvmf_tgt_poll_group_000", 00:13:43.232 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:43.232 "listen_address": { 00:13:43.232 "trtype": "TCP", 00:13:43.232 "adrfam": "IPv4", 00:13:43.232 "traddr": "10.0.0.3", 00:13:43.232 "trsvcid": "4420" 00:13:43.232 }, 00:13:43.232 "peer_address": { 00:13:43.232 "trtype": "TCP", 00:13:43.232 "adrfam": "IPv4", 00:13:43.232 "traddr": "10.0.0.1", 00:13:43.232 "trsvcid": "51926" 00:13:43.232 }, 00:13:43.232 "auth": { 00:13:43.232 "state": "completed", 00:13:43.232 "digest": "sha384", 00:13:43.232 "dhgroup": "ffdhe3072" 00:13:43.232 } 00:13:43.232 } 00:13:43.232 ]' 00:13:43.232 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:43.232 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:43.232 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:43.232 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:13:43.232 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:43.489 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:43.489 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:43.489 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:43.747 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:13:43.747 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:13:44.681 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:44.681 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:44.681 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:44.681 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.681 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:44.681 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.681 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:44.681 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:13:44.681 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:13:44.939 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe3072 3 00:13:44.939 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:44.939 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:44.939 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:13:44.939 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:13:44.939 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:44.939 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:13:44.939 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.939 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:44.939 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.939 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:13:44.939 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:44.939 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:45.197 00:13:45.197 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:45.197 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:45.197 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:45.764 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:45.764 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:45.764 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.764 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:45.764 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.764 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:45.764 { 00:13:45.764 "cntlid": 71, 00:13:45.764 "qid": 0, 00:13:45.764 "state": "enabled", 00:13:45.764 "thread": "nvmf_tgt_poll_group_000", 00:13:45.764 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:45.764 "listen_address": { 00:13:45.764 "trtype": "TCP", 00:13:45.764 "adrfam": "IPv4", 00:13:45.764 "traddr": "10.0.0.3", 00:13:45.764 "trsvcid": "4420" 00:13:45.764 }, 00:13:45.764 "peer_address": { 00:13:45.764 "trtype": "TCP", 00:13:45.764 "adrfam": "IPv4", 00:13:45.764 "traddr": "10.0.0.1", 00:13:45.764 "trsvcid": "57052" 00:13:45.764 }, 00:13:45.764 "auth": { 00:13:45.764 "state": "completed", 00:13:45.764 "digest": "sha384", 00:13:45.764 "dhgroup": "ffdhe3072" 00:13:45.764 } 00:13:45.764 } 00:13:45.764 ]' 00:13:45.764 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:45.764 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:45.764 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:45.764 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:13:45.764 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:45.764 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:45.764 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:45.764 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:46.022 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:13:46.023 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:13:46.956 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:46.956 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:46.956 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:46.956 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.956 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:46.956 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.956 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:13:46.956 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:46.956 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:13:46.956 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:13:47.231 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe4096 0 00:13:47.231 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:47.231 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:47.231 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:13:47.231 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:13:47.231 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:47.231 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:47.231 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.231 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:47.231 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:47.231 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:47.231 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:47.231 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:47.825 00:13:47.825 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:47.825 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:47.825 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:48.082 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:48.082 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:48.082 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.082 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:48.082 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.082 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:48.082 { 00:13:48.082 "cntlid": 73, 00:13:48.082 "qid": 0, 00:13:48.082 "state": "enabled", 00:13:48.082 "thread": "nvmf_tgt_poll_group_000", 00:13:48.082 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:48.082 "listen_address": { 00:13:48.082 "trtype": "TCP", 00:13:48.082 "adrfam": "IPv4", 00:13:48.082 "traddr": "10.0.0.3", 00:13:48.082 "trsvcid": "4420" 00:13:48.082 }, 00:13:48.082 "peer_address": { 00:13:48.082 "trtype": "TCP", 00:13:48.082 "adrfam": "IPv4", 00:13:48.082 "traddr": "10.0.0.1", 00:13:48.082 "trsvcid": "57070" 00:13:48.082 }, 00:13:48.082 "auth": { 00:13:48.082 "state": "completed", 00:13:48.082 "digest": "sha384", 00:13:48.082 "dhgroup": "ffdhe4096" 00:13:48.082 } 00:13:48.082 } 00:13:48.082 ]' 00:13:48.082 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:48.082 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:48.083 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:48.083 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:13:48.083 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:48.340 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:48.340 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:48.340 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:48.599 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:13:48.599 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:13:49.164 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:49.164 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:49.164 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:49.164 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.164 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:49.164 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.164 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:49.164 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:13:49.164 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:13:49.729 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe4096 1 00:13:49.729 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:49.729 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:49.729 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:13:49.729 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:13:49.729 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:49.729 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:49.729 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.729 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:49.729 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.730 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:49.730 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:49.730 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:49.987 00:13:49.987 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:49.987 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:49.987 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:50.552 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:50.552 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:50.552 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.552 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:50.552 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.552 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:50.552 { 00:13:50.552 "cntlid": 75, 00:13:50.552 "qid": 0, 00:13:50.552 "state": "enabled", 00:13:50.552 "thread": "nvmf_tgt_poll_group_000", 00:13:50.552 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:50.552 "listen_address": { 00:13:50.553 "trtype": "TCP", 00:13:50.553 "adrfam": "IPv4", 00:13:50.553 "traddr": "10.0.0.3", 00:13:50.553 "trsvcid": "4420" 00:13:50.553 }, 00:13:50.553 "peer_address": { 00:13:50.553 "trtype": "TCP", 00:13:50.553 "adrfam": "IPv4", 00:13:50.553 "traddr": "10.0.0.1", 00:13:50.553 "trsvcid": "57096" 00:13:50.553 }, 00:13:50.553 "auth": { 00:13:50.553 "state": "completed", 00:13:50.553 "digest": "sha384", 00:13:50.553 "dhgroup": "ffdhe4096" 00:13:50.553 } 00:13:50.553 } 00:13:50.553 ]' 00:13:50.553 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:50.553 11:24:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:50.553 11:24:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:50.553 11:24:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:13:50.553 11:24:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:50.553 11:24:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:50.553 11:24:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:50.553 11:24:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:50.810 11:24:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:13:50.810 11:24:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:13:51.376 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:51.376 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:51.376 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:51.376 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:51.633 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:51.633 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:51.633 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:51.633 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:13:51.633 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:13:51.901 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe4096 2 00:13:51.901 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:51.901 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:51.901 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:13:51.901 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:13:51.901 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:51.901 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:51.901 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:51.901 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:51.901 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:51.901 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:51.901 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:51.901 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:52.159 00:13:52.159 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:52.159 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:52.159 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:52.418 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:52.418 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:52.418 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:52.418 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:52.418 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:52.418 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:52.418 { 00:13:52.418 "cntlid": 77, 00:13:52.418 "qid": 0, 00:13:52.418 "state": "enabled", 00:13:52.418 "thread": "nvmf_tgt_poll_group_000", 00:13:52.418 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:52.418 "listen_address": { 00:13:52.418 "trtype": "TCP", 00:13:52.418 "adrfam": "IPv4", 00:13:52.418 "traddr": "10.0.0.3", 00:13:52.418 "trsvcid": "4420" 00:13:52.418 }, 00:13:52.418 "peer_address": { 00:13:52.418 "trtype": "TCP", 00:13:52.418 "adrfam": "IPv4", 00:13:52.418 "traddr": "10.0.0.1", 00:13:52.418 "trsvcid": "57124" 00:13:52.418 }, 00:13:52.418 "auth": { 00:13:52.418 "state": "completed", 00:13:52.418 "digest": "sha384", 00:13:52.418 "dhgroup": "ffdhe4096" 00:13:52.418 } 00:13:52.418 } 00:13:52.418 ]' 00:13:52.418 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:52.677 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:52.677 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:52.677 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:13:52.677 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:52.677 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:52.677 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:52.677 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:52.935 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:13:52.935 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:13:53.870 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:53.870 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:53.870 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:53.871 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.871 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:53.871 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.871 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:53.871 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:13:53.871 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:13:54.128 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe4096 3 00:13:54.128 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:54.128 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:54.128 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:13:54.128 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:13:54.128 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:54.128 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:13:54.128 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:54.128 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:54.128 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:54.128 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:13:54.129 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:54.129 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:54.387 00:13:54.387 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:54.387 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:54.387 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:54.954 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:54.954 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:54.954 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:54.954 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:54.954 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:54.954 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:54.954 { 00:13:54.954 "cntlid": 79, 00:13:54.954 "qid": 0, 00:13:54.954 "state": "enabled", 00:13:54.954 "thread": "nvmf_tgt_poll_group_000", 00:13:54.954 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:54.954 "listen_address": { 00:13:54.954 "trtype": "TCP", 00:13:54.954 "adrfam": "IPv4", 00:13:54.954 "traddr": "10.0.0.3", 00:13:54.954 "trsvcid": "4420" 00:13:54.954 }, 00:13:54.954 "peer_address": { 00:13:54.954 "trtype": "TCP", 00:13:54.954 "adrfam": "IPv4", 00:13:54.954 "traddr": "10.0.0.1", 00:13:54.954 "trsvcid": "57150" 00:13:54.954 }, 00:13:54.954 "auth": { 00:13:54.954 "state": "completed", 00:13:54.954 "digest": "sha384", 00:13:54.954 "dhgroup": "ffdhe4096" 00:13:54.954 } 00:13:54.954 } 00:13:54.954 ]' 00:13:54.954 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:54.954 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:54.954 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:54.954 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:13:54.954 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:54.954 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:54.954 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:54.954 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:55.212 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:13:55.212 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:13:56.146 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:56.146 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:56.146 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:56.146 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.146 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:56.146 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.146 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:13:56.146 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:56.146 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:13:56.146 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:13:56.404 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe6144 0 00:13:56.404 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:56.404 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:56.404 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:13:56.404 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:13:56.404 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:56.404 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:56.404 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.404 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:56.404 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.404 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:56.405 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:56.405 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:56.970 00:13:56.971 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:56.971 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:56.971 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:57.228 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:57.228 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:57.228 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:57.228 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:57.228 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:57.228 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:57.228 { 00:13:57.228 "cntlid": 81, 00:13:57.228 "qid": 0, 00:13:57.228 "state": "enabled", 00:13:57.228 "thread": "nvmf_tgt_poll_group_000", 00:13:57.228 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:57.228 "listen_address": { 00:13:57.228 "trtype": "TCP", 00:13:57.228 "adrfam": "IPv4", 00:13:57.228 "traddr": "10.0.0.3", 00:13:57.228 "trsvcid": "4420" 00:13:57.228 }, 00:13:57.228 "peer_address": { 00:13:57.228 "trtype": "TCP", 00:13:57.228 "adrfam": "IPv4", 00:13:57.228 "traddr": "10.0.0.1", 00:13:57.228 "trsvcid": "46348" 00:13:57.228 }, 00:13:57.228 "auth": { 00:13:57.228 "state": "completed", 00:13:57.228 "digest": "sha384", 00:13:57.228 "dhgroup": "ffdhe6144" 00:13:57.228 } 00:13:57.228 } 00:13:57.228 ]' 00:13:57.228 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:57.228 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:57.228 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:57.228 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:13:57.228 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:57.228 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:57.228 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:57.228 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:57.795 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:13:57.795 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:13:58.362 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:58.362 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:58.362 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:13:58.362 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.362 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:58.362 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.362 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:58.362 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:13:58.362 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:13:58.621 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe6144 1 00:13:58.621 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:58.621 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:58.621 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:13:58.621 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:13:58.621 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:58.621 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:58.621 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.621 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:58.621 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.621 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:58.621 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:58.621 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:59.186 00:13:59.186 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:59.187 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:59.187 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:59.445 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:59.445 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:59.445 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.445 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:59.445 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:59.445 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:59.445 { 00:13:59.445 "cntlid": 83, 00:13:59.445 "qid": 0, 00:13:59.445 "state": "enabled", 00:13:59.445 "thread": "nvmf_tgt_poll_group_000", 00:13:59.445 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:13:59.445 "listen_address": { 00:13:59.445 "trtype": "TCP", 00:13:59.445 "adrfam": "IPv4", 00:13:59.445 "traddr": "10.0.0.3", 00:13:59.445 "trsvcid": "4420" 00:13:59.445 }, 00:13:59.445 "peer_address": { 00:13:59.445 "trtype": "TCP", 00:13:59.445 "adrfam": "IPv4", 00:13:59.445 "traddr": "10.0.0.1", 00:13:59.445 "trsvcid": "46364" 00:13:59.445 }, 00:13:59.445 "auth": { 00:13:59.445 "state": "completed", 00:13:59.445 "digest": "sha384", 00:13:59.445 "dhgroup": "ffdhe6144" 00:13:59.445 } 00:13:59.445 } 00:13:59.445 ]' 00:13:59.445 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:59.445 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:59.445 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:59.702 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:13:59.702 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:59.702 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:59.702 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:59.702 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:59.960 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:13:59.960 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:14:00.894 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:00.894 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:00.894 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:00.894 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:00.894 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:00.894 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:00.894 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:00.894 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:14:00.894 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:14:01.154 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe6144 2 00:14:01.154 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:01.154 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:14:01.154 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:14:01.154 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:14:01.154 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:01.154 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:01.154 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:01.154 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:01.154 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:01.154 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:01.154 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:01.154 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:01.719 00:14:01.719 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:01.719 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:01.719 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:01.978 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:01.978 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:01.978 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:01.978 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:01.978 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:01.978 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:01.978 { 00:14:01.978 "cntlid": 85, 00:14:01.978 "qid": 0, 00:14:01.978 "state": "enabled", 00:14:01.978 "thread": "nvmf_tgt_poll_group_000", 00:14:01.978 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:01.978 "listen_address": { 00:14:01.978 "trtype": "TCP", 00:14:01.978 "adrfam": "IPv4", 00:14:01.978 "traddr": "10.0.0.3", 00:14:01.978 "trsvcid": "4420" 00:14:01.978 }, 00:14:01.978 "peer_address": { 00:14:01.978 "trtype": "TCP", 00:14:01.978 "adrfam": "IPv4", 00:14:01.978 "traddr": "10.0.0.1", 00:14:01.978 "trsvcid": "46384" 00:14:01.978 }, 00:14:01.978 "auth": { 00:14:01.978 "state": "completed", 00:14:01.978 "digest": "sha384", 00:14:01.978 "dhgroup": "ffdhe6144" 00:14:01.978 } 00:14:01.978 } 00:14:01.978 ]' 00:14:01.978 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:01.978 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:14:01.978 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:01.978 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:14:01.978 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:01.978 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:01.978 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:01.978 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:02.546 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:14:02.546 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:14:03.112 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:03.112 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:03.112 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:03.112 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:03.112 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:03.112 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:03.112 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:03.112 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:14:03.112 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:14:03.371 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe6144 3 00:14:03.371 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:03.371 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:14:03.371 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:14:03.371 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:14:03.371 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:03.371 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:14:03.371 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:03.371 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:03.629 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:03.629 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:14:03.629 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:03.629 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:03.887 00:14:04.145 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:04.145 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:04.145 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:04.403 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:04.403 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:04.403 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.403 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:04.403 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.403 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:04.403 { 00:14:04.403 "cntlid": 87, 00:14:04.403 "qid": 0, 00:14:04.403 "state": "enabled", 00:14:04.403 "thread": "nvmf_tgt_poll_group_000", 00:14:04.403 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:04.403 "listen_address": { 00:14:04.403 "trtype": "TCP", 00:14:04.403 "adrfam": "IPv4", 00:14:04.403 "traddr": "10.0.0.3", 00:14:04.403 "trsvcid": "4420" 00:14:04.403 }, 00:14:04.403 "peer_address": { 00:14:04.403 "trtype": "TCP", 00:14:04.403 "adrfam": "IPv4", 00:14:04.403 "traddr": "10.0.0.1", 00:14:04.403 "trsvcid": "46422" 00:14:04.403 }, 00:14:04.403 "auth": { 00:14:04.403 "state": "completed", 00:14:04.403 "digest": "sha384", 00:14:04.403 "dhgroup": "ffdhe6144" 00:14:04.403 } 00:14:04.403 } 00:14:04.403 ]' 00:14:04.403 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:04.403 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:14:04.403 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:04.403 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:14:04.403 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:04.403 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:04.403 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:04.403 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:04.967 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:14:04.967 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:14:05.533 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:05.533 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:05.533 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:05.533 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:05.533 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:05.533 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:05.533 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:14:05.533 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:05.533 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:14:05.533 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:14:06.099 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe8192 0 00:14:06.099 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:06.099 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:14:06.099 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:14:06.099 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:14:06.099 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:06.099 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:06.099 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:06.099 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:06.099 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:06.099 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:06.099 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:06.099 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:06.665 00:14:06.665 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:06.665 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:06.665 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:06.924 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:06.924 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:06.924 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:06.924 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:06.924 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:06.924 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:06.924 { 00:14:06.924 "cntlid": 89, 00:14:06.924 "qid": 0, 00:14:06.924 "state": "enabled", 00:14:06.924 "thread": "nvmf_tgt_poll_group_000", 00:14:06.924 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:06.924 "listen_address": { 00:14:06.924 "trtype": "TCP", 00:14:06.924 "adrfam": "IPv4", 00:14:06.924 "traddr": "10.0.0.3", 00:14:06.924 "trsvcid": "4420" 00:14:06.924 }, 00:14:06.924 "peer_address": { 00:14:06.924 "trtype": "TCP", 00:14:06.924 "adrfam": "IPv4", 00:14:06.924 "traddr": "10.0.0.1", 00:14:06.924 "trsvcid": "58402" 00:14:06.924 }, 00:14:06.924 "auth": { 00:14:06.924 "state": "completed", 00:14:06.924 "digest": "sha384", 00:14:06.924 "dhgroup": "ffdhe8192" 00:14:06.924 } 00:14:06.924 } 00:14:06.924 ]' 00:14:06.924 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:07.182 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:14:07.183 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:07.183 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:14:07.183 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:07.183 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:07.183 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:07.183 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:07.441 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:14:07.441 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:14:08.375 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:08.375 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:08.375 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:08.375 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:08.375 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:08.375 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:08.375 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:08.375 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:14:08.375 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:14:08.375 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe8192 1 00:14:08.375 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:08.375 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:14:08.375 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:14:08.375 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:14:08.375 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:08.375 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:08.375 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:08.375 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:08.375 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:08.375 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:08.375 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:08.375 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:09.309 00:14:09.309 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:09.309 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:09.309 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:09.567 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:09.567 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:09.567 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:09.567 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:09.567 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:09.567 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:09.567 { 00:14:09.567 "cntlid": 91, 00:14:09.567 "qid": 0, 00:14:09.567 "state": "enabled", 00:14:09.567 "thread": "nvmf_tgt_poll_group_000", 00:14:09.567 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:09.567 "listen_address": { 00:14:09.567 "trtype": "TCP", 00:14:09.567 "adrfam": "IPv4", 00:14:09.567 "traddr": "10.0.0.3", 00:14:09.567 "trsvcid": "4420" 00:14:09.567 }, 00:14:09.567 "peer_address": { 00:14:09.567 "trtype": "TCP", 00:14:09.567 "adrfam": "IPv4", 00:14:09.567 "traddr": "10.0.0.1", 00:14:09.567 "trsvcid": "58424" 00:14:09.567 }, 00:14:09.567 "auth": { 00:14:09.567 "state": "completed", 00:14:09.567 "digest": "sha384", 00:14:09.567 "dhgroup": "ffdhe8192" 00:14:09.567 } 00:14:09.567 } 00:14:09.567 ]' 00:14:09.567 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:09.567 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:14:09.567 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:09.567 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:14:09.567 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:09.824 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:09.824 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:09.825 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:10.084 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:14:10.084 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:14:10.655 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:10.655 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:10.655 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:10.655 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:10.655 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:10.655 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:10.655 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:10.655 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:14:10.655 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:14:11.221 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe8192 2 00:14:11.221 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:11.221 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:14:11.221 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:14:11.221 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:14:11.221 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:11.221 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:11.221 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.221 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:11.221 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.221 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:11.221 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:11.221 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:11.788 00:14:11.788 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:11.788 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:11.788 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:12.046 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:12.046 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:12.046 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:12.046 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:12.304 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:12.304 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:12.304 { 00:14:12.304 "cntlid": 93, 00:14:12.304 "qid": 0, 00:14:12.304 "state": "enabled", 00:14:12.304 "thread": "nvmf_tgt_poll_group_000", 00:14:12.304 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:12.304 "listen_address": { 00:14:12.304 "trtype": "TCP", 00:14:12.304 "adrfam": "IPv4", 00:14:12.304 "traddr": "10.0.0.3", 00:14:12.304 "trsvcid": "4420" 00:14:12.304 }, 00:14:12.304 "peer_address": { 00:14:12.304 "trtype": "TCP", 00:14:12.304 "adrfam": "IPv4", 00:14:12.304 "traddr": "10.0.0.1", 00:14:12.304 "trsvcid": "58464" 00:14:12.304 }, 00:14:12.304 "auth": { 00:14:12.304 "state": "completed", 00:14:12.304 "digest": "sha384", 00:14:12.304 "dhgroup": "ffdhe8192" 00:14:12.304 } 00:14:12.304 } 00:14:12.304 ]' 00:14:12.304 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:12.304 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:14:12.304 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:12.304 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:14:12.304 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:12.304 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:12.304 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:12.304 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:12.562 11:24:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:14:12.562 11:24:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:14:13.494 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:13.494 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:13.494 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:13.494 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:13.494 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:13.494 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:13.494 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:13.494 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:14:13.494 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:14:13.751 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe8192 3 00:14:13.751 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:13.751 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:14:13.751 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:14:13.751 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:14:13.751 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:13.751 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:14:13.752 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:13.752 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:13.752 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:13.752 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:14:13.752 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:13.752 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:14.317 00:14:14.574 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:14.574 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:14.574 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:14.832 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:14.832 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:14.832 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:14.832 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:14.832 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:14.832 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:14.832 { 00:14:14.832 "cntlid": 95, 00:14:14.832 "qid": 0, 00:14:14.832 "state": "enabled", 00:14:14.832 "thread": "nvmf_tgt_poll_group_000", 00:14:14.832 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:14.833 "listen_address": { 00:14:14.833 "trtype": "TCP", 00:14:14.833 "adrfam": "IPv4", 00:14:14.833 "traddr": "10.0.0.3", 00:14:14.833 "trsvcid": "4420" 00:14:14.833 }, 00:14:14.833 "peer_address": { 00:14:14.833 "trtype": "TCP", 00:14:14.833 "adrfam": "IPv4", 00:14:14.833 "traddr": "10.0.0.1", 00:14:14.833 "trsvcid": "58504" 00:14:14.833 }, 00:14:14.833 "auth": { 00:14:14.833 "state": "completed", 00:14:14.833 "digest": "sha384", 00:14:14.833 "dhgroup": "ffdhe8192" 00:14:14.833 } 00:14:14.833 } 00:14:14.833 ]' 00:14:14.833 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:14.833 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:14:14.833 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:14.833 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:14:14.833 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:14.833 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:14.833 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:14.833 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:15.403 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:14:15.403 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:14:16.336 11:24:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:16.336 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:16.336 11:24:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:16.336 11:24:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:16.336 11:24:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:16.336 11:24:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:16.336 11:24:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@118 -- # for digest in "${digests[@]}" 00:14:16.336 11:24:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:14:16.336 11:24:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:16.336 11:24:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:14:16.336 11:24:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:14:16.336 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 null 0 00:14:16.594 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:16.594 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:16.594 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:14:16.594 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:14:16.594 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:16.594 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:16.594 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:16.594 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:16.594 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:16.594 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:16.594 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:16.594 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:16.856 00:14:16.856 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:16.856 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:16.857 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:17.119 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:17.119 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:17.119 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.119 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:17.119 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.119 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:17.119 { 00:14:17.119 "cntlid": 97, 00:14:17.119 "qid": 0, 00:14:17.119 "state": "enabled", 00:14:17.119 "thread": "nvmf_tgt_poll_group_000", 00:14:17.119 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:17.119 "listen_address": { 00:14:17.119 "trtype": "TCP", 00:14:17.119 "adrfam": "IPv4", 00:14:17.119 "traddr": "10.0.0.3", 00:14:17.119 "trsvcid": "4420" 00:14:17.119 }, 00:14:17.119 "peer_address": { 00:14:17.119 "trtype": "TCP", 00:14:17.119 "adrfam": "IPv4", 00:14:17.119 "traddr": "10.0.0.1", 00:14:17.119 "trsvcid": "35272" 00:14:17.119 }, 00:14:17.119 "auth": { 00:14:17.119 "state": "completed", 00:14:17.119 "digest": "sha512", 00:14:17.119 "dhgroup": "null" 00:14:17.119 } 00:14:17.119 } 00:14:17.119 ]' 00:14:17.119 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:17.119 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:17.119 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:17.376 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:14:17.376 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:17.376 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:17.377 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:17.377 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:17.634 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:14:17.634 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:14:18.566 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:18.566 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:18.566 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:18.566 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:18.566 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:18.566 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:18.566 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:18.566 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:14:18.566 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:14:18.824 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 null 1 00:14:18.824 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:18.824 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:18.824 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:14:18.824 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:14:18.824 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:18.824 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:18.824 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:18.824 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:18.824 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:18.824 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:18.824 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:18.824 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:19.082 00:14:19.082 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:19.082 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:19.082 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:19.647 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:19.647 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:19.647 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:19.647 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:19.647 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:19.647 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:19.647 { 00:14:19.647 "cntlid": 99, 00:14:19.647 "qid": 0, 00:14:19.647 "state": "enabled", 00:14:19.647 "thread": "nvmf_tgt_poll_group_000", 00:14:19.647 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:19.647 "listen_address": { 00:14:19.647 "trtype": "TCP", 00:14:19.647 "adrfam": "IPv4", 00:14:19.647 "traddr": "10.0.0.3", 00:14:19.647 "trsvcid": "4420" 00:14:19.647 }, 00:14:19.647 "peer_address": { 00:14:19.647 "trtype": "TCP", 00:14:19.647 "adrfam": "IPv4", 00:14:19.647 "traddr": "10.0.0.1", 00:14:19.647 "trsvcid": "35292" 00:14:19.647 }, 00:14:19.647 "auth": { 00:14:19.647 "state": "completed", 00:14:19.647 "digest": "sha512", 00:14:19.647 "dhgroup": "null" 00:14:19.647 } 00:14:19.647 } 00:14:19.647 ]' 00:14:19.647 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:19.647 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:19.647 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:19.647 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:14:19.647 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:19.647 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:19.647 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:19.647 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:19.905 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:14:19.905 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:14:20.840 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:20.840 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:20.840 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:20.840 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:20.840 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:20.840 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:20.840 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:20.840 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:14:20.840 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:14:21.099 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 null 2 00:14:21.099 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:21.099 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:21.099 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:14:21.099 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:14:21.099 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:21.099 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:21.099 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.099 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:21.099 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.099 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:21.099 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:21.099 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:21.357 00:14:21.357 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:21.357 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:21.357 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:21.614 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:21.614 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:21.614 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.614 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:21.614 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.614 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:21.614 { 00:14:21.614 "cntlid": 101, 00:14:21.614 "qid": 0, 00:14:21.614 "state": "enabled", 00:14:21.614 "thread": "nvmf_tgt_poll_group_000", 00:14:21.614 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:21.614 "listen_address": { 00:14:21.614 "trtype": "TCP", 00:14:21.614 "adrfam": "IPv4", 00:14:21.614 "traddr": "10.0.0.3", 00:14:21.614 "trsvcid": "4420" 00:14:21.614 }, 00:14:21.614 "peer_address": { 00:14:21.614 "trtype": "TCP", 00:14:21.614 "adrfam": "IPv4", 00:14:21.614 "traddr": "10.0.0.1", 00:14:21.614 "trsvcid": "35316" 00:14:21.614 }, 00:14:21.614 "auth": { 00:14:21.614 "state": "completed", 00:14:21.614 "digest": "sha512", 00:14:21.614 "dhgroup": "null" 00:14:21.614 } 00:14:21.614 } 00:14:21.614 ]' 00:14:21.614 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:21.614 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:21.614 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:21.873 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:14:21.873 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:21.873 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:21.873 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:21.873 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:22.131 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:14:22.131 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:14:22.698 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:22.698 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:22.698 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:22.698 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.698 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:22.698 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.698 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:22.698 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:14:22.698 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:14:23.264 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 null 3 00:14:23.264 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:23.264 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:23.264 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:14:23.264 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:14:23.264 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:23.264 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:14:23.264 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.264 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:23.264 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.264 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:14:23.264 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:23.264 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:23.522 00:14:23.522 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:23.522 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:23.522 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:23.779 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:23.779 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:23.779 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.779 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:23.779 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.780 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:23.780 { 00:14:23.780 "cntlid": 103, 00:14:23.780 "qid": 0, 00:14:23.780 "state": "enabled", 00:14:23.780 "thread": "nvmf_tgt_poll_group_000", 00:14:23.780 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:23.780 "listen_address": { 00:14:23.780 "trtype": "TCP", 00:14:23.780 "adrfam": "IPv4", 00:14:23.780 "traddr": "10.0.0.3", 00:14:23.780 "trsvcid": "4420" 00:14:23.780 }, 00:14:23.780 "peer_address": { 00:14:23.780 "trtype": "TCP", 00:14:23.780 "adrfam": "IPv4", 00:14:23.780 "traddr": "10.0.0.1", 00:14:23.780 "trsvcid": "35338" 00:14:23.780 }, 00:14:23.780 "auth": { 00:14:23.780 "state": "completed", 00:14:23.780 "digest": "sha512", 00:14:23.780 "dhgroup": "null" 00:14:23.780 } 00:14:23.780 } 00:14:23.780 ]' 00:14:23.780 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:23.780 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:23.780 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:23.780 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:14:23.780 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:24.038 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:24.038 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:24.038 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:24.295 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:14:24.295 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:14:24.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:24.863 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:24.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:24.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:24.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:24.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:24.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:14:24.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:24.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:14:24.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:14:25.429 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe2048 0 00:14:25.429 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:25.429 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:25.429 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:14:25.429 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:14:25.429 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:25.429 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:25.429 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:25.429 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:25.429 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:25.429 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:25.429 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:25.429 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:25.687 00:14:25.687 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:25.687 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:25.687 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:25.946 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:25.946 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:25.946 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:25.946 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:25.946 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:25.946 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:25.946 { 00:14:25.946 "cntlid": 105, 00:14:25.946 "qid": 0, 00:14:25.946 "state": "enabled", 00:14:25.946 "thread": "nvmf_tgt_poll_group_000", 00:14:25.946 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:25.946 "listen_address": { 00:14:25.946 "trtype": "TCP", 00:14:25.946 "adrfam": "IPv4", 00:14:25.946 "traddr": "10.0.0.3", 00:14:25.946 "trsvcid": "4420" 00:14:25.946 }, 00:14:25.946 "peer_address": { 00:14:25.946 "trtype": "TCP", 00:14:25.946 "adrfam": "IPv4", 00:14:25.946 "traddr": "10.0.0.1", 00:14:25.946 "trsvcid": "35618" 00:14:25.946 }, 00:14:25.946 "auth": { 00:14:25.946 "state": "completed", 00:14:25.946 "digest": "sha512", 00:14:25.946 "dhgroup": "ffdhe2048" 00:14:25.946 } 00:14:25.946 } 00:14:25.946 ]' 00:14:25.946 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:25.946 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:25.946 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:26.204 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:14:26.204 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:26.204 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:26.204 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:26.204 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:26.462 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:14:26.462 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:14:27.029 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:27.029 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:27.029 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:27.029 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:27.029 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:27.029 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:27.029 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:27.029 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:14:27.029 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:14:27.596 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe2048 1 00:14:27.596 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:27.596 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:27.596 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:14:27.596 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:14:27.596 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:27.596 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:27.597 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:27.597 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:27.597 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:27.597 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:27.597 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:27.597 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:27.855 00:14:27.855 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:27.855 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:27.855 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:28.113 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:28.113 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:28.113 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:28.113 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:28.113 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:28.113 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:28.113 { 00:14:28.113 "cntlid": 107, 00:14:28.113 "qid": 0, 00:14:28.113 "state": "enabled", 00:14:28.113 "thread": "nvmf_tgt_poll_group_000", 00:14:28.113 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:28.113 "listen_address": { 00:14:28.113 "trtype": "TCP", 00:14:28.113 "adrfam": "IPv4", 00:14:28.113 "traddr": "10.0.0.3", 00:14:28.113 "trsvcid": "4420" 00:14:28.113 }, 00:14:28.113 "peer_address": { 00:14:28.113 "trtype": "TCP", 00:14:28.113 "adrfam": "IPv4", 00:14:28.113 "traddr": "10.0.0.1", 00:14:28.113 "trsvcid": "35646" 00:14:28.113 }, 00:14:28.113 "auth": { 00:14:28.113 "state": "completed", 00:14:28.113 "digest": "sha512", 00:14:28.113 "dhgroup": "ffdhe2048" 00:14:28.113 } 00:14:28.113 } 00:14:28.113 ]' 00:14:28.113 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:28.113 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:28.113 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:28.371 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:14:28.371 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:28.371 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:28.371 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:28.371 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:28.628 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:14:28.629 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:14:29.562 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:29.562 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:29.562 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:29.562 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:29.562 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:29.562 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:29.562 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:29.562 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:14:29.562 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:14:29.874 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe2048 2 00:14:29.874 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:29.874 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:29.874 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:14:29.874 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:14:29.874 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:29.874 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:29.874 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:29.874 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:29.874 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:29.874 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:29.874 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:29.874 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:30.143 00:14:30.143 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:30.143 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:30.143 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:30.400 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:30.400 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:30.400 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:30.400 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:30.400 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:30.400 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:30.400 { 00:14:30.400 "cntlid": 109, 00:14:30.400 "qid": 0, 00:14:30.400 "state": "enabled", 00:14:30.400 "thread": "nvmf_tgt_poll_group_000", 00:14:30.400 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:30.400 "listen_address": { 00:14:30.400 "trtype": "TCP", 00:14:30.400 "adrfam": "IPv4", 00:14:30.400 "traddr": "10.0.0.3", 00:14:30.400 "trsvcid": "4420" 00:14:30.400 }, 00:14:30.400 "peer_address": { 00:14:30.400 "trtype": "TCP", 00:14:30.400 "adrfam": "IPv4", 00:14:30.400 "traddr": "10.0.0.1", 00:14:30.400 "trsvcid": "35672" 00:14:30.400 }, 00:14:30.400 "auth": { 00:14:30.400 "state": "completed", 00:14:30.400 "digest": "sha512", 00:14:30.400 "dhgroup": "ffdhe2048" 00:14:30.400 } 00:14:30.400 } 00:14:30.400 ]' 00:14:30.401 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:30.659 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:30.659 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:30.659 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:14:30.659 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:30.659 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:30.659 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:30.659 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:30.917 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:14:30.917 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:14:31.851 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:31.851 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:31.851 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:31.851 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:31.851 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:31.851 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:31.851 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:31.851 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:14:31.851 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:14:32.109 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe2048 3 00:14:32.109 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:32.110 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:32.110 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:14:32.110 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:14:32.110 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:32.110 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:14:32.110 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:32.110 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:32.110 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:32.110 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:14:32.110 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:32.110 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:32.368 00:14:32.368 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:32.368 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:32.368 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:32.627 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:32.627 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:32.627 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:32.627 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:32.886 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:32.886 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:32.886 { 00:14:32.886 "cntlid": 111, 00:14:32.886 "qid": 0, 00:14:32.886 "state": "enabled", 00:14:32.886 "thread": "nvmf_tgt_poll_group_000", 00:14:32.886 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:32.886 "listen_address": { 00:14:32.886 "trtype": "TCP", 00:14:32.886 "adrfam": "IPv4", 00:14:32.886 "traddr": "10.0.0.3", 00:14:32.886 "trsvcid": "4420" 00:14:32.886 }, 00:14:32.886 "peer_address": { 00:14:32.886 "trtype": "TCP", 00:14:32.886 "adrfam": "IPv4", 00:14:32.886 "traddr": "10.0.0.1", 00:14:32.886 "trsvcid": "35688" 00:14:32.886 }, 00:14:32.886 "auth": { 00:14:32.886 "state": "completed", 00:14:32.886 "digest": "sha512", 00:14:32.886 "dhgroup": "ffdhe2048" 00:14:32.886 } 00:14:32.886 } 00:14:32.886 ]' 00:14:32.886 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:32.886 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:32.886 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:32.886 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:14:32.886 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:32.886 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:32.886 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:32.886 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:33.144 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:14:33.144 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:14:34.078 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:34.078 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:34.078 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:34.078 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:34.078 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:34.078 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:34.078 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:14:34.078 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:34.078 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:14:34.078 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:14:34.336 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe3072 0 00:14:34.336 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:34.336 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:34.336 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:14:34.336 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:14:34.336 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:34.336 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:34.336 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:34.336 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:34.336 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:34.336 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:34.336 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:34.336 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:34.594 00:14:34.594 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:34.594 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:34.594 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:35.162 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:35.162 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:35.162 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:35.162 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:35.162 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:35.162 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:35.162 { 00:14:35.162 "cntlid": 113, 00:14:35.162 "qid": 0, 00:14:35.162 "state": "enabled", 00:14:35.162 "thread": "nvmf_tgt_poll_group_000", 00:14:35.162 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:35.162 "listen_address": { 00:14:35.162 "trtype": "TCP", 00:14:35.162 "adrfam": "IPv4", 00:14:35.162 "traddr": "10.0.0.3", 00:14:35.162 "trsvcid": "4420" 00:14:35.162 }, 00:14:35.162 "peer_address": { 00:14:35.162 "trtype": "TCP", 00:14:35.162 "adrfam": "IPv4", 00:14:35.162 "traddr": "10.0.0.1", 00:14:35.162 "trsvcid": "35710" 00:14:35.162 }, 00:14:35.162 "auth": { 00:14:35.162 "state": "completed", 00:14:35.162 "digest": "sha512", 00:14:35.162 "dhgroup": "ffdhe3072" 00:14:35.162 } 00:14:35.162 } 00:14:35.162 ]' 00:14:35.162 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:35.162 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:35.162 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:35.162 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:14:35.162 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:35.162 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:35.162 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:35.162 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:35.420 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:14:35.420 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:14:36.352 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:36.352 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:36.352 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:36.352 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.352 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:36.352 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.352 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:36.352 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:14:36.352 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:14:36.609 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe3072 1 00:14:36.609 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:36.609 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:36.609 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:14:36.609 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:14:36.609 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:36.609 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:36.609 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.609 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:36.609 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.609 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:36.609 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:36.609 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:37.175 00:14:37.175 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:37.175 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:37.175 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:37.175 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:37.175 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:37.175 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:37.175 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:37.433 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:37.433 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:37.433 { 00:14:37.433 "cntlid": 115, 00:14:37.433 "qid": 0, 00:14:37.433 "state": "enabled", 00:14:37.433 "thread": "nvmf_tgt_poll_group_000", 00:14:37.433 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:37.433 "listen_address": { 00:14:37.433 "trtype": "TCP", 00:14:37.433 "adrfam": "IPv4", 00:14:37.433 "traddr": "10.0.0.3", 00:14:37.433 "trsvcid": "4420" 00:14:37.433 }, 00:14:37.433 "peer_address": { 00:14:37.433 "trtype": "TCP", 00:14:37.433 "adrfam": "IPv4", 00:14:37.433 "traddr": "10.0.0.1", 00:14:37.433 "trsvcid": "60752" 00:14:37.433 }, 00:14:37.433 "auth": { 00:14:37.433 "state": "completed", 00:14:37.433 "digest": "sha512", 00:14:37.433 "dhgroup": "ffdhe3072" 00:14:37.433 } 00:14:37.433 } 00:14:37.433 ]' 00:14:37.433 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:37.433 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:37.433 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:37.433 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:14:37.433 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:37.433 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:37.433 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:37.433 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:37.691 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:14:37.691 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:14:38.645 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:38.645 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:38.645 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:38.645 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:38.645 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:38.645 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:38.645 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:38.645 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:14:38.645 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:14:38.903 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe3072 2 00:14:38.903 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:38.903 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:38.903 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:14:38.903 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:14:38.903 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:38.903 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:38.903 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:38.903 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:38.903 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:38.903 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:38.903 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:38.903 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:39.470 00:14:39.470 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:39.470 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:39.470 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:39.728 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:39.728 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:39.728 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.728 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:39.728 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.728 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:39.728 { 00:14:39.728 "cntlid": 117, 00:14:39.728 "qid": 0, 00:14:39.728 "state": "enabled", 00:14:39.728 "thread": "nvmf_tgt_poll_group_000", 00:14:39.728 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:39.728 "listen_address": { 00:14:39.728 "trtype": "TCP", 00:14:39.728 "adrfam": "IPv4", 00:14:39.728 "traddr": "10.0.0.3", 00:14:39.728 "trsvcid": "4420" 00:14:39.728 }, 00:14:39.728 "peer_address": { 00:14:39.728 "trtype": "TCP", 00:14:39.728 "adrfam": "IPv4", 00:14:39.728 "traddr": "10.0.0.1", 00:14:39.728 "trsvcid": "60768" 00:14:39.728 }, 00:14:39.728 "auth": { 00:14:39.728 "state": "completed", 00:14:39.728 "digest": "sha512", 00:14:39.728 "dhgroup": "ffdhe3072" 00:14:39.728 } 00:14:39.728 } 00:14:39.728 ]' 00:14:39.728 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:39.728 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:39.728 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:39.728 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:14:39.728 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:39.728 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:39.728 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:39.728 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:40.292 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:14:40.292 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:14:40.859 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:40.859 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:40.859 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:40.859 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.859 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:40.859 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.859 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:40.859 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:14:40.859 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:14:41.117 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe3072 3 00:14:41.117 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:41.117 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:41.117 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:14:41.117 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:14:41.117 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:41.117 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:14:41.117 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:41.117 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:41.117 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:41.117 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:14:41.117 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:41.117 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:41.719 00:14:41.719 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:41.719 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:41.719 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:41.994 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:41.994 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:41.994 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:41.994 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:41.994 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:41.994 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:41.994 { 00:14:41.994 "cntlid": 119, 00:14:41.994 "qid": 0, 00:14:41.994 "state": "enabled", 00:14:41.994 "thread": "nvmf_tgt_poll_group_000", 00:14:41.994 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:41.994 "listen_address": { 00:14:41.994 "trtype": "TCP", 00:14:41.994 "adrfam": "IPv4", 00:14:41.994 "traddr": "10.0.0.3", 00:14:41.994 "trsvcid": "4420" 00:14:41.994 }, 00:14:41.994 "peer_address": { 00:14:41.994 "trtype": "TCP", 00:14:41.994 "adrfam": "IPv4", 00:14:41.994 "traddr": "10.0.0.1", 00:14:41.994 "trsvcid": "60784" 00:14:41.994 }, 00:14:41.994 "auth": { 00:14:41.994 "state": "completed", 00:14:41.994 "digest": "sha512", 00:14:41.994 "dhgroup": "ffdhe3072" 00:14:41.994 } 00:14:41.994 } 00:14:41.994 ]' 00:14:41.994 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:41.994 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:41.994 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:42.256 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:14:42.256 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:42.256 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:42.256 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:42.256 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:42.513 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:14:42.513 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:14:43.079 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:43.079 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:43.079 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:43.079 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:43.079 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:43.079 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:43.079 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:14:43.079 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:43.079 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:14:43.079 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:14:43.338 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe4096 0 00:14:43.338 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:43.338 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:43.338 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:14:43.338 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:14:43.338 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:43.338 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:43.338 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:43.338 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:43.338 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:43.338 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:43.338 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:43.338 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:43.904 00:14:43.904 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:43.904 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:43.904 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:44.162 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:44.162 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:44.162 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.162 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:44.162 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.162 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:44.162 { 00:14:44.162 "cntlid": 121, 00:14:44.162 "qid": 0, 00:14:44.162 "state": "enabled", 00:14:44.162 "thread": "nvmf_tgt_poll_group_000", 00:14:44.162 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:44.162 "listen_address": { 00:14:44.162 "trtype": "TCP", 00:14:44.162 "adrfam": "IPv4", 00:14:44.162 "traddr": "10.0.0.3", 00:14:44.162 "trsvcid": "4420" 00:14:44.162 }, 00:14:44.162 "peer_address": { 00:14:44.162 "trtype": "TCP", 00:14:44.162 "adrfam": "IPv4", 00:14:44.162 "traddr": "10.0.0.1", 00:14:44.162 "trsvcid": "60818" 00:14:44.162 }, 00:14:44.162 "auth": { 00:14:44.162 "state": "completed", 00:14:44.162 "digest": "sha512", 00:14:44.162 "dhgroup": "ffdhe4096" 00:14:44.162 } 00:14:44.162 } 00:14:44.162 ]' 00:14:44.162 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:44.162 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:44.162 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:44.162 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:14:44.162 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:44.420 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:44.420 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:44.420 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:44.677 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:14:44.677 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:14:45.243 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:45.243 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:45.243 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:45.243 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.243 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:45.501 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.501 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:45.501 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:14:45.501 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:14:45.760 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe4096 1 00:14:45.760 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:45.760 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:45.760 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:14:45.760 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:14:45.760 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:45.760 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:45.760 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.760 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:45.760 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.760 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:45.760 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:45.760 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:46.018 00:14:46.018 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:46.018 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:46.018 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:46.276 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:46.276 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:46.276 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.276 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:46.276 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.276 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:46.276 { 00:14:46.276 "cntlid": 123, 00:14:46.276 "qid": 0, 00:14:46.276 "state": "enabled", 00:14:46.276 "thread": "nvmf_tgt_poll_group_000", 00:14:46.276 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:46.276 "listen_address": { 00:14:46.276 "trtype": "TCP", 00:14:46.276 "adrfam": "IPv4", 00:14:46.276 "traddr": "10.0.0.3", 00:14:46.276 "trsvcid": "4420" 00:14:46.276 }, 00:14:46.276 "peer_address": { 00:14:46.276 "trtype": "TCP", 00:14:46.276 "adrfam": "IPv4", 00:14:46.276 "traddr": "10.0.0.1", 00:14:46.276 "trsvcid": "49544" 00:14:46.276 }, 00:14:46.276 "auth": { 00:14:46.276 "state": "completed", 00:14:46.276 "digest": "sha512", 00:14:46.276 "dhgroup": "ffdhe4096" 00:14:46.276 } 00:14:46.276 } 00:14:46.276 ]' 00:14:46.276 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:46.534 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:46.534 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:46.534 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:14:46.534 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:46.534 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:46.534 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:46.534 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:46.793 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:14:46.793 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:47.729 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe4096 2 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:47.729 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:48.294 00:14:48.294 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:48.294 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:48.294 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:48.552 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:48.552 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:48.552 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.552 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:48.552 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.552 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:48.552 { 00:14:48.552 "cntlid": 125, 00:14:48.552 "qid": 0, 00:14:48.552 "state": "enabled", 00:14:48.552 "thread": "nvmf_tgt_poll_group_000", 00:14:48.552 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:48.552 "listen_address": { 00:14:48.552 "trtype": "TCP", 00:14:48.552 "adrfam": "IPv4", 00:14:48.552 "traddr": "10.0.0.3", 00:14:48.552 "trsvcid": "4420" 00:14:48.552 }, 00:14:48.552 "peer_address": { 00:14:48.552 "trtype": "TCP", 00:14:48.552 "adrfam": "IPv4", 00:14:48.552 "traddr": "10.0.0.1", 00:14:48.552 "trsvcid": "49560" 00:14:48.552 }, 00:14:48.552 "auth": { 00:14:48.552 "state": "completed", 00:14:48.552 "digest": "sha512", 00:14:48.552 "dhgroup": "ffdhe4096" 00:14:48.552 } 00:14:48.552 } 00:14:48.552 ]' 00:14:48.552 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:48.552 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:48.552 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:48.552 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:14:48.552 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:48.552 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:48.552 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:48.552 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:49.119 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:14:49.119 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:14:49.685 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:49.685 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:49.685 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:49.685 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.685 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:49.685 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.685 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:49.685 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:14:49.685 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:14:49.943 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe4096 3 00:14:49.943 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:49.943 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:49.943 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:14:49.943 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:14:49.943 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:49.943 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:14:49.943 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.943 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:49.943 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.943 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:14:49.943 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:49.943 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:50.508 00:14:50.508 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:50.508 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:50.508 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:50.766 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:50.766 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:50.766 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.766 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:50.766 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.766 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:50.766 { 00:14:50.766 "cntlid": 127, 00:14:50.766 "qid": 0, 00:14:50.766 "state": "enabled", 00:14:50.766 "thread": "nvmf_tgt_poll_group_000", 00:14:50.766 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:50.766 "listen_address": { 00:14:50.766 "trtype": "TCP", 00:14:50.766 "adrfam": "IPv4", 00:14:50.766 "traddr": "10.0.0.3", 00:14:50.766 "trsvcid": "4420" 00:14:50.766 }, 00:14:50.766 "peer_address": { 00:14:50.766 "trtype": "TCP", 00:14:50.766 "adrfam": "IPv4", 00:14:50.766 "traddr": "10.0.0.1", 00:14:50.766 "trsvcid": "49582" 00:14:50.766 }, 00:14:50.766 "auth": { 00:14:50.766 "state": "completed", 00:14:50.766 "digest": "sha512", 00:14:50.766 "dhgroup": "ffdhe4096" 00:14:50.766 } 00:14:50.766 } 00:14:50.766 ]' 00:14:50.766 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:50.766 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:50.766 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:51.040 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:14:51.040 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:51.040 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:51.040 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:51.040 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:51.330 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:14:51.330 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:14:51.896 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:51.896 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:51.896 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:51.896 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.896 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:51.896 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.896 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:14:51.896 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:51.896 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:14:51.896 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:14:52.461 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe6144 0 00:14:52.461 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:52.461 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:52.461 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:14:52.461 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:14:52.461 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:52.461 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:52.461 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.461 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:52.461 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.461 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:52.461 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:52.461 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:52.720 00:14:52.984 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:52.984 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:52.984 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:53.248 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:53.248 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:53.249 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.249 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:53.249 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.249 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:53.249 { 00:14:53.249 "cntlid": 129, 00:14:53.249 "qid": 0, 00:14:53.249 "state": "enabled", 00:14:53.249 "thread": "nvmf_tgt_poll_group_000", 00:14:53.249 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:53.249 "listen_address": { 00:14:53.249 "trtype": "TCP", 00:14:53.249 "adrfam": "IPv4", 00:14:53.249 "traddr": "10.0.0.3", 00:14:53.249 "trsvcid": "4420" 00:14:53.249 }, 00:14:53.249 "peer_address": { 00:14:53.249 "trtype": "TCP", 00:14:53.249 "adrfam": "IPv4", 00:14:53.249 "traddr": "10.0.0.1", 00:14:53.249 "trsvcid": "49618" 00:14:53.249 }, 00:14:53.249 "auth": { 00:14:53.249 "state": "completed", 00:14:53.249 "digest": "sha512", 00:14:53.249 "dhgroup": "ffdhe6144" 00:14:53.249 } 00:14:53.249 } 00:14:53.249 ]' 00:14:53.249 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:53.249 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:53.249 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:53.249 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:14:53.249 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:53.249 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:53.249 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:53.249 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:53.514 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:14:53.514 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:14:54.451 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:54.451 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:54.451 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:54.451 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:54.451 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:54.451 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:54.451 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:54.451 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:14:54.451 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:14:54.710 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe6144 1 00:14:54.710 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:54.710 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:54.710 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:14:54.710 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:14:54.710 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:54.710 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:54.710 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:54.710 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:54.710 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:54.710 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:54.710 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:54.710 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:55.276 00:14:55.276 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:55.276 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:55.276 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:55.534 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:55.534 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:55.534 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.534 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:55.534 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.534 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:55.534 { 00:14:55.534 "cntlid": 131, 00:14:55.534 "qid": 0, 00:14:55.534 "state": "enabled", 00:14:55.534 "thread": "nvmf_tgt_poll_group_000", 00:14:55.534 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:55.534 "listen_address": { 00:14:55.534 "trtype": "TCP", 00:14:55.534 "adrfam": "IPv4", 00:14:55.534 "traddr": "10.0.0.3", 00:14:55.534 "trsvcid": "4420" 00:14:55.534 }, 00:14:55.534 "peer_address": { 00:14:55.534 "trtype": "TCP", 00:14:55.534 "adrfam": "IPv4", 00:14:55.534 "traddr": "10.0.0.1", 00:14:55.534 "trsvcid": "49638" 00:14:55.534 }, 00:14:55.534 "auth": { 00:14:55.534 "state": "completed", 00:14:55.534 "digest": "sha512", 00:14:55.534 "dhgroup": "ffdhe6144" 00:14:55.534 } 00:14:55.534 } 00:14:55.534 ]' 00:14:55.534 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:55.534 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:55.534 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:55.534 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:14:55.534 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:55.792 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:55.792 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:55.792 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:56.051 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:14:56.051 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:14:56.617 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:56.617 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:56.617 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:56.617 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.617 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:56.617 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.617 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:56.617 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:14:56.617 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:14:57.195 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe6144 2 00:14:57.195 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:57.195 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:57.195 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:14:57.195 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:14:57.195 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:57.195 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:57.195 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.195 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:57.195 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.195 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:57.195 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:57.195 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:57.454 00:14:57.454 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:57.454 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:57.454 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:58.021 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:58.021 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:58.021 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.021 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:58.021 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.021 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:58.021 { 00:14:58.021 "cntlid": 133, 00:14:58.021 "qid": 0, 00:14:58.021 "state": "enabled", 00:14:58.021 "thread": "nvmf_tgt_poll_group_000", 00:14:58.021 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:14:58.021 "listen_address": { 00:14:58.021 "trtype": "TCP", 00:14:58.021 "adrfam": "IPv4", 00:14:58.021 "traddr": "10.0.0.3", 00:14:58.021 "trsvcid": "4420" 00:14:58.021 }, 00:14:58.021 "peer_address": { 00:14:58.021 "trtype": "TCP", 00:14:58.021 "adrfam": "IPv4", 00:14:58.021 "traddr": "10.0.0.1", 00:14:58.021 "trsvcid": "54402" 00:14:58.021 }, 00:14:58.021 "auth": { 00:14:58.021 "state": "completed", 00:14:58.021 "digest": "sha512", 00:14:58.021 "dhgroup": "ffdhe6144" 00:14:58.021 } 00:14:58.021 } 00:14:58.021 ]' 00:14:58.021 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:58.021 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:58.021 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:58.021 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:14:58.021 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:58.021 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:58.021 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:58.021 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:58.278 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:14:58.278 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:14:59.211 11:25:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:59.211 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:59.211 11:25:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:14:59.211 11:25:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.211 11:25:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:59.211 11:25:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.211 11:25:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:59.211 11:25:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:14:59.211 11:25:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:14:59.470 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe6144 3 00:14:59.470 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:59.470 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:59.470 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:14:59.470 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:14:59.470 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:59.470 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:14:59.470 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.470 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:59.470 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.470 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:14:59.470 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:59.470 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:15:00.036 00:15:00.036 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:15:00.036 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:15:00.036 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:00.294 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:00.294 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:15:00.294 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.294 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:00.294 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.294 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:15:00.294 { 00:15:00.294 "cntlid": 135, 00:15:00.294 "qid": 0, 00:15:00.294 "state": "enabled", 00:15:00.294 "thread": "nvmf_tgt_poll_group_000", 00:15:00.294 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:15:00.294 "listen_address": { 00:15:00.294 "trtype": "TCP", 00:15:00.294 "adrfam": "IPv4", 00:15:00.294 "traddr": "10.0.0.3", 00:15:00.294 "trsvcid": "4420" 00:15:00.294 }, 00:15:00.294 "peer_address": { 00:15:00.294 "trtype": "TCP", 00:15:00.294 "adrfam": "IPv4", 00:15:00.294 "traddr": "10.0.0.1", 00:15:00.294 "trsvcid": "54428" 00:15:00.294 }, 00:15:00.294 "auth": { 00:15:00.294 "state": "completed", 00:15:00.294 "digest": "sha512", 00:15:00.294 "dhgroup": "ffdhe6144" 00:15:00.294 } 00:15:00.294 } 00:15:00.294 ]' 00:15:00.294 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:15:00.553 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:15:00.553 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:15:00.553 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:15:00.553 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:15:00.553 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:15:00.553 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:15:00.553 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:15:01.119 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:15:01.119 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:15:01.685 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:15:01.685 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:15:01.685 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:15:01.685 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.685 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:01.685 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.685 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:15:01.685 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:15:01.685 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:15:01.685 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:15:01.943 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe8192 0 00:15:01.943 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:15:01.943 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:15:01.943 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:15:01.943 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:15:01.943 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:15:01.943 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:15:01.943 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.943 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:01.943 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.943 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:15:01.943 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:15:01.943 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:15:02.912 00:15:02.912 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:15:02.912 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:02.912 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:15:03.207 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:03.207 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:15:03.207 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.207 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:03.207 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.207 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:15:03.207 { 00:15:03.207 "cntlid": 137, 00:15:03.207 "qid": 0, 00:15:03.207 "state": "enabled", 00:15:03.207 "thread": "nvmf_tgt_poll_group_000", 00:15:03.207 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:15:03.207 "listen_address": { 00:15:03.207 "trtype": "TCP", 00:15:03.207 "adrfam": "IPv4", 00:15:03.207 "traddr": "10.0.0.3", 00:15:03.207 "trsvcid": "4420" 00:15:03.207 }, 00:15:03.207 "peer_address": { 00:15:03.207 "trtype": "TCP", 00:15:03.207 "adrfam": "IPv4", 00:15:03.207 "traddr": "10.0.0.1", 00:15:03.207 "trsvcid": "54444" 00:15:03.207 }, 00:15:03.207 "auth": { 00:15:03.207 "state": "completed", 00:15:03.207 "digest": "sha512", 00:15:03.207 "dhgroup": "ffdhe8192" 00:15:03.207 } 00:15:03.207 } 00:15:03.207 ]' 00:15:03.207 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:15:03.207 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:15:03.207 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:15:03.207 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:15:03.207 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:15:03.207 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:15:03.207 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:15:03.207 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:15:03.776 11:25:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:15:03.776 11:25:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:15:04.342 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:15:04.342 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:15:04.342 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:15:04.343 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:04.343 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:04.343 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:04.343 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:15:04.343 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:15:04.343 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:15:04.601 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe8192 1 00:15:04.601 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:15:04.601 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:15:04.601 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:15:04.601 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:15:04.601 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:15:04.601 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:15:04.601 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:04.601 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:04.601 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:04.601 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:15:04.601 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:15:04.601 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:15:05.535 00:15:05.535 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:15:05.535 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:15:05.535 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:05.794 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:05.794 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:15:05.794 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.794 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:05.794 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.794 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:15:05.794 { 00:15:05.794 "cntlid": 139, 00:15:05.794 "qid": 0, 00:15:05.794 "state": "enabled", 00:15:05.794 "thread": "nvmf_tgt_poll_group_000", 00:15:05.794 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:15:05.794 "listen_address": { 00:15:05.794 "trtype": "TCP", 00:15:05.794 "adrfam": "IPv4", 00:15:05.794 "traddr": "10.0.0.3", 00:15:05.794 "trsvcid": "4420" 00:15:05.794 }, 00:15:05.794 "peer_address": { 00:15:05.794 "trtype": "TCP", 00:15:05.794 "adrfam": "IPv4", 00:15:05.794 "traddr": "10.0.0.1", 00:15:05.794 "trsvcid": "54470" 00:15:05.794 }, 00:15:05.794 "auth": { 00:15:05.794 "state": "completed", 00:15:05.794 "digest": "sha512", 00:15:05.794 "dhgroup": "ffdhe8192" 00:15:05.794 } 00:15:05.794 } 00:15:05.794 ]' 00:15:05.794 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:15:05.794 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:15:05.794 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:15:05.794 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:15:05.794 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:15:06.067 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:15:06.067 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:15:06.067 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:15:06.326 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:15:06.326 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: --dhchap-ctrl-secret DHHC-1:02:YzFiYmQxNzAyMDliMDYxM2I5ZDE3NjkwZDMyOWQ5Y2FkNWE1OTMwYjE3ZmI2YWVjZg0feA==: 00:15:06.892 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:15:06.892 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:15:06.892 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:15:06.892 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:06.892 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:06.892 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:06.892 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:15:06.892 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:15:06.892 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:15:07.150 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe8192 2 00:15:07.150 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:15:07.150 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:15:07.150 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:15:07.150 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:15:07.150 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:15:07.150 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:15:07.150 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.150 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:07.150 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.150 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:15:07.150 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:15:07.150 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:15:08.083 00:15:08.083 11:25:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:15:08.083 11:25:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:15:08.083 11:25:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:08.341 11:25:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:08.341 11:25:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:15:08.341 11:25:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.341 11:25:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:08.341 11:25:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.341 11:25:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:15:08.341 { 00:15:08.341 "cntlid": 141, 00:15:08.341 "qid": 0, 00:15:08.341 "state": "enabled", 00:15:08.341 "thread": "nvmf_tgt_poll_group_000", 00:15:08.341 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:15:08.341 "listen_address": { 00:15:08.341 "trtype": "TCP", 00:15:08.341 "adrfam": "IPv4", 00:15:08.341 "traddr": "10.0.0.3", 00:15:08.341 "trsvcid": "4420" 00:15:08.341 }, 00:15:08.341 "peer_address": { 00:15:08.341 "trtype": "TCP", 00:15:08.341 "adrfam": "IPv4", 00:15:08.341 "traddr": "10.0.0.1", 00:15:08.341 "trsvcid": "41078" 00:15:08.341 }, 00:15:08.341 "auth": { 00:15:08.341 "state": "completed", 00:15:08.341 "digest": "sha512", 00:15:08.341 "dhgroup": "ffdhe8192" 00:15:08.341 } 00:15:08.341 } 00:15:08.341 ]' 00:15:08.341 11:25:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:15:08.341 11:25:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:15:08.341 11:25:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:15:08.341 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:15:08.341 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:15:08.598 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:15:08.598 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:15:08.598 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:15:08.856 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:15:08.856 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:01:ZGNhMzk1MGM4ZGMzZjkxODNjOWI2ODkxMGY0M2I4NjCPoyB0: 00:15:09.422 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:15:09.680 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:15:09.680 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:15:09.680 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.680 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:09.680 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.680 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:15:09.680 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:15:09.680 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:15:09.966 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe8192 3 00:15:09.966 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:15:09.966 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:15:09.966 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:15:09.966 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:15:09.966 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:15:09.966 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:15:09.966 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.966 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:09.966 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.966 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:15:09.966 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:15:09.966 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:15:10.531 00:15:10.531 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:15:10.531 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:15:10.531 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:10.789 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:10.789 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:15:10.789 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.789 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:10.789 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.789 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:15:10.789 { 00:15:10.789 "cntlid": 143, 00:15:10.789 "qid": 0, 00:15:10.789 "state": "enabled", 00:15:10.789 "thread": "nvmf_tgt_poll_group_000", 00:15:10.789 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:15:10.789 "listen_address": { 00:15:10.789 "trtype": "TCP", 00:15:10.789 "adrfam": "IPv4", 00:15:10.789 "traddr": "10.0.0.3", 00:15:10.789 "trsvcid": "4420" 00:15:10.789 }, 00:15:10.789 "peer_address": { 00:15:10.789 "trtype": "TCP", 00:15:10.789 "adrfam": "IPv4", 00:15:10.789 "traddr": "10.0.0.1", 00:15:10.789 "trsvcid": "41102" 00:15:10.789 }, 00:15:10.789 "auth": { 00:15:10.789 "state": "completed", 00:15:10.789 "digest": "sha512", 00:15:10.789 "dhgroup": "ffdhe8192" 00:15:10.789 } 00:15:10.789 } 00:15:10.789 ]' 00:15:10.789 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:15:10.789 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:15:10.789 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:15:11.046 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:15:11.046 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:15:11.046 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:15:11.046 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:15:11.047 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:15:11.304 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:15:11.304 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:15:12.237 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:15:12.237 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:15:12.237 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:15:12.237 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:12.237 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:12.237 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:12.237 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@129 -- # IFS=, 00:15:12.237 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@130 -- # printf %s sha256,sha384,sha512 00:15:12.237 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@129 -- # IFS=, 00:15:12.237 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@130 -- # printf %s null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:15:12.237 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@129 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:15:12.237 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:15:12.495 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@141 -- # connect_authenticate sha512 ffdhe8192 0 00:15:12.495 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:15:12.495 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:15:12.495 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:15:12.495 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:15:12.495 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:15:12.496 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:15:12.496 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:12.496 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:12.496 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:12.496 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:15:12.496 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:15:12.496 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:15:13.435 00:15:13.435 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:15:13.435 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:15:13.435 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:13.705 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:13.705 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:15:13.705 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:13.705 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:13.705 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:13.705 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:15:13.705 { 00:15:13.705 "cntlid": 145, 00:15:13.705 "qid": 0, 00:15:13.705 "state": "enabled", 00:15:13.705 "thread": "nvmf_tgt_poll_group_000", 00:15:13.705 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:15:13.705 "listen_address": { 00:15:13.705 "trtype": "TCP", 00:15:13.705 "adrfam": "IPv4", 00:15:13.705 "traddr": "10.0.0.3", 00:15:13.705 "trsvcid": "4420" 00:15:13.705 }, 00:15:13.705 "peer_address": { 00:15:13.705 "trtype": "TCP", 00:15:13.705 "adrfam": "IPv4", 00:15:13.705 "traddr": "10.0.0.1", 00:15:13.705 "trsvcid": "41140" 00:15:13.705 }, 00:15:13.705 "auth": { 00:15:13.705 "state": "completed", 00:15:13.705 "digest": "sha512", 00:15:13.705 "dhgroup": "ffdhe8192" 00:15:13.705 } 00:15:13.705 } 00:15:13.705 ]' 00:15:13.705 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:15:13.706 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:15:13.706 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:15:13.706 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:15:13.706 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:15:13.706 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:15:13.706 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:15:13.706 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:15:13.962 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:15:13.962 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:00:MTY0MTdlMWI5YjIwZjM3OWNkNDNhYzUxNmE4ZmEyMjI4MTYzYzk3NmMxYTk2YjYxz20aZw==: --dhchap-ctrl-secret DHHC-1:03:MjViZDQ5OWZjOTkzMDM4NzgwNzUyYTg2YmZiYjRiYmVkNTM4ZmRkYWZmNjJjZmJhM2IzYjhlNjVjODQyNzdjN395Bxo=: 00:15:14.894 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:15:14.894 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:15:14.895 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:15:14.895 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:14.895 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:14.895 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:14.895 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@144 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 00:15:14.895 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:14.895 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:14.895 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:14.895 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@145 -- # NOT bdev_connect -b nvme0 --dhchap-key key2 00:15:14.895 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:15:14.895 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key2 00:15:14.895 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:15:14.895 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:14.895 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:15:14.895 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:14.895 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key2 00:15:14.895 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 00:15:14.895 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 00:15:15.458 request: 00:15:15.458 { 00:15:15.458 "name": "nvme0", 00:15:15.458 "trtype": "tcp", 00:15:15.458 "traddr": "10.0.0.3", 00:15:15.458 "adrfam": "ipv4", 00:15:15.458 "trsvcid": "4420", 00:15:15.458 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:15:15.458 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:15:15.458 "prchk_reftag": false, 00:15:15.458 "prchk_guard": false, 00:15:15.459 "hdgst": false, 00:15:15.459 "ddgst": false, 00:15:15.459 "dhchap_key": "key2", 00:15:15.459 "allow_unrecognized_csi": false, 00:15:15.459 "method": "bdev_nvme_attach_controller", 00:15:15.459 "req_id": 1 00:15:15.459 } 00:15:15.459 Got JSON-RPC error response 00:15:15.459 response: 00:15:15.459 { 00:15:15.459 "code": -5, 00:15:15.459 "message": "Input/output error" 00:15:15.459 } 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@146 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@149 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@150 -- # NOT bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:15:15.459 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:15:16.392 request: 00:15:16.392 { 00:15:16.392 "name": "nvme0", 00:15:16.392 "trtype": "tcp", 00:15:16.392 "traddr": "10.0.0.3", 00:15:16.392 "adrfam": "ipv4", 00:15:16.392 "trsvcid": "4420", 00:15:16.392 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:15:16.392 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:15:16.392 "prchk_reftag": false, 00:15:16.392 "prchk_guard": false, 00:15:16.392 "hdgst": false, 00:15:16.392 "ddgst": false, 00:15:16.392 "dhchap_key": "key1", 00:15:16.392 "dhchap_ctrlr_key": "ckey2", 00:15:16.392 "allow_unrecognized_csi": false, 00:15:16.392 "method": "bdev_nvme_attach_controller", 00:15:16.392 "req_id": 1 00:15:16.392 } 00:15:16.392 Got JSON-RPC error response 00:15:16.392 response: 00:15:16.392 { 00:15:16.392 "code": -5, 00:15:16.392 "message": "Input/output error" 00:15:16.392 } 00:15:16.392 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:15:16.392 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:16.392 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:16.392 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:16.392 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@151 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:15:16.392 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.392 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:16.392 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.392 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@154 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 00:15:16.392 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.392 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:16.392 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.393 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@155 -- # NOT bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:15:16.393 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:15:16.393 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:15:16.393 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:15:16.393 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:16.393 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:15:16.393 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:16.393 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:15:16.393 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:15:16.393 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:15:16.960 request: 00:15:16.960 { 00:15:16.960 "name": "nvme0", 00:15:16.960 "trtype": "tcp", 00:15:16.960 "traddr": "10.0.0.3", 00:15:16.960 "adrfam": "ipv4", 00:15:16.960 "trsvcid": "4420", 00:15:16.960 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:15:16.960 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:15:16.960 "prchk_reftag": false, 00:15:16.960 "prchk_guard": false, 00:15:16.960 "hdgst": false, 00:15:16.960 "ddgst": false, 00:15:16.960 "dhchap_key": "key1", 00:15:16.960 "dhchap_ctrlr_key": "ckey1", 00:15:16.960 "allow_unrecognized_csi": false, 00:15:16.960 "method": "bdev_nvme_attach_controller", 00:15:16.960 "req_id": 1 00:15:16.960 } 00:15:16.960 Got JSON-RPC error response 00:15:16.960 response: 00:15:16.960 { 00:15:16.960 "code": -5, 00:15:16.960 "message": "Input/output error" 00:15:16.960 } 00:15:16.960 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:15:16.960 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:16.960 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:16.960 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:16.960 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@156 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:15:16.960 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.960 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:16.960 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.960 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@159 -- # killprocess 67395 00:15:16.960 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@950 -- # '[' -z 67395 ']' 00:15:16.960 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@954 -- # kill -0 67395 00:15:16.960 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # uname 00:15:16.960 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:15:16.960 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 67395 00:15:16.960 killing process with pid 67395 00:15:16.960 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:15:16.960 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:15:16.960 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@968 -- # echo 'killing process with pid 67395' 00:15:16.960 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@969 -- # kill 67395 00:15:16.960 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@974 -- # wait 67395 00:15:17.225 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@160 -- # nvmfappstart --wait-for-rpc -L nvmf_auth 00:15:17.225 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:15:17.225 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@724 -- # xtrace_disable 00:15:17.225 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:17.225 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@507 -- # nvmfpid=70628 00:15:17.225 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc -L nvmf_auth 00:15:17.225 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@508 -- # waitforlisten 70628 00:15:17.225 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 70628 ']' 00:15:17.225 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:17.225 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:15:17.225 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:17.225 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:15:17.225 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:18.168 11:25:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:15:18.168 11:25:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:15:18.168 11:25:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:15:18.168 11:25:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@730 -- # xtrace_disable 00:15:18.169 11:25:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:18.169 11:25:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:18.169 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:18.169 11:25:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@161 -- # trap 'dumplogs; cleanup' SIGINT SIGTERM EXIT 00:15:18.169 11:25:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@163 -- # waitforlisten 70628 00:15:18.169 11:25:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 70628 ']' 00:15:18.169 11:25:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:18.169 11:25:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:15:18.169 11:25:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:18.169 11:25:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:15:18.169 11:25:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:18.426 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:15:18.426 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:15:18.426 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@164 -- # rpc_cmd 00:15:18.426 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.426 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:18.684 null0 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@174 -- # for i in "${!keys[@]}" 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@175 -- # rpc_cmd keyring_file_add_key key0 /tmp/spdk.key-null.JHQ 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # [[ -n /tmp/spdk.key-sha512.iVq ]] 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # rpc_cmd keyring_file_add_key ckey0 /tmp/spdk.key-sha512.iVq 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@174 -- # for i in "${!keys[@]}" 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@175 -- # rpc_cmd keyring_file_add_key key1 /tmp/spdk.key-sha256.VHY 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # [[ -n /tmp/spdk.key-sha384.4wT ]] 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # rpc_cmd keyring_file_add_key ckey1 /tmp/spdk.key-sha384.4wT 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@174 -- # for i in "${!keys[@]}" 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@175 -- # rpc_cmd keyring_file_add_key key2 /tmp/spdk.key-sha384.Sgg 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # [[ -n /tmp/spdk.key-sha256.9EA ]] 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # rpc_cmd keyring_file_add_key ckey2 /tmp/spdk.key-sha256.9EA 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@174 -- # for i in "${!keys[@]}" 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@175 -- # rpc_cmd keyring_file_add_key key3 /tmp/spdk.key-sha512.i1O 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # [[ -n '' ]] 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@179 -- # connect_authenticate sha512 ffdhe8192 3 00:15:18.684 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:15:18.685 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:15:18.685 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:15:18.685 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:15:18.685 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:15:18.685 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:15:18.685 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.685 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:18.685 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.685 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:15:18.685 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:15:18.685 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:15:19.618 nvme0n1 00:15:19.618 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:15:19.618 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:15:19.618 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:20.185 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:20.185 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:15:20.185 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.185 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:20.185 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.185 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:15:20.185 { 00:15:20.185 "cntlid": 1, 00:15:20.185 "qid": 0, 00:15:20.185 "state": "enabled", 00:15:20.185 "thread": "nvmf_tgt_poll_group_000", 00:15:20.185 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:15:20.185 "listen_address": { 00:15:20.185 "trtype": "TCP", 00:15:20.185 "adrfam": "IPv4", 00:15:20.185 "traddr": "10.0.0.3", 00:15:20.185 "trsvcid": "4420" 00:15:20.185 }, 00:15:20.185 "peer_address": { 00:15:20.185 "trtype": "TCP", 00:15:20.185 "adrfam": "IPv4", 00:15:20.185 "traddr": "10.0.0.1", 00:15:20.185 "trsvcid": "38644" 00:15:20.185 }, 00:15:20.185 "auth": { 00:15:20.185 "state": "completed", 00:15:20.185 "digest": "sha512", 00:15:20.185 "dhgroup": "ffdhe8192" 00:15:20.185 } 00:15:20.185 } 00:15:20.185 ]' 00:15:20.185 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:15:20.185 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:15:20.185 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:15:20.185 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:15:20.185 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:15:20.185 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:15:20.185 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:15:20.185 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:15:20.480 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:15:20.480 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:15:21.436 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:15:21.436 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:15:21.436 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:15:21.436 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:21.436 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:21.436 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:21.436 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@182 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key3 00:15:21.436 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:21.436 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:21.436 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:21.436 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@183 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 00:15:21.436 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 00:15:21.693 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@184 -- # NOT bdev_connect -b nvme0 --dhchap-key key3 00:15:21.693 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:15:21.693 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key3 00:15:21.693 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:15:21.693 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:21.693 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:15:21.693 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:21.693 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key3 00:15:21.693 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:15:21.693 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:15:21.952 request: 00:15:21.952 { 00:15:21.952 "name": "nvme0", 00:15:21.952 "trtype": "tcp", 00:15:21.952 "traddr": "10.0.0.3", 00:15:21.952 "adrfam": "ipv4", 00:15:21.952 "trsvcid": "4420", 00:15:21.952 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:15:21.952 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:15:21.952 "prchk_reftag": false, 00:15:21.952 "prchk_guard": false, 00:15:21.952 "hdgst": false, 00:15:21.952 "ddgst": false, 00:15:21.952 "dhchap_key": "key3", 00:15:21.952 "allow_unrecognized_csi": false, 00:15:21.952 "method": "bdev_nvme_attach_controller", 00:15:21.952 "req_id": 1 00:15:21.952 } 00:15:21.952 Got JSON-RPC error response 00:15:21.952 response: 00:15:21.952 { 00:15:21.952 "code": -5, 00:15:21.952 "message": "Input/output error" 00:15:21.952 } 00:15:21.952 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:15:21.952 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:21.952 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:21.952 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:21.952 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@187 -- # IFS=, 00:15:21.952 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@188 -- # printf %s sha256,sha384,sha512 00:15:21.952 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@187 -- # hostrpc bdev_nvme_set_options --dhchap-dhgroups ffdhe2048 --dhchap-digests sha256,sha384,sha512 00:15:21.952 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-dhgroups ffdhe2048 --dhchap-digests sha256,sha384,sha512 00:15:22.517 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@193 -- # NOT bdev_connect -b nvme0 --dhchap-key key3 00:15:22.517 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:15:22.517 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key3 00:15:22.517 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:15:22.517 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:22.517 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:15:22.517 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:22.517 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key3 00:15:22.517 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:15:22.518 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:15:22.775 request: 00:15:22.775 { 00:15:22.775 "name": "nvme0", 00:15:22.775 "trtype": "tcp", 00:15:22.775 "traddr": "10.0.0.3", 00:15:22.775 "adrfam": "ipv4", 00:15:22.775 "trsvcid": "4420", 00:15:22.775 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:15:22.775 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:15:22.775 "prchk_reftag": false, 00:15:22.776 "prchk_guard": false, 00:15:22.776 "hdgst": false, 00:15:22.776 "ddgst": false, 00:15:22.776 "dhchap_key": "key3", 00:15:22.776 "allow_unrecognized_csi": false, 00:15:22.776 "method": "bdev_nvme_attach_controller", 00:15:22.776 "req_id": 1 00:15:22.776 } 00:15:22.776 Got JSON-RPC error response 00:15:22.776 response: 00:15:22.776 { 00:15:22.776 "code": -5, 00:15:22.776 "message": "Input/output error" 00:15:22.776 } 00:15:22.776 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:15:22.776 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:22.776 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:22.776 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:22.776 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@197 -- # IFS=, 00:15:22.776 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@198 -- # printf %s sha256,sha384,sha512 00:15:22.776 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@197 -- # IFS=, 00:15:22.776 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@198 -- # printf %s null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:15:22.776 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@197 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:15:22.776 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:15:23.034 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@208 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:15:23.034 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.034 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:23.034 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.034 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@209 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:15:23.034 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.034 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:23.034 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.034 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@210 -- # NOT bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:15:23.034 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:15:23.034 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:15:23.034 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:15:23.034 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:23.034 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:15:23.034 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:23.034 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:15:23.034 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:15:23.034 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:15:23.599 request: 00:15:23.599 { 00:15:23.599 "name": "nvme0", 00:15:23.599 "trtype": "tcp", 00:15:23.599 "traddr": "10.0.0.3", 00:15:23.599 "adrfam": "ipv4", 00:15:23.599 "trsvcid": "4420", 00:15:23.599 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:15:23.599 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:15:23.599 "prchk_reftag": false, 00:15:23.599 "prchk_guard": false, 00:15:23.599 "hdgst": false, 00:15:23.599 "ddgst": false, 00:15:23.599 "dhchap_key": "key0", 00:15:23.599 "dhchap_ctrlr_key": "key1", 00:15:23.599 "allow_unrecognized_csi": false, 00:15:23.599 "method": "bdev_nvme_attach_controller", 00:15:23.599 "req_id": 1 00:15:23.599 } 00:15:23.599 Got JSON-RPC error response 00:15:23.599 response: 00:15:23.599 { 00:15:23.599 "code": -5, 00:15:23.599 "message": "Input/output error" 00:15:23.599 } 00:15:23.599 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:15:23.599 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:23.599 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:23.599 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:23.599 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@213 -- # bdev_connect -b nvme0 --dhchap-key key0 00:15:23.599 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 00:15:23.600 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 00:15:24.165 nvme0n1 00:15:24.165 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@214 -- # hostrpc bdev_nvme_get_controllers 00:15:24.165 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@214 -- # jq -r '.[].name' 00:15:24.165 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:24.423 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@214 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:24.423 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@215 -- # hostrpc bdev_nvme_detach_controller nvme0 00:15:24.423 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:15:24.680 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@218 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 00:15:24.680 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:24.680 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:24.680 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:24.680 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@219 -- # bdev_connect -b nvme0 --dhchap-key key1 00:15:24.681 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 00:15:24.681 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 00:15:26.053 nvme0n1 00:15:26.053 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@220 -- # hostrpc bdev_nvme_get_controllers 00:15:26.053 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:26.053 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@220 -- # jq -r '.[].name' 00:15:26.053 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@220 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:26.053 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@222 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key key3 00:15:26.053 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:26.053 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:26.053 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:26.053 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@223 -- # hostrpc bdev_nvme_get_controllers 00:15:26.053 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@223 -- # jq -r '.[].name' 00:15:26.053 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:26.311 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@223 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:26.311 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@225 -- # nvme_connect --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:15:26.311 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --hostid 801d435b-e3d4-4ca3-aead-ebb283315d5b -l 0 --dhchap-secret DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: --dhchap-ctrl-secret DHHC-1:03:MGRiNmIzMzdiY2ZiMGJjMmI3YmQ0MjFlZTc4Mzg5YTMzYTQ1ZmU5ODg4NDYwNGRjMGZhZDlkMjc5ZTliYWZmZgCGaPs=: 00:15:27.245 11:26:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@226 -- # nvme_get_ctrlr 00:15:27.245 11:26:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@41 -- # local dev 00:15:27.245 11:26:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@43 -- # for dev in /sys/devices/virtual/nvme-fabrics/ctl/nvme* 00:15:27.245 11:26:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@44 -- # [[ nqn.2024-03.io.spdk:cnode0 == \n\q\n\.\2\0\2\4\-\0\3\.\i\o\.\s\p\d\k\:\c\n\o\d\e\0 ]] 00:15:27.245 11:26:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@44 -- # echo nvme0 00:15:27.245 11:26:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@44 -- # break 00:15:27.245 11:26:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@226 -- # nctrlr=nvme0 00:15:27.245 11:26:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@227 -- # hostrpc bdev_nvme_detach_controller nvme0 00:15:27.245 11:26:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:15:27.502 11:26:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@228 -- # NOT bdev_connect -b nvme0 --dhchap-key key1 00:15:27.502 11:26:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:15:27.503 11:26:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key1 00:15:27.503 11:26:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:15:27.503 11:26:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:27.503 11:26:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:15:27.503 11:26:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:27.503 11:26:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key1 00:15:27.503 11:26:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 00:15:27.503 11:26:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 00:15:28.099 request: 00:15:28.099 { 00:15:28.099 "name": "nvme0", 00:15:28.099 "trtype": "tcp", 00:15:28.099 "traddr": "10.0.0.3", 00:15:28.099 "adrfam": "ipv4", 00:15:28.099 "trsvcid": "4420", 00:15:28.099 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:15:28.099 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b", 00:15:28.099 "prchk_reftag": false, 00:15:28.099 "prchk_guard": false, 00:15:28.099 "hdgst": false, 00:15:28.099 "ddgst": false, 00:15:28.099 "dhchap_key": "key1", 00:15:28.099 "allow_unrecognized_csi": false, 00:15:28.099 "method": "bdev_nvme_attach_controller", 00:15:28.099 "req_id": 1 00:15:28.099 } 00:15:28.099 Got JSON-RPC error response 00:15:28.099 response: 00:15:28.099 { 00:15:28.099 "code": -5, 00:15:28.099 "message": "Input/output error" 00:15:28.099 } 00:15:28.099 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:15:28.099 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:28.099 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:28.099 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:28.099 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@229 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:15:28.099 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:15:28.099 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:15:29.470 nvme0n1 00:15:29.470 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@230 -- # hostrpc bdev_nvme_get_controllers 00:15:29.470 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@230 -- # jq -r '.[].name' 00:15:29.470 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:29.470 11:26:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@230 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:29.470 11:26:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@231 -- # hostrpc bdev_nvme_detach_controller nvme0 00:15:29.470 11:26:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:15:29.729 11:26:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@233 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:15:29.729 11:26:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.729 11:26:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:29.729 11:26:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.729 11:26:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@234 -- # bdev_connect -b nvme0 00:15:29.729 11:26:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 00:15:29.729 11:26:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 00:15:30.295 nvme0n1 00:15:30.295 11:26:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@235 -- # hostrpc bdev_nvme_get_controllers 00:15:30.295 11:26:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@235 -- # jq -r '.[].name' 00:15:30.295 11:26:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:30.553 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@235 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:30.553 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@236 -- # hostrpc bdev_nvme_detach_controller nvme0 00:15:30.553 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:15:30.812 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@239 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key key3 00:15:30.812 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.812 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:30.812 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.812 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@240 -- # nvme_set_keys nvme0 DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: '' 2s 00:15:30.812 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@49 -- # local ctl key ckey dev timeout 00:15:30.812 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # ctl=nvme0 00:15:30.812 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # key=DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: 00:15:30.812 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # ckey= 00:15:30.812 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # timeout=2s 00:15:30.812 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@52 -- # dev=/sys/devices/virtual/nvme-fabrics/ctl/nvme0 00:15:30.812 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@54 -- # [[ -z DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: ]] 00:15:30.812 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@54 -- # echo DHHC-1:01:NzYxZDA1Nzk1YjczZGI1Y2M1OTAwMDAzMWMxY2UyZDWd5wHW: 00:15:30.812 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@55 -- # [[ -z '' ]] 00:15:30.812 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@56 -- # [[ -z 2s ]] 00:15:30.812 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@56 -- # sleep 2s 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@241 -- # waitforblk nvme0n1 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1235 -- # local i=0 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1236 -- # lsblk -l -o NAME 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1236 -- # grep -q -w nvme0n1 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1242 -- # lsblk -l -o NAME 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1242 -- # grep -q -w nvme0n1 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1246 -- # return 0 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@243 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key1 --dhchap-ctrlr-key key2 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@244 -- # nvme_set_keys nvme0 '' DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: 2s 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@49 -- # local ctl key ckey dev timeout 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # ctl=nvme0 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # key= 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # ckey=DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # timeout=2s 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@52 -- # dev=/sys/devices/virtual/nvme-fabrics/ctl/nvme0 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@54 -- # [[ -z '' ]] 00:15:32.711 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@55 -- # [[ -z DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: ]] 00:15:32.712 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@55 -- # echo DHHC-1:02:ZGQwNGFjMzU3OGViYzMxODIxYjA4YzY1MjA3YzlmNmJhY2QwNjhmOGYwMmM5ZGEzPVn7rA==: 00:15:32.712 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@56 -- # [[ -z 2s ]] 00:15:32.712 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@56 -- # sleep 2s 00:15:35.240 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@245 -- # waitforblk nvme0n1 00:15:35.240 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1235 -- # local i=0 00:15:35.240 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1236 -- # lsblk -l -o NAME 00:15:35.240 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1236 -- # grep -q -w nvme0n1 00:15:35.240 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1242 -- # lsblk -l -o NAME 00:15:35.240 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1242 -- # grep -q -w nvme0n1 00:15:35.240 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1246 -- # return 0 00:15:35.240 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@246 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:15:35.240 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:15:35.240 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@249 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key key1 00:15:35.240 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:35.240 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:35.240 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:35.240 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@250 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:15:35.240 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:15:35.240 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:15:36.173 nvme0n1 00:15:36.173 11:26:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@252 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key key3 00:15:36.173 11:26:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:36.173 11:26:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:36.173 11:26:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:36.173 11:26:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@253 -- # hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:15:36.173 11:26:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:15:36.738 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@254 -- # hostrpc bdev_nvme_get_controllers 00:15:36.738 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:36.738 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@254 -- # jq -r '.[].name' 00:15:36.995 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@254 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:36.995 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@256 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:15:36.995 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:36.995 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:36.995 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:36.995 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@257 -- # hostrpc bdev_nvme_set_keys nvme0 00:15:36.995 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_keys nvme0 00:15:37.561 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@258 -- # hostrpc bdev_nvme_get_controllers 00:15:37.561 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:37.561 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@258 -- # jq -r '.[].name' 00:15:38.136 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@258 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:38.136 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@260 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key key3 00:15:38.136 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:38.136 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:38.136 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:38.136 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@261 -- # NOT hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key1 --dhchap-ctrlr-key key3 00:15:38.136 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:15:38.136 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key1 --dhchap-ctrlr-key key3 00:15:38.136 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=hostrpc 00:15:38.136 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:38.136 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t hostrpc 00:15:38.136 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:38.136 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key1 --dhchap-ctrlr-key key3 00:15:38.136 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_keys nvme0 --dhchap-key key1 --dhchap-ctrlr-key key3 00:15:38.740 request: 00:15:38.740 { 00:15:38.740 "name": "nvme0", 00:15:38.740 "dhchap_key": "key1", 00:15:38.740 "dhchap_ctrlr_key": "key3", 00:15:38.740 "method": "bdev_nvme_set_keys", 00:15:38.740 "req_id": 1 00:15:38.740 } 00:15:38.740 Got JSON-RPC error response 00:15:38.740 response: 00:15:38.740 { 00:15:38.740 "code": -13, 00:15:38.740 "message": "Permission denied" 00:15:38.740 } 00:15:38.740 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:15:38.740 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:38.740 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:38.740 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:38.740 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # hostrpc bdev_nvme_get_controllers 00:15:38.740 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:38.740 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # jq length 00:15:39.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # (( 1 != 0 )) 00:15:39.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@263 -- # sleep 1s 00:15:40.237 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # hostrpc bdev_nvme_get_controllers 00:15:40.237 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # jq length 00:15:40.237 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:40.495 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # (( 0 != 0 )) 00:15:40.495 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@267 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key0 --dhchap-ctrlr-key key1 00:15:40.495 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:40.495 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:40.495 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:40.495 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@268 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:15:40.495 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:15:40.495 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:15:41.910 nvme0n1 00:15:41.910 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@270 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b --dhchap-key key2 --dhchap-ctrlr-key key3 00:15:41.910 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:41.910 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:41.910 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:41.910 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@271 -- # NOT hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key0 00:15:41.910 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:15:41.910 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key0 00:15:41.910 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=hostrpc 00:15:41.910 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:41.910 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t hostrpc 00:15:41.910 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:41.910 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key0 00:15:41.910 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key0 00:15:42.475 request: 00:15:42.475 { 00:15:42.475 "name": "nvme0", 00:15:42.475 "dhchap_key": "key2", 00:15:42.475 "dhchap_ctrlr_key": "key0", 00:15:42.475 "method": "bdev_nvme_set_keys", 00:15:42.475 "req_id": 1 00:15:42.475 } 00:15:42.476 Got JSON-RPC error response 00:15:42.476 response: 00:15:42.476 { 00:15:42.476 "code": -13, 00:15:42.476 "message": "Permission denied" 00:15:42.476 } 00:15:42.476 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:15:42.476 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:42.476 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:42.476 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:42.476 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # hostrpc bdev_nvme_get_controllers 00:15:42.476 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # jq length 00:15:42.476 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:42.733 11:26:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # (( 1 != 0 )) 00:15:42.733 11:26:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@273 -- # sleep 1s 00:15:43.665 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # hostrpc bdev_nvme_get_controllers 00:15:43.665 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # jq length 00:15:43.665 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:44.231 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # (( 0 != 0 )) 00:15:44.231 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@276 -- # trap - SIGINT SIGTERM EXIT 00:15:44.231 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@277 -- # cleanup 00:15:44.231 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@21 -- # killprocess 67427 00:15:44.231 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@950 -- # '[' -z 67427 ']' 00:15:44.231 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@954 -- # kill -0 67427 00:15:44.231 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # uname 00:15:44.231 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:15:44.231 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 67427 00:15:44.231 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:15:44.231 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:15:44.231 killing process with pid 67427 00:15:44.231 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@968 -- # echo 'killing process with pid 67427' 00:15:44.231 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@969 -- # kill 67427 00:15:44.231 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@974 -- # wait 67427 00:15:44.489 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@22 -- # nvmftestfini 00:15:44.489 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@514 -- # nvmfcleanup 00:15:44.489 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@121 -- # sync 00:15:44.489 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:15:44.489 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@124 -- # set +e 00:15:44.489 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@125 -- # for i in {1..20} 00:15:44.489 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:15:44.489 rmmod nvme_tcp 00:15:44.489 rmmod nvme_fabrics 00:15:44.489 rmmod nvme_keyring 00:15:44.489 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@128 -- # set -e 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@129 -- # return 0 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@515 -- # '[' -n 70628 ']' 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@516 -- # killprocess 70628 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@950 -- # '[' -z 70628 ']' 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@954 -- # kill -0 70628 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # uname 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 70628 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:15:44.760 killing process with pid 70628 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@968 -- # echo 'killing process with pid 70628' 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@969 -- # kill 70628 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@974 -- # wait 70628 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@297 -- # iptr 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@789 -- # iptables-save 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@789 -- # iptables-restore 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:15:44.760 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@246 -- # remove_spdk_ns 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@300 -- # return 0 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@23 -- # rm -f /tmp/spdk.key-null.JHQ /tmp/spdk.key-sha256.VHY /tmp/spdk.key-sha384.Sgg /tmp/spdk.key-sha512.i1O /tmp/spdk.key-sha512.iVq /tmp/spdk.key-sha384.4wT /tmp/spdk.key-sha256.9EA '' /home/vagrant/spdk_repo/spdk/../output/nvme-auth.log /home/vagrant/spdk_repo/spdk/../output/nvmf-auth.log 00:15:45.018 ************************************ 00:15:45.018 END TEST nvmf_auth_target 00:15:45.018 ************************************ 00:15:45.018 00:15:45.018 real 3m29.354s 00:15:45.018 user 8m22.109s 00:15:45.018 sys 0m31.015s 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1126 -- # xtrace_disable 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@39 -- # '[' tcp = tcp ']' 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@40 -- # run_test nvmf_bdevio_no_huge /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:15:45.018 ************************************ 00:15:45.018 START TEST nvmf_bdevio_no_huge 00:15:45.018 ************************************ 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:15:45.018 * Looking for test storage... 00:15:45.018 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1681 -- # lcov --version 00:15:45.018 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:15:45.277 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:15:45.277 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:15:45.277 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@333 -- # local ver1 ver1_l 00:15:45.277 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@334 -- # local ver2 ver2_l 00:15:45.277 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@336 -- # IFS=.-: 00:15:45.277 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@336 -- # read -ra ver1 00:15:45.277 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@337 -- # IFS=.-: 00:15:45.277 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@337 -- # read -ra ver2 00:15:45.277 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@338 -- # local 'op=<' 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@340 -- # ver1_l=2 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@341 -- # ver2_l=1 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@344 -- # case "$op" in 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@345 -- # : 1 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@364 -- # (( v = 0 )) 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@365 -- # decimal 1 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@353 -- # local d=1 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@355 -- # echo 1 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@365 -- # ver1[v]=1 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@366 -- # decimal 2 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@353 -- # local d=2 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@355 -- # echo 2 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@366 -- # ver2[v]=2 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@368 -- # return 0 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:15:45.278 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:45.278 --rc genhtml_branch_coverage=1 00:15:45.278 --rc genhtml_function_coverage=1 00:15:45.278 --rc genhtml_legend=1 00:15:45.278 --rc geninfo_all_blocks=1 00:15:45.278 --rc geninfo_unexecuted_blocks=1 00:15:45.278 00:15:45.278 ' 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:15:45.278 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:45.278 --rc genhtml_branch_coverage=1 00:15:45.278 --rc genhtml_function_coverage=1 00:15:45.278 --rc genhtml_legend=1 00:15:45.278 --rc geninfo_all_blocks=1 00:15:45.278 --rc geninfo_unexecuted_blocks=1 00:15:45.278 00:15:45.278 ' 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:15:45.278 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:45.278 --rc genhtml_branch_coverage=1 00:15:45.278 --rc genhtml_function_coverage=1 00:15:45.278 --rc genhtml_legend=1 00:15:45.278 --rc geninfo_all_blocks=1 00:15:45.278 --rc geninfo_unexecuted_blocks=1 00:15:45.278 00:15:45.278 ' 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:15:45.278 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:45.278 --rc genhtml_branch_coverage=1 00:15:45.278 --rc genhtml_function_coverage=1 00:15:45.278 --rc genhtml_legend=1 00:15:45.278 --rc geninfo_all_blocks=1 00:15:45.278 --rc geninfo_unexecuted_blocks=1 00:15:45.278 00:15:45.278 ' 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@7 -- # uname -s 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@15 -- # shopt -s extglob 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@5 -- # export PATH 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@51 -- # : 0 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:15:45.278 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@55 -- # have_pci_nics=0 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@14 -- # nvmftestinit 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@474 -- # prepare_net_devs 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@436 -- # local -g is_hw=no 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@438 -- # remove_spdk_ns 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:15:45.278 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@458 -- # nvmf_veth_init 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:15:45.279 Cannot find device "nvmf_init_br" 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@162 -- # true 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:15:45.279 Cannot find device "nvmf_init_br2" 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@163 -- # true 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:15:45.279 Cannot find device "nvmf_tgt_br" 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@164 -- # true 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:15:45.279 Cannot find device "nvmf_tgt_br2" 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@165 -- # true 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:15:45.279 Cannot find device "nvmf_init_br" 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@166 -- # true 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:15:45.279 Cannot find device "nvmf_init_br2" 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@167 -- # true 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:15:45.279 Cannot find device "nvmf_tgt_br" 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@168 -- # true 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:15:45.279 Cannot find device "nvmf_tgt_br2" 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@169 -- # true 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:15:45.279 Cannot find device "nvmf_br" 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@170 -- # true 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:15:45.279 Cannot find device "nvmf_init_if" 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@171 -- # true 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:15:45.279 Cannot find device "nvmf_init_if2" 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@172 -- # true 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:15:45.279 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@173 -- # true 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:15:45.279 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@174 -- # true 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:15:45.279 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:15:45.536 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:15:45.536 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:15:45.536 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:15:45.536 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:15:45.536 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:15:45.536 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:15:45.537 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:15:45.537 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.075 ms 00:15:45.537 00:15:45.537 --- 10.0.0.3 ping statistics --- 00:15:45.537 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:45.537 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:15:45.537 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:15:45.537 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.050 ms 00:15:45.537 00:15:45.537 --- 10.0.0.4 ping statistics --- 00:15:45.537 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:45.537 rtt min/avg/max/mdev = 0.050/0.050/0.050/0.000 ms 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:15:45.537 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:45.537 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.024 ms 00:15:45.537 00:15:45.537 --- 10.0.0.1 ping statistics --- 00:15:45.537 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:45.537 rtt min/avg/max/mdev = 0.024/0.024/0.024/0.000 ms 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:15:45.537 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:45.537 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.056 ms 00:15:45.537 00:15:45.537 --- 10.0.0.2 ping statistics --- 00:15:45.537 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:45.537 rtt min/avg/max/mdev = 0.056/0.056/0.056/0.000 ms 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@459 -- # return 0 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@724 -- # xtrace_disable 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@507 -- # nvmfpid=71310 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@508 -- # waitforlisten 71310 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@831 -- # '[' -z 71310 ']' 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@836 -- # local max_retries=100 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:45.537 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@840 -- # xtrace_disable 00:15:45.537 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:45.794 [2024-10-07 11:26:27.282798] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:15:45.794 [2024-10-07 11:26:27.282917] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:15:45.794 [2024-10-07 11:26:27.430890] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:46.052 [2024-10-07 11:26:27.575694] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:46.052 [2024-10-07 11:26:27.575754] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:46.052 [2024-10-07 11:26:27.575771] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:46.052 [2024-10-07 11:26:27.575782] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:46.052 [2024-10-07 11:26:27.575792] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:46.052 [2024-10-07 11:26:27.576673] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:15:46.052 [2024-10-07 11:26:27.576726] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 5 00:15:46.052 [2024-10-07 11:26:27.578437] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 6 00:15:46.053 [2024-10-07 11:26:27.578453] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:15:46.053 [2024-10-07 11:26:27.597886] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@864 -- # return 0 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@730 -- # xtrace_disable 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:46.984 [2024-10-07 11:26:28.523474] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:46.984 Malloc0 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:46.984 [2024-10-07 11:26:28.575005] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@24 -- # /home/vagrant/spdk_repo/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@558 -- # config=() 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@558 -- # local subsystem config 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:15:46.984 { 00:15:46.984 "params": { 00:15:46.984 "name": "Nvme$subsystem", 00:15:46.984 "trtype": "$TEST_TRANSPORT", 00:15:46.984 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:46.984 "adrfam": "ipv4", 00:15:46.984 "trsvcid": "$NVMF_PORT", 00:15:46.984 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:46.984 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:46.984 "hdgst": ${hdgst:-false}, 00:15:46.984 "ddgst": ${ddgst:-false} 00:15:46.984 }, 00:15:46.984 "method": "bdev_nvme_attach_controller" 00:15:46.984 } 00:15:46.984 EOF 00:15:46.984 )") 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@580 -- # cat 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@582 -- # jq . 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@583 -- # IFS=, 00:15:46.984 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:15:46.984 "params": { 00:15:46.984 "name": "Nvme1", 00:15:46.984 "trtype": "tcp", 00:15:46.984 "traddr": "10.0.0.3", 00:15:46.984 "adrfam": "ipv4", 00:15:46.984 "trsvcid": "4420", 00:15:46.984 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:46.984 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:46.984 "hdgst": false, 00:15:46.984 "ddgst": false 00:15:46.984 }, 00:15:46.984 "method": "bdev_nvme_attach_controller" 00:15:46.984 }' 00:15:46.984 [2024-10-07 11:26:28.636111] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:15:46.984 [2024-10-07 11:26:28.636210] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid71352 ] 00:15:47.242 [2024-10-07 11:26:28.775382] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:47.242 [2024-10-07 11:26:28.897024] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:15:47.242 [2024-10-07 11:26:28.897109] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:15:47.242 [2024-10-07 11:26:28.897100] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:15:47.242 [2024-10-07 11:26:28.910573] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:15:47.500 I/O targets: 00:15:47.500 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:15:47.500 00:15:47.500 00:15:47.500 CUnit - A unit testing framework for C - Version 2.1-3 00:15:47.500 http://cunit.sourceforge.net/ 00:15:47.500 00:15:47.500 00:15:47.500 Suite: bdevio tests on: Nvme1n1 00:15:47.500 Test: blockdev write read block ...passed 00:15:47.500 Test: blockdev write zeroes read block ...passed 00:15:47.500 Test: blockdev write zeroes read no split ...passed 00:15:47.500 Test: blockdev write zeroes read split ...passed 00:15:47.500 Test: blockdev write zeroes read split partial ...passed 00:15:47.500 Test: blockdev reset ...[2024-10-07 11:26:29.183503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:15:47.500 [2024-10-07 11:26:29.183686] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1264720 (9): Bad file descriptor 00:15:47.500 [2024-10-07 11:26:29.194786] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:15:47.500 passed 00:15:47.500 Test: blockdev write read 8 blocks ...passed 00:15:47.500 Test: blockdev write read size > 128k ...passed 00:15:47.500 Test: blockdev write read invalid size ...passed 00:15:47.500 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:15:47.500 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:15:47.500 Test: blockdev write read max offset ...passed 00:15:47.500 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:15:47.500 Test: blockdev writev readv 8 blocks ...passed 00:15:47.500 Test: blockdev writev readv 30 x 1block ...passed 00:15:47.500 Test: blockdev writev readv block ...passed 00:15:47.500 Test: blockdev writev readv size > 128k ...passed 00:15:47.500 Test: blockdev writev readv size > 128k in two iovs ...passed 00:15:47.500 Test: blockdev comparev and writev ...[2024-10-07 11:26:29.203720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:47.500 [2024-10-07 11:26:29.203988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:15:47.500 [2024-10-07 11:26:29.204250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:47.500 [2024-10-07 11:26:29.204494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:15:47.500 [2024-10-07 11:26:29.204949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:47.500 [2024-10-07 11:26:29.205189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:15:47.500 [2024-10-07 11:26:29.205278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:47.500 [2024-10-07 11:26:29.205512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:15:47.500 [2024-10-07 11:26:29.206123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:47.500 [2024-10-07 11:26:29.206429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:15:47.500 [2024-10-07 11:26:29.206524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:47.500 [2024-10-07 11:26:29.206600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:15:47.500 [2024-10-07 11:26:29.207137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:47.500 [2024-10-07 11:26:29.207242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:15:47.500 [2024-10-07 11:26:29.207337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:47.500 [2024-10-07 11:26:29.207418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:15:47.500 passed 00:15:47.500 Test: blockdev nvme passthru rw ...passed 00:15:47.500 Test: blockdev nvme passthru vendor specific ...[2024-10-07 11:26:29.208337] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:15:47.500 [2024-10-07 11:26:29.208465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:15:47.500 [2024-10-07 11:26:29.208686] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:15:47.500 [2024-10-07 11:26:29.208793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:15:47.500 [2024-10-07 11:26:29.208987] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:15:47.500 [2024-10-07 11:26:29.209111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:15:47.500 [2024-10-07 11:26:29.209334] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:15:47.500 [2024-10-07 11:26:29.209453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:15:47.500 passed 00:15:47.764 Test: blockdev nvme admin passthru ...passed 00:15:47.764 Test: blockdev copy ...passed 00:15:47.764 00:15:47.764 Run Summary: Type Total Ran Passed Failed Inactive 00:15:47.764 suites 1 1 n/a 0 0 00:15:47.764 tests 23 23 23 0 0 00:15:47.764 asserts 152 152 152 0 n/a 00:15:47.764 00:15:47.764 Elapsed time = 0.217 seconds 00:15:48.033 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:48.033 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:48.033 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:48.033 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:48.033 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:15:48.033 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@30 -- # nvmftestfini 00:15:48.033 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@514 -- # nvmfcleanup 00:15:48.033 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@121 -- # sync 00:15:48.033 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:15:48.033 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@124 -- # set +e 00:15:48.033 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@125 -- # for i in {1..20} 00:15:48.033 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:15:48.033 rmmod nvme_tcp 00:15:48.033 rmmod nvme_fabrics 00:15:48.033 rmmod nvme_keyring 00:15:48.290 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:15:48.290 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@128 -- # set -e 00:15:48.290 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@129 -- # return 0 00:15:48.290 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@515 -- # '[' -n 71310 ']' 00:15:48.290 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@516 -- # killprocess 71310 00:15:48.290 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@950 -- # '[' -z 71310 ']' 00:15:48.290 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@954 -- # kill -0 71310 00:15:48.290 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@955 -- # uname 00:15:48.290 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:15:48.290 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 71310 00:15:48.290 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@956 -- # process_name=reactor_3 00:15:48.290 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@960 -- # '[' reactor_3 = sudo ']' 00:15:48.290 killing process with pid 71310 00:15:48.290 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@968 -- # echo 'killing process with pid 71310' 00:15:48.290 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@969 -- # kill 71310 00:15:48.290 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@974 -- # wait 71310 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@297 -- # iptr 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@789 -- # iptables-save 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@789 -- # iptables-restore 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@246 -- # remove_spdk_ns 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@300 -- # return 0 00:15:48.856 00:15:48.856 real 0m3.842s 00:15:48.856 user 0m12.255s 00:15:48.856 sys 0m1.535s 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1126 -- # xtrace_disable 00:15:48.856 ************************************ 00:15:48.856 END TEST nvmf_bdevio_no_huge 00:15:48.856 ************************************ 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@41 -- # run_test nvmf_tls /home/vagrant/spdk_repo/spdk/test/nvmf/target/tls.sh --transport=tcp 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:15:48.856 ************************************ 00:15:48.856 START TEST nvmf_tls 00:15:48.856 ************************************ 00:15:48.856 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/tls.sh --transport=tcp 00:15:49.114 * Looking for test storage... 00:15:49.114 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1681 -- # lcov --version 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@333 -- # local ver1 ver1_l 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@334 -- # local ver2 ver2_l 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@336 -- # IFS=.-: 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@336 -- # read -ra ver1 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@337 -- # IFS=.-: 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@337 -- # read -ra ver2 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@338 -- # local 'op=<' 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@340 -- # ver1_l=2 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@341 -- # ver2_l=1 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@344 -- # case "$op" in 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@345 -- # : 1 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@364 -- # (( v = 0 )) 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@365 -- # decimal 1 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@353 -- # local d=1 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@355 -- # echo 1 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@365 -- # ver1[v]=1 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@366 -- # decimal 2 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@353 -- # local d=2 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@355 -- # echo 2 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@366 -- # ver2[v]=2 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@368 -- # return 0 00:15:49.114 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:15:49.115 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:49.115 --rc genhtml_branch_coverage=1 00:15:49.115 --rc genhtml_function_coverage=1 00:15:49.115 --rc genhtml_legend=1 00:15:49.115 --rc geninfo_all_blocks=1 00:15:49.115 --rc geninfo_unexecuted_blocks=1 00:15:49.115 00:15:49.115 ' 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:15:49.115 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:49.115 --rc genhtml_branch_coverage=1 00:15:49.115 --rc genhtml_function_coverage=1 00:15:49.115 --rc genhtml_legend=1 00:15:49.115 --rc geninfo_all_blocks=1 00:15:49.115 --rc geninfo_unexecuted_blocks=1 00:15:49.115 00:15:49.115 ' 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:15:49.115 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:49.115 --rc genhtml_branch_coverage=1 00:15:49.115 --rc genhtml_function_coverage=1 00:15:49.115 --rc genhtml_legend=1 00:15:49.115 --rc geninfo_all_blocks=1 00:15:49.115 --rc geninfo_unexecuted_blocks=1 00:15:49.115 00:15:49.115 ' 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:15:49.115 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:49.115 --rc genhtml_branch_coverage=1 00:15:49.115 --rc genhtml_function_coverage=1 00:15:49.115 --rc genhtml_legend=1 00:15:49.115 --rc geninfo_all_blocks=1 00:15:49.115 --rc geninfo_unexecuted_blocks=1 00:15:49.115 00:15:49.115 ' 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@7 -- # uname -s 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@15 -- # shopt -s extglob 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@5 -- # export PATH 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@51 -- # : 0 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:15:49.115 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@55 -- # have_pci_nics=0 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@12 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@63 -- # nvmftestinit 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@474 -- # prepare_net_devs 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@436 -- # local -g is_hw=no 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@438 -- # remove_spdk_ns 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@458 -- # nvmf_veth_init 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:15:49.115 Cannot find device "nvmf_init_br" 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@162 -- # true 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:15:49.115 Cannot find device "nvmf_init_br2" 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@163 -- # true 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:15:49.115 Cannot find device "nvmf_tgt_br" 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@164 -- # true 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:15:49.115 Cannot find device "nvmf_tgt_br2" 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@165 -- # true 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:15:49.115 Cannot find device "nvmf_init_br" 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@166 -- # true 00:15:49.115 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:15:49.115 Cannot find device "nvmf_init_br2" 00:15:49.116 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@167 -- # true 00:15:49.116 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:15:49.374 Cannot find device "nvmf_tgt_br" 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@168 -- # true 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:15:49.374 Cannot find device "nvmf_tgt_br2" 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@169 -- # true 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:15:49.374 Cannot find device "nvmf_br" 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@170 -- # true 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:15:49.374 Cannot find device "nvmf_init_if" 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@171 -- # true 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:15:49.374 Cannot find device "nvmf_init_if2" 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@172 -- # true 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:15:49.374 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@173 -- # true 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:15:49.374 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@174 -- # true 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:15:49.374 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:15:49.374 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:15:49.374 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:15:49.374 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:15:49.374 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:15:49.374 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:15:49.374 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:15:49.374 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:15:49.374 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:15:49.374 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:15:49.374 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:15:49.374 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:15:49.374 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:15:49.374 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:15:49.374 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:15:49.374 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:15:49.632 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:15:49.632 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:15:49.632 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:15:49.632 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:15:49.632 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:15:49.632 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:15:49.632 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:15:49.632 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:15:49.632 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:15:49.632 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:15:49.632 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:15:49.632 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:15:49.632 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.097 ms 00:15:49.632 00:15:49.632 --- 10.0.0.3 ping statistics --- 00:15:49.632 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:49.632 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:15:49.633 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:15:49.633 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.059 ms 00:15:49.633 00:15:49.633 --- 10.0.0.4 ping statistics --- 00:15:49.633 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:49.633 rtt min/avg/max/mdev = 0.059/0.059/0.059/0.000 ms 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:15:49.633 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:49.633 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.022 ms 00:15:49.633 00:15:49.633 --- 10.0.0.1 ping statistics --- 00:15:49.633 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:49.633 rtt min/avg/max/mdev = 0.022/0.022/0.022/0.000 ms 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:15:49.633 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:49.633 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.062 ms 00:15:49.633 00:15:49.633 --- 10.0.0.2 ping statistics --- 00:15:49.633 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:49.633 rtt min/avg/max/mdev = 0.062/0.062/0.062/0.000 ms 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@459 -- # return 0 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@64 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=71587 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 71587 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 71587 ']' 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:15:49.633 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:15:49.633 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:15:49.633 [2024-10-07 11:26:31.271480] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:15:49.633 [2024-10-07 11:26:31.271588] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:49.890 [2024-10-07 11:26:31.408909] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:49.890 [2024-10-07 11:26:31.493507] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:49.890 [2024-10-07 11:26:31.493577] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:49.890 [2024-10-07 11:26:31.493597] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:49.890 [2024-10-07 11:26:31.493612] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:49.890 [2024-10-07 11:26:31.493622] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:49.890 [2024-10-07 11:26:31.493976] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:15:50.148 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:15:50.148 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:15:50.148 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:15:50.148 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:15:50.148 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:15:50.148 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:50.148 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@66 -- # '[' tcp '!=' tcp ']' 00:15:50.148 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@71 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:15:50.405 true 00:15:50.405 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@74 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:15:50.405 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@74 -- # jq -r .tls_version 00:15:50.972 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@74 -- # version=0 00:15:50.972 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@75 -- # [[ 0 != \0 ]] 00:15:50.972 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@81 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:15:51.230 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@82 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:15:51.230 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@82 -- # jq -r .tls_version 00:15:51.512 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@82 -- # version=13 00:15:51.512 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@83 -- # [[ 13 != \1\3 ]] 00:15:51.512 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@89 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:15:52.078 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@90 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:15:52.078 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@90 -- # jq -r .tls_version 00:15:52.335 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@90 -- # version=7 00:15:52.335 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@91 -- # [[ 7 != \7 ]] 00:15:52.335 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@97 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:15:52.335 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@97 -- # jq -r .enable_ktls 00:15:52.901 11:26:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@97 -- # ktls=false 00:15:52.901 11:26:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@98 -- # [[ false != \f\a\l\s\e ]] 00:15:52.901 11:26:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@104 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:15:53.159 11:26:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@105 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:15:53.159 11:26:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@105 -- # jq -r .enable_ktls 00:15:53.725 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@105 -- # ktls=true 00:15:53.725 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@106 -- # [[ true != \t\r\u\e ]] 00:15:53.725 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@112 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:15:53.983 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@113 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:15:53.983 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@113 -- # jq -r .enable_ktls 00:15:54.240 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@113 -- # ktls=false 00:15:54.240 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@114 -- # [[ false != \f\a\l\s\e ]] 00:15:54.240 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@119 -- # format_interchange_psk 00112233445566778899aabbccddeeff 1 00:15:54.240 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@741 -- # format_key NVMeTLSkey-1 00112233445566778899aabbccddeeff 1 00:15:54.240 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@728 -- # local prefix key digest 00:15:54.240 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # prefix=NVMeTLSkey-1 00:15:54.240 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # key=00112233445566778899aabbccddeeff 00:15:54.240 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # digest=1 00:15:54.240 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@731 -- # python - 00:15:54.240 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@119 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:15:54.240 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@120 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 1 00:15:54.240 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@741 -- # format_key NVMeTLSkey-1 ffeeddccbbaa99887766554433221100 1 00:15:54.240 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@728 -- # local prefix key digest 00:15:54.240 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # prefix=NVMeTLSkey-1 00:15:54.240 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # key=ffeeddccbbaa99887766554433221100 00:15:54.241 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # digest=1 00:15:54.241 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@731 -- # python - 00:15:54.241 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@120 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:15:54.241 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@122 -- # mktemp 00:15:54.241 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@122 -- # key_path=/tmp/tmp.KuRNlgGtwf 00:15:54.241 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@123 -- # mktemp 00:15:54.241 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@123 -- # key_2_path=/tmp/tmp.VsRwRXAbOf 00:15:54.241 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@125 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:15:54.241 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@126 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:15:54.241 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@128 -- # chmod 0600 /tmp/tmp.KuRNlgGtwf 00:15:54.241 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@129 -- # chmod 0600 /tmp/tmp.VsRwRXAbOf 00:15:54.498 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@131 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:15:54.756 11:26:36 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@132 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py framework_start_init 00:15:55.321 [2024-10-07 11:26:36.812163] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:15:55.321 11:26:36 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@134 -- # setup_nvmf_tgt /tmp/tmp.KuRNlgGtwf 00:15:55.321 11:26:36 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.KuRNlgGtwf 00:15:55.321 11:26:36 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:15:55.579 [2024-10-07 11:26:37.177808] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:55.579 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:15:56.144 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -k 00:15:56.402 [2024-10-07 11:26:37.983763] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:15:56.402 [2024-10-07 11:26:37.984012] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:15:56.402 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:15:56.966 malloc0 00:15:56.966 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:57.224 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.KuRNlgGtwf 00:15:57.482 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:15:57.740 11:26:39 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@138 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /tmp/tmp.KuRNlgGtwf 00:16:09.988 Initializing NVMe Controllers 00:16:09.988 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:16:09.988 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:09.988 Initialization complete. Launching workers. 00:16:09.988 ======================================================== 00:16:09.988 Latency(us) 00:16:09.988 Device Information : IOPS MiB/s Average min max 00:16:09.988 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8051.07 31.45 7950.87 1401.83 17225.75 00:16:09.988 ======================================================== 00:16:09.988 Total : 8051.07 31.45 7950.87 1401.83 17225.75 00:16:09.988 00:16:09.988 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@144 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.KuRNlgGtwf 00:16:09.988 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:09.988 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:16:09.988 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:16:09.988 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.KuRNlgGtwf 00:16:09.988 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:09.988 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=71845 00:16:09.988 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:09.988 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:09.988 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 71845 /var/tmp/bdevperf.sock 00:16:09.988 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 71845 ']' 00:16:09.988 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:09.988 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:09.988 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:09.988 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:09.988 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:09.988 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:09.988 [2024-10-07 11:26:49.638228] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:09.988 [2024-10-07 11:26:49.638365] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid71845 ] 00:16:09.988 [2024-10-07 11:26:49.778888] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:09.988 [2024-10-07 11:26:49.867800] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:16:09.988 [2024-10-07 11:26:49.906937] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:16:09.988 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:09.988 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:09.988 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.KuRNlgGtwf 00:16:09.988 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:16:09.988 [2024-10-07 11:26:50.496103] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:09.988 TLSTESTn1 00:16:09.988 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@42 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:16:09.988 Running I/O for 10 seconds... 00:16:11.197 3596.00 IOPS, 14.05 MiB/s [2024-10-07T11:26:53.892Z] 3683.50 IOPS, 14.39 MiB/s [2024-10-07T11:26:54.826Z] 3807.00 IOPS, 14.87 MiB/s [2024-10-07T11:26:55.759Z] 3844.50 IOPS, 15.02 MiB/s [2024-10-07T11:26:57.131Z] 3870.40 IOPS, 15.12 MiB/s [2024-10-07T11:26:58.073Z] 3882.17 IOPS, 15.16 MiB/s [2024-10-07T11:26:59.005Z] 3876.00 IOPS, 15.14 MiB/s [2024-10-07T11:26:59.936Z] 3875.62 IOPS, 15.14 MiB/s [2024-10-07T11:27:00.869Z] 3883.56 IOPS, 15.17 MiB/s [2024-10-07T11:27:00.869Z] 3892.10 IOPS, 15.20 MiB/s 00:16:19.158 Latency(us) 00:16:19.158 [2024-10-07T11:27:00.869Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:19.158 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:16:19.158 Verification LBA range: start 0x0 length 0x2000 00:16:19.158 TLSTESTn1 : 10.02 3897.74 15.23 0.00 0.00 32777.25 6970.65 36223.53 00:16:19.158 [2024-10-07T11:27:00.869Z] =================================================================================================================== 00:16:19.158 [2024-10-07T11:27:00.869Z] Total : 3897.74 15.23 0.00 0.00 32777.25 6970.65 36223.53 00:16:19.158 { 00:16:19.158 "results": [ 00:16:19.158 { 00:16:19.158 "job": "TLSTESTn1", 00:16:19.158 "core_mask": "0x4", 00:16:19.158 "workload": "verify", 00:16:19.158 "status": "finished", 00:16:19.158 "verify_range": { 00:16:19.158 "start": 0, 00:16:19.158 "length": 8192 00:16:19.158 }, 00:16:19.158 "queue_depth": 128, 00:16:19.158 "io_size": 4096, 00:16:19.158 "runtime": 10.017592, 00:16:19.158 "iops": 3897.743090355447, 00:16:19.158 "mibps": 15.225558946700964, 00:16:19.158 "io_failed": 0, 00:16:19.158 "io_timeout": 0, 00:16:19.158 "avg_latency_us": 32777.24891535857, 00:16:19.158 "min_latency_us": 6970.647272727273, 00:16:19.158 "max_latency_us": 36223.534545454546 00:16:19.158 } 00:16:19.158 ], 00:16:19.158 "core_count": 1 00:16:19.158 } 00:16:19.158 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@45 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:19.158 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@46 -- # killprocess 71845 00:16:19.158 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 71845 ']' 00:16:19.158 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 71845 00:16:19.158 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:19.158 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:19.158 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 71845 00:16:19.158 killing process with pid 71845 00:16:19.158 Received shutdown signal, test time was about 10.000000 seconds 00:16:19.158 00:16:19.158 Latency(us) 00:16:19.158 [2024-10-07T11:27:00.869Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:19.158 [2024-10-07T11:27:00.869Z] =================================================================================================================== 00:16:19.158 [2024-10-07T11:27:00.869Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:19.159 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:16:19.159 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:16:19.159 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 71845' 00:16:19.159 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 71845 00:16:19.159 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 71845 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@147 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.VsRwRXAbOf 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.VsRwRXAbOf 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.VsRwRXAbOf 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.VsRwRXAbOf 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:19.417 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=71980 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 71980 /var/tmp/bdevperf.sock 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 71980 ']' 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:19.417 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:19.417 [2024-10-07 11:27:01.009606] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:19.417 [2024-10-07 11:27:01.009747] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid71980 ] 00:16:19.675 [2024-10-07 11:27:01.148861] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:19.675 [2024-10-07 11:27:01.237568] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:16:19.675 [2024-10-07 11:27:01.272027] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:16:19.675 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:19.675 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:19.675 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.VsRwRXAbOf 00:16:19.933 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:16:20.499 [2024-10-07 11:27:01.996193] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:20.499 [2024-10-07 11:27:02.005708] /home/vagrant/spdk_repo/spdk/include/spdk_internal/nvme_tcp.h: 421:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:16:20.499 [2024-10-07 11:27:02.005957] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1914090 (107): Transport endpoint is not connected 00:16:20.499 [2024-10-07 11:27:02.006944] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1914090 (9): Bad file descriptor 00:16:20.499 [2024-10-07 11:27:02.007941] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:16:20.499 [2024-10-07 11:27:02.007979] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.3 00:16:20.499 [2024-10-07 11:27:02.007993] nvme.c: 884:nvme_dummy_attach_fail_cb: *ERROR*: Failed to attach nvme ctrlr: trtype=TCP adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 subnqn=nqn.2016-06.io.spdk:cnode1, Operation not permitted 00:16:20.499 [2024-10-07 11:27:02.008005] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:16:20.499 request: 00:16:20.499 { 00:16:20.499 "name": "TLSTEST", 00:16:20.499 "trtype": "tcp", 00:16:20.499 "traddr": "10.0.0.3", 00:16:20.499 "adrfam": "ipv4", 00:16:20.499 "trsvcid": "4420", 00:16:20.499 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:20.499 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:20.499 "prchk_reftag": false, 00:16:20.499 "prchk_guard": false, 00:16:20.499 "hdgst": false, 00:16:20.499 "ddgst": false, 00:16:20.499 "psk": "key0", 00:16:20.499 "allow_unrecognized_csi": false, 00:16:20.499 "method": "bdev_nvme_attach_controller", 00:16:20.499 "req_id": 1 00:16:20.499 } 00:16:20.499 Got JSON-RPC error response 00:16:20.499 response: 00:16:20.499 { 00:16:20.499 "code": -5, 00:16:20.499 "message": "Input/output error" 00:16:20.499 } 00:16:20.499 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 71980 00:16:20.499 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 71980 ']' 00:16:20.499 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 71980 00:16:20.500 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:20.500 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:20.500 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 71980 00:16:20.500 killing process with pid 71980 00:16:20.500 Received shutdown signal, test time was about 10.000000 seconds 00:16:20.500 00:16:20.500 Latency(us) 00:16:20.500 [2024-10-07T11:27:02.211Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:20.500 [2024-10-07T11:27:02.211Z] =================================================================================================================== 00:16:20.500 [2024-10-07T11:27:02.211Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:20.500 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:16:20.500 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:16:20.500 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 71980' 00:16:20.500 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 71980 00:16:20.500 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 71980 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@150 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /tmp/tmp.KuRNlgGtwf 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /tmp/tmp.KuRNlgGtwf 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /tmp/tmp.KuRNlgGtwf 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.KuRNlgGtwf 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=72001 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 72001 /var/tmp/bdevperf.sock 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 72001 ']' 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:20.757 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:20.757 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:20.757 [2024-10-07 11:27:02.316467] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:20.757 [2024-10-07 11:27:02.316605] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid72001 ] 00:16:20.757 [2024-10-07 11:27:02.455434] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:21.014 [2024-10-07 11:27:02.515756] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:16:21.014 [2024-10-07 11:27:02.546061] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:16:21.014 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:21.014 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:21.014 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.KuRNlgGtwf 00:16:21.580 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk key0 00:16:21.838 [2024-10-07 11:27:03.493941] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:21.838 [2024-10-07 11:27:03.505800] tcp.c: 969:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:16:21.838 [2024-10-07 11:27:03.505857] posix.c: 574:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:16:21.838 [2024-10-07 11:27:03.505925] /home/vagrant/spdk_repo/spdk/include/spdk_internal/nvme_tcp.h: 421:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:16:21.838 [2024-10-07 11:27:03.506586] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20e0090 (107): Transport endpoint is not connected 00:16:21.838 [2024-10-07 11:27:03.507573] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20e0090 (9): Bad file descriptor 00:16:21.838 [2024-10-07 11:27:03.508567] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:16:21.838 [2024-10-07 11:27:03.508591] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.3 00:16:21.838 [2024-10-07 11:27:03.508603] nvme.c: 884:nvme_dummy_attach_fail_cb: *ERROR*: Failed to attach nvme ctrlr: trtype=TCP adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 subnqn=nqn.2016-06.io.spdk:cnode1, Operation not permitted 00:16:21.838 [2024-10-07 11:27:03.508615] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:16:21.838 request: 00:16:21.838 { 00:16:21.838 "name": "TLSTEST", 00:16:21.838 "trtype": "tcp", 00:16:21.838 "traddr": "10.0.0.3", 00:16:21.838 "adrfam": "ipv4", 00:16:21.838 "trsvcid": "4420", 00:16:21.838 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:21.838 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:16:21.838 "prchk_reftag": false, 00:16:21.838 "prchk_guard": false, 00:16:21.838 "hdgst": false, 00:16:21.838 "ddgst": false, 00:16:21.838 "psk": "key0", 00:16:21.838 "allow_unrecognized_csi": false, 00:16:21.838 "method": "bdev_nvme_attach_controller", 00:16:21.838 "req_id": 1 00:16:21.838 } 00:16:21.838 Got JSON-RPC error response 00:16:21.838 response: 00:16:21.838 { 00:16:21.838 "code": -5, 00:16:21.838 "message": "Input/output error" 00:16:21.838 } 00:16:21.838 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 72001 00:16:21.838 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 72001 ']' 00:16:21.838 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 72001 00:16:21.838 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:21.838 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:21.838 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72001 00:16:22.095 killing process with pid 72001 00:16:22.095 Received shutdown signal, test time was about 10.000000 seconds 00:16:22.095 00:16:22.095 Latency(us) 00:16:22.095 [2024-10-07T11:27:03.806Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:22.095 [2024-10-07T11:27:03.806Z] =================================================================================================================== 00:16:22.095 [2024-10-07T11:27:03.806Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:22.095 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:16:22.095 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:16:22.095 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72001' 00:16:22.095 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 72001 00:16:22.095 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 72001 00:16:22.095 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:16:22.095 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:16:22.095 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:16:22.095 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:16:22.095 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:16:22.095 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@153 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /tmp/tmp.KuRNlgGtwf 00:16:22.095 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:16:22.095 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /tmp/tmp.KuRNlgGtwf 00:16:22.095 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:16:22.095 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:22.096 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:16:22.096 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:22.096 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:22.096 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /tmp/tmp.KuRNlgGtwf 00:16:22.096 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:22.096 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:16:22.096 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:16:22.096 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.KuRNlgGtwf 00:16:22.096 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:22.096 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=72029 00:16:22.096 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:22.096 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:22.096 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 72029 /var/tmp/bdevperf.sock 00:16:22.096 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 72029 ']' 00:16:22.096 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:22.096 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:22.096 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:22.096 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:22.096 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:22.353 [2024-10-07 11:27:03.809644] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:22.353 [2024-10-07 11:27:03.810027] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid72029 ] 00:16:22.353 [2024-10-07 11:27:03.960662] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:22.353 [2024-10-07 11:27:04.052340] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:16:22.610 [2024-10-07 11:27:04.088846] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:16:22.610 11:27:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:22.610 11:27:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:22.610 11:27:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.KuRNlgGtwf 00:16:22.868 11:27:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk key0 00:16:23.125 [2024-10-07 11:27:04.791775] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:23.125 [2024-10-07 11:27:04.796958] tcp.c: 969:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:16:23.125 [2024-10-07 11:27:04.797159] posix.c: 574:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:16:23.125 [2024-10-07 11:27:04.797222] /home/vagrant/spdk_repo/spdk/include/spdk_internal/nvme_tcp.h: 421:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:16:23.125 [2024-10-07 11:27:04.797687] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bff090 (107): Transport endpoint is not connected 00:16:23.125 [2024-10-07 11:27:04.798673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bff090 (9): Bad file descriptor 00:16:23.125 [2024-10-07 11:27:04.799679] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:16:23.125 [2024-10-07 11:27:04.799698] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.3 00:16:23.125 [2024-10-07 11:27:04.799709] nvme.c: 884:nvme_dummy_attach_fail_cb: *ERROR*: Failed to attach nvme ctrlr: trtype=TCP adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 subnqn=nqn.2016-06.io.spdk:cnode2, Operation not permitted 00:16:23.125 [2024-10-07 11:27:04.799721] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:16:23.125 request: 00:16:23.125 { 00:16:23.125 "name": "TLSTEST", 00:16:23.125 "trtype": "tcp", 00:16:23.125 "traddr": "10.0.0.3", 00:16:23.125 "adrfam": "ipv4", 00:16:23.125 "trsvcid": "4420", 00:16:23.125 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:16:23.125 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:23.125 "prchk_reftag": false, 00:16:23.125 "prchk_guard": false, 00:16:23.125 "hdgst": false, 00:16:23.125 "ddgst": false, 00:16:23.125 "psk": "key0", 00:16:23.125 "allow_unrecognized_csi": false, 00:16:23.125 "method": "bdev_nvme_attach_controller", 00:16:23.125 "req_id": 1 00:16:23.125 } 00:16:23.125 Got JSON-RPC error response 00:16:23.125 response: 00:16:23.125 { 00:16:23.125 "code": -5, 00:16:23.125 "message": "Input/output error" 00:16:23.125 } 00:16:23.125 11:27:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 72029 00:16:23.125 11:27:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 72029 ']' 00:16:23.125 11:27:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 72029 00:16:23.125 11:27:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:23.125 11:27:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:23.125 11:27:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72029 00:16:23.384 killing process with pid 72029 00:16:23.384 Received shutdown signal, test time was about 10.000000 seconds 00:16:23.384 00:16:23.384 Latency(us) 00:16:23.384 [2024-10-07T11:27:05.095Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:23.384 [2024-10-07T11:27:05.095Z] =================================================================================================================== 00:16:23.384 [2024-10-07T11:27:05.095Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:23.384 11:27:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:16:23.384 11:27:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:16:23.384 11:27:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72029' 00:16:23.384 11:27:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 72029 00:16:23.384 11:27:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 72029 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@156 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk= 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=72062 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 72062 /var/tmp/bdevperf.sock 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 72062 ']' 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:23.384 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:23.384 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:23.642 [2024-10-07 11:27:05.093920] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:23.642 [2024-10-07 11:27:05.094043] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid72062 ] 00:16:23.642 [2024-10-07 11:27:05.234201] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:23.642 [2024-10-07 11:27:05.321861] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:16:23.907 [2024-10-07 11:27:05.358051] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:16:23.907 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:23.907 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:23.907 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 '' 00:16:24.165 [2024-10-07 11:27:05.774574] keyring.c: 24:keyring_file_check_path: *ERROR*: Non-absolute paths are not allowed: 00:16:24.165 [2024-10-07 11:27:05.774842] keyring.c: 126:spdk_keyring_add_key: *ERROR*: Failed to add key 'key0' to the keyring 00:16:24.165 request: 00:16:24.165 { 00:16:24.165 "name": "key0", 00:16:24.165 "path": "", 00:16:24.165 "method": "keyring_file_add_key", 00:16:24.165 "req_id": 1 00:16:24.165 } 00:16:24.165 Got JSON-RPC error response 00:16:24.165 response: 00:16:24.165 { 00:16:24.165 "code": -1, 00:16:24.165 "message": "Operation not permitted" 00:16:24.165 } 00:16:24.165 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:16:24.423 [2024-10-07 11:27:06.066757] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:24.423 [2024-10-07 11:27:06.067073] bdev_nvme.c:6391:spdk_bdev_nvme_create: *ERROR*: Could not load PSK: key0 00:16:24.423 request: 00:16:24.423 { 00:16:24.423 "name": "TLSTEST", 00:16:24.423 "trtype": "tcp", 00:16:24.423 "traddr": "10.0.0.3", 00:16:24.423 "adrfam": "ipv4", 00:16:24.423 "trsvcid": "4420", 00:16:24.423 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:24.423 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:24.423 "prchk_reftag": false, 00:16:24.423 "prchk_guard": false, 00:16:24.423 "hdgst": false, 00:16:24.423 "ddgst": false, 00:16:24.423 "psk": "key0", 00:16:24.423 "allow_unrecognized_csi": false, 00:16:24.423 "method": "bdev_nvme_attach_controller", 00:16:24.423 "req_id": 1 00:16:24.423 } 00:16:24.423 Got JSON-RPC error response 00:16:24.423 response: 00:16:24.423 { 00:16:24.423 "code": -126, 00:16:24.423 "message": "Required key not available" 00:16:24.423 } 00:16:24.423 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 72062 00:16:24.423 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 72062 ']' 00:16:24.423 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 72062 00:16:24.423 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:24.423 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:24.423 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72062 00:16:24.423 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:16:24.423 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:16:24.423 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72062' 00:16:24.423 killing process with pid 72062 00:16:24.423 Received shutdown signal, test time was about 10.000000 seconds 00:16:24.423 00:16:24.423 Latency(us) 00:16:24.423 [2024-10-07T11:27:06.134Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:24.423 [2024-10-07T11:27:06.134Z] =================================================================================================================== 00:16:24.423 [2024-10-07T11:27:06.134Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:24.423 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 72062 00:16:24.423 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 72062 00:16:24.681 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:16:24.681 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:16:24.681 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:16:24.681 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:16:24.681 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:16:24.681 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@159 -- # killprocess 71587 00:16:24.681 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 71587 ']' 00:16:24.681 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 71587 00:16:24.681 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:24.682 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:24.682 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 71587 00:16:24.682 killing process with pid 71587 00:16:24.682 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:16:24.682 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:16:24.682 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 71587' 00:16:24.682 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 71587 00:16:24.682 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 71587 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@160 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 2 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@741 -- # format_key NVMeTLSkey-1 00112233445566778899aabbccddeeff0011223344556677 2 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@728 -- # local prefix key digest 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # prefix=NVMeTLSkey-1 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # digest=2 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@731 -- # python - 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@160 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@161 -- # mktemp 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@161 -- # key_long_path=/tmp/tmp.IF1CqfyxzF 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@162 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@163 -- # chmod 0600 /tmp/tmp.IF1CqfyxzF 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@164 -- # nvmfappstart -m 0x2 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:24.939 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=72101 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 72101 00:16:24.939 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 72101 ']' 00:16:24.940 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:24.940 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:24.940 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:24.940 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:24.940 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:24.940 [2024-10-07 11:27:06.615209] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:24.940 [2024-10-07 11:27:06.615514] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:25.197 [2024-10-07 11:27:06.747195] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:25.197 [2024-10-07 11:27:06.832610] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:25.197 [2024-10-07 11:27:06.832691] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:25.197 [2024-10-07 11:27:06.832713] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:25.197 [2024-10-07 11:27:06.832728] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:25.197 [2024-10-07 11:27:06.832740] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:25.197 [2024-10-07 11:27:06.833141] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:16:25.197 [2024-10-07 11:27:06.868061] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:16:26.130 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:26.130 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:26.130 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:16:26.130 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:16:26.130 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:26.387 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:26.387 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@166 -- # setup_nvmf_tgt /tmp/tmp.IF1CqfyxzF 00:16:26.387 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.IF1CqfyxzF 00:16:26.387 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:16:26.644 [2024-10-07 11:27:08.164905] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:26.644 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:16:26.902 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -k 00:16:27.160 [2024-10-07 11:27:08.813047] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:27.160 [2024-10-07 11:27:08.813285] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:16:27.160 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:16:27.417 malloc0 00:16:27.417 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:27.982 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.IF1CqfyxzF 00:16:28.240 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:16:28.805 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:28.805 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@168 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.IF1CqfyxzF 00:16:28.805 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:28.805 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:16:28.805 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:16:28.805 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.IF1CqfyxzF 00:16:28.805 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:28.805 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=72168 00:16:28.805 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:28.805 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 72168 /var/tmp/bdevperf.sock 00:16:28.805 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 72168 ']' 00:16:28.805 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:28.805 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:28.805 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:28.805 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:28.805 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:28.805 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:28.805 [2024-10-07 11:27:10.258033] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:28.805 [2024-10-07 11:27:10.258133] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid72168 ] 00:16:28.805 [2024-10-07 11:27:10.395539] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:28.805 [2024-10-07 11:27:10.483472] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:16:29.063 [2024-10-07 11:27:10.519951] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:16:29.063 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:29.063 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:29.063 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.IF1CqfyxzF 00:16:29.320 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:16:29.577 [2024-10-07 11:27:11.212326] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:29.577 TLSTESTn1 00:16:29.834 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@42 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:16:29.834 Running I/O for 10 seconds... 00:16:31.773 3287.00 IOPS, 12.84 MiB/s [2024-10-07T11:27:14.859Z] 3109.00 IOPS, 12.14 MiB/s [2024-10-07T11:27:15.792Z] 3082.00 IOPS, 12.04 MiB/s [2024-10-07T11:27:16.773Z] 3238.75 IOPS, 12.65 MiB/s [2024-10-07T11:27:17.706Z] 3226.80 IOPS, 12.60 MiB/s [2024-10-07T11:27:18.639Z] 3283.83 IOPS, 12.83 MiB/s [2024-10-07T11:27:19.573Z] 3301.43 IOPS, 12.90 MiB/s [2024-10-07T11:27:20.505Z] 3331.25 IOPS, 13.01 MiB/s [2024-10-07T11:27:21.878Z] 3308.11 IOPS, 12.92 MiB/s [2024-10-07T11:27:21.878Z] 3336.70 IOPS, 13.03 MiB/s 00:16:40.167 Latency(us) 00:16:40.167 [2024-10-07T11:27:21.878Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:40.167 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:16:40.167 Verification LBA range: start 0x0 length 0x2000 00:16:40.167 TLSTESTn1 : 10.04 3336.57 13.03 0.00 0.00 38260.54 9770.82 37653.41 00:16:40.167 [2024-10-07T11:27:21.878Z] =================================================================================================================== 00:16:40.167 [2024-10-07T11:27:21.879Z] Total : 3336.57 13.03 0.00 0.00 38260.54 9770.82 37653.41 00:16:40.168 { 00:16:40.168 "results": [ 00:16:40.168 { 00:16:40.168 "job": "TLSTESTn1", 00:16:40.168 "core_mask": "0x4", 00:16:40.168 "workload": "verify", 00:16:40.168 "status": "finished", 00:16:40.168 "verify_range": { 00:16:40.168 "start": 0, 00:16:40.168 "length": 8192 00:16:40.168 }, 00:16:40.168 "queue_depth": 128, 00:16:40.168 "io_size": 4096, 00:16:40.168 "runtime": 10.03846, 00:16:40.168 "iops": 3336.5675611597794, 00:16:40.168 "mibps": 13.033467035780388, 00:16:40.168 "io_failed": 0, 00:16:40.168 "io_timeout": 0, 00:16:40.168 "avg_latency_us": 38260.54218058051, 00:16:40.168 "min_latency_us": 9770.821818181817, 00:16:40.168 "max_latency_us": 37653.41090909091 00:16:40.168 } 00:16:40.168 ], 00:16:40.168 "core_count": 1 00:16:40.168 } 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@45 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@46 -- # killprocess 72168 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 72168 ']' 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 72168 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72168 00:16:40.168 killing process with pid 72168 00:16:40.168 Received shutdown signal, test time was about 10.000000 seconds 00:16:40.168 00:16:40.168 Latency(us) 00:16:40.168 [2024-10-07T11:27:21.879Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:40.168 [2024-10-07T11:27:21.879Z] =================================================================================================================== 00:16:40.168 [2024-10-07T11:27:21.879Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72168' 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 72168 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 72168 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@171 -- # chmod 0666 /tmp/tmp.IF1CqfyxzF 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@172 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.IF1CqfyxzF 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.IF1CqfyxzF 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.IF1CqfyxzF 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.IF1CqfyxzF 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=72297 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 72297 /var/tmp/bdevperf.sock 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 72297 ']' 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:40.168 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:40.168 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:40.168 [2024-10-07 11:27:21.830167] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:40.168 [2024-10-07 11:27:21.830500] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid72297 ] 00:16:40.426 [2024-10-07 11:27:21.974338] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:40.426 [2024-10-07 11:27:22.043039] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:16:40.426 [2024-10-07 11:27:22.075486] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:16:40.683 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:40.683 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:40.683 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.IF1CqfyxzF 00:16:40.941 [2024-10-07 11:27:22.524149] keyring.c: 36:keyring_file_check_path: *ERROR*: Invalid permissions for key file '/tmp/tmp.IF1CqfyxzF': 0100666 00:16:40.941 [2024-10-07 11:27:22.524487] keyring.c: 126:spdk_keyring_add_key: *ERROR*: Failed to add key 'key0' to the keyring 00:16:40.941 request: 00:16:40.941 { 00:16:40.941 "name": "key0", 00:16:40.941 "path": "/tmp/tmp.IF1CqfyxzF", 00:16:40.941 "method": "keyring_file_add_key", 00:16:40.941 "req_id": 1 00:16:40.941 } 00:16:40.941 Got JSON-RPC error response 00:16:40.941 response: 00:16:40.941 { 00:16:40.941 "code": -1, 00:16:40.941 "message": "Operation not permitted" 00:16:40.941 } 00:16:40.941 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:16:41.508 [2024-10-07 11:27:22.932391] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:41.508 [2024-10-07 11:27:22.932508] bdev_nvme.c:6391:spdk_bdev_nvme_create: *ERROR*: Could not load PSK: key0 00:16:41.508 request: 00:16:41.508 { 00:16:41.508 "name": "TLSTEST", 00:16:41.508 "trtype": "tcp", 00:16:41.508 "traddr": "10.0.0.3", 00:16:41.508 "adrfam": "ipv4", 00:16:41.508 "trsvcid": "4420", 00:16:41.508 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:41.508 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:41.508 "prchk_reftag": false, 00:16:41.508 "prchk_guard": false, 00:16:41.508 "hdgst": false, 00:16:41.508 "ddgst": false, 00:16:41.508 "psk": "key0", 00:16:41.508 "allow_unrecognized_csi": false, 00:16:41.508 "method": "bdev_nvme_attach_controller", 00:16:41.508 "req_id": 1 00:16:41.508 } 00:16:41.508 Got JSON-RPC error response 00:16:41.508 response: 00:16:41.508 { 00:16:41.508 "code": -126, 00:16:41.508 "message": "Required key not available" 00:16:41.508 } 00:16:41.508 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 72297 00:16:41.508 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 72297 ']' 00:16:41.508 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 72297 00:16:41.508 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:41.508 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:41.508 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72297 00:16:41.508 killing process with pid 72297 00:16:41.508 Received shutdown signal, test time was about 10.000000 seconds 00:16:41.508 00:16:41.508 Latency(us) 00:16:41.508 [2024-10-07T11:27:23.219Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:41.508 [2024-10-07T11:27:23.219Z] =================================================================================================================== 00:16:41.508 [2024-10-07T11:27:23.219Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:41.508 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:16:41.508 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:16:41.508 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72297' 00:16:41.508 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 72297 00:16:41.508 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 72297 00:16:41.508 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:16:41.508 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:16:41.508 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:16:41.508 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:16:41.508 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:16:41.508 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@175 -- # killprocess 72101 00:16:41.508 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 72101 ']' 00:16:41.508 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 72101 00:16:41.508 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:41.508 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:41.766 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72101 00:16:41.766 killing process with pid 72101 00:16:41.766 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:16:41.766 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:16:41.766 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72101' 00:16:41.766 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 72101 00:16:41.766 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 72101 00:16:41.766 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@176 -- # nvmfappstart -m 0x2 00:16:41.766 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:16:41.766 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:16:41.766 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:41.766 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:41.766 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=72330 00:16:41.766 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 72330 00:16:41.766 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:41.766 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 72330 ']' 00:16:41.766 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:41.766 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:41.766 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:41.766 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:41.766 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:42.025 [2024-10-07 11:27:23.494980] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:42.025 [2024-10-07 11:27:23.495086] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:42.025 [2024-10-07 11:27:23.629934] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:42.025 [2024-10-07 11:27:23.691967] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:42.025 [2024-10-07 11:27:23.692255] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:42.025 [2024-10-07 11:27:23.692278] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:42.025 [2024-10-07 11:27:23.692287] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:42.025 [2024-10-07 11:27:23.692294] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:42.025 [2024-10-07 11:27:23.692631] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:16:42.025 [2024-10-07 11:27:23.723502] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:16:42.284 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:42.284 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:42.284 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:16:42.284 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:16:42.284 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:42.284 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:42.284 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@178 -- # NOT setup_nvmf_tgt /tmp/tmp.IF1CqfyxzF 00:16:42.284 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:16:42.284 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /tmp/tmp.IF1CqfyxzF 00:16:42.284 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:16:42.284 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:42.284 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:16:42.284 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:42.284 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /tmp/tmp.IF1CqfyxzF 00:16:42.284 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.IF1CqfyxzF 00:16:42.284 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:16:42.542 [2024-10-07 11:27:24.155579] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:42.542 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:16:43.121 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -k 00:16:43.379 [2024-10-07 11:27:24.923700] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:43.379 [2024-10-07 11:27:24.923948] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:16:43.379 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:16:43.637 malloc0 00:16:43.637 11:27:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:44.202 11:27:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.IF1CqfyxzF 00:16:44.459 [2024-10-07 11:27:25.977657] keyring.c: 36:keyring_file_check_path: *ERROR*: Invalid permissions for key file '/tmp/tmp.IF1CqfyxzF': 0100666 00:16:44.459 [2024-10-07 11:27:25.977924] keyring.c: 126:spdk_keyring_add_key: *ERROR*: Failed to add key 'key0' to the keyring 00:16:44.459 request: 00:16:44.459 { 00:16:44.459 "name": "key0", 00:16:44.459 "path": "/tmp/tmp.IF1CqfyxzF", 00:16:44.459 "method": "keyring_file_add_key", 00:16:44.459 "req_id": 1 00:16:44.459 } 00:16:44.459 Got JSON-RPC error response 00:16:44.459 response: 00:16:44.459 { 00:16:44.459 "code": -1, 00:16:44.459 "message": "Operation not permitted" 00:16:44.459 } 00:16:44.459 11:27:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:16:45.026 [2024-10-07 11:27:26.437780] tcp.c:3792:nvmf_tcp_subsystem_add_host: *ERROR*: Key 'key0' does not exist 00:16:45.026 [2024-10-07 11:27:26.437879] subsystem.c:1055:spdk_nvmf_subsystem_add_host_ext: *ERROR*: Unable to add host to TCP transport 00:16:45.026 request: 00:16:45.026 { 00:16:45.026 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:45.026 "host": "nqn.2016-06.io.spdk:host1", 00:16:45.026 "psk": "key0", 00:16:45.026 "method": "nvmf_subsystem_add_host", 00:16:45.026 "req_id": 1 00:16:45.026 } 00:16:45.026 Got JSON-RPC error response 00:16:45.026 response: 00:16:45.026 { 00:16:45.026 "code": -32603, 00:16:45.026 "message": "Internal error" 00:16:45.026 } 00:16:45.026 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:16:45.026 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:16:45.026 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:16:45.026 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:16:45.026 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@181 -- # killprocess 72330 00:16:45.026 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 72330 ']' 00:16:45.026 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 72330 00:16:45.026 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:45.026 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:45.026 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72330 00:16:45.026 killing process with pid 72330 00:16:45.026 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:16:45.026 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:16:45.026 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72330' 00:16:45.026 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 72330 00:16:45.026 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 72330 00:16:45.026 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@182 -- # chmod 0600 /tmp/tmp.IF1CqfyxzF 00:16:45.026 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@185 -- # nvmfappstart -m 0x2 00:16:45.027 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:16:45.027 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:16:45.027 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:45.027 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:45.027 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=72397 00:16:45.027 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:45.027 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 72397 00:16:45.027 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 72397 ']' 00:16:45.027 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:45.027 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:45.027 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:45.027 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:45.027 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:45.027 [2024-10-07 11:27:26.738147] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:45.293 [2024-10-07 11:27:26.738476] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:45.293 [2024-10-07 11:27:26.872163] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:45.293 [2024-10-07 11:27:26.943143] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:45.293 [2024-10-07 11:27:26.943468] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:45.293 [2024-10-07 11:27:26.943676] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:45.293 [2024-10-07 11:27:26.943905] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:45.293 [2024-10-07 11:27:26.944101] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:45.293 [2024-10-07 11:27:26.944500] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:16:45.293 [2024-10-07 11:27:26.976991] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:16:45.550 11:27:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:45.550 11:27:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:45.550 11:27:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:16:45.550 11:27:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:16:45.550 11:27:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:45.550 11:27:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:45.550 11:27:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@186 -- # setup_nvmf_tgt /tmp/tmp.IF1CqfyxzF 00:16:45.550 11:27:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.IF1CqfyxzF 00:16:45.550 11:27:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:16:45.808 [2024-10-07 11:27:27.366838] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:45.808 11:27:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:16:46.066 11:27:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -k 00:16:46.632 [2024-10-07 11:27:28.042952] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:46.632 [2024-10-07 11:27:28.043183] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:16:46.632 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:16:46.888 malloc0 00:16:46.888 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:47.146 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.IF1CqfyxzF 00:16:47.404 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:16:47.662 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@189 -- # bdevperf_pid=72445 00:16:47.662 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@188 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:47.662 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@191 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:47.662 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@192 -- # waitforlisten 72445 /var/tmp/bdevperf.sock 00:16:47.662 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 72445 ']' 00:16:47.662 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:47.662 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:47.662 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:47.662 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:47.662 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:47.662 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:47.920 [2024-10-07 11:27:29.400371] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:47.920 [2024-10-07 11:27:29.400707] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid72445 ] 00:16:47.920 [2024-10-07 11:27:29.539321] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:47.920 [2024-10-07 11:27:29.613294] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:16:48.177 [2024-10-07 11:27:29.645610] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:16:48.177 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:48.177 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:48.177 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@193 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.IF1CqfyxzF 00:16:48.434 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@194 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:16:48.692 [2024-10-07 11:27:30.378855] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:48.950 TLSTESTn1 00:16:48.950 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@198 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py save_config 00:16:49.209 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@198 -- # tgtconf='{ 00:16:49.209 "subsystems": [ 00:16:49.209 { 00:16:49.209 "subsystem": "keyring", 00:16:49.209 "config": [ 00:16:49.209 { 00:16:49.209 "method": "keyring_file_add_key", 00:16:49.209 "params": { 00:16:49.209 "name": "key0", 00:16:49.209 "path": "/tmp/tmp.IF1CqfyxzF" 00:16:49.209 } 00:16:49.209 } 00:16:49.209 ] 00:16:49.209 }, 00:16:49.209 { 00:16:49.209 "subsystem": "iobuf", 00:16:49.209 "config": [ 00:16:49.209 { 00:16:49.209 "method": "iobuf_set_options", 00:16:49.209 "params": { 00:16:49.209 "small_pool_count": 8192, 00:16:49.209 "large_pool_count": 1024, 00:16:49.209 "small_bufsize": 8192, 00:16:49.209 "large_bufsize": 135168 00:16:49.209 } 00:16:49.209 } 00:16:49.209 ] 00:16:49.209 }, 00:16:49.209 { 00:16:49.209 "subsystem": "sock", 00:16:49.209 "config": [ 00:16:49.209 { 00:16:49.209 "method": "sock_set_default_impl", 00:16:49.209 "params": { 00:16:49.209 "impl_name": "uring" 00:16:49.209 } 00:16:49.209 }, 00:16:49.209 { 00:16:49.209 "method": "sock_impl_set_options", 00:16:49.209 "params": { 00:16:49.209 "impl_name": "ssl", 00:16:49.209 "recv_buf_size": 4096, 00:16:49.209 "send_buf_size": 4096, 00:16:49.209 "enable_recv_pipe": true, 00:16:49.209 "enable_quickack": false, 00:16:49.209 "enable_placement_id": 0, 00:16:49.209 "enable_zerocopy_send_server": true, 00:16:49.209 "enable_zerocopy_send_client": false, 00:16:49.209 "zerocopy_threshold": 0, 00:16:49.209 "tls_version": 0, 00:16:49.209 "enable_ktls": false 00:16:49.209 } 00:16:49.209 }, 00:16:49.209 { 00:16:49.209 "method": "sock_impl_set_options", 00:16:49.209 "params": { 00:16:49.209 "impl_name": "posix", 00:16:49.209 "recv_buf_size": 2097152, 00:16:49.209 "send_buf_size": 2097152, 00:16:49.209 "enable_recv_pipe": true, 00:16:49.209 "enable_quickack": false, 00:16:49.209 "enable_placement_id": 0, 00:16:49.209 "enable_zerocopy_send_server": true, 00:16:49.209 "enable_zerocopy_send_client": false, 00:16:49.209 "zerocopy_threshold": 0, 00:16:49.209 "tls_version": 0, 00:16:49.209 "enable_ktls": false 00:16:49.209 } 00:16:49.209 }, 00:16:49.209 { 00:16:49.209 "method": "sock_impl_set_options", 00:16:49.209 "params": { 00:16:49.209 "impl_name": "uring", 00:16:49.209 "recv_buf_size": 2097152, 00:16:49.209 "send_buf_size": 2097152, 00:16:49.209 "enable_recv_pipe": true, 00:16:49.209 "enable_quickack": false, 00:16:49.209 "enable_placement_id": 0, 00:16:49.209 "enable_zerocopy_send_server": false, 00:16:49.209 "enable_zerocopy_send_client": false, 00:16:49.209 "zerocopy_threshold": 0, 00:16:49.209 "tls_version": 0, 00:16:49.209 "enable_ktls": false 00:16:49.209 } 00:16:49.209 } 00:16:49.209 ] 00:16:49.209 }, 00:16:49.209 { 00:16:49.209 "subsystem": "vmd", 00:16:49.209 "config": [] 00:16:49.209 }, 00:16:49.209 { 00:16:49.209 "subsystem": "accel", 00:16:49.209 "config": [ 00:16:49.209 { 00:16:49.209 "method": "accel_set_options", 00:16:49.209 "params": { 00:16:49.209 "small_cache_size": 128, 00:16:49.209 "large_cache_size": 16, 00:16:49.209 "task_count": 2048, 00:16:49.209 "sequence_count": 2048, 00:16:49.209 "buf_count": 2048 00:16:49.209 } 00:16:49.209 } 00:16:49.209 ] 00:16:49.209 }, 00:16:49.209 { 00:16:49.209 "subsystem": "bdev", 00:16:49.209 "config": [ 00:16:49.209 { 00:16:49.209 "method": "bdev_set_options", 00:16:49.209 "params": { 00:16:49.209 "bdev_io_pool_size": 65535, 00:16:49.209 "bdev_io_cache_size": 256, 00:16:49.209 "bdev_auto_examine": true, 00:16:49.209 "iobuf_small_cache_size": 128, 00:16:49.209 "iobuf_large_cache_size": 16 00:16:49.209 } 00:16:49.209 }, 00:16:49.209 { 00:16:49.209 "method": "bdev_raid_set_options", 00:16:49.209 "params": { 00:16:49.209 "process_window_size_kb": 1024, 00:16:49.209 "process_max_bandwidth_mb_sec": 0 00:16:49.209 } 00:16:49.209 }, 00:16:49.209 { 00:16:49.209 "method": "bdev_iscsi_set_options", 00:16:49.209 "params": { 00:16:49.209 "timeout_sec": 30 00:16:49.209 } 00:16:49.209 }, 00:16:49.209 { 00:16:49.209 "method": "bdev_nvme_set_options", 00:16:49.209 "params": { 00:16:49.209 "action_on_timeout": "none", 00:16:49.209 "timeout_us": 0, 00:16:49.209 "timeout_admin_us": 0, 00:16:49.209 "keep_alive_timeout_ms": 10000, 00:16:49.209 "arbitration_burst": 0, 00:16:49.209 "low_priority_weight": 0, 00:16:49.209 "medium_priority_weight": 0, 00:16:49.209 "high_priority_weight": 0, 00:16:49.209 "nvme_adminq_poll_period_us": 10000, 00:16:49.209 "nvme_ioq_poll_period_us": 0, 00:16:49.209 "io_queue_requests": 0, 00:16:49.209 "delay_cmd_submit": true, 00:16:49.209 "transport_retry_count": 4, 00:16:49.209 "bdev_retry_count": 3, 00:16:49.209 "transport_ack_timeout": 0, 00:16:49.209 "ctrlr_loss_timeout_sec": 0, 00:16:49.209 "reconnect_delay_sec": 0, 00:16:49.209 "fast_io_fail_timeout_sec": 0, 00:16:49.209 "disable_auto_failback": false, 00:16:49.209 "generate_uuids": false, 00:16:49.209 "transport_tos": 0, 00:16:49.209 "nvme_error_stat": false, 00:16:49.209 "rdma_srq_size": 0, 00:16:49.209 "io_path_stat": false, 00:16:49.209 "allow_accel_sequence": false, 00:16:49.209 "rdma_max_cq_size": 0, 00:16:49.209 "rdma_cm_event_timeout_ms": 0, 00:16:49.209 "dhchap_digests": [ 00:16:49.209 "sha256", 00:16:49.209 "sha384", 00:16:49.209 "sha512" 00:16:49.209 ], 00:16:49.209 "dhchap_dhgroups": [ 00:16:49.209 "null", 00:16:49.209 "ffdhe2048", 00:16:49.209 "ffdhe3072", 00:16:49.209 "ffdhe4096", 00:16:49.209 "ffdhe6144", 00:16:49.209 "ffdhe8192" 00:16:49.209 ] 00:16:49.209 } 00:16:49.209 }, 00:16:49.209 { 00:16:49.209 "method": "bdev_nvme_set_hotplug", 00:16:49.209 "params": { 00:16:49.209 "period_us": 100000, 00:16:49.209 "enable": false 00:16:49.209 } 00:16:49.209 }, 00:16:49.209 { 00:16:49.209 "method": "bdev_malloc_create", 00:16:49.209 "params": { 00:16:49.209 "name": "malloc0", 00:16:49.209 "num_blocks": 8192, 00:16:49.209 "block_size": 4096, 00:16:49.209 "physical_block_size": 4096, 00:16:49.209 "uuid": "d8d49d4e-495e-46a4-bf0b-46f49fc22acd", 00:16:49.209 "optimal_io_boundary": 0, 00:16:49.209 "md_size": 0, 00:16:49.209 "dif_type": 0, 00:16:49.209 "dif_is_head_of_md": false, 00:16:49.209 "dif_pi_format": 0 00:16:49.209 } 00:16:49.210 }, 00:16:49.210 { 00:16:49.210 "method": "bdev_wait_for_examine" 00:16:49.210 } 00:16:49.210 ] 00:16:49.210 }, 00:16:49.210 { 00:16:49.210 "subsystem": "nbd", 00:16:49.210 "config": [] 00:16:49.210 }, 00:16:49.210 { 00:16:49.210 "subsystem": "scheduler", 00:16:49.210 "config": [ 00:16:49.210 { 00:16:49.210 "method": "framework_set_scheduler", 00:16:49.210 "params": { 00:16:49.210 "name": "static" 00:16:49.210 } 00:16:49.210 } 00:16:49.210 ] 00:16:49.210 }, 00:16:49.210 { 00:16:49.210 "subsystem": "nvmf", 00:16:49.210 "config": [ 00:16:49.210 { 00:16:49.210 "method": "nvmf_set_config", 00:16:49.210 "params": { 00:16:49.210 "discovery_filter": "match_any", 00:16:49.210 "admin_cmd_passthru": { 00:16:49.210 "identify_ctrlr": false 00:16:49.210 }, 00:16:49.210 "dhchap_digests": [ 00:16:49.210 "sha256", 00:16:49.210 "sha384", 00:16:49.210 "sha512" 00:16:49.210 ], 00:16:49.210 "dhchap_dhgroups": [ 00:16:49.210 "null", 00:16:49.210 "ffdhe2048", 00:16:49.210 "ffdhe3072", 00:16:49.210 "ffdhe4096", 00:16:49.210 "ffdhe6144", 00:16:49.210 "ffdhe8192" 00:16:49.210 ] 00:16:49.210 } 00:16:49.210 }, 00:16:49.210 { 00:16:49.210 "method": "nvmf_set_max_subsystems", 00:16:49.210 "params": { 00:16:49.210 "max_subsystems": 1024 00:16:49.210 } 00:16:49.210 }, 00:16:49.210 { 00:16:49.210 "method": "nvmf_set_crdt", 00:16:49.210 "params": { 00:16:49.210 "crdt1": 0, 00:16:49.210 "crdt2": 0, 00:16:49.210 "crdt3": 0 00:16:49.210 } 00:16:49.210 }, 00:16:49.210 { 00:16:49.210 "method": "nvmf_create_transport", 00:16:49.210 "params": { 00:16:49.210 "trtype": "TCP", 00:16:49.210 "max_queue_depth": 128, 00:16:49.210 "max_io_qpairs_per_ctrlr": 127, 00:16:49.210 "in_capsule_data_size": 4096, 00:16:49.210 "max_io_size": 131072, 00:16:49.210 "io_unit_size": 131072, 00:16:49.210 "max_aq_depth": 128, 00:16:49.210 "num_shared_buffers": 511, 00:16:49.210 "buf_cache_size": 4294967295, 00:16:49.210 "dif_insert_or_strip": false, 00:16:49.210 "zcopy": false, 00:16:49.210 "c2h_success": false, 00:16:49.210 "sock_priority": 0, 00:16:49.210 "abort_timeout_sec": 1, 00:16:49.210 "ack_timeout": 0, 00:16:49.210 "data_wr_pool_size": 0 00:16:49.210 } 00:16:49.210 }, 00:16:49.210 { 00:16:49.210 "method": "nvmf_create_subsystem", 00:16:49.210 "params": { 00:16:49.210 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:49.210 "allow_any_host": false, 00:16:49.210 "serial_number": "SPDK00000000000001", 00:16:49.210 "model_number": "SPDK bdev Controller", 00:16:49.210 "max_namespaces": 10, 00:16:49.210 "min_cntlid": 1, 00:16:49.210 "max_cntlid": 65519, 00:16:49.210 "ana_reporting": false 00:16:49.210 } 00:16:49.210 }, 00:16:49.210 { 00:16:49.210 "method": "nvmf_subsystem_add_host", 00:16:49.210 "params": { 00:16:49.210 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:49.210 "host": "nqn.2016-06.io.spdk:host1", 00:16:49.210 "psk": "key0" 00:16:49.210 } 00:16:49.210 }, 00:16:49.210 { 00:16:49.210 "method": "nvmf_subsystem_add_ns", 00:16:49.210 "params": { 00:16:49.210 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:49.210 "namespace": { 00:16:49.210 "nsid": 1, 00:16:49.210 "bdev_name": "malloc0", 00:16:49.210 "nguid": "D8D49D4E495E46A4BF0B46F49FC22ACD", 00:16:49.210 "uuid": "d8d49d4e-495e-46a4-bf0b-46f49fc22acd", 00:16:49.210 "no_auto_visible": false 00:16:49.210 } 00:16:49.210 } 00:16:49.210 }, 00:16:49.210 { 00:16:49.210 "method": "nvmf_subsystem_add_listener", 00:16:49.210 "params": { 00:16:49.210 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:49.210 "listen_address": { 00:16:49.210 "trtype": "TCP", 00:16:49.210 "adrfam": "IPv4", 00:16:49.210 "traddr": "10.0.0.3", 00:16:49.210 "trsvcid": "4420" 00:16:49.210 }, 00:16:49.210 "secure_channel": true 00:16:49.210 } 00:16:49.210 } 00:16:49.210 ] 00:16:49.210 } 00:16:49.210 ] 00:16:49.210 }' 00:16:49.210 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@199 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:16:49.775 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@199 -- # bdevperfconf='{ 00:16:49.775 "subsystems": [ 00:16:49.775 { 00:16:49.775 "subsystem": "keyring", 00:16:49.775 "config": [ 00:16:49.775 { 00:16:49.775 "method": "keyring_file_add_key", 00:16:49.775 "params": { 00:16:49.775 "name": "key0", 00:16:49.775 "path": "/tmp/tmp.IF1CqfyxzF" 00:16:49.775 } 00:16:49.775 } 00:16:49.775 ] 00:16:49.775 }, 00:16:49.775 { 00:16:49.775 "subsystem": "iobuf", 00:16:49.775 "config": [ 00:16:49.775 { 00:16:49.775 "method": "iobuf_set_options", 00:16:49.775 "params": { 00:16:49.775 "small_pool_count": 8192, 00:16:49.775 "large_pool_count": 1024, 00:16:49.775 "small_bufsize": 8192, 00:16:49.775 "large_bufsize": 135168 00:16:49.775 } 00:16:49.775 } 00:16:49.775 ] 00:16:49.775 }, 00:16:49.775 { 00:16:49.775 "subsystem": "sock", 00:16:49.775 "config": [ 00:16:49.775 { 00:16:49.775 "method": "sock_set_default_impl", 00:16:49.775 "params": { 00:16:49.775 "impl_name": "uring" 00:16:49.775 } 00:16:49.775 }, 00:16:49.775 { 00:16:49.775 "method": "sock_impl_set_options", 00:16:49.775 "params": { 00:16:49.775 "impl_name": "ssl", 00:16:49.775 "recv_buf_size": 4096, 00:16:49.775 "send_buf_size": 4096, 00:16:49.775 "enable_recv_pipe": true, 00:16:49.775 "enable_quickack": false, 00:16:49.775 "enable_placement_id": 0, 00:16:49.775 "enable_zerocopy_send_server": true, 00:16:49.775 "enable_zerocopy_send_client": false, 00:16:49.775 "zerocopy_threshold": 0, 00:16:49.775 "tls_version": 0, 00:16:49.775 "enable_ktls": false 00:16:49.775 } 00:16:49.775 }, 00:16:49.775 { 00:16:49.775 "method": "sock_impl_set_options", 00:16:49.775 "params": { 00:16:49.775 "impl_name": "posix", 00:16:49.775 "recv_buf_size": 2097152, 00:16:49.775 "send_buf_size": 2097152, 00:16:49.775 "enable_recv_pipe": true, 00:16:49.775 "enable_quickack": false, 00:16:49.775 "enable_placement_id": 0, 00:16:49.775 "enable_zerocopy_send_server": true, 00:16:49.775 "enable_zerocopy_send_client": false, 00:16:49.775 "zerocopy_threshold": 0, 00:16:49.775 "tls_version": 0, 00:16:49.775 "enable_ktls": false 00:16:49.775 } 00:16:49.775 }, 00:16:49.775 { 00:16:49.775 "method": "sock_impl_set_options", 00:16:49.775 "params": { 00:16:49.775 "impl_name": "uring", 00:16:49.775 "recv_buf_size": 2097152, 00:16:49.775 "send_buf_size": 2097152, 00:16:49.775 "enable_recv_pipe": true, 00:16:49.775 "enable_quickack": false, 00:16:49.775 "enable_placement_id": 0, 00:16:49.775 "enable_zerocopy_send_server": false, 00:16:49.776 "enable_zerocopy_send_client": false, 00:16:49.776 "zerocopy_threshold": 0, 00:16:49.776 "tls_version": 0, 00:16:49.776 "enable_ktls": false 00:16:49.776 } 00:16:49.776 } 00:16:49.776 ] 00:16:49.776 }, 00:16:49.776 { 00:16:49.776 "subsystem": "vmd", 00:16:49.776 "config": [] 00:16:49.776 }, 00:16:49.776 { 00:16:49.776 "subsystem": "accel", 00:16:49.776 "config": [ 00:16:49.776 { 00:16:49.776 "method": "accel_set_options", 00:16:49.776 "params": { 00:16:49.776 "small_cache_size": 128, 00:16:49.776 "large_cache_size": 16, 00:16:49.776 "task_count": 2048, 00:16:49.776 "sequence_count": 2048, 00:16:49.776 "buf_count": 2048 00:16:49.776 } 00:16:49.776 } 00:16:49.776 ] 00:16:49.776 }, 00:16:49.776 { 00:16:49.776 "subsystem": "bdev", 00:16:49.776 "config": [ 00:16:49.776 { 00:16:49.776 "method": "bdev_set_options", 00:16:49.776 "params": { 00:16:49.776 "bdev_io_pool_size": 65535, 00:16:49.776 "bdev_io_cache_size": 256, 00:16:49.776 "bdev_auto_examine": true, 00:16:49.776 "iobuf_small_cache_size": 128, 00:16:49.776 "iobuf_large_cache_size": 16 00:16:49.776 } 00:16:49.776 }, 00:16:49.776 { 00:16:49.776 "method": "bdev_raid_set_options", 00:16:49.776 "params": { 00:16:49.776 "process_window_size_kb": 1024, 00:16:49.776 "process_max_bandwidth_mb_sec": 0 00:16:49.776 } 00:16:49.776 }, 00:16:49.776 { 00:16:49.776 "method": "bdev_iscsi_set_options", 00:16:49.776 "params": { 00:16:49.776 "timeout_sec": 30 00:16:49.776 } 00:16:49.776 }, 00:16:49.776 { 00:16:49.776 "method": "bdev_nvme_set_options", 00:16:49.776 "params": { 00:16:49.776 "action_on_timeout": "none", 00:16:49.776 "timeout_us": 0, 00:16:49.776 "timeout_admin_us": 0, 00:16:49.776 "keep_alive_timeout_ms": 10000, 00:16:49.776 "arbitration_burst": 0, 00:16:49.776 "low_priority_weight": 0, 00:16:49.776 "medium_priority_weight": 0, 00:16:49.776 "high_priority_weight": 0, 00:16:49.776 "nvme_adminq_poll_period_us": 10000, 00:16:49.776 "nvme_ioq_poll_period_us": 0, 00:16:49.776 "io_queue_requests": 512, 00:16:49.776 "delay_cmd_submit": true, 00:16:49.776 "transport_retry_count": 4, 00:16:49.776 "bdev_retry_count": 3, 00:16:49.776 "transport_ack_timeout": 0, 00:16:49.776 "ctrlr_loss_timeout_sec": 0, 00:16:49.776 "reconnect_delay_sec": 0, 00:16:49.776 "fast_io_fail_timeout_sec": 0, 00:16:49.776 "disable_auto_failback": false, 00:16:49.776 "generate_uuids": false, 00:16:49.776 "transport_tos": 0, 00:16:49.776 "nvme_error_stat": false, 00:16:49.776 "rdma_srq_size": 0, 00:16:49.776 "io_path_stat": false, 00:16:49.776 "allow_accel_sequence": false, 00:16:49.776 "rdma_max_cq_size": 0, 00:16:49.776 "rdma_cm_event_timeout_ms": 0, 00:16:49.776 "dhchap_digests": [ 00:16:49.776 "sha256", 00:16:49.776 "sha384", 00:16:49.776 "sha512" 00:16:49.776 ], 00:16:49.776 "dhchap_dhgroups": [ 00:16:49.776 "null", 00:16:49.776 "ffdhe2048", 00:16:49.776 "ffdhe3072", 00:16:49.776 "ffdhe4096", 00:16:49.776 "ffdhe6144", 00:16:49.776 "ffdhe8192" 00:16:49.776 ] 00:16:49.776 } 00:16:49.776 }, 00:16:49.776 { 00:16:49.776 "method": "bdev_nvme_attach_controller", 00:16:49.776 "params": { 00:16:49.776 "name": "TLSTEST", 00:16:49.776 "trtype": "TCP", 00:16:49.776 "adrfam": "IPv4", 00:16:49.776 "traddr": "10.0.0.3", 00:16:49.776 "trsvcid": "4420", 00:16:49.776 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:49.776 "prchk_reftag": false, 00:16:49.776 "prchk_guard": false, 00:16:49.776 "ctrlr_loss_timeout_sec": 0, 00:16:49.776 "reconnect_delay_sec": 0, 00:16:49.776 "fast_io_fail_timeout_sec": 0, 00:16:49.776 "psk": "key0", 00:16:49.776 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:49.776 "hdgst": false, 00:16:49.776 "ddgst": false, 00:16:49.776 "multipath": "multipath" 00:16:49.776 } 00:16:49.776 }, 00:16:49.776 { 00:16:49.776 "method": "bdev_nvme_set_hotplug", 00:16:49.776 "params": { 00:16:49.776 "period_us": 100000, 00:16:49.776 "enable": false 00:16:49.776 } 00:16:49.776 }, 00:16:49.776 { 00:16:49.776 "method": "bdev_wait_for_examine" 00:16:49.776 } 00:16:49.776 ] 00:16:49.776 }, 00:16:49.776 { 00:16:49.776 "subsystem": "nbd", 00:16:49.776 "config": [] 00:16:49.776 } 00:16:49.776 ] 00:16:49.776 }' 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@201 -- # killprocess 72445 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 72445 ']' 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 72445 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72445 00:16:49.776 killing process with pid 72445 00:16:49.776 Received shutdown signal, test time was about 10.000000 seconds 00:16:49.776 00:16:49.776 Latency(us) 00:16:49.776 [2024-10-07T11:27:31.487Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:49.776 [2024-10-07T11:27:31.487Z] =================================================================================================================== 00:16:49.776 [2024-10-07T11:27:31.487Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72445' 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 72445 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 72445 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@202 -- # killprocess 72397 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 72397 ']' 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 72397 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72397 00:16:49.776 killing process with pid 72397 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72397' 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 72397 00:16:49.776 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 72397 00:16:50.034 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@205 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:16:50.035 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:16:50.035 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@205 -- # echo '{ 00:16:50.035 "subsystems": [ 00:16:50.035 { 00:16:50.035 "subsystem": "keyring", 00:16:50.035 "config": [ 00:16:50.035 { 00:16:50.035 "method": "keyring_file_add_key", 00:16:50.035 "params": { 00:16:50.035 "name": "key0", 00:16:50.035 "path": "/tmp/tmp.IF1CqfyxzF" 00:16:50.035 } 00:16:50.035 } 00:16:50.035 ] 00:16:50.035 }, 00:16:50.035 { 00:16:50.035 "subsystem": "iobuf", 00:16:50.035 "config": [ 00:16:50.035 { 00:16:50.035 "method": "iobuf_set_options", 00:16:50.035 "params": { 00:16:50.035 "small_pool_count": 8192, 00:16:50.035 "large_pool_count": 1024, 00:16:50.035 "small_bufsize": 8192, 00:16:50.035 "large_bufsize": 135168 00:16:50.035 } 00:16:50.035 } 00:16:50.035 ] 00:16:50.035 }, 00:16:50.035 { 00:16:50.035 "subsystem": "sock", 00:16:50.035 "config": [ 00:16:50.035 { 00:16:50.035 "method": "sock_set_default_impl", 00:16:50.035 "params": { 00:16:50.035 "impl_name": "uring" 00:16:50.035 } 00:16:50.035 }, 00:16:50.035 { 00:16:50.035 "method": "sock_impl_set_options", 00:16:50.035 "params": { 00:16:50.035 "impl_name": "ssl", 00:16:50.035 "recv_buf_size": 4096, 00:16:50.035 "send_buf_size": 4096, 00:16:50.035 "enable_recv_pipe": true, 00:16:50.035 "enable_quickack": false, 00:16:50.035 "enable_placement_id": 0, 00:16:50.035 "enable_zerocopy_send_server": true, 00:16:50.035 "enable_zerocopy_send_client": false, 00:16:50.035 "zerocopy_threshold": 0, 00:16:50.035 "tls_version": 0, 00:16:50.035 "enable_ktls": false 00:16:50.035 } 00:16:50.035 }, 00:16:50.035 { 00:16:50.035 "method": "sock_impl_set_options", 00:16:50.035 "params": { 00:16:50.035 "impl_name": "posix", 00:16:50.035 "recv_buf_size": 2097152, 00:16:50.035 "send_buf_size": 2097152, 00:16:50.035 "enable_recv_pipe": true, 00:16:50.035 "enable_quickack": false, 00:16:50.035 "enable_placement_id": 0, 00:16:50.035 "enable_zerocopy_send_server": true, 00:16:50.035 "enable_zerocopy_send_client": false, 00:16:50.035 "zerocopy_threshold": 0, 00:16:50.035 "tls_version": 0, 00:16:50.035 "enable_ktls": false 00:16:50.035 } 00:16:50.035 }, 00:16:50.035 { 00:16:50.035 "method": "sock_impl_set_options", 00:16:50.035 "params": { 00:16:50.035 "impl_name": "uring", 00:16:50.035 "recv_buf_size": 2097152, 00:16:50.035 "send_buf_size": 2097152, 00:16:50.035 "enable_recv_pipe": true, 00:16:50.035 "enable_quickack": false, 00:16:50.035 "enable_placement_id": 0, 00:16:50.035 "enable_zerocopy_send_server": false, 00:16:50.035 "enable_zerocopy_send_client": false, 00:16:50.035 "zerocopy_threshold": 0, 00:16:50.035 "tls_version": 0, 00:16:50.035 "enable_ktls": false 00:16:50.035 } 00:16:50.035 } 00:16:50.035 ] 00:16:50.035 }, 00:16:50.035 { 00:16:50.035 "subsystem": "vmd", 00:16:50.035 "config": [] 00:16:50.035 }, 00:16:50.035 { 00:16:50.035 "subsystem": "accel", 00:16:50.035 "config": [ 00:16:50.035 { 00:16:50.035 "method": "accel_set_options", 00:16:50.035 "params": { 00:16:50.035 "small_cache_size": 128, 00:16:50.035 "large_cache_size": 16, 00:16:50.035 "task_count": 2048, 00:16:50.035 "sequence_count": 2048, 00:16:50.035 "buf_count": 2048 00:16:50.035 } 00:16:50.035 } 00:16:50.035 ] 00:16:50.035 }, 00:16:50.035 { 00:16:50.035 "subsystem": "bdev", 00:16:50.035 "config": [ 00:16:50.035 { 00:16:50.035 "method": "bdev_set_options", 00:16:50.035 "params": { 00:16:50.035 "bdev_io_pool_size": 65535, 00:16:50.035 "bdev_io_cache_size": 256, 00:16:50.035 "bdev_auto_examine": true, 00:16:50.035 "iobuf_small_cache_size": 128, 00:16:50.035 "iobuf_large_cache_size": 16 00:16:50.035 } 00:16:50.035 }, 00:16:50.035 { 00:16:50.035 "method": "bdev_raid_set_options", 00:16:50.035 "params": { 00:16:50.035 "process_window_size_kb": 1024, 00:16:50.035 "process_max_bandwidth_mb_sec": 0 00:16:50.035 } 00:16:50.035 }, 00:16:50.035 { 00:16:50.035 "method": "bdev_iscsi_set_options", 00:16:50.035 "params": { 00:16:50.035 "timeout_sec": 30 00:16:50.035 } 00:16:50.035 }, 00:16:50.035 { 00:16:50.035 "method": "bdev_nvme_set_options", 00:16:50.035 "params": { 00:16:50.035 "action_on_timeout": "none", 00:16:50.035 "timeout_us": 0, 00:16:50.035 "timeout_admin_us": 0, 00:16:50.035 "keep_alive_timeout_ms": 10000, 00:16:50.035 "arbitration_burst": 0, 00:16:50.035 "low_priority_weight": 0, 00:16:50.035 "medium_priority_weight": 0, 00:16:50.035 "high_priority_weight": 0, 00:16:50.035 "nvme_adminq_poll_period_us": 10000, 00:16:50.035 "nvme_ioq_poll_period_us": 0, 00:16:50.035 "io_queue_requests": 0, 00:16:50.035 "delay_cmd_submit": true, 00:16:50.035 "transport_retry_count": 4, 00:16:50.035 "bdev_retry_count": 3, 00:16:50.035 "transport_ack_timeout": 0, 00:16:50.035 "ctrlr_loss_timeout_sec": 0, 00:16:50.035 "reconnect_delay_sec": 0, 00:16:50.035 "fast_io_fail_timeout_sec": 0, 00:16:50.035 "disable_auto_failback": false, 00:16:50.035 "generate_uuids": false, 00:16:50.035 "transport_tos": 0, 00:16:50.035 "nvme_error_stat": false, 00:16:50.035 "rdma_srq_size": 0, 00:16:50.035 "io_path_stat": false, 00:16:50.035 "allow_accel_sequence": false, 00:16:50.035 "rdma_max_cq_size": 0, 00:16:50.035 "rdma_cm_event_timeout_ms": 0, 00:16:50.035 "dhchap_digests": [ 00:16:50.035 "sha256", 00:16:50.035 "sha384", 00:16:50.035 "sha512" 00:16:50.035 ], 00:16:50.035 "dhchap_dhgroups": [ 00:16:50.035 "null", 00:16:50.035 "ffdhe2048", 00:16:50.035 "ffdhe3072", 00:16:50.035 "ffdhe4096", 00:16:50.035 "ffdhe6144", 00:16:50.035 "ffdhe8192" 00:16:50.035 ] 00:16:50.035 } 00:16:50.035 }, 00:16:50.035 { 00:16:50.035 "method": "bdev_nvme_set_hotplug", 00:16:50.035 "params": { 00:16:50.035 "period_us": 100000, 00:16:50.035 "enable": false 00:16:50.035 } 00:16:50.035 }, 00:16:50.035 { 00:16:50.035 "method": "bdev_malloc_create", 00:16:50.035 "params": { 00:16:50.035 "name": "malloc0", 00:16:50.035 "num_blocks": 8192, 00:16:50.035 "block_size": 4096, 00:16:50.035 "physical_block_size": 4096, 00:16:50.035 "uuid": "d8d49d4e-495e-46a4-bf0b-46f49fc22acd", 00:16:50.035 "optimal_io_boundary": 0, 00:16:50.035 "md_size": 0, 00:16:50.035 "dif_type": 0, 00:16:50.035 "dif_is_head_of_md": false, 00:16:50.035 "dif_pi_format": 0 00:16:50.035 } 00:16:50.035 }, 00:16:50.035 { 00:16:50.035 "method": "bdev_wait_for_examine" 00:16:50.035 } 00:16:50.035 ] 00:16:50.035 }, 00:16:50.035 { 00:16:50.035 "subsystem": "nbd", 00:16:50.035 "config": [] 00:16:50.035 }, 00:16:50.035 { 00:16:50.035 "subsystem": "scheduler", 00:16:50.035 "config": [ 00:16:50.035 { 00:16:50.035 "method": "framework_set_scheduler", 00:16:50.035 "params": { 00:16:50.035 "name": "static" 00:16:50.035 } 00:16:50.035 } 00:16:50.035 ] 00:16:50.035 }, 00:16:50.035 { 00:16:50.035 "subsystem": "nvmf", 00:16:50.035 "config": [ 00:16:50.035 { 00:16:50.035 "method": "nvmf_set_config", 00:16:50.035 "params": { 00:16:50.035 "discovery_filter": "match_any", 00:16:50.035 "admin_cmd_passthru": { 00:16:50.035 "identify_ctrlr": false 00:16:50.035 }, 00:16:50.035 "dhchap_digests": [ 00:16:50.035 "sha256", 00:16:50.035 "sha384", 00:16:50.035 "sha512" 00:16:50.035 ], 00:16:50.035 "dhchap_dhgroups": [ 00:16:50.035 "null", 00:16:50.035 "ffdhe2048", 00:16:50.035 "ffdhe3072", 00:16:50.035 "ffdhe4096", 00:16:50.035 "ffdhe6144", 00:16:50.035 "ffdhe8192" 00:16:50.035 ] 00:16:50.036 } 00:16:50.036 }, 00:16:50.036 { 00:16:50.036 "method": "nvmf_set_max_subsystems", 00:16:50.036 "params": { 00:16:50.036 "max_subsystems": 1024 00:16:50.036 } 00:16:50.036 }, 00:16:50.036 { 00:16:50.036 "method": "nvmf_set_crdt", 00:16:50.036 "params": { 00:16:50.036 "crdt1": 0, 00:16:50.036 "crdt2": 0, 00:16:50.036 "crdt3": 0 00:16:50.036 } 00:16:50.036 }, 00:16:50.036 { 00:16:50.036 "method": "nvmf_create_transport", 00:16:50.036 "params": { 00:16:50.036 "trtype": "TCP", 00:16:50.036 "max_queue_depth": 128, 00:16:50.036 "max_io_qpairs_per_ctrlr": 127, 00:16:50.036 "in_capsule_data_size": 4096, 00:16:50.036 "max_io_size": 131072, 00:16:50.036 "io_unit_size": 131072, 00:16:50.036 "max_aq_depth": 128, 00:16:50.036 "num_shared_buffers": 511, 00:16:50.036 "buf_cache_size": 4294967295, 00:16:50.036 "dif_insert_or_strip": false, 00:16:50.036 "zcopy": false, 00:16:50.036 "c2h_success": false, 00:16:50.036 "sock_priority": 0, 00:16:50.036 "abort_timeout_sec": 1, 00:16:50.036 "ack_timeout": 0, 00:16:50.036 "data_wr_pool_size": 0 00:16:50.036 } 00:16:50.036 }, 00:16:50.036 { 00:16:50.036 "method": "nvmf_create_subsystem", 00:16:50.036 "params": { 00:16:50.036 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:50.036 "allow_any_host": false, 00:16:50.036 "serial_number": "SPDK00000000000001", 00:16:50.036 "model_number": "SPDK bdev Controller", 00:16:50.036 "max_namespaces": 10, 00:16:50.036 "min_cntlid": 1, 00:16:50.036 "max_cntlid": 65519, 00:16:50.036 "ana_reporting": false 00:16:50.036 } 00:16:50.036 }, 00:16:50.036 { 00:16:50.036 "method": "nvmf_subsystem_add_host", 00:16:50.036 "params": { 00:16:50.036 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:50.036 "host": "nqn.2016-06.io.spdk:host1", 00:16:50.036 "psk": "key0" 00:16:50.036 } 00:16:50.036 }, 00:16:50.036 { 00:16:50.036 "method": "nvmf_subsystem_add_ns", 00:16:50.036 "params": { 00:16:50.036 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:50.036 "namespace": { 00:16:50.036 "nsid": 1, 00:16:50.036 "bdev_name": "malloc0", 00:16:50.036 "nguid": "D8D49D4E495E46A4BF0B46F49FC22ACD", 00:16:50.036 "uuid": "d8d49d4e-495e-46a4-bf0b-46f49fc22acd", 00:16:50.036 "no_auto_visible": false 00:16:50.036 } 00:16:50.036 } 00:16:50.036 }, 00:16:50.036 { 00:16:50.036 "method": "nvmf_subsystem_add_listener", 00:16:50.036 "params": { 00:16:50.036 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:50.036 "listen_address": { 00:16:50.036 "trtype": "TCP", 00:16:50.036 "adrfam": "IPv4", 00:16:50.036 "traddr": "10.0.0.3", 00:16:50.036 "trsvcid": "4420" 00:16:50.036 }, 00:16:50.036 "secure_channel": true 00:16:50.036 } 00:16:50.036 } 00:16:50.036 ] 00:16:50.036 } 00:16:50.036 ] 00:16:50.036 }' 00:16:50.036 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:16:50.036 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:50.036 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:50.036 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=72493 00:16:50.036 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 72493 00:16:50.036 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:16:50.036 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 72493 ']' 00:16:50.036 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:50.036 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:50.036 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:50.036 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:50.036 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:50.036 [2024-10-07 11:27:31.679645] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:50.036 [2024-10-07 11:27:31.680640] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:50.294 [2024-10-07 11:27:31.818098] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:50.294 [2024-10-07 11:27:31.875367] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:50.294 [2024-10-07 11:27:31.875625] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:50.294 [2024-10-07 11:27:31.875859] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:50.294 [2024-10-07 11:27:31.876063] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:50.294 [2024-10-07 11:27:31.876273] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:50.294 [2024-10-07 11:27:31.876879] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:16:50.552 [2024-10-07 11:27:32.019442] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:16:50.552 [2024-10-07 11:27:32.076900] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:50.552 [2024-10-07 11:27:32.113906] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:50.552 [2024-10-07 11:27:32.114517] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:16:51.118 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:51.118 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:51.118 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:16:51.118 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:16:51.118 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:51.118 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:51.118 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@209 -- # bdevperf_pid=72525 00:16:51.118 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@210 -- # waitforlisten 72525 /var/tmp/bdevperf.sock 00:16:51.118 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 72525 ']' 00:16:51.118 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@206 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:16:51.118 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:51.118 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@206 -- # echo '{ 00:16:51.118 "subsystems": [ 00:16:51.118 { 00:16:51.118 "subsystem": "keyring", 00:16:51.118 "config": [ 00:16:51.118 { 00:16:51.118 "method": "keyring_file_add_key", 00:16:51.118 "params": { 00:16:51.118 "name": "key0", 00:16:51.118 "path": "/tmp/tmp.IF1CqfyxzF" 00:16:51.118 } 00:16:51.118 } 00:16:51.118 ] 00:16:51.118 }, 00:16:51.118 { 00:16:51.118 "subsystem": "iobuf", 00:16:51.118 "config": [ 00:16:51.118 { 00:16:51.118 "method": "iobuf_set_options", 00:16:51.118 "params": { 00:16:51.118 "small_pool_count": 8192, 00:16:51.118 "large_pool_count": 1024, 00:16:51.118 "small_bufsize": 8192, 00:16:51.118 "large_bufsize": 135168 00:16:51.118 } 00:16:51.118 } 00:16:51.118 ] 00:16:51.118 }, 00:16:51.118 { 00:16:51.118 "subsystem": "sock", 00:16:51.118 "config": [ 00:16:51.118 { 00:16:51.118 "method": "sock_set_default_impl", 00:16:51.118 "params": { 00:16:51.118 "impl_name": "uring" 00:16:51.118 } 00:16:51.118 }, 00:16:51.118 { 00:16:51.118 "method": "sock_impl_set_options", 00:16:51.118 "params": { 00:16:51.118 "impl_name": "ssl", 00:16:51.118 "recv_buf_size": 4096, 00:16:51.118 "send_buf_size": 4096, 00:16:51.118 "enable_recv_pipe": true, 00:16:51.118 "enable_quickack": false, 00:16:51.118 "enable_placement_id": 0, 00:16:51.118 "enable_zerocopy_send_server": true, 00:16:51.118 "enable_zerocopy_send_client": false, 00:16:51.118 "zerocopy_threshold": 0, 00:16:51.118 "tls_version": 0, 00:16:51.118 "enable_ktls": false 00:16:51.118 } 00:16:51.118 }, 00:16:51.119 { 00:16:51.119 "method": "sock_impl_set_options", 00:16:51.119 "params": { 00:16:51.119 "impl_name": "posix", 00:16:51.119 "recv_buf_size": 2097152, 00:16:51.119 "send_buf_size": 2097152, 00:16:51.119 "enable_recv_pipe": true, 00:16:51.119 "enable_quickack": false, 00:16:51.119 "enable_placement_id": 0, 00:16:51.119 "enable_zerocopy_send_server": true, 00:16:51.119 "enable_zerocopy_send_client": false, 00:16:51.119 "zerocopy_threshold": 0, 00:16:51.119 "tls_version": 0, 00:16:51.119 "enable_ktls": false 00:16:51.119 } 00:16:51.119 }, 00:16:51.119 { 00:16:51.119 "method": "sock_impl_set_options", 00:16:51.119 "params": { 00:16:51.119 "impl_name": "uring", 00:16:51.119 "recv_buf_size": 2097152, 00:16:51.119 "send_buf_size": 2097152, 00:16:51.119 "enable_recv_pipe": true, 00:16:51.119 "enable_quickack": false, 00:16:51.119 "enable_placement_id": 0, 00:16:51.119 "enable_zerocopy_send_server": false, 00:16:51.119 "enable_zerocopy_send_client": false, 00:16:51.119 "zerocopy_threshold": 0, 00:16:51.119 "tls_version": 0, 00:16:51.119 "enable_ktls": false 00:16:51.119 } 00:16:51.119 } 00:16:51.119 ] 00:16:51.119 }, 00:16:51.119 { 00:16:51.119 "subsystem": "vmd", 00:16:51.119 "config": [] 00:16:51.119 }, 00:16:51.119 { 00:16:51.119 "subsystem": "accel", 00:16:51.119 "config": [ 00:16:51.119 { 00:16:51.119 "method": "accel_set_options", 00:16:51.119 "params": { 00:16:51.119 "small_cache_size": 128, 00:16:51.119 "large_cache_size": 16, 00:16:51.119 "task_count": 2048, 00:16:51.119 "sequence_count": 2048, 00:16:51.119 "buf_count": 2048 00:16:51.119 } 00:16:51.119 } 00:16:51.119 ] 00:16:51.119 }, 00:16:51.119 { 00:16:51.119 "subsystem": "bdev", 00:16:51.119 "config": [ 00:16:51.119 { 00:16:51.119 "method": "bdev_set_options", 00:16:51.119 "params": { 00:16:51.119 "bdev_io_pool_size": 65535, 00:16:51.119 "bdev_io_cache_size": 256, 00:16:51.119 "bdev_auto_examine": true, 00:16:51.119 "iobuf_small_cache_size": 128, 00:16:51.119 "iobuf_large_cache_size": 16 00:16:51.119 } 00:16:51.119 }, 00:16:51.119 { 00:16:51.119 "method": "bdev_raid_set_options", 00:16:51.119 "params": { 00:16:51.119 "process_window_size_kb": 1024, 00:16:51.119 "process_max_bandwidth_mb_sec": 0 00:16:51.119 } 00:16:51.119 }, 00:16:51.119 { 00:16:51.119 "method": "bdev_iscsi_set_options", 00:16:51.119 "params": { 00:16:51.119 "timeout_sec": 30 00:16:51.119 } 00:16:51.119 }, 00:16:51.119 { 00:16:51.119 "method": "bdev_nvme_set_options", 00:16:51.119 "params": { 00:16:51.119 "action_on_timeout": "none", 00:16:51.119 "timeout_us": 0, 00:16:51.119 "timeout_admin_us": 0, 00:16:51.119 "keep_alive_timeout_ms": 10000, 00:16:51.119 "arbitration_burst": 0, 00:16:51.119 "low_priority_weight": 0, 00:16:51.119 "medium_priority_weight": 0, 00:16:51.119 "high_priority_weight": 0, 00:16:51.119 "nvme_adminq_poll_period_us": 10000, 00:16:51.119 "nvme_ioq_poll_period_us": 0, 00:16:51.119 "io_queue_requests": 512, 00:16:51.119 "delay_cmd_submit": true, 00:16:51.119 "transport_retry_count": 4, 00:16:51.119 "bdev_retry_count": 3, 00:16:51.119 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:51.119 "transport_ack_timeout": 0, 00:16:51.119 "ctrlr_loss_timeout_sec": 0, 00:16:51.119 "reconnect_delay_sec": 0, 00:16:51.119 "fast_io_fail_timeout_sec": 0, 00:16:51.119 "disable_auto_failback": false, 00:16:51.119 "generate_uuids": false, 00:16:51.119 "transport_tos": 0, 00:16:51.119 "nvme_error_stat": false, 00:16:51.119 "rdma_srq_size": 0, 00:16:51.119 "io_path_stat": false, 00:16:51.119 "allow_accel_sequence": false, 00:16:51.119 "rdma_max_cq_size": 0, 00:16:51.119 "rdma_cm_event_timeout_ms": 0, 00:16:51.119 "dhchap_digests": [ 00:16:51.119 "sha256", 00:16:51.119 "sha384", 00:16:51.119 "sha512" 00:16:51.119 ], 00:16:51.119 "dhchap_dhgroups": [ 00:16:51.119 "null", 00:16:51.119 "ffdhe2048", 00:16:51.119 "ffdhe3072", 00:16:51.119 "ffdhe4096", 00:16:51.119 "ffdhe6144", 00:16:51.119 "ffdhe8192" 00:16:51.119 ] 00:16:51.119 } 00:16:51.119 }, 00:16:51.119 { 00:16:51.119 "method": "bdev_nvme_attach_controller", 00:16:51.119 "params": { 00:16:51.119 "name": "TLSTEST", 00:16:51.119 "trtype": "TCP", 00:16:51.119 "adrfam": "IPv4", 00:16:51.119 "traddr": "10.0.0.3", 00:16:51.119 "trsvcid": "4420", 00:16:51.119 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:51.119 "prchk_reftag": false, 00:16:51.119 "prchk_guard": false, 00:16:51.119 "ctrlr_loss_timeout_sec": 0, 00:16:51.119 "reconnect_delay_sec": 0, 00:16:51.119 "fast_io_fail_timeout_sec": 0, 00:16:51.119 "psk": "key0", 00:16:51.119 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:51.119 "hdgst": false, 00:16:51.119 "ddgst": false, 00:16:51.119 "multipath": "multipath" 00:16:51.119 } 00:16:51.119 }, 00:16:51.119 { 00:16:51.119 "method": "bdev_nvme_set_hotplug", 00:16:51.119 "params": { 00:16:51.119 "period_us": 100000, 00:16:51.119 "enable": false 00:16:51.119 } 00:16:51.119 }, 00:16:51.119 { 00:16:51.119 "method": "bdev_wait_for_examine" 00:16:51.119 } 00:16:51.119 ] 00:16:51.119 }, 00:16:51.119 { 00:16:51.119 "subsystem": "nbd", 00:16:51.119 "config": [] 00:16:51.119 } 00:16:51.119 ] 00:16:51.119 }' 00:16:51.119 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:51.119 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:51.119 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:51.119 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:51.119 [2024-10-07 11:27:32.792669] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:51.119 [2024-10-07 11:27:32.793031] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid72525 ] 00:16:51.377 [2024-10-07 11:27:32.933730] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:51.377 [2024-10-07 11:27:33.005272] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:16:51.634 [2024-10-07 11:27:33.121298] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:16:51.634 [2024-10-07 11:27:33.156469] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:52.199 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:52.199 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:52.199 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@213 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:16:52.457 Running I/O for 10 seconds... 00:16:54.344 3888.00 IOPS, 15.19 MiB/s [2024-10-07T11:27:37.428Z] 3882.50 IOPS, 15.17 MiB/s [2024-10-07T11:27:38.360Z] 3931.00 IOPS, 15.36 MiB/s [2024-10-07T11:27:39.294Z] 3954.00 IOPS, 15.45 MiB/s [2024-10-07T11:27:40.272Z] 3946.40 IOPS, 15.42 MiB/s [2024-10-07T11:27:41.204Z] 3959.00 IOPS, 15.46 MiB/s [2024-10-07T11:27:42.137Z] 3954.86 IOPS, 15.45 MiB/s [2024-10-07T11:27:43.071Z] 3938.25 IOPS, 15.38 MiB/s [2024-10-07T11:27:44.451Z] 3948.00 IOPS, 15.42 MiB/s [2024-10-07T11:27:44.451Z] 3953.40 IOPS, 15.44 MiB/s 00:17:02.740 Latency(us) 00:17:02.740 [2024-10-07T11:27:44.451Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:02.740 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:02.740 Verification LBA range: start 0x0 length 0x2000 00:17:02.740 TLSTESTn1 : 10.02 3959.04 15.47 0.00 0.00 32270.33 6196.13 26691.03 00:17:02.740 [2024-10-07T11:27:44.451Z] =================================================================================================================== 00:17:02.740 [2024-10-07T11:27:44.451Z] Total : 3959.04 15.47 0.00 0.00 32270.33 6196.13 26691.03 00:17:02.740 { 00:17:02.740 "results": [ 00:17:02.740 { 00:17:02.740 "job": "TLSTESTn1", 00:17:02.740 "core_mask": "0x4", 00:17:02.740 "workload": "verify", 00:17:02.740 "status": "finished", 00:17:02.740 "verify_range": { 00:17:02.740 "start": 0, 00:17:02.740 "length": 8192 00:17:02.740 }, 00:17:02.740 "queue_depth": 128, 00:17:02.740 "io_size": 4096, 00:17:02.740 "runtime": 10.017318, 00:17:02.740 "iops": 3959.0437280717256, 00:17:02.740 "mibps": 15.465014562780178, 00:17:02.740 "io_failed": 0, 00:17:02.740 "io_timeout": 0, 00:17:02.740 "avg_latency_us": 32270.332371099994, 00:17:02.740 "min_latency_us": 6196.130909090909, 00:17:02.740 "max_latency_us": 26691.025454545455 00:17:02.740 } 00:17:02.740 ], 00:17:02.740 "core_count": 1 00:17:02.740 } 00:17:02.740 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@215 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:02.740 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@216 -- # killprocess 72525 00:17:02.740 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 72525 ']' 00:17:02.740 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 72525 00:17:02.740 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:17:02.740 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:02.740 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72525 00:17:02.741 killing process with pid 72525 00:17:02.741 Received shutdown signal, test time was about 10.000000 seconds 00:17:02.741 00:17:02.741 Latency(us) 00:17:02.741 [2024-10-07T11:27:44.452Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:02.741 [2024-10-07T11:27:44.452Z] =================================================================================================================== 00:17:02.741 [2024-10-07T11:27:44.452Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72525' 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 72525 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 72525 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@217 -- # killprocess 72493 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 72493 ']' 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 72493 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72493 00:17:02.741 killing process with pid 72493 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72493' 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 72493 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 72493 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@220 -- # nvmfappstart 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:02.741 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=72658 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 72658 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 72658 ']' 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:02.741 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:02.999 [2024-10-07 11:27:44.507684] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:02.999 [2024-10-07 11:27:44.507979] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:02.999 [2024-10-07 11:27:44.647397] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:03.256 [2024-10-07 11:27:44.718377] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:03.256 [2024-10-07 11:27:44.718654] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:03.256 [2024-10-07 11:27:44.718820] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:03.256 [2024-10-07 11:27:44.718975] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:03.256 [2024-10-07 11:27:44.719018] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:03.256 [2024-10-07 11:27:44.719487] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:17:03.256 [2024-10-07 11:27:44.753633] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:17:03.822 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:03.822 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:17:03.822 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:17:03.822 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:17:03.822 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:04.080 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:04.080 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@221 -- # setup_nvmf_tgt /tmp/tmp.IF1CqfyxzF 00:17:04.080 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.IF1CqfyxzF 00:17:04.080 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:04.338 [2024-10-07 11:27:45.828348] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:04.338 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:04.595 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -k 00:17:04.853 [2024-10-07 11:27:46.480537] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:04.853 [2024-10-07 11:27:46.480799] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:17:04.853 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:05.111 malloc0 00:17:05.111 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:05.677 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.IF1CqfyxzF 00:17:05.935 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:17:06.193 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:06.193 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@224 -- # bdevperf_pid=72721 00:17:06.193 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@222 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 2 -z -r /var/tmp/bdevperf.sock -q 128 -o 4k -w verify -t 1 00:17:06.193 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@226 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:06.193 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@227 -- # waitforlisten 72721 /var/tmp/bdevperf.sock 00:17:06.193 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 72721 ']' 00:17:06.193 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:06.193 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:06.193 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:06.193 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:06.193 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:06.193 [2024-10-07 11:27:47.735941] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:06.193 [2024-10-07 11:27:47.736236] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid72721 ] 00:17:06.193 [2024-10-07 11:27:47.873630] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:06.451 [2024-10-07 11:27:47.943922] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:17:06.451 [2024-10-07 11:27:47.976220] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:17:06.451 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:06.451 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:17:06.451 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@229 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.IF1CqfyxzF 00:17:06.710 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@230 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 --psk key0 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:06.967 [2024-10-07 11:27:48.605335] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:06.967 nvme0n1 00:17:07.225 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@234 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:07.225 Running I/O for 1 seconds... 00:17:08.159 3661.00 IOPS, 14.30 MiB/s 00:17:08.159 Latency(us) 00:17:08.159 [2024-10-07T11:27:49.870Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:08.159 Job: nvme0n1 (Core Mask 0x2, workload: verify, depth: 128, IO size: 4096) 00:17:08.159 Verification LBA range: start 0x0 length 0x2000 00:17:08.159 nvme0n1 : 1.02 3721.17 14.54 0.00 0.00 34065.14 5957.82 31218.97 00:17:08.159 [2024-10-07T11:27:49.870Z] =================================================================================================================== 00:17:08.159 [2024-10-07T11:27:49.870Z] Total : 3721.17 14.54 0.00 0.00 34065.14 5957.82 31218.97 00:17:08.159 { 00:17:08.159 "results": [ 00:17:08.159 { 00:17:08.159 "job": "nvme0n1", 00:17:08.159 "core_mask": "0x2", 00:17:08.159 "workload": "verify", 00:17:08.159 "status": "finished", 00:17:08.159 "verify_range": { 00:17:08.159 "start": 0, 00:17:08.159 "length": 8192 00:17:08.159 }, 00:17:08.159 "queue_depth": 128, 00:17:08.159 "io_size": 4096, 00:17:08.159 "runtime": 1.018497, 00:17:08.159 "iops": 3721.1695272543757, 00:17:08.159 "mibps": 14.535818465837405, 00:17:08.159 "io_failed": 0, 00:17:08.159 "io_timeout": 0, 00:17:08.159 "avg_latency_us": 34065.13806092588, 00:17:08.159 "min_latency_us": 5957.818181818182, 00:17:08.159 "max_latency_us": 31218.967272727274 00:17:08.159 } 00:17:08.159 ], 00:17:08.159 "core_count": 1 00:17:08.159 } 00:17:08.159 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@236 -- # killprocess 72721 00:17:08.159 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 72721 ']' 00:17:08.159 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 72721 00:17:08.159 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:17:08.159 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:08.159 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72721 00:17:08.418 killing process with pid 72721 00:17:08.418 Received shutdown signal, test time was about 1.000000 seconds 00:17:08.418 00:17:08.418 Latency(us) 00:17:08.418 [2024-10-07T11:27:50.129Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:08.418 [2024-10-07T11:27:50.129Z] =================================================================================================================== 00:17:08.418 [2024-10-07T11:27:50.129Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:08.418 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:17:08.418 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:17:08.418 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72721' 00:17:08.418 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 72721 00:17:08.418 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 72721 00:17:08.418 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@237 -- # killprocess 72658 00:17:08.418 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 72658 ']' 00:17:08.418 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 72658 00:17:08.418 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:17:08.418 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:08.418 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72658 00:17:08.418 killing process with pid 72658 00:17:08.418 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:17:08.418 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:17:08.418 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72658' 00:17:08.418 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 72658 00:17:08.418 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 72658 00:17:08.676 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@242 -- # nvmfappstart 00:17:08.676 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:17:08.676 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:17:08.676 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:08.676 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:08.676 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=72765 00:17:08.676 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:17:08.676 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 72765 00:17:08.676 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 72765 ']' 00:17:08.676 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:08.676 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:08.676 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:08.676 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:08.676 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:08.676 [2024-10-07 11:27:50.298698] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:08.676 [2024-10-07 11:27:50.298972] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:08.934 [2024-10-07 11:27:50.433566] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:08.934 [2024-10-07 11:27:50.503166] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:08.934 [2024-10-07 11:27:50.503436] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:08.934 [2024-10-07 11:27:50.503603] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:08.934 [2024-10-07 11:27:50.503793] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:08.934 [2024-10-07 11:27:50.503929] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:08.934 [2024-10-07 11:27:50.504317] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:17:08.934 [2024-10-07 11:27:50.538046] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:17:08.934 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:08.934 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:17:08.934 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:17:08.934 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:17:08.934 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:08.934 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:08.934 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@243 -- # rpc_cmd 00:17:08.934 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:08.934 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:08.934 [2024-10-07 11:27:50.640146] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:09.193 malloc0 00:17:09.193 [2024-10-07 11:27:50.687151] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:09.193 [2024-10-07 11:27:50.687595] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:17:09.193 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.193 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@256 -- # bdevperf_pid=72788 00:17:09.193 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@254 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 2 -z -r /var/tmp/bdevperf.sock -q 128 -o 4k -w verify -t 1 00:17:09.193 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@258 -- # waitforlisten 72788 /var/tmp/bdevperf.sock 00:17:09.193 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 72788 ']' 00:17:09.193 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:09.193 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:09.193 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:09.193 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:09.193 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:09.193 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:09.193 [2024-10-07 11:27:50.773985] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:09.193 [2024-10-07 11:27:50.774115] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid72788 ] 00:17:09.451 [2024-10-07 11:27:50.911701] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:09.451 [2024-10-07 11:27:50.990243] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:17:09.451 [2024-10-07 11:27:51.025105] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:17:09.451 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:09.451 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:17:09.451 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@259 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.IF1CqfyxzF 00:17:09.745 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@260 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 --psk key0 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:10.023 [2024-10-07 11:27:51.718779] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:10.281 nvme0n1 00:17:10.281 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@264 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:10.281 Running I/O for 1 seconds... 00:17:11.655 3848.00 IOPS, 15.03 MiB/s 00:17:11.655 Latency(us) 00:17:11.655 [2024-10-07T11:27:53.366Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:11.655 Job: nvme0n1 (Core Mask 0x2, workload: verify, depth: 128, IO size: 4096) 00:17:11.655 Verification LBA range: start 0x0 length 0x2000 00:17:11.655 nvme0n1 : 1.02 3912.14 15.28 0.00 0.00 32404.32 5957.82 23950.43 00:17:11.655 [2024-10-07T11:27:53.366Z] =================================================================================================================== 00:17:11.655 [2024-10-07T11:27:53.366Z] Total : 3912.14 15.28 0.00 0.00 32404.32 5957.82 23950.43 00:17:11.655 { 00:17:11.655 "results": [ 00:17:11.655 { 00:17:11.655 "job": "nvme0n1", 00:17:11.655 "core_mask": "0x2", 00:17:11.655 "workload": "verify", 00:17:11.655 "status": "finished", 00:17:11.655 "verify_range": { 00:17:11.655 "start": 0, 00:17:11.655 "length": 8192 00:17:11.655 }, 00:17:11.655 "queue_depth": 128, 00:17:11.655 "io_size": 4096, 00:17:11.655 "runtime": 1.016578, 00:17:11.655 "iops": 3912.1444689930336, 00:17:11.655 "mibps": 15.281814332004037, 00:17:11.655 "io_failed": 0, 00:17:11.655 "io_timeout": 0, 00:17:11.655 "avg_latency_us": 32404.31767024025, 00:17:11.655 "min_latency_us": 5957.818181818182, 00:17:11.655 "max_latency_us": 23950.429090909092 00:17:11.655 } 00:17:11.655 ], 00:17:11.655 "core_count": 1 00:17:11.655 } 00:17:11.655 11:27:52 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@267 -- # rpc_cmd save_config 00:17:11.655 11:27:52 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:11.655 11:27:52 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:11.655 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:11.655 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@267 -- # tgtcfg='{ 00:17:11.655 "subsystems": [ 00:17:11.655 { 00:17:11.655 "subsystem": "keyring", 00:17:11.655 "config": [ 00:17:11.655 { 00:17:11.655 "method": "keyring_file_add_key", 00:17:11.655 "params": { 00:17:11.655 "name": "key0", 00:17:11.655 "path": "/tmp/tmp.IF1CqfyxzF" 00:17:11.655 } 00:17:11.655 } 00:17:11.655 ] 00:17:11.655 }, 00:17:11.655 { 00:17:11.655 "subsystem": "iobuf", 00:17:11.655 "config": [ 00:17:11.655 { 00:17:11.655 "method": "iobuf_set_options", 00:17:11.655 "params": { 00:17:11.655 "small_pool_count": 8192, 00:17:11.655 "large_pool_count": 1024, 00:17:11.655 "small_bufsize": 8192, 00:17:11.655 "large_bufsize": 135168 00:17:11.655 } 00:17:11.655 } 00:17:11.655 ] 00:17:11.655 }, 00:17:11.655 { 00:17:11.655 "subsystem": "sock", 00:17:11.655 "config": [ 00:17:11.655 { 00:17:11.655 "method": "sock_set_default_impl", 00:17:11.655 "params": { 00:17:11.655 "impl_name": "uring" 00:17:11.655 } 00:17:11.655 }, 00:17:11.655 { 00:17:11.655 "method": "sock_impl_set_options", 00:17:11.655 "params": { 00:17:11.655 "impl_name": "ssl", 00:17:11.655 "recv_buf_size": 4096, 00:17:11.655 "send_buf_size": 4096, 00:17:11.655 "enable_recv_pipe": true, 00:17:11.655 "enable_quickack": false, 00:17:11.655 "enable_placement_id": 0, 00:17:11.655 "enable_zerocopy_send_server": true, 00:17:11.655 "enable_zerocopy_send_client": false, 00:17:11.655 "zerocopy_threshold": 0, 00:17:11.655 "tls_version": 0, 00:17:11.655 "enable_ktls": false 00:17:11.655 } 00:17:11.655 }, 00:17:11.655 { 00:17:11.655 "method": "sock_impl_set_options", 00:17:11.655 "params": { 00:17:11.655 "impl_name": "posix", 00:17:11.655 "recv_buf_size": 2097152, 00:17:11.655 "send_buf_size": 2097152, 00:17:11.655 "enable_recv_pipe": true, 00:17:11.655 "enable_quickack": false, 00:17:11.655 "enable_placement_id": 0, 00:17:11.655 "enable_zerocopy_send_server": true, 00:17:11.655 "enable_zerocopy_send_client": false, 00:17:11.655 "zerocopy_threshold": 0, 00:17:11.655 "tls_version": 0, 00:17:11.655 "enable_ktls": false 00:17:11.655 } 00:17:11.655 }, 00:17:11.655 { 00:17:11.655 "method": "sock_impl_set_options", 00:17:11.655 "params": { 00:17:11.655 "impl_name": "uring", 00:17:11.655 "recv_buf_size": 2097152, 00:17:11.655 "send_buf_size": 2097152, 00:17:11.655 "enable_recv_pipe": true, 00:17:11.655 "enable_quickack": false, 00:17:11.655 "enable_placement_id": 0, 00:17:11.655 "enable_zerocopy_send_server": false, 00:17:11.655 "enable_zerocopy_send_client": false, 00:17:11.655 "zerocopy_threshold": 0, 00:17:11.655 "tls_version": 0, 00:17:11.655 "enable_ktls": false 00:17:11.655 } 00:17:11.655 } 00:17:11.655 ] 00:17:11.655 }, 00:17:11.655 { 00:17:11.655 "subsystem": "vmd", 00:17:11.655 "config": [] 00:17:11.655 }, 00:17:11.655 { 00:17:11.655 "subsystem": "accel", 00:17:11.655 "config": [ 00:17:11.655 { 00:17:11.655 "method": "accel_set_options", 00:17:11.655 "params": { 00:17:11.655 "small_cache_size": 128, 00:17:11.655 "large_cache_size": 16, 00:17:11.655 "task_count": 2048, 00:17:11.656 "sequence_count": 2048, 00:17:11.656 "buf_count": 2048 00:17:11.656 } 00:17:11.656 } 00:17:11.656 ] 00:17:11.656 }, 00:17:11.656 { 00:17:11.656 "subsystem": "bdev", 00:17:11.656 "config": [ 00:17:11.656 { 00:17:11.656 "method": "bdev_set_options", 00:17:11.656 "params": { 00:17:11.656 "bdev_io_pool_size": 65535, 00:17:11.656 "bdev_io_cache_size": 256, 00:17:11.656 "bdev_auto_examine": true, 00:17:11.656 "iobuf_small_cache_size": 128, 00:17:11.656 "iobuf_large_cache_size": 16 00:17:11.656 } 00:17:11.656 }, 00:17:11.656 { 00:17:11.656 "method": "bdev_raid_set_options", 00:17:11.656 "params": { 00:17:11.656 "process_window_size_kb": 1024, 00:17:11.656 "process_max_bandwidth_mb_sec": 0 00:17:11.656 } 00:17:11.656 }, 00:17:11.656 { 00:17:11.656 "method": "bdev_iscsi_set_options", 00:17:11.656 "params": { 00:17:11.656 "timeout_sec": 30 00:17:11.656 } 00:17:11.656 }, 00:17:11.656 { 00:17:11.656 "method": "bdev_nvme_set_options", 00:17:11.656 "params": { 00:17:11.656 "action_on_timeout": "none", 00:17:11.656 "timeout_us": 0, 00:17:11.656 "timeout_admin_us": 0, 00:17:11.656 "keep_alive_timeout_ms": 10000, 00:17:11.656 "arbitration_burst": 0, 00:17:11.656 "low_priority_weight": 0, 00:17:11.656 "medium_priority_weight": 0, 00:17:11.656 "high_priority_weight": 0, 00:17:11.656 "nvme_adminq_poll_period_us": 10000, 00:17:11.656 "nvme_ioq_poll_period_us": 0, 00:17:11.656 "io_queue_requests": 0, 00:17:11.656 "delay_cmd_submit": true, 00:17:11.656 "transport_retry_count": 4, 00:17:11.656 "bdev_retry_count": 3, 00:17:11.656 "transport_ack_timeout": 0, 00:17:11.656 "ctrlr_loss_timeout_sec": 0, 00:17:11.656 "reconnect_delay_sec": 0, 00:17:11.656 "fast_io_fail_timeout_sec": 0, 00:17:11.656 "disable_auto_failback": false, 00:17:11.656 "generate_uuids": false, 00:17:11.656 "transport_tos": 0, 00:17:11.656 "nvme_error_stat": false, 00:17:11.656 "rdma_srq_size": 0, 00:17:11.656 "io_path_stat": false, 00:17:11.656 "allow_accel_sequence": false, 00:17:11.656 "rdma_max_cq_size": 0, 00:17:11.656 "rdma_cm_event_timeout_ms": 0, 00:17:11.656 "dhchap_digests": [ 00:17:11.656 "sha256", 00:17:11.656 "sha384", 00:17:11.656 "sha512" 00:17:11.656 ], 00:17:11.656 "dhchap_dhgroups": [ 00:17:11.656 "null", 00:17:11.656 "ffdhe2048", 00:17:11.656 "ffdhe3072", 00:17:11.656 "ffdhe4096", 00:17:11.656 "ffdhe6144", 00:17:11.656 "ffdhe8192" 00:17:11.656 ] 00:17:11.656 } 00:17:11.656 }, 00:17:11.656 { 00:17:11.656 "method": "bdev_nvme_set_hotplug", 00:17:11.656 "params": { 00:17:11.656 "period_us": 100000, 00:17:11.656 "enable": false 00:17:11.656 } 00:17:11.656 }, 00:17:11.656 { 00:17:11.656 "method": "bdev_malloc_create", 00:17:11.656 "params": { 00:17:11.656 "name": "malloc0", 00:17:11.656 "num_blocks": 8192, 00:17:11.656 "block_size": 4096, 00:17:11.656 "physical_block_size": 4096, 00:17:11.656 "uuid": "e58809f2-cb2d-42d0-982d-21a3d177cc0b", 00:17:11.656 "optimal_io_boundary": 0, 00:17:11.656 "md_size": 0, 00:17:11.656 "dif_type": 0, 00:17:11.656 "dif_is_head_of_md": false, 00:17:11.656 "dif_pi_format": 0 00:17:11.656 } 00:17:11.656 }, 00:17:11.656 { 00:17:11.656 "method": "bdev_wait_for_examine" 00:17:11.656 } 00:17:11.656 ] 00:17:11.656 }, 00:17:11.656 { 00:17:11.656 "subsystem": "nbd", 00:17:11.656 "config": [] 00:17:11.656 }, 00:17:11.656 { 00:17:11.656 "subsystem": "scheduler", 00:17:11.656 "config": [ 00:17:11.656 { 00:17:11.656 "method": "framework_set_scheduler", 00:17:11.656 "params": { 00:17:11.656 "name": "static" 00:17:11.656 } 00:17:11.656 } 00:17:11.656 ] 00:17:11.656 }, 00:17:11.656 { 00:17:11.656 "subsystem": "nvmf", 00:17:11.656 "config": [ 00:17:11.656 { 00:17:11.656 "method": "nvmf_set_config", 00:17:11.656 "params": { 00:17:11.656 "discovery_filter": "match_any", 00:17:11.656 "admin_cmd_passthru": { 00:17:11.656 "identify_ctrlr": false 00:17:11.656 }, 00:17:11.656 "dhchap_digests": [ 00:17:11.656 "sha256", 00:17:11.656 "sha384", 00:17:11.656 "sha512" 00:17:11.656 ], 00:17:11.656 "dhchap_dhgroups": [ 00:17:11.656 "null", 00:17:11.656 "ffdhe2048", 00:17:11.656 "ffdhe3072", 00:17:11.656 "ffdhe4096", 00:17:11.656 "ffdhe6144", 00:17:11.656 "ffdhe8192" 00:17:11.656 ] 00:17:11.656 } 00:17:11.656 }, 00:17:11.656 { 00:17:11.656 "method": "nvmf_set_max_subsystems", 00:17:11.656 "params": { 00:17:11.656 "max_subsystems": 1024 00:17:11.656 } 00:17:11.656 }, 00:17:11.656 { 00:17:11.656 "method": "nvmf_set_crdt", 00:17:11.656 "params": { 00:17:11.656 "crdt1": 0, 00:17:11.656 "crdt2": 0, 00:17:11.656 "crdt3": 0 00:17:11.656 } 00:17:11.656 }, 00:17:11.656 { 00:17:11.656 "method": "nvmf_create_transport", 00:17:11.656 "params": { 00:17:11.656 "trtype": "TCP", 00:17:11.656 "max_queue_depth": 128, 00:17:11.656 "max_io_qpairs_per_ctrlr": 127, 00:17:11.656 "in_capsule_data_size": 4096, 00:17:11.656 "max_io_size": 131072, 00:17:11.656 "io_unit_size": 131072, 00:17:11.656 "max_aq_depth": 128, 00:17:11.656 "num_shared_buffers": 511, 00:17:11.656 "buf_cache_size": 4294967295, 00:17:11.656 "dif_insert_or_strip": false, 00:17:11.656 "zcopy": false, 00:17:11.656 "c2h_success": false, 00:17:11.656 "sock_priority": 0, 00:17:11.656 "abort_timeout_sec": 1, 00:17:11.656 "ack_timeout": 0, 00:17:11.656 "data_wr_pool_size": 0 00:17:11.656 } 00:17:11.656 }, 00:17:11.656 { 00:17:11.656 "method": "nvmf_create_subsystem", 00:17:11.656 "params": { 00:17:11.656 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:11.656 "allow_any_host": false, 00:17:11.656 "serial_number": "00000000000000000000", 00:17:11.656 "model_number": "SPDK bdev Controller", 00:17:11.656 "max_namespaces": 32, 00:17:11.656 "min_cntlid": 1, 00:17:11.656 "max_cntlid": 65519, 00:17:11.656 "ana_reporting": false 00:17:11.656 } 00:17:11.656 }, 00:17:11.656 { 00:17:11.656 "method": "nvmf_subsystem_add_host", 00:17:11.656 "params": { 00:17:11.656 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:11.656 "host": "nqn.2016-06.io.spdk:host1", 00:17:11.656 "psk": "key0" 00:17:11.656 } 00:17:11.656 }, 00:17:11.656 { 00:17:11.656 "method": "nvmf_subsystem_add_ns", 00:17:11.656 "params": { 00:17:11.656 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:11.656 "namespace": { 00:17:11.656 "nsid": 1, 00:17:11.656 "bdev_name": "malloc0", 00:17:11.656 "nguid": "E58809F2CB2D42D0982D21A3D177CC0B", 00:17:11.656 "uuid": "e58809f2-cb2d-42d0-982d-21a3d177cc0b", 00:17:11.656 "no_auto_visible": false 00:17:11.656 } 00:17:11.656 } 00:17:11.656 }, 00:17:11.656 { 00:17:11.656 "method": "nvmf_subsystem_add_listener", 00:17:11.656 "params": { 00:17:11.656 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:11.656 "listen_address": { 00:17:11.656 "trtype": "TCP", 00:17:11.656 "adrfam": "IPv4", 00:17:11.656 "traddr": "10.0.0.3", 00:17:11.656 "trsvcid": "4420" 00:17:11.656 }, 00:17:11.656 "secure_channel": false, 00:17:11.656 "sock_impl": "ssl" 00:17:11.656 } 00:17:11.656 } 00:17:11.656 ] 00:17:11.656 } 00:17:11.656 ] 00:17:11.656 }' 00:17:11.656 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@268 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:17:11.915 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@268 -- # bperfcfg='{ 00:17:11.915 "subsystems": [ 00:17:11.915 { 00:17:11.915 "subsystem": "keyring", 00:17:11.915 "config": [ 00:17:11.915 { 00:17:11.915 "method": "keyring_file_add_key", 00:17:11.915 "params": { 00:17:11.915 "name": "key0", 00:17:11.915 "path": "/tmp/tmp.IF1CqfyxzF" 00:17:11.915 } 00:17:11.915 } 00:17:11.915 ] 00:17:11.915 }, 00:17:11.915 { 00:17:11.915 "subsystem": "iobuf", 00:17:11.915 "config": [ 00:17:11.915 { 00:17:11.915 "method": "iobuf_set_options", 00:17:11.915 "params": { 00:17:11.915 "small_pool_count": 8192, 00:17:11.915 "large_pool_count": 1024, 00:17:11.915 "small_bufsize": 8192, 00:17:11.915 "large_bufsize": 135168 00:17:11.915 } 00:17:11.915 } 00:17:11.915 ] 00:17:11.915 }, 00:17:11.915 { 00:17:11.915 "subsystem": "sock", 00:17:11.915 "config": [ 00:17:11.915 { 00:17:11.915 "method": "sock_set_default_impl", 00:17:11.915 "params": { 00:17:11.915 "impl_name": "uring" 00:17:11.915 } 00:17:11.915 }, 00:17:11.915 { 00:17:11.915 "method": "sock_impl_set_options", 00:17:11.915 "params": { 00:17:11.915 "impl_name": "ssl", 00:17:11.915 "recv_buf_size": 4096, 00:17:11.915 "send_buf_size": 4096, 00:17:11.915 "enable_recv_pipe": true, 00:17:11.915 "enable_quickack": false, 00:17:11.915 "enable_placement_id": 0, 00:17:11.915 "enable_zerocopy_send_server": true, 00:17:11.915 "enable_zerocopy_send_client": false, 00:17:11.915 "zerocopy_threshold": 0, 00:17:11.915 "tls_version": 0, 00:17:11.915 "enable_ktls": false 00:17:11.915 } 00:17:11.915 }, 00:17:11.915 { 00:17:11.915 "method": "sock_impl_set_options", 00:17:11.915 "params": { 00:17:11.915 "impl_name": "posix", 00:17:11.915 "recv_buf_size": 2097152, 00:17:11.915 "send_buf_size": 2097152, 00:17:11.915 "enable_recv_pipe": true, 00:17:11.915 "enable_quickack": false, 00:17:11.915 "enable_placement_id": 0, 00:17:11.915 "enable_zerocopy_send_server": true, 00:17:11.915 "enable_zerocopy_send_client": false, 00:17:11.915 "zerocopy_threshold": 0, 00:17:11.915 "tls_version": 0, 00:17:11.915 "enable_ktls": false 00:17:11.915 } 00:17:11.915 }, 00:17:11.915 { 00:17:11.915 "method": "sock_impl_set_options", 00:17:11.915 "params": { 00:17:11.915 "impl_name": "uring", 00:17:11.915 "recv_buf_size": 2097152, 00:17:11.915 "send_buf_size": 2097152, 00:17:11.915 "enable_recv_pipe": true, 00:17:11.915 "enable_quickack": false, 00:17:11.915 "enable_placement_id": 0, 00:17:11.915 "enable_zerocopy_send_server": false, 00:17:11.915 "enable_zerocopy_send_client": false, 00:17:11.915 "zerocopy_threshold": 0, 00:17:11.915 "tls_version": 0, 00:17:11.915 "enable_ktls": false 00:17:11.915 } 00:17:11.915 } 00:17:11.915 ] 00:17:11.915 }, 00:17:11.915 { 00:17:11.915 "subsystem": "vmd", 00:17:11.915 "config": [] 00:17:11.915 }, 00:17:11.915 { 00:17:11.915 "subsystem": "accel", 00:17:11.915 "config": [ 00:17:11.915 { 00:17:11.915 "method": "accel_set_options", 00:17:11.915 "params": { 00:17:11.915 "small_cache_size": 128, 00:17:11.915 "large_cache_size": 16, 00:17:11.915 "task_count": 2048, 00:17:11.915 "sequence_count": 2048, 00:17:11.915 "buf_count": 2048 00:17:11.915 } 00:17:11.915 } 00:17:11.915 ] 00:17:11.915 }, 00:17:11.915 { 00:17:11.915 "subsystem": "bdev", 00:17:11.915 "config": [ 00:17:11.915 { 00:17:11.915 "method": "bdev_set_options", 00:17:11.915 "params": { 00:17:11.915 "bdev_io_pool_size": 65535, 00:17:11.915 "bdev_io_cache_size": 256, 00:17:11.915 "bdev_auto_examine": true, 00:17:11.915 "iobuf_small_cache_size": 128, 00:17:11.915 "iobuf_large_cache_size": 16 00:17:11.915 } 00:17:11.915 }, 00:17:11.915 { 00:17:11.915 "method": "bdev_raid_set_options", 00:17:11.915 "params": { 00:17:11.915 "process_window_size_kb": 1024, 00:17:11.915 "process_max_bandwidth_mb_sec": 0 00:17:11.915 } 00:17:11.915 }, 00:17:11.915 { 00:17:11.915 "method": "bdev_iscsi_set_options", 00:17:11.915 "params": { 00:17:11.915 "timeout_sec": 30 00:17:11.915 } 00:17:11.915 }, 00:17:11.915 { 00:17:11.915 "method": "bdev_nvme_set_options", 00:17:11.915 "params": { 00:17:11.915 "action_on_timeout": "none", 00:17:11.915 "timeout_us": 0, 00:17:11.915 "timeout_admin_us": 0, 00:17:11.915 "keep_alive_timeout_ms": 10000, 00:17:11.915 "arbitration_burst": 0, 00:17:11.915 "low_priority_weight": 0, 00:17:11.915 "medium_priority_weight": 0, 00:17:11.915 "high_priority_weight": 0, 00:17:11.915 "nvme_adminq_poll_period_us": 10000, 00:17:11.915 "nvme_ioq_poll_period_us": 0, 00:17:11.915 "io_queue_requests": 512, 00:17:11.915 "delay_cmd_submit": true, 00:17:11.915 "transport_retry_count": 4, 00:17:11.915 "bdev_retry_count": 3, 00:17:11.915 "transport_ack_timeout": 0, 00:17:11.915 "ctrlr_loss_timeout_sec": 0, 00:17:11.915 "reconnect_delay_sec": 0, 00:17:11.915 "fast_io_fail_timeout_sec": 0, 00:17:11.915 "disable_auto_failback": false, 00:17:11.915 "generate_uuids": false, 00:17:11.915 "transport_tos": 0, 00:17:11.915 "nvme_error_stat": false, 00:17:11.915 "rdma_srq_size": 0, 00:17:11.915 "io_path_stat": false, 00:17:11.915 "allow_accel_sequence": false, 00:17:11.915 "rdma_max_cq_size": 0, 00:17:11.915 "rdma_cm_event_timeout_ms": 0, 00:17:11.915 "dhchap_digests": [ 00:17:11.915 "sha256", 00:17:11.915 "sha384", 00:17:11.915 "sha512" 00:17:11.915 ], 00:17:11.915 "dhchap_dhgroups": [ 00:17:11.915 "null", 00:17:11.915 "ffdhe2048", 00:17:11.915 "ffdhe3072", 00:17:11.915 "ffdhe4096", 00:17:11.915 "ffdhe6144", 00:17:11.915 "ffdhe8192" 00:17:11.915 ] 00:17:11.915 } 00:17:11.915 }, 00:17:11.916 { 00:17:11.916 "method": "bdev_nvme_attach_controller", 00:17:11.916 "params": { 00:17:11.916 "name": "nvme0", 00:17:11.916 "trtype": "TCP", 00:17:11.916 "adrfam": "IPv4", 00:17:11.916 "traddr": "10.0.0.3", 00:17:11.916 "trsvcid": "4420", 00:17:11.916 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:11.916 "prchk_reftag": false, 00:17:11.916 "prchk_guard": false, 00:17:11.916 "ctrlr_loss_timeout_sec": 0, 00:17:11.916 "reconnect_delay_sec": 0, 00:17:11.916 "fast_io_fail_timeout_sec": 0, 00:17:11.916 "psk": "key0", 00:17:11.916 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:11.916 "hdgst": false, 00:17:11.916 "ddgst": false, 00:17:11.916 "multipath": "multipath" 00:17:11.916 } 00:17:11.916 }, 00:17:11.916 { 00:17:11.916 "method": "bdev_nvme_set_hotplug", 00:17:11.916 "params": { 00:17:11.916 "period_us": 100000, 00:17:11.916 "enable": false 00:17:11.916 } 00:17:11.916 }, 00:17:11.916 { 00:17:11.916 "method": "bdev_enable_histogram", 00:17:11.916 "params": { 00:17:11.916 "name": "nvme0n1", 00:17:11.916 "enable": true 00:17:11.916 } 00:17:11.916 }, 00:17:11.916 { 00:17:11.916 "method": "bdev_wait_for_examine" 00:17:11.916 } 00:17:11.916 ] 00:17:11.916 }, 00:17:11.916 { 00:17:11.916 "subsystem": "nbd", 00:17:11.916 "config": [] 00:17:11.916 } 00:17:11.916 ] 00:17:11.916 }' 00:17:11.916 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@270 -- # killprocess 72788 00:17:11.916 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 72788 ']' 00:17:11.916 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 72788 00:17:11.916 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:17:11.916 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:11.916 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72788 00:17:11.916 killing process with pid 72788 00:17:11.916 Received shutdown signal, test time was about 1.000000 seconds 00:17:11.916 00:17:11.916 Latency(us) 00:17:11.916 [2024-10-07T11:27:53.627Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:11.916 [2024-10-07T11:27:53.627Z] =================================================================================================================== 00:17:11.916 [2024-10-07T11:27:53.627Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:11.916 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:17:11.916 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:17:11.916 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72788' 00:17:11.916 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 72788 00:17:11.916 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 72788 00:17:12.173 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@271 -- # killprocess 72765 00:17:12.173 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 72765 ']' 00:17:12.173 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 72765 00:17:12.174 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:17:12.174 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:12.174 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72765 00:17:12.174 killing process with pid 72765 00:17:12.174 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:17:12.174 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:17:12.174 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72765' 00:17:12.174 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 72765 00:17:12.174 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 72765 00:17:12.432 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@273 -- # nvmfappstart -c /dev/fd/62 00:17:12.432 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:17:12.432 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:17:12.432 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:12.432 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@273 -- # echo '{ 00:17:12.432 "subsystems": [ 00:17:12.432 { 00:17:12.432 "subsystem": "keyring", 00:17:12.432 "config": [ 00:17:12.432 { 00:17:12.432 "method": "keyring_file_add_key", 00:17:12.432 "params": { 00:17:12.432 "name": "key0", 00:17:12.432 "path": "/tmp/tmp.IF1CqfyxzF" 00:17:12.432 } 00:17:12.432 } 00:17:12.432 ] 00:17:12.432 }, 00:17:12.432 { 00:17:12.432 "subsystem": "iobuf", 00:17:12.432 "config": [ 00:17:12.432 { 00:17:12.432 "method": "iobuf_set_options", 00:17:12.432 "params": { 00:17:12.432 "small_pool_count": 8192, 00:17:12.432 "large_pool_count": 1024, 00:17:12.432 "small_bufsize": 8192, 00:17:12.432 "large_bufsize": 135168 00:17:12.432 } 00:17:12.432 } 00:17:12.432 ] 00:17:12.432 }, 00:17:12.432 { 00:17:12.432 "subsystem": "sock", 00:17:12.432 "config": [ 00:17:12.432 { 00:17:12.432 "method": "sock_set_default_impl", 00:17:12.432 "params": { 00:17:12.432 "impl_name": "uring" 00:17:12.432 } 00:17:12.432 }, 00:17:12.432 { 00:17:12.432 "method": "sock_impl_set_options", 00:17:12.432 "params": { 00:17:12.432 "impl_name": "ssl", 00:17:12.432 "recv_buf_size": 4096, 00:17:12.432 "send_buf_size": 4096, 00:17:12.432 "enable_recv_pipe": true, 00:17:12.432 "enable_quickack": false, 00:17:12.432 "enable_placement_id": 0, 00:17:12.432 "enable_zerocopy_send_server": true, 00:17:12.432 "enable_zerocopy_send_client": false, 00:17:12.432 "zerocopy_threshold": 0, 00:17:12.432 "tls_version": 0, 00:17:12.432 "enable_ktls": false 00:17:12.432 } 00:17:12.432 }, 00:17:12.432 { 00:17:12.432 "method": "sock_impl_set_options", 00:17:12.432 "params": { 00:17:12.432 "impl_name": "posix", 00:17:12.432 "recv_buf_size": 2097152, 00:17:12.432 "send_buf_size": 2097152, 00:17:12.432 "enable_recv_pipe": true, 00:17:12.432 "enable_quickack": false, 00:17:12.432 "enable_placement_id": 0, 00:17:12.432 "enable_zerocopy_send_server": true, 00:17:12.432 "enable_zerocopy_send_client": false, 00:17:12.432 "zerocopy_threshold": 0, 00:17:12.432 "tls_version": 0, 00:17:12.432 "enable_ktls": false 00:17:12.432 } 00:17:12.432 }, 00:17:12.432 { 00:17:12.432 "method": "sock_impl_set_options", 00:17:12.432 "params": { 00:17:12.432 "impl_name": "uring", 00:17:12.432 "recv_buf_size": 2097152, 00:17:12.432 "send_buf_size": 2097152, 00:17:12.432 "enable_recv_pipe": true, 00:17:12.432 "enable_quickack": false, 00:17:12.432 "enable_placement_id": 0, 00:17:12.432 "enable_zerocopy_send_server": false, 00:17:12.432 "enable_zerocopy_send_client": false, 00:17:12.432 "zerocopy_threshold": 0, 00:17:12.432 "tls_version": 0, 00:17:12.432 "enable_ktls": false 00:17:12.432 } 00:17:12.432 } 00:17:12.432 ] 00:17:12.432 }, 00:17:12.432 { 00:17:12.432 "subsystem": "vmd", 00:17:12.432 "config": [] 00:17:12.432 }, 00:17:12.432 { 00:17:12.432 "subsystem": "accel", 00:17:12.432 "config": [ 00:17:12.432 { 00:17:12.432 "method": "accel_set_options", 00:17:12.432 "params": { 00:17:12.432 "small_cache_size": 128, 00:17:12.432 "large_cache_size": 16, 00:17:12.432 "task_count": 2048, 00:17:12.432 "sequence_count": 2048, 00:17:12.432 "buf_count": 2048 00:17:12.432 } 00:17:12.432 } 00:17:12.432 ] 00:17:12.432 }, 00:17:12.432 { 00:17:12.433 "subsystem": "bdev", 00:17:12.433 "config": [ 00:17:12.433 { 00:17:12.433 "method": "bdev_set_options", 00:17:12.433 "params": { 00:17:12.433 "bdev_io_pool_size": 65535, 00:17:12.433 "bdev_io_cache_size": 256, 00:17:12.433 "bdev_auto_examine": true, 00:17:12.433 "iobuf_small_cache_size": 128, 00:17:12.433 "iobuf_large_cache_size": 16 00:17:12.433 } 00:17:12.433 }, 00:17:12.433 { 00:17:12.433 "method": "bdev_raid_set_options", 00:17:12.433 "params": { 00:17:12.433 "process_window_size_kb": 1024, 00:17:12.433 "process_max_bandwidth_mb_sec": 0 00:17:12.433 } 00:17:12.433 }, 00:17:12.433 { 00:17:12.433 "method": "bdev_iscsi_set_options", 00:17:12.433 "params": { 00:17:12.433 "timeout_sec": 30 00:17:12.433 } 00:17:12.433 }, 00:17:12.433 { 00:17:12.433 "method": "bdev_nvme_set_options", 00:17:12.433 "params": { 00:17:12.433 "action_on_timeout": "none", 00:17:12.433 "timeout_us": 0, 00:17:12.433 "timeout_admin_us": 0, 00:17:12.433 "keep_alive_timeout_ms": 10000, 00:17:12.433 "arbitration_burst": 0, 00:17:12.433 "low_priority_weight": 0, 00:17:12.433 "medium_priority_weight": 0, 00:17:12.433 "high_priority_weight": 0, 00:17:12.433 "nvme_adminq_poll_period_us": 10000, 00:17:12.433 "nvme_ioq_poll_period_us": 0, 00:17:12.433 "io_queue_requests": 0, 00:17:12.433 "delay_cmd_submit": true, 00:17:12.433 "transport_retry_count": 4, 00:17:12.433 "bdev_retry_count": 3, 00:17:12.433 "transport_ack_timeout": 0, 00:17:12.433 "ctrlr_loss_timeout_sec": 0, 00:17:12.433 "reconnect_delay_sec": 0, 00:17:12.433 "fast_io_fail_timeout_sec": 0, 00:17:12.433 "disable_auto_failback": false, 00:17:12.433 "generate_uuids": false, 00:17:12.433 "transport_tos": 0, 00:17:12.433 "nvme_error_stat": false, 00:17:12.433 "rdma_srq_size": 0, 00:17:12.433 "io_path_stat": false, 00:17:12.433 "allow_accel_sequence": false, 00:17:12.433 "rdma_max_cq_size": 0, 00:17:12.433 "rdma_cm_event_timeout_ms": 0, 00:17:12.433 "dhchap_digests": [ 00:17:12.433 "sha256", 00:17:12.433 "sha384", 00:17:12.433 "sha512" 00:17:12.433 ], 00:17:12.433 "dhchap_dhgroups": [ 00:17:12.433 "null", 00:17:12.433 "ffdhe2048", 00:17:12.433 "ffdhe3072", 00:17:12.433 "ffdhe4096", 00:17:12.433 "ffdhe6144", 00:17:12.433 "ffdhe8192" 00:17:12.433 ] 00:17:12.433 } 00:17:12.433 }, 00:17:12.433 { 00:17:12.433 "method": "bdev_nvme_set_hotplug", 00:17:12.433 "params": { 00:17:12.433 "period_us": 100000, 00:17:12.433 "enable": false 00:17:12.433 } 00:17:12.433 }, 00:17:12.433 { 00:17:12.433 "method": "bdev_malloc_create", 00:17:12.433 "params": { 00:17:12.433 "name": "malloc0", 00:17:12.433 "num_blocks": 8192, 00:17:12.433 "block_size": 4096, 00:17:12.433 "physical_block_size": 4096, 00:17:12.433 "uuid": "e58809f2-cb2d-42d0-982d-21a3d177cc0b", 00:17:12.433 "optimal_io_boundary": 0, 00:17:12.433 "md_size": 0, 00:17:12.433 "dif_type": 0, 00:17:12.433 "dif_is_head_of_md": false, 00:17:12.433 "dif_pi_format": 0 00:17:12.433 } 00:17:12.433 }, 00:17:12.433 { 00:17:12.433 "method": "bdev_wait_for_examine" 00:17:12.433 } 00:17:12.433 ] 00:17:12.433 }, 00:17:12.433 { 00:17:12.433 "subsystem": "nbd", 00:17:12.433 "config": [] 00:17:12.433 }, 00:17:12.433 { 00:17:12.433 "subsystem": "scheduler", 00:17:12.433 "config": [ 00:17:12.433 { 00:17:12.433 "method": "framework_set_scheduler", 00:17:12.433 "params": { 00:17:12.433 "name": "static" 00:17:12.433 } 00:17:12.433 } 00:17:12.433 ] 00:17:12.433 }, 00:17:12.433 { 00:17:12.433 "subsystem": "nvmf", 00:17:12.433 "config": [ 00:17:12.433 { 00:17:12.433 "method": "nvmf_set_config", 00:17:12.433 "params": { 00:17:12.433 "discovery_filter": "match_any", 00:17:12.433 "admin_cmd_passthru": { 00:17:12.433 "identify_ctrlr": false 00:17:12.433 }, 00:17:12.433 "dhchap_digests": [ 00:17:12.433 "sha256", 00:17:12.433 "sha384", 00:17:12.433 "sha512" 00:17:12.433 ], 00:17:12.433 "dhchap_dhgroups": [ 00:17:12.433 "null", 00:17:12.433 "ffdhe2048", 00:17:12.433 "ffdhe3072", 00:17:12.433 "ffdhe4096", 00:17:12.433 "ffdhe6144", 00:17:12.433 "ffdhe8192" 00:17:12.433 ] 00:17:12.433 } 00:17:12.433 }, 00:17:12.433 { 00:17:12.433 "method": "nvmf_set_max_subsystems", 00:17:12.433 "params": { 00:17:12.433 "max_subsystems": 1024 00:17:12.433 } 00:17:12.433 }, 00:17:12.433 { 00:17:12.433 "method": "nvmf_set_crdt", 00:17:12.433 "params": { 00:17:12.433 "crdt1": 0, 00:17:12.433 "crdt2": 0, 00:17:12.433 "crdt3": 0 00:17:12.433 } 00:17:12.433 }, 00:17:12.433 { 00:17:12.433 "method": "nvmf_create_transport", 00:17:12.433 "params": { 00:17:12.433 "trtype": "TCP", 00:17:12.433 "max_queue_depth": 128, 00:17:12.433 "max_io_qpairs_per_ctrlr": 127, 00:17:12.433 "in_capsule_data_size": 4096, 00:17:12.433 "max_io_size": 131072, 00:17:12.433 "io_unit_size": 131072, 00:17:12.433 "max_aq_depth": 128, 00:17:12.433 "num_shared_buffers": 511, 00:17:12.433 "buf_cache_size": 4294967295, 00:17:12.433 "dif_insert_or_strip": false, 00:17:12.433 "zcopy": false, 00:17:12.433 "c2h_success": false, 00:17:12.433 "sock_priority": 0, 00:17:12.433 "abort_timeout_sec": 1, 00:17:12.433 "ack_timeout": 0, 00:17:12.433 "data_wr_pool_size": 0 00:17:12.433 } 00:17:12.433 }, 00:17:12.433 { 00:17:12.433 "method": "nvmf_create_subsystem", 00:17:12.433 "params": { 00:17:12.433 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:12.433 "allow_any_host": false, 00:17:12.433 "serial_number": "00000000000000000000", 00:17:12.433 "model_number": "SPDK bdev Controller", 00:17:12.433 "max_namespaces": 32, 00:17:12.433 "min_cntlid": 1, 00:17:12.433 "max_cntlid": 65519, 00:17:12.433 "ana_reporting": false 00:17:12.433 } 00:17:12.433 }, 00:17:12.433 { 00:17:12.433 "method": "nvmf_subsystem_add_host", 00:17:12.433 "params": { 00:17:12.433 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:12.433 "host": "nqn.2016-06.io.spdk:host1", 00:17:12.433 "psk": "key0" 00:17:12.433 } 00:17:12.433 }, 00:17:12.433 { 00:17:12.433 "method": "nvmf_subsystem_add_ns", 00:17:12.433 "params": { 00:17:12.433 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:12.433 "namespace": { 00:17:12.433 "nsid": 1, 00:17:12.433 "bdev_name": "malloc0", 00:17:12.433 "nguid": "E58809F2CB2D42D0982D21A3D177CC0B", 00:17:12.433 "uuid": "e58809f2-cb2d-42d0-982d-21a3d177cc0b", 00:17:12.433 "no_auto_visible": false 00:17:12.433 } 00:17:12.433 } 00:17:12.433 }, 00:17:12.433 { 00:17:12.433 "method": "nvmf_subsystem_add_listener", 00:17:12.433 "params": { 00:17:12.433 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:12.433 "listen_address": { 00:17:12.433 "trtype": "TCP", 00:17:12.433 "adrfam": "IPv4", 00:17:12.433 "traddr": "10.0.0.3", 00:17:12.433 "trsvcid": "4420" 00:17:12.433 }, 00:17:12.433 "secure_channel": false, 00:17:12.433 "sock_impl": "ssl" 00:17:12.433 } 00:17:12.433 } 00:17:12.433 ] 00:17:12.433 } 00:17:12.433 ] 00:17:12.433 }' 00:17:12.433 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=72838 00:17:12.433 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -c /dev/fd/62 00:17:12.433 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 72838 00:17:12.433 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 72838 ']' 00:17:12.433 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:12.433 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:12.433 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:12.433 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:12.433 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:12.433 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:12.433 [2024-10-07 11:27:53.965470] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:12.433 [2024-10-07 11:27:53.965750] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:12.433 [2024-10-07 11:27:54.100850] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:12.691 [2024-10-07 11:27:54.176392] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:12.691 [2024-10-07 11:27:54.176736] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:12.691 [2024-10-07 11:27:54.176965] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:12.691 [2024-10-07 11:27:54.176994] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:12.691 [2024-10-07 11:27:54.177015] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:12.691 [2024-10-07 11:27:54.177650] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:17:12.691 [2024-10-07 11:27:54.333601] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:17:12.691 [2024-10-07 11:27:54.394702] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:12.949 [2024-10-07 11:27:54.433171] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:12.949 [2024-10-07 11:27:54.433484] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:17:13.515 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:13.515 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:17:13.515 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:17:13.515 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:17:13.515 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:13.773 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:13.773 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:13.773 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@276 -- # bdevperf_pid=72875 00:17:13.773 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@277 -- # waitforlisten 72875 /var/tmp/bdevperf.sock 00:17:13.773 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 72875 ']' 00:17:13.773 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:13.773 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:13.773 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:13.773 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:13.773 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:13.773 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@274 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 2 -z -r /var/tmp/bdevperf.sock -q 128 -o 4k -w verify -t 1 -c /dev/fd/63 00:17:13.773 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@274 -- # echo '{ 00:17:13.773 "subsystems": [ 00:17:13.773 { 00:17:13.773 "subsystem": "keyring", 00:17:13.773 "config": [ 00:17:13.773 { 00:17:13.773 "method": "keyring_file_add_key", 00:17:13.773 "params": { 00:17:13.773 "name": "key0", 00:17:13.773 "path": "/tmp/tmp.IF1CqfyxzF" 00:17:13.773 } 00:17:13.773 } 00:17:13.773 ] 00:17:13.773 }, 00:17:13.773 { 00:17:13.773 "subsystem": "iobuf", 00:17:13.773 "config": [ 00:17:13.773 { 00:17:13.773 "method": "iobuf_set_options", 00:17:13.773 "params": { 00:17:13.773 "small_pool_count": 8192, 00:17:13.773 "large_pool_count": 1024, 00:17:13.773 "small_bufsize": 8192, 00:17:13.773 "large_bufsize": 135168 00:17:13.773 } 00:17:13.773 } 00:17:13.773 ] 00:17:13.773 }, 00:17:13.773 { 00:17:13.773 "subsystem": "sock", 00:17:13.773 "config": [ 00:17:13.773 { 00:17:13.773 "method": "sock_set_default_impl", 00:17:13.773 "params": { 00:17:13.773 "impl_name": "uring" 00:17:13.773 } 00:17:13.773 }, 00:17:13.773 { 00:17:13.773 "method": "sock_impl_set_options", 00:17:13.773 "params": { 00:17:13.773 "impl_name": "ssl", 00:17:13.773 "recv_buf_size": 4096, 00:17:13.773 "send_buf_size": 4096, 00:17:13.773 "enable_recv_pipe": true, 00:17:13.773 "enable_quickack": false, 00:17:13.773 "enable_placement_id": 0, 00:17:13.773 "enable_zerocopy_send_server": true, 00:17:13.773 "enable_zerocopy_send_client": false, 00:17:13.773 "zerocopy_threshold": 0, 00:17:13.773 "tls_version": 0, 00:17:13.773 "enable_ktls": false 00:17:13.773 } 00:17:13.773 }, 00:17:13.773 { 00:17:13.773 "method": "sock_impl_set_options", 00:17:13.773 "params": { 00:17:13.773 "impl_name": "posix", 00:17:13.773 "recv_buf_size": 2097152, 00:17:13.773 "send_buf_size": 2097152, 00:17:13.773 "enable_recv_pipe": true, 00:17:13.773 "enable_quickack": false, 00:17:13.773 "enable_placement_id": 0, 00:17:13.773 "enable_zerocopy_send_server": true, 00:17:13.773 "enable_zerocopy_send_client": false, 00:17:13.773 "zerocopy_threshold": 0, 00:17:13.773 "tls_version": 0, 00:17:13.773 "enable_ktls": false 00:17:13.773 } 00:17:13.773 }, 00:17:13.773 { 00:17:13.773 "method": "sock_impl_set_options", 00:17:13.773 "params": { 00:17:13.773 "impl_name": "uring", 00:17:13.774 "recv_buf_size": 2097152, 00:17:13.774 "send_buf_size": 2097152, 00:17:13.774 "enable_recv_pipe": true, 00:17:13.774 "enable_quickack": false, 00:17:13.774 "enable_placement_id": 0, 00:17:13.774 "enable_zerocopy_send_server": false, 00:17:13.774 "enable_zerocopy_send_client": false, 00:17:13.774 "zerocopy_threshold": 0, 00:17:13.774 "tls_version": 0, 00:17:13.774 "enable_ktls": false 00:17:13.774 } 00:17:13.774 } 00:17:13.774 ] 00:17:13.774 }, 00:17:13.774 { 00:17:13.774 "subsystem": "vmd", 00:17:13.774 "config": [] 00:17:13.774 }, 00:17:13.774 { 00:17:13.774 "subsystem": "accel", 00:17:13.774 "config": [ 00:17:13.774 { 00:17:13.774 "method": "accel_set_options", 00:17:13.774 "params": { 00:17:13.774 "small_cache_size": 128, 00:17:13.774 "large_cache_size": 16, 00:17:13.774 "task_count": 2048, 00:17:13.774 "sequence_count": 2048, 00:17:13.774 "buf_count": 2048 00:17:13.774 } 00:17:13.774 } 00:17:13.774 ] 00:17:13.774 }, 00:17:13.774 { 00:17:13.774 "subsystem": "bdev", 00:17:13.774 "config": [ 00:17:13.774 { 00:17:13.774 "method": "bdev_set_options", 00:17:13.774 "params": { 00:17:13.774 "bdev_io_pool_size": 65535, 00:17:13.774 "bdev_io_cache_size": 256, 00:17:13.774 "bdev_auto_examine": true, 00:17:13.774 "iobuf_small_cache_size": 128, 00:17:13.774 "iobuf_large_cache_size": 16 00:17:13.774 } 00:17:13.774 }, 00:17:13.774 { 00:17:13.774 "method": "bdev_raid_set_options", 00:17:13.774 "params": { 00:17:13.774 "process_window_size_kb": 1024, 00:17:13.774 "process_max_bandwidth_mb_sec": 0 00:17:13.774 } 00:17:13.774 }, 00:17:13.774 { 00:17:13.774 "method": "bdev_iscsi_set_options", 00:17:13.774 "params": { 00:17:13.774 "timeout_sec": 30 00:17:13.774 } 00:17:13.774 }, 00:17:13.774 { 00:17:13.774 "method": "bdev_nvme_set_options", 00:17:13.774 "params": { 00:17:13.774 "action_on_timeout": "none", 00:17:13.774 "timeout_us": 0, 00:17:13.774 "timeout_admin_us": 0, 00:17:13.774 "keep_alive_timeout_ms": 10000, 00:17:13.774 "arbitration_burst": 0, 00:17:13.774 "low_priority_weight": 0, 00:17:13.774 "medium_priority_weight": 0, 00:17:13.774 "high_priority_weight": 0, 00:17:13.774 "nvme_adminq_poll_period_us": 10000, 00:17:13.774 "nvme_ioq_poll_period_us": 0, 00:17:13.774 "io_queue_requests": 512, 00:17:13.774 "delay_cmd_submit": true, 00:17:13.774 "transport_retry_count": 4, 00:17:13.774 "bdev_retry_count": 3, 00:17:13.774 "transport_ack_timeout": 0, 00:17:13.774 "ctrlr_loss_timeout_sec": 0, 00:17:13.774 "reconnect_delay_sec": 0, 00:17:13.774 "fast_io_fail_timeout_sec": 0, 00:17:13.774 "disable_auto_failback": false, 00:17:13.774 "generate_uuids": false, 00:17:13.774 "transport_tos": 0, 00:17:13.774 "nvme_error_stat": false, 00:17:13.774 "rdma_srq_size": 0, 00:17:13.774 "io_path_stat": false, 00:17:13.774 "allow_accel_sequence": false, 00:17:13.774 "rdma_max_cq_size": 0, 00:17:13.774 "rdma_cm_event_timeout_ms": 0, 00:17:13.774 "dhchap_digests": [ 00:17:13.774 "sha256", 00:17:13.774 "sha384", 00:17:13.774 "sha512" 00:17:13.774 ], 00:17:13.774 "dhchap_dhgroups": [ 00:17:13.774 "null", 00:17:13.774 "ffdhe2048", 00:17:13.774 "ffdhe3072", 00:17:13.774 "ffdhe4096", 00:17:13.774 "ffdhe6144", 00:17:13.774 "ffdhe8192" 00:17:13.774 ] 00:17:13.774 } 00:17:13.774 }, 00:17:13.774 { 00:17:13.774 "method": "bdev_nvme_attach_controller", 00:17:13.774 "params": { 00:17:13.774 "name": "nvme0", 00:17:13.774 "trtype": "TCP", 00:17:13.774 "adrfam": "IPv4", 00:17:13.774 "traddr": "10.0.0.3", 00:17:13.774 "trsvcid": "4420", 00:17:13.774 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:13.774 "prchk_reftag": false, 00:17:13.774 "prchk_guard": false, 00:17:13.774 "ctrlr_loss_timeout_sec": 0, 00:17:13.774 "reconnect_delay_sec": 0, 00:17:13.774 "fast_io_fail_timeout_sec": 0, 00:17:13.774 "psk": "key0", 00:17:13.774 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:13.774 "hdgst": false, 00:17:13.774 "ddgst": false, 00:17:13.774 "multipath": "multipath" 00:17:13.774 } 00:17:13.774 }, 00:17:13.774 { 00:17:13.774 "method": "bdev_nvme_set_hotplug", 00:17:13.774 "params": { 00:17:13.774 "period_us": 100000, 00:17:13.774 "enable": false 00:17:13.774 } 00:17:13.774 }, 00:17:13.774 { 00:17:13.774 "method": "bdev_enable_histogram", 00:17:13.774 "params": { 00:17:13.774 "name": "nvme0n1", 00:17:13.774 "enable": true 00:17:13.774 } 00:17:13.774 }, 00:17:13.774 { 00:17:13.774 "method": "bdev_wait_for_examine" 00:17:13.774 } 00:17:13.774 ] 00:17:13.774 }, 00:17:13.774 { 00:17:13.774 "subsystem": "nbd", 00:17:13.774 "config": [] 00:17:13.774 } 00:17:13.774 ] 00:17:13.774 }' 00:17:13.774 [2024-10-07 11:27:55.295219] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:13.774 [2024-10-07 11:27:55.295347] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid72875 ] 00:17:13.774 [2024-10-07 11:27:55.440250] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:14.031 [2024-10-07 11:27:55.514547] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:17:14.031 [2024-10-07 11:27:55.630504] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:17:14.031 [2024-10-07 11:27:55.670700] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:14.613 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:14.613 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:17:14.613 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@279 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:17:14.613 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@279 -- # jq -r '.[].name' 00:17:15.178 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@279 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:15.179 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@280 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:15.179 Running I/O for 1 seconds... 00:17:16.112 3751.00 IOPS, 14.65 MiB/s 00:17:16.112 Latency(us) 00:17:16.112 [2024-10-07T11:27:57.823Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:16.112 Job: nvme0n1 (Core Mask 0x2, workload: verify, depth: 128, IO size: 4096) 00:17:16.112 Verification LBA range: start 0x0 length 0x2000 00:17:16.112 nvme0n1 : 1.02 3800.92 14.85 0.00 0.00 33283.71 8936.73 28597.53 00:17:16.112 [2024-10-07T11:27:57.823Z] =================================================================================================================== 00:17:16.112 [2024-10-07T11:27:57.823Z] Total : 3800.92 14.85 0.00 0.00 33283.71 8936.73 28597.53 00:17:16.112 { 00:17:16.112 "results": [ 00:17:16.112 { 00:17:16.112 "job": "nvme0n1", 00:17:16.112 "core_mask": "0x2", 00:17:16.112 "workload": "verify", 00:17:16.112 "status": "finished", 00:17:16.112 "verify_range": { 00:17:16.112 "start": 0, 00:17:16.112 "length": 8192 00:17:16.112 }, 00:17:16.112 "queue_depth": 128, 00:17:16.112 "io_size": 4096, 00:17:16.112 "runtime": 1.020542, 00:17:16.112 "iops": 3800.9214711398454, 00:17:16.112 "mibps": 14.847349496640021, 00:17:16.112 "io_failed": 0, 00:17:16.112 "io_timeout": 0, 00:17:16.112 "avg_latency_us": 33283.71451686236, 00:17:16.112 "min_latency_us": 8936.727272727272, 00:17:16.112 "max_latency_us": 28597.52727272727 00:17:16.112 } 00:17:16.112 ], 00:17:16.112 "core_count": 1 00:17:16.112 } 00:17:16.112 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@282 -- # trap - SIGINT SIGTERM EXIT 00:17:16.112 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@283 -- # cleanup 00:17:16.112 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@15 -- # process_shm --id 0 00:17:16.112 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@808 -- # type=--id 00:17:16.112 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@809 -- # id=0 00:17:16.112 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@810 -- # '[' --id = --pid ']' 00:17:16.112 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@814 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:16.112 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@814 -- # shm_files=nvmf_trace.0 00:17:16.112 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@816 -- # [[ -z nvmf_trace.0 ]] 00:17:16.112 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@820 -- # for n in $shm_files 00:17:16.112 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@821 -- # tar -C /dev/shm/ -cvzf /home/vagrant/spdk_repo/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:16.112 nvmf_trace.0 00:17:16.404 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@823 -- # return 0 00:17:16.404 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@16 -- # killprocess 72875 00:17:16.404 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 72875 ']' 00:17:16.404 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 72875 00:17:16.404 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:17:16.404 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:16.404 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72875 00:17:16.404 killing process with pid 72875 00:17:16.404 Received shutdown signal, test time was about 1.000000 seconds 00:17:16.404 00:17:16.404 Latency(us) 00:17:16.404 [2024-10-07T11:27:58.115Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:16.404 [2024-10-07T11:27:58.115Z] =================================================================================================================== 00:17:16.404 [2024-10-07T11:27:58.115Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:16.404 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:17:16.404 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:17:16.404 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72875' 00:17:16.404 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 72875 00:17:16.404 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 72875 00:17:16.404 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@17 -- # nvmftestfini 00:17:16.404 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@514 -- # nvmfcleanup 00:17:16.404 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@121 -- # sync 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@124 -- # set +e 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@125 -- # for i in {1..20} 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:17:16.662 rmmod nvme_tcp 00:17:16.662 rmmod nvme_fabrics 00:17:16.662 rmmod nvme_keyring 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@128 -- # set -e 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@129 -- # return 0 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@515 -- # '[' -n 72838 ']' 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@516 -- # killprocess 72838 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 72838 ']' 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 72838 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72838 00:17:16.662 killing process with pid 72838 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72838' 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 72838 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 72838 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@297 -- # iptr 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@789 -- # iptables-save 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@789 -- # iptables-restore 00:17:16.662 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@246 -- # remove_spdk_ns 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@300 -- # return 0 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@18 -- # rm -f /tmp/tmp.KuRNlgGtwf /tmp/tmp.VsRwRXAbOf /tmp/tmp.IF1CqfyxzF 00:17:16.921 ************************************ 00:17:16.921 END TEST nvmf_tls 00:17:16.921 ************************************ 00:17:16.921 00:17:16.921 real 1m28.084s 00:17:16.921 user 2m26.803s 00:17:16.921 sys 0m26.577s 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1126 -- # xtrace_disable 00:17:16.921 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@42 -- # run_test nvmf_fips /home/vagrant/spdk_repo/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:17:17.180 ************************************ 00:17:17.180 START TEST nvmf_fips 00:17:17.180 ************************************ 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:17:17.180 * Looking for test storage... 00:17:17.180 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/fips 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1681 -- # lcov --version 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@333 -- # local ver1 ver1_l 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@334 -- # local ver2 ver2_l 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@336 -- # IFS=.-: 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@336 -- # read -ra ver1 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@337 -- # IFS=.-: 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@337 -- # read -ra ver2 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@338 -- # local 'op=<' 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@340 -- # ver1_l=2 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@341 -- # ver2_l=1 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@344 -- # case "$op" in 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@345 -- # : 1 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v = 0 )) 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # decimal 1 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=1 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 1 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # ver1[v]=1 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # decimal 2 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=2 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 2 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # ver2[v]=2 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@368 -- # return 0 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:17:17.180 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:17.180 --rc genhtml_branch_coverage=1 00:17:17.180 --rc genhtml_function_coverage=1 00:17:17.180 --rc genhtml_legend=1 00:17:17.180 --rc geninfo_all_blocks=1 00:17:17.180 --rc geninfo_unexecuted_blocks=1 00:17:17.180 00:17:17.180 ' 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:17:17.180 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:17.180 --rc genhtml_branch_coverage=1 00:17:17.180 --rc genhtml_function_coverage=1 00:17:17.180 --rc genhtml_legend=1 00:17:17.180 --rc geninfo_all_blocks=1 00:17:17.180 --rc geninfo_unexecuted_blocks=1 00:17:17.180 00:17:17.180 ' 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:17:17.180 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:17.180 --rc genhtml_branch_coverage=1 00:17:17.180 --rc genhtml_function_coverage=1 00:17:17.180 --rc genhtml_legend=1 00:17:17.180 --rc geninfo_all_blocks=1 00:17:17.180 --rc geninfo_unexecuted_blocks=1 00:17:17.180 00:17:17.180 ' 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:17:17.180 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:17.180 --rc genhtml_branch_coverage=1 00:17:17.180 --rc genhtml_function_coverage=1 00:17:17.180 --rc genhtml_legend=1 00:17:17.180 --rc geninfo_all_blocks=1 00:17:17.180 --rc geninfo_unexecuted_blocks=1 00:17:17.180 00:17:17.180 ' 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@11 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@7 -- # uname -s 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@15 -- # shopt -s extglob 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:17.180 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@5 -- # export PATH 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@51 -- # : 0 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:17:17.181 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@55 -- # have_pci_nics=0 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@12 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@90 -- # check_openssl_version 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@84 -- # local target=3.0.0 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@86 -- # openssl version 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@86 -- # awk '{print $2}' 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@86 -- # ge 3.1.1 3.0.0 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@376 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@333 -- # local ver1 ver1_l 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@334 -- # local ver2 ver2_l 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@336 -- # IFS=.-: 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@336 -- # read -ra ver1 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@337 -- # IFS=.-: 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@337 -- # read -ra ver2 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@338 -- # local 'op=>=' 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@340 -- # ver1_l=3 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@341 -- # ver2_l=3 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@344 -- # case "$op" in 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@348 -- # : 1 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v = 0 )) 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # decimal 3 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=3 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 3 =~ ^[0-9]+$ ]] 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 3 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # ver1[v]=3 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # decimal 3 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=3 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 3 =~ ^[0-9]+$ ]] 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 3 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # ver2[v]=3 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v++ )) 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # decimal 1 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=1 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 1 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # ver1[v]=1 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # decimal 0 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=0 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 0 =~ ^[0-9]+$ ]] 00:17:17.181 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 0 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # ver2[v]=0 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@367 -- # return 0 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@96 -- # openssl info -modulesdir 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@96 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@101 -- # openssl fipsinstall -help 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@101 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@102 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@105 -- # export callback=build_openssl_config 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@105 -- # callback=build_openssl_config 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@114 -- # build_openssl_config 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@38 -- # cat 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@58 -- # [[ ! -t 0 ]] 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@59 -- # cat - 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@115 -- # export OPENSSL_CONF=spdk_fips.conf 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@115 -- # OPENSSL_CONF=spdk_fips.conf 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@117 -- # mapfile -t providers 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@117 -- # openssl list -providers 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@117 -- # grep name 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@121 -- # (( 2 != 2 )) 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@121 -- # [[ name: openssl base provider != *base* ]] 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@121 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@128 -- # NOT openssl md5 /dev/fd/62 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@128 -- # : 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@650 -- # local es=0 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:17:17.439 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@638 -- # local arg=openssl 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@642 -- # type -t openssl 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@644 -- # type -P openssl 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:17:17.440 Error setting digest 00:17:17.440 40A257C1727F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:17:17.440 40A257C1727F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@653 -- # es=1 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@131 -- # nvmftestinit 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@474 -- # prepare_net_devs 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@436 -- # local -g is_hw=no 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@438 -- # remove_spdk_ns 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:17.440 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@458 -- # nvmf_veth_init 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:17:17.440 Cannot find device "nvmf_init_br" 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@162 -- # true 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:17:17.440 Cannot find device "nvmf_init_br2" 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@163 -- # true 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:17:17.440 Cannot find device "nvmf_tgt_br" 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@164 -- # true 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:17:17.440 Cannot find device "nvmf_tgt_br2" 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@165 -- # true 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:17:17.440 Cannot find device "nvmf_init_br" 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@166 -- # true 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:17:17.440 Cannot find device "nvmf_init_br2" 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@167 -- # true 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:17:17.440 Cannot find device "nvmf_tgt_br" 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@168 -- # true 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:17:17.440 Cannot find device "nvmf_tgt_br2" 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@169 -- # true 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:17:17.440 Cannot find device "nvmf_br" 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@170 -- # true 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:17:17.440 Cannot find device "nvmf_init_if" 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@171 -- # true 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:17:17.440 Cannot find device "nvmf_init_if2" 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@172 -- # true 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:17.440 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@173 -- # true 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:17.440 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@174 -- # true 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:17:17.440 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:17:17.698 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:17:17.698 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.068 ms 00:17:17.698 00:17:17.698 --- 10.0.0.3 ping statistics --- 00:17:17.698 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:17.698 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:17:17.698 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:17:17.698 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.068 ms 00:17:17.698 00:17:17.698 --- 10.0.0.4 ping statistics --- 00:17:17.698 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:17.698 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:17:17.698 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:17.698 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.027 ms 00:17:17.698 00:17:17.698 --- 10.0.0.1 ping statistics --- 00:17:17.698 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:17.698 rtt min/avg/max/mdev = 0.027/0.027/0.027/0.000 ms 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:17:17.698 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:17.698 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.068 ms 00:17:17.698 00:17:17.698 --- 10.0.0.2 ping statistics --- 00:17:17.698 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:17.698 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@459 -- # return 0 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:17:17.698 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:17:17.956 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@132 -- # nvmfappstart -m 0x2 00:17:17.956 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:17:17.956 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@724 -- # xtrace_disable 00:17:17.956 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:17:17.956 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@507 -- # nvmfpid=73198 00:17:17.956 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:17.956 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@508 -- # waitforlisten 73198 00:17:17.956 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@831 -- # '[' -z 73198 ']' 00:17:17.956 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:17.956 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:17.956 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:17.956 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:17.956 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:17.956 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:17:17.956 [2024-10-07 11:27:59.505523] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:17.956 [2024-10-07 11:27:59.506104] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:17.956 [2024-10-07 11:27:59.635957] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:18.214 [2024-10-07 11:27:59.693841] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:18.214 [2024-10-07 11:27:59.693890] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:18.214 [2024-10-07 11:27:59.693901] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:18.214 [2024-10-07 11:27:59.693909] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:18.214 [2024-10-07 11:27:59.693917] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:18.214 [2024-10-07 11:27:59.694215] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:17:18.214 [2024-10-07 11:27:59.722814] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:17:19.146 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:19.146 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@864 -- # return 0 00:17:19.146 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:17:19.146 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@730 -- # xtrace_disable 00:17:19.146 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:17:19.146 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:19.146 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@134 -- # trap cleanup EXIT 00:17:19.146 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@137 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:17:19.146 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@138 -- # mktemp -t spdk-psk.XXX 00:17:19.146 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@138 -- # key_path=/tmp/spdk-psk.lCU 00:17:19.146 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@139 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:17:19.146 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@140 -- # chmod 0600 /tmp/spdk-psk.lCU 00:17:19.146 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@142 -- # setup_nvmf_tgt_conf /tmp/spdk-psk.lCU 00:17:19.146 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@22 -- # local key=/tmp/spdk-psk.lCU 00:17:19.146 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@24 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:17:19.403 [2024-10-07 11:28:00.922050] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:19.403 [2024-10-07 11:28:00.938014] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:19.403 [2024-10-07 11:28:00.938252] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:17:19.403 malloc0 00:17:19.403 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@145 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:19.403 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@148 -- # bdevperf_pid=73234 00:17:19.403 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@146 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:19.403 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@149 -- # waitforlisten 73234 /var/tmp/bdevperf.sock 00:17:19.403 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@831 -- # '[' -z 73234 ']' 00:17:19.403 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:19.403 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:19.403 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:19.403 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:19.403 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:19.403 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:17:19.403 [2024-10-07 11:28:01.082686] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:19.403 [2024-10-07 11:28:01.082796] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid73234 ] 00:17:19.660 [2024-10-07 11:28:01.214995] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:19.660 [2024-10-07 11:28:01.280289] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:17:19.660 [2024-10-07 11:28:01.310544] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:17:20.618 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:20.618 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@864 -- # return 0 00:17:20.618 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@151 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/spdk-psk.lCU 00:17:20.875 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@152 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:17:21.133 [2024-10-07 11:28:02.633631] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:21.133 TLSTESTn1 00:17:21.133 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@156 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:21.391 Running I/O for 10 seconds... 00:17:23.258 3761.00 IOPS, 14.69 MiB/s [2024-10-07T11:28:06.342Z] 3863.50 IOPS, 15.09 MiB/s [2024-10-07T11:28:06.932Z] 3763.33 IOPS, 14.70 MiB/s [2024-10-07T11:28:08.305Z] 3766.75 IOPS, 14.71 MiB/s [2024-10-07T11:28:09.236Z] 3782.00 IOPS, 14.77 MiB/s [2024-10-07T11:28:10.170Z] 3790.67 IOPS, 14.81 MiB/s [2024-10-07T11:28:11.136Z] 3820.71 IOPS, 14.92 MiB/s [2024-10-07T11:28:12.068Z] 3812.12 IOPS, 14.89 MiB/s [2024-10-07T11:28:13.002Z] 3819.11 IOPS, 14.92 MiB/s [2024-10-07T11:28:13.002Z] 3820.10 IOPS, 14.92 MiB/s 00:17:31.291 Latency(us) 00:17:31.291 [2024-10-07T11:28:13.002Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:31.291 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:31.291 Verification LBA range: start 0x0 length 0x2000 00:17:31.291 TLSTESTn1 : 10.02 3826.31 14.95 0.00 0.00 33392.12 5957.82 33125.47 00:17:31.291 [2024-10-07T11:28:13.002Z] =================================================================================================================== 00:17:31.291 [2024-10-07T11:28:13.002Z] Total : 3826.31 14.95 0.00 0.00 33392.12 5957.82 33125.47 00:17:31.291 { 00:17:31.291 "results": [ 00:17:31.291 { 00:17:31.291 "job": "TLSTESTn1", 00:17:31.291 "core_mask": "0x4", 00:17:31.291 "workload": "verify", 00:17:31.291 "status": "finished", 00:17:31.291 "verify_range": { 00:17:31.291 "start": 0, 00:17:31.291 "length": 8192 00:17:31.291 }, 00:17:31.291 "queue_depth": 128, 00:17:31.291 "io_size": 4096, 00:17:31.291 "runtime": 10.016443, 00:17:31.291 "iops": 3826.308401096078, 00:17:31.291 "mibps": 14.946517191781554, 00:17:31.291 "io_failed": 0, 00:17:31.291 "io_timeout": 0, 00:17:31.291 "avg_latency_us": 33392.11821872643, 00:17:31.291 "min_latency_us": 5957.818181818182, 00:17:31.291 "max_latency_us": 33125.46909090909 00:17:31.291 } 00:17:31.291 ], 00:17:31.291 "core_count": 1 00:17:31.291 } 00:17:31.291 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@1 -- # cleanup 00:17:31.291 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@15 -- # process_shm --id 0 00:17:31.291 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@808 -- # type=--id 00:17:31.291 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@809 -- # id=0 00:17:31.291 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@810 -- # '[' --id = --pid ']' 00:17:31.291 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@814 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:31.291 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@814 -- # shm_files=nvmf_trace.0 00:17:31.291 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@816 -- # [[ -z nvmf_trace.0 ]] 00:17:31.291 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@820 -- # for n in $shm_files 00:17:31.291 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@821 -- # tar -C /dev/shm/ -cvzf /home/vagrant/spdk_repo/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:31.291 nvmf_trace.0 00:17:31.549 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@823 -- # return 0 00:17:31.549 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@16 -- # killprocess 73234 00:17:31.549 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@950 -- # '[' -z 73234 ']' 00:17:31.549 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@954 -- # kill -0 73234 00:17:31.549 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@955 -- # uname 00:17:31.549 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:31.549 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 73234 00:17:31.549 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:17:31.549 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:17:31.549 killing process with pid 73234 00:17:31.549 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@968 -- # echo 'killing process with pid 73234' 00:17:31.549 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@969 -- # kill 73234 00:17:31.549 Received shutdown signal, test time was about 10.000000 seconds 00:17:31.549 00:17:31.549 Latency(us) 00:17:31.549 [2024-10-07T11:28:13.260Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:31.549 [2024-10-07T11:28:13.260Z] =================================================================================================================== 00:17:31.549 [2024-10-07T11:28:13.260Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:31.549 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@974 -- # wait 73234 00:17:31.549 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@17 -- # nvmftestfini 00:17:31.549 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@514 -- # nvmfcleanup 00:17:31.549 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@121 -- # sync 00:17:31.807 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:17:31.807 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@124 -- # set +e 00:17:31.807 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@125 -- # for i in {1..20} 00:17:31.807 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:17:31.807 rmmod nvme_tcp 00:17:31.807 rmmod nvme_fabrics 00:17:31.807 rmmod nvme_keyring 00:17:31.807 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:17:31.807 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@128 -- # set -e 00:17:31.807 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@129 -- # return 0 00:17:31.807 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@515 -- # '[' -n 73198 ']' 00:17:31.807 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@516 -- # killprocess 73198 00:17:31.807 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@950 -- # '[' -z 73198 ']' 00:17:31.807 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@954 -- # kill -0 73198 00:17:31.807 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@955 -- # uname 00:17:31.807 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:31.807 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 73198 00:17:31.807 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:17:31.807 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:17:31.807 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@968 -- # echo 'killing process with pid 73198' 00:17:31.807 killing process with pid 73198 00:17:31.807 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@969 -- # kill 73198 00:17:31.807 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@974 -- # wait 73198 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@297 -- # iptr 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@789 -- # iptables-save 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@789 -- # iptables-restore 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@246 -- # remove_spdk_ns 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:32.066 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:32.324 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@300 -- # return 0 00:17:32.324 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@18 -- # rm -f /tmp/spdk-psk.lCU 00:17:32.324 00:17:32.324 real 0m15.126s 00:17:32.324 user 0m21.652s 00:17:32.324 sys 0m5.511s 00:17:32.324 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1126 -- # xtrace_disable 00:17:32.324 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:17:32.324 ************************************ 00:17:32.324 END TEST nvmf_fips 00:17:32.324 ************************************ 00:17:32.324 11:28:13 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@43 -- # run_test nvmf_control_msg_list /home/vagrant/spdk_repo/spdk/test/nvmf/target/control_msg_list.sh --transport=tcp 00:17:32.324 11:28:13 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:17:32.324 11:28:13 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:17:32.324 11:28:13 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:17:32.324 ************************************ 00:17:32.324 START TEST nvmf_control_msg_list 00:17:32.324 ************************************ 00:17:32.324 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/control_msg_list.sh --transport=tcp 00:17:32.324 * Looking for test storage... 00:17:32.324 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:17:32.324 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:17:32.324 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:17:32.324 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1681 -- # lcov --version 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@333 -- # local ver1 ver1_l 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@334 -- # local ver2 ver2_l 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@336 -- # IFS=.-: 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@336 -- # read -ra ver1 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@337 -- # IFS=.-: 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@337 -- # read -ra ver2 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@338 -- # local 'op=<' 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@340 -- # ver1_l=2 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@341 -- # ver2_l=1 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@344 -- # case "$op" in 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@345 -- # : 1 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@364 -- # (( v = 0 )) 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@365 -- # decimal 1 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@353 -- # local d=1 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@355 -- # echo 1 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@365 -- # ver1[v]=1 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@366 -- # decimal 2 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@353 -- # local d=2 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@355 -- # echo 2 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@366 -- # ver2[v]=2 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@368 -- # return 0 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:17:32.325 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:32.325 --rc genhtml_branch_coverage=1 00:17:32.325 --rc genhtml_function_coverage=1 00:17:32.325 --rc genhtml_legend=1 00:17:32.325 --rc geninfo_all_blocks=1 00:17:32.325 --rc geninfo_unexecuted_blocks=1 00:17:32.325 00:17:32.325 ' 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:17:32.325 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:32.325 --rc genhtml_branch_coverage=1 00:17:32.325 --rc genhtml_function_coverage=1 00:17:32.325 --rc genhtml_legend=1 00:17:32.325 --rc geninfo_all_blocks=1 00:17:32.325 --rc geninfo_unexecuted_blocks=1 00:17:32.325 00:17:32.325 ' 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:17:32.325 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:32.325 --rc genhtml_branch_coverage=1 00:17:32.325 --rc genhtml_function_coverage=1 00:17:32.325 --rc genhtml_legend=1 00:17:32.325 --rc geninfo_all_blocks=1 00:17:32.325 --rc geninfo_unexecuted_blocks=1 00:17:32.325 00:17:32.325 ' 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:17:32.325 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:32.325 --rc genhtml_branch_coverage=1 00:17:32.325 --rc genhtml_function_coverage=1 00:17:32.325 --rc genhtml_legend=1 00:17:32.325 --rc geninfo_all_blocks=1 00:17:32.325 --rc geninfo_unexecuted_blocks=1 00:17:32.325 00:17:32.325 ' 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@7 -- # uname -s 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:32.325 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@15 -- # shopt -s extglob 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@5 -- # export PATH 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@51 -- # : 0 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:17:32.584 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@55 -- # have_pci_nics=0 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@12 -- # nvmftestinit 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@474 -- # prepare_net_devs 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@436 -- # local -g is_hw=no 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@438 -- # remove_spdk_ns 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@458 -- # nvmf_veth_init 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:17:32.584 Cannot find device "nvmf_init_br" 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@162 -- # true 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:17:32.584 Cannot find device "nvmf_init_br2" 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@163 -- # true 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:17:32.584 Cannot find device "nvmf_tgt_br" 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@164 -- # true 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:17:32.584 Cannot find device "nvmf_tgt_br2" 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@165 -- # true 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:17:32.584 Cannot find device "nvmf_init_br" 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@166 -- # true 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:17:32.584 Cannot find device "nvmf_init_br2" 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@167 -- # true 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:17:32.584 Cannot find device "nvmf_tgt_br" 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@168 -- # true 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:17:32.584 Cannot find device "nvmf_tgt_br2" 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@169 -- # true 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:17:32.584 Cannot find device "nvmf_br" 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@170 -- # true 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:17:32.584 Cannot find device "nvmf_init_if" 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@171 -- # true 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:17:32.584 Cannot find device "nvmf_init_if2" 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@172 -- # true 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:32.584 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@173 -- # true 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:32.584 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@174 -- # true 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:17:32.584 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:17:32.585 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:17:32.585 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:17:32.585 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:17:32.585 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:17:32.585 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:17:32.585 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:17:32.585 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:17:32.585 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:17:32.585 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:17:32.585 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:17:32.585 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:17:32.585 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:17:32.585 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:17:32.585 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:17:32.585 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:17:32.585 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:17:32.585 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:17:32.585 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:17:32.843 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:17:32.843 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.087 ms 00:17:32.843 00:17:32.843 --- 10.0.0.3 ping statistics --- 00:17:32.843 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:32.843 rtt min/avg/max/mdev = 0.087/0.087/0.087/0.000 ms 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:17:32.843 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:17:32.843 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.061 ms 00:17:32.843 00:17:32.843 --- 10.0.0.4 ping statistics --- 00:17:32.843 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:32.843 rtt min/avg/max/mdev = 0.061/0.061/0.061/0.000 ms 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:17:32.843 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:32.843 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.030 ms 00:17:32.843 00:17:32.843 --- 10.0.0.1 ping statistics --- 00:17:32.843 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:32.843 rtt min/avg/max/mdev = 0.030/0.030/0.030/0.000 ms 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:17:32.843 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:32.843 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.072 ms 00:17:32.843 00:17:32.843 --- 10.0.0.2 ping statistics --- 00:17:32.843 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:32.843 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@459 -- # return 0 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@13 -- # nvmfappstart 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@724 -- # xtrace_disable 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:17:32.843 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@507 -- # nvmfpid=73629 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@508 -- # waitforlisten 73629 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@831 -- # '[' -z 73629 ']' 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:32.843 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:17:32.843 [2024-10-07 11:28:14.503225] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:32.843 [2024-10-07 11:28:14.504269] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:33.102 [2024-10-07 11:28:14.653255] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:33.102 [2024-10-07 11:28:14.722667] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:33.102 [2024-10-07 11:28:14.722952] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:33.102 [2024-10-07 11:28:14.723115] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:33.102 [2024-10-07 11:28:14.723280] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:33.102 [2024-10-07 11:28:14.723328] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:33.102 [2024-10-07 11:28:14.723822] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:17:33.102 [2024-10-07 11:28:14.756563] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@864 -- # return 0 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@730 -- # xtrace_disable 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@15 -- # subnqn=nqn.2024-07.io.spdk:cnode0 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@16 -- # perf=/home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@19 -- # rpc_cmd nvmf_create_transport '-t tcp -o' --in-capsule-data-size 768 --control-msg-num 1 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:17:34.065 [2024-10-07 11:28:15.587043] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2024-07.io.spdk:cnode0 -a 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 32 512 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:17:34.065 Malloc0 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2024-07.io.spdk:cnode0 Malloc0 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2024-07.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4420 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:17:34.065 [2024-10-07 11:28:15.642327] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@27 -- # perf_pid1=73662 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@26 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -c 0x2 -q 1 -o 4096 -w randread -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@29 -- # perf_pid2=73663 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@28 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -c 0x4 -q 1 -o 4096 -w randread -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@31 -- # perf_pid3=73664 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@33 -- # wait 73662 00:17:34.065 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@30 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -c 0x8 -q 1 -o 4096 -w randread -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:17:34.323 [2024-10-07 11:28:15.812719] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.3/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:17:34.323 [2024-10-07 11:28:15.823199] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.3/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:17:34.323 [2024-10-07 11:28:15.823435] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.3/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:17:35.257 Initializing NVMe Controllers 00:17:35.257 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2024-07.io.spdk:cnode0 00:17:35.257 Associating TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 with lcore 1 00:17:35.257 Initialization complete. Launching workers. 00:17:35.257 ======================================================== 00:17:35.257 Latency(us) 00:17:35.257 Device Information : IOPS MiB/s Average min max 00:17:35.257 TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 from core 1: 3262.99 12.75 306.21 140.60 694.04 00:17:35.257 ======================================================== 00:17:35.257 Total : 3262.99 12.75 306.21 140.60 694.04 00:17:35.257 00:17:35.257 Initializing NVMe Controllers 00:17:35.257 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2024-07.io.spdk:cnode0 00:17:35.257 Associating TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 with lcore 2 00:17:35.257 Initialization complete. Launching workers. 00:17:35.257 ======================================================== 00:17:35.257 Latency(us) 00:17:35.257 Device Information : IOPS MiB/s Average min max 00:17:35.257 TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 from core 2: 3219.00 12.57 310.21 230.99 707.42 00:17:35.257 ======================================================== 00:17:35.257 Total : 3219.00 12.57 310.21 230.99 707.42 00:17:35.257 00:17:35.257 Initializing NVMe Controllers 00:17:35.257 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2024-07.io.spdk:cnode0 00:17:35.257 Associating TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 with lcore 3 00:17:35.257 Initialization complete. Launching workers. 00:17:35.257 ======================================================== 00:17:35.257 Latency(us) 00:17:35.257 Device Information : IOPS MiB/s Average min max 00:17:35.257 TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 from core 3: 3240.00 12.66 308.21 187.96 653.60 00:17:35.257 ======================================================== 00:17:35.257 Total : 3240.00 12.66 308.21 187.96 653.60 00:17:35.257 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@34 -- # wait 73663 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@35 -- # wait 73664 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@38 -- # nvmftestfini 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@514 -- # nvmfcleanup 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@121 -- # sync 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@124 -- # set +e 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@125 -- # for i in {1..20} 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:17:35.257 rmmod nvme_tcp 00:17:35.257 rmmod nvme_fabrics 00:17:35.257 rmmod nvme_keyring 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@128 -- # set -e 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@129 -- # return 0 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@515 -- # '[' -n 73629 ']' 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@516 -- # killprocess 73629 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@950 -- # '[' -z 73629 ']' 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@954 -- # kill -0 73629 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@955 -- # uname 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:35.257 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 73629 00:17:35.515 killing process with pid 73629 00:17:35.515 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:17:35.515 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:17:35.515 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@968 -- # echo 'killing process with pid 73629' 00:17:35.515 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@969 -- # kill 73629 00:17:35.515 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@974 -- # wait 73629 00:17:35.515 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:17:35.515 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:17:35.515 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:17:35.515 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@297 -- # iptr 00:17:35.515 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@789 -- # iptables-save 00:17:35.515 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:17:35.515 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@789 -- # iptables-restore 00:17:35.515 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:17:35.515 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:17:35.515 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:17:35.515 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:17:35.515 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:17:35.515 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@246 -- # remove_spdk_ns 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@300 -- # return 0 00:17:35.772 00:17:35.772 real 0m3.580s 00:17:35.772 user 0m5.706s 00:17:35.772 sys 0m1.307s 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1126 -- # xtrace_disable 00:17:35.772 ************************************ 00:17:35.772 END TEST nvmf_control_msg_list 00:17:35.772 ************************************ 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@44 -- # run_test nvmf_wait_for_buf /home/vagrant/spdk_repo/spdk/test/nvmf/target/wait_for_buf.sh --transport=tcp 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:17:35.772 11:28:17 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:17:35.772 ************************************ 00:17:35.772 START TEST nvmf_wait_for_buf 00:17:35.772 ************************************ 00:17:35.773 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/wait_for_buf.sh --transport=tcp 00:17:36.031 * Looking for test storage... 00:17:36.031 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1681 -- # lcov --version 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@333 -- # local ver1 ver1_l 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@334 -- # local ver2 ver2_l 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@336 -- # IFS=.-: 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@336 -- # read -ra ver1 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@337 -- # IFS=.-: 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@337 -- # read -ra ver2 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@338 -- # local 'op=<' 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@340 -- # ver1_l=2 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@341 -- # ver2_l=1 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@344 -- # case "$op" in 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@345 -- # : 1 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@364 -- # (( v = 0 )) 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@365 -- # decimal 1 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@353 -- # local d=1 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@355 -- # echo 1 00:17:36.031 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@365 -- # ver1[v]=1 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@366 -- # decimal 2 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@353 -- # local d=2 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@355 -- # echo 2 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@366 -- # ver2[v]=2 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@368 -- # return 0 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:17:36.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:36.032 --rc genhtml_branch_coverage=1 00:17:36.032 --rc genhtml_function_coverage=1 00:17:36.032 --rc genhtml_legend=1 00:17:36.032 --rc geninfo_all_blocks=1 00:17:36.032 --rc geninfo_unexecuted_blocks=1 00:17:36.032 00:17:36.032 ' 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:17:36.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:36.032 --rc genhtml_branch_coverage=1 00:17:36.032 --rc genhtml_function_coverage=1 00:17:36.032 --rc genhtml_legend=1 00:17:36.032 --rc geninfo_all_blocks=1 00:17:36.032 --rc geninfo_unexecuted_blocks=1 00:17:36.032 00:17:36.032 ' 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:17:36.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:36.032 --rc genhtml_branch_coverage=1 00:17:36.032 --rc genhtml_function_coverage=1 00:17:36.032 --rc genhtml_legend=1 00:17:36.032 --rc geninfo_all_blocks=1 00:17:36.032 --rc geninfo_unexecuted_blocks=1 00:17:36.032 00:17:36.032 ' 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:17:36.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:36.032 --rc genhtml_branch_coverage=1 00:17:36.032 --rc genhtml_function_coverage=1 00:17:36.032 --rc genhtml_legend=1 00:17:36.032 --rc geninfo_all_blocks=1 00:17:36.032 --rc geninfo_unexecuted_blocks=1 00:17:36.032 00:17:36.032 ' 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@7 -- # uname -s 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@15 -- # shopt -s extglob 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@5 -- # export PATH 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@51 -- # : 0 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:17:36.032 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@55 -- # have_pci_nics=0 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@12 -- # nvmftestinit 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@474 -- # prepare_net_devs 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@436 -- # local -g is_hw=no 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@438 -- # remove_spdk_ns 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@458 -- # nvmf_veth_init 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:17:36.032 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:17:36.033 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:17:36.033 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:17:36.033 Cannot find device "nvmf_init_br" 00:17:36.033 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@162 -- # true 00:17:36.033 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:17:36.033 Cannot find device "nvmf_init_br2" 00:17:36.033 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@163 -- # true 00:17:36.033 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:17:36.033 Cannot find device "nvmf_tgt_br" 00:17:36.033 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@164 -- # true 00:17:36.033 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:17:36.033 Cannot find device "nvmf_tgt_br2" 00:17:36.033 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@165 -- # true 00:17:36.033 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:17:36.033 Cannot find device "nvmf_init_br" 00:17:36.033 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@166 -- # true 00:17:36.033 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:17:36.033 Cannot find device "nvmf_init_br2" 00:17:36.033 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@167 -- # true 00:17:36.033 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:17:36.033 Cannot find device "nvmf_tgt_br" 00:17:36.033 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@168 -- # true 00:17:36.033 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:17:36.291 Cannot find device "nvmf_tgt_br2" 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@169 -- # true 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:17:36.291 Cannot find device "nvmf_br" 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@170 -- # true 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:17:36.291 Cannot find device "nvmf_init_if" 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@171 -- # true 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:17:36.291 Cannot find device "nvmf_init_if2" 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@172 -- # true 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:36.291 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@173 -- # true 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:36.291 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@174 -- # true 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:17:36.291 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:17:36.292 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:17:36.292 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:17:36.292 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:17:36.292 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:17:36.292 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:17:36.292 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:17:36.292 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:17:36.292 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:17:36.292 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:17:36.292 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:17:36.292 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:17:36.292 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:17:36.292 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:17:36.292 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:17:36.292 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:17:36.292 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:17:36.292 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.093 ms 00:17:36.292 00:17:36.292 --- 10.0.0.3 ping statistics --- 00:17:36.292 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:36.292 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:17:36.292 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:17:36.550 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:17:36.550 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.063 ms 00:17:36.550 00:17:36.550 --- 10.0.0.4 ping statistics --- 00:17:36.550 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:36.550 rtt min/avg/max/mdev = 0.063/0.063/0.063/0.000 ms 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:17:36.550 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:36.550 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.040 ms 00:17:36.550 00:17:36.550 --- 10.0.0.1 ping statistics --- 00:17:36.550 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:36.550 rtt min/avg/max/mdev = 0.040/0.040/0.040/0.000 ms 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:17:36.550 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:36.550 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.045 ms 00:17:36.550 00:17:36.550 --- 10.0.0.2 ping statistics --- 00:17:36.550 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:36.550 rtt min/avg/max/mdev = 0.045/0.045/0.045/0.000 ms 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@459 -- # return 0 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@13 -- # nvmfappstart --wait-for-rpc 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@724 -- # xtrace_disable 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:36.550 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@507 -- # nvmfpid=73892 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@508 -- # waitforlisten 73892 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@831 -- # '[' -z 73892 ']' 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:36.550 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:36.550 [2024-10-07 11:28:18.098594] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:36.550 [2024-10-07 11:28:18.098681] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:36.550 [2024-10-07 11:28:18.233076] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:36.807 [2024-10-07 11:28:18.289650] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:36.807 [2024-10-07 11:28:18.289709] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:36.807 [2024-10-07 11:28:18.289721] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:36.807 [2024-10-07 11:28:18.289730] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:36.807 [2024-10-07 11:28:18.289737] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:36.807 [2024-10-07 11:28:18.290038] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@864 -- # return 0 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@730 -- # xtrace_disable 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@15 -- # subnqn=nqn.2024-07.io.spdk:cnode0 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@16 -- # perf=/home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@19 -- # rpc_cmd accel_set_options --small-cache-size 0 --large-cache-size 0 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@20 -- # rpc_cmd iobuf_set_options --small-pool-count 154 --small_bufsize=8192 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@21 -- # rpc_cmd framework_start_init 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:36.807 [2024-10-07 11:28:18.399265] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@22 -- # rpc_cmd bdev_malloc_create -b Malloc0 32 512 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:36.807 Malloc0 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@23 -- # rpc_cmd nvmf_create_transport '-t tcp -o' -u 8192 -n 24 -b 24 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:36.807 [2024-10-07 11:28:18.439866] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2024-07.io.spdk:cnode0 -a -s SPDK00000000000001 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2024-07.io.spdk:cnode0 Malloc0 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2024-07.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4420 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:36.807 [2024-10-07 11:28:18.463957] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:36.807 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@30 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 4 -o 131072 -w randread -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:17:37.064 [2024-10-07 11:28:18.651528] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.3/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:17:38.433 Initializing NVMe Controllers 00:17:38.433 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2024-07.io.spdk:cnode0 00:17:38.433 Associating TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 with lcore 0 00:17:38.433 Initialization complete. Launching workers. 00:17:38.433 ======================================================== 00:17:38.434 Latency(us) 00:17:38.434 Device Information : IOPS MiB/s Average min max 00:17:38.434 TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 from core 0: 499.98 62.50 8000.28 6944.97 8983.55 00:17:38.434 ======================================================== 00:17:38.434 Total : 499.98 62.50 8000.28 6944.97 8983.55 00:17:38.434 00:17:38.434 11:28:19 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@32 -- # rpc_cmd iobuf_get_stats 00:17:38.434 11:28:19 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@32 -- # jq -r '.[] | select(.module == "nvmf_TCP") | .small_pool.retry' 00:17:38.434 11:28:19 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:38.434 11:28:19 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:38.434 11:28:19 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:38.434 11:28:19 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@32 -- # retry_count=4750 00:17:38.434 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@33 -- # [[ 4750 -eq 0 ]] 00:17:38.434 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:17:38.434 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@38 -- # nvmftestfini 00:17:38.434 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@514 -- # nvmfcleanup 00:17:38.434 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@121 -- # sync 00:17:38.434 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:17:38.434 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@124 -- # set +e 00:17:38.434 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@125 -- # for i in {1..20} 00:17:38.434 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:17:38.434 rmmod nvme_tcp 00:17:38.434 rmmod nvme_fabrics 00:17:38.434 rmmod nvme_keyring 00:17:38.434 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:17:38.434 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@128 -- # set -e 00:17:38.434 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@129 -- # return 0 00:17:38.434 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@515 -- # '[' -n 73892 ']' 00:17:38.434 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@516 -- # killprocess 73892 00:17:38.434 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@950 -- # '[' -z 73892 ']' 00:17:38.434 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@954 -- # kill -0 73892 00:17:38.434 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@955 -- # uname 00:17:38.434 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:38.434 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 73892 00:17:38.691 killing process with pid 73892 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@968 -- # echo 'killing process with pid 73892' 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@969 -- # kill 73892 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@974 -- # wait 73892 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@297 -- # iptr 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@789 -- # iptables-save 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@789 -- # iptables-restore 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:17:38.691 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:17:38.692 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:17:38.692 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:17:38.692 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:17:38.949 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:17:38.949 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:17:38.949 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:38.949 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:38.949 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@246 -- # remove_spdk_ns 00:17:38.949 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:38.949 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:38.949 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:38.949 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@300 -- # return 0 00:17:38.949 00:17:38.949 real 0m3.086s 00:17:38.949 user 0m2.497s 00:17:38.949 sys 0m0.687s 00:17:38.949 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:17:38.949 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:38.949 ************************************ 00:17:38.949 END TEST nvmf_wait_for_buf 00:17:38.949 ************************************ 00:17:38.949 11:28:20 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@47 -- # '[' 0 -eq 1 ']' 00:17:38.949 11:28:20 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@53 -- # [[ virt == phy ]] 00:17:38.949 11:28:20 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:17:38.949 00:17:38.949 real 5m23.542s 00:17:38.949 user 11m31.246s 00:17:38.949 sys 1m6.860s 00:17:38.949 11:28:20 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1126 -- # xtrace_disable 00:17:38.949 11:28:20 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:17:38.949 ************************************ 00:17:38.949 END TEST nvmf_target_extra 00:17:38.949 ************************************ 00:17:38.949 11:28:20 nvmf_tcp -- nvmf/nvmf.sh@16 -- # run_test nvmf_host /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh --transport=tcp 00:17:38.949 11:28:20 nvmf_tcp -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:17:38.949 11:28:20 nvmf_tcp -- common/autotest_common.sh@1107 -- # xtrace_disable 00:17:38.949 11:28:20 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:17:38.949 ************************************ 00:17:38.949 START TEST nvmf_host 00:17:38.949 ************************************ 00:17:38.949 11:28:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh --transport=tcp 00:17:39.208 * Looking for test storage... 00:17:39.208 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1681 -- # lcov --version 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@333 -- # local ver1 ver1_l 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@334 -- # local ver2 ver2_l 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@336 -- # IFS=.-: 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@336 -- # read -ra ver1 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@337 -- # IFS=.-: 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@337 -- # read -ra ver2 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@338 -- # local 'op=<' 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@340 -- # ver1_l=2 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@341 -- # ver2_l=1 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@344 -- # case "$op" in 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@345 -- # : 1 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@364 -- # (( v = 0 )) 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@365 -- # decimal 1 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@353 -- # local d=1 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@355 -- # echo 1 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@365 -- # ver1[v]=1 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@366 -- # decimal 2 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@353 -- # local d=2 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@355 -- # echo 2 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@366 -- # ver2[v]=2 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@368 -- # return 0 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:17:39.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:39.208 --rc genhtml_branch_coverage=1 00:17:39.208 --rc genhtml_function_coverage=1 00:17:39.208 --rc genhtml_legend=1 00:17:39.208 --rc geninfo_all_blocks=1 00:17:39.208 --rc geninfo_unexecuted_blocks=1 00:17:39.208 00:17:39.208 ' 00:17:39.208 11:28:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:17:39.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:39.208 --rc genhtml_branch_coverage=1 00:17:39.208 --rc genhtml_function_coverage=1 00:17:39.208 --rc genhtml_legend=1 00:17:39.208 --rc geninfo_all_blocks=1 00:17:39.208 --rc geninfo_unexecuted_blocks=1 00:17:39.209 00:17:39.209 ' 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:17:39.209 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:39.209 --rc genhtml_branch_coverage=1 00:17:39.209 --rc genhtml_function_coverage=1 00:17:39.209 --rc genhtml_legend=1 00:17:39.209 --rc geninfo_all_blocks=1 00:17:39.209 --rc geninfo_unexecuted_blocks=1 00:17:39.209 00:17:39.209 ' 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:17:39.209 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:39.209 --rc genhtml_branch_coverage=1 00:17:39.209 --rc genhtml_function_coverage=1 00:17:39.209 --rc genhtml_legend=1 00:17:39.209 --rc geninfo_all_blocks=1 00:17:39.209 --rc geninfo_unexecuted_blocks=1 00:17:39.209 00:17:39.209 ' 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@7 -- # uname -s 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@15 -- # shopt -s extglob 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- paths/export.sh@5 -- # export PATH 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@51 -- # : 0 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:17:39.209 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/common.sh@55 -- # have_pci_nics=0 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@11 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@13 -- # TEST_ARGS=("$@") 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@15 -- # [[ 1 -eq 0 ]] 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@22 -- # run_test nvmf_identify /home/vagrant/spdk_repo/spdk/test/nvmf/host/identify.sh --transport=tcp 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:17:39.209 ************************************ 00:17:39.209 START TEST nvmf_identify 00:17:39.209 ************************************ 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/identify.sh --transport=tcp 00:17:39.209 * Looking for test storage... 00:17:39.209 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1681 -- # lcov --version 00:17:39.209 11:28:20 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@333 -- # local ver1 ver1_l 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@334 -- # local ver2 ver2_l 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@336 -- # IFS=.-: 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@336 -- # read -ra ver1 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@337 -- # IFS=.-: 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@337 -- # read -ra ver2 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@338 -- # local 'op=<' 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@340 -- # ver1_l=2 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@341 -- # ver2_l=1 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@344 -- # case "$op" in 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@345 -- # : 1 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@364 -- # (( v = 0 )) 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@365 -- # decimal 1 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@353 -- # local d=1 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@355 -- # echo 1 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@365 -- # ver1[v]=1 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@366 -- # decimal 2 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@353 -- # local d=2 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@355 -- # echo 2 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@366 -- # ver2[v]=2 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@368 -- # return 0 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:17:39.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:39.468 --rc genhtml_branch_coverage=1 00:17:39.468 --rc genhtml_function_coverage=1 00:17:39.468 --rc genhtml_legend=1 00:17:39.468 --rc geninfo_all_blocks=1 00:17:39.468 --rc geninfo_unexecuted_blocks=1 00:17:39.468 00:17:39.468 ' 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:17:39.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:39.468 --rc genhtml_branch_coverage=1 00:17:39.468 --rc genhtml_function_coverage=1 00:17:39.468 --rc genhtml_legend=1 00:17:39.468 --rc geninfo_all_blocks=1 00:17:39.468 --rc geninfo_unexecuted_blocks=1 00:17:39.468 00:17:39.468 ' 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:17:39.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:39.468 --rc genhtml_branch_coverage=1 00:17:39.468 --rc genhtml_function_coverage=1 00:17:39.468 --rc genhtml_legend=1 00:17:39.468 --rc geninfo_all_blocks=1 00:17:39.468 --rc geninfo_unexecuted_blocks=1 00:17:39.468 00:17:39.468 ' 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:17:39.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:39.468 --rc genhtml_branch_coverage=1 00:17:39.468 --rc genhtml_function_coverage=1 00:17:39.468 --rc genhtml_legend=1 00:17:39.468 --rc geninfo_all_blocks=1 00:17:39.468 --rc geninfo_unexecuted_blocks=1 00:17:39.468 00:17:39.468 ' 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@7 -- # uname -s 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:39.468 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@15 -- # shopt -s extglob 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@5 -- # export PATH 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@51 -- # : 0 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:17:39.469 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@55 -- # have_pci_nics=0 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@14 -- # nvmftestinit 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@474 -- # prepare_net_devs 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@436 -- # local -g is_hw=no 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@438 -- # remove_spdk_ns 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@458 -- # nvmf_veth_init 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:17:39.469 Cannot find device "nvmf_init_br" 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@162 -- # true 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:17:39.469 Cannot find device "nvmf_init_br2" 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@163 -- # true 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:17:39.469 Cannot find device "nvmf_tgt_br" 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@164 -- # true 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:17:39.469 Cannot find device "nvmf_tgt_br2" 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@165 -- # true 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:17:39.469 Cannot find device "nvmf_init_br" 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@166 -- # true 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:17:39.469 Cannot find device "nvmf_init_br2" 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@167 -- # true 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:17:39.469 Cannot find device "nvmf_tgt_br" 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@168 -- # true 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:17:39.469 Cannot find device "nvmf_tgt_br2" 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@169 -- # true 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:17:39.469 Cannot find device "nvmf_br" 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@170 -- # true 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:17:39.469 Cannot find device "nvmf_init_if" 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@171 -- # true 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:17:39.469 Cannot find device "nvmf_init_if2" 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@172 -- # true 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:39.469 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@173 -- # true 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:39.469 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@174 -- # true 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:17:39.469 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:17:39.728 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:17:39.728 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.095 ms 00:17:39.728 00:17:39.728 --- 10.0.0.3 ping statistics --- 00:17:39.728 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:39.728 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:17:39.728 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:17:39.987 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:17:39.987 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.052 ms 00:17:39.987 00:17:39.987 --- 10.0.0.4 ping statistics --- 00:17:39.987 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:39.987 rtt min/avg/max/mdev = 0.052/0.052/0.052/0.000 ms 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:17:39.987 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:39.987 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.029 ms 00:17:39.987 00:17:39.987 --- 10.0.0.1 ping statistics --- 00:17:39.987 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:39.987 rtt min/avg/max/mdev = 0.029/0.029/0.029/0.000 ms 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:17:39.987 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:39.987 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.072 ms 00:17:39.987 00:17:39.987 --- 10.0.0.2 ping statistics --- 00:17:39.987 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:39.987 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@459 -- # return 0 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@724 -- # xtrace_disable 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@19 -- # nvmfpid=74207 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@18 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@23 -- # waitforlisten 74207 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@831 -- # '[' -z 74207 ']' 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:39.987 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:39.987 11:28:21 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:39.987 [2024-10-07 11:28:21.539072] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:39.987 [2024-10-07 11:28:21.539157] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:39.987 [2024-10-07 11:28:21.673759] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:40.245 [2024-10-07 11:28:21.764089] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:40.245 [2024-10-07 11:28:21.764171] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:40.245 [2024-10-07 11:28:21.764189] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:40.245 [2024-10-07 11:28:21.764201] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:40.245 [2024-10-07 11:28:21.764213] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:40.245 [2024-10-07 11:28:21.765275] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:17:40.245 [2024-10-07 11:28:21.765334] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:17:40.245 [2024-10-07 11:28:21.765417] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:17:40.245 [2024-10-07 11:28:21.765422] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:17:40.245 [2024-10-07 11:28:21.800147] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:17:41.176 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:41.176 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@864 -- # return 0 00:17:41.176 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:41.176 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:41.177 [2024-10-07 11:28:22.699419] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@730 -- # xtrace_disable 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:41.177 Malloc0 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:41.177 [2024-10-07 11:28:22.772898] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:41.177 [ 00:17:41.177 { 00:17:41.177 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:17:41.177 "subtype": "Discovery", 00:17:41.177 "listen_addresses": [ 00:17:41.177 { 00:17:41.177 "trtype": "TCP", 00:17:41.177 "adrfam": "IPv4", 00:17:41.177 "traddr": "10.0.0.3", 00:17:41.177 "trsvcid": "4420" 00:17:41.177 } 00:17:41.177 ], 00:17:41.177 "allow_any_host": true, 00:17:41.177 "hosts": [] 00:17:41.177 }, 00:17:41.177 { 00:17:41.177 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:41.177 "subtype": "NVMe", 00:17:41.177 "listen_addresses": [ 00:17:41.177 { 00:17:41.177 "trtype": "TCP", 00:17:41.177 "adrfam": "IPv4", 00:17:41.177 "traddr": "10.0.0.3", 00:17:41.177 "trsvcid": "4420" 00:17:41.177 } 00:17:41.177 ], 00:17:41.177 "allow_any_host": true, 00:17:41.177 "hosts": [], 00:17:41.177 "serial_number": "SPDK00000000000001", 00:17:41.177 "model_number": "SPDK bdev Controller", 00:17:41.177 "max_namespaces": 32, 00:17:41.177 "min_cntlid": 1, 00:17:41.177 "max_cntlid": 65519, 00:17:41.177 "namespaces": [ 00:17:41.177 { 00:17:41.177 "nsid": 1, 00:17:41.177 "bdev_name": "Malloc0", 00:17:41.177 "name": "Malloc0", 00:17:41.177 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:17:41.177 "eui64": "ABCDEF0123456789", 00:17:41.177 "uuid": "314b1b31-cad6-4940-87d6-b07c8c1a5127" 00:17:41.177 } 00:17:41.177 ] 00:17:41.177 } 00:17:41.177 ] 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:41.177 11:28:22 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@39 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:17:41.177 [2024-10-07 11:28:22.823364] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:41.177 [2024-10-07 11:28:22.823449] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid74243 ] 00:17:41.437 [2024-10-07 11:28:22.967652] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:17:41.437 [2024-10-07 11:28:22.967737] nvme_tcp.c:2349:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:17:41.437 [2024-10-07 11:28:22.967745] nvme_tcp.c:2353:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:17:41.437 [2024-10-07 11:28:22.967761] nvme_tcp.c:2374:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:17:41.437 [2024-10-07 11:28:22.967772] sock.c: 373:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:17:41.437 [2024-10-07 11:28:22.968114] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:17:41.437 [2024-10-07 11:28:22.968208] nvme_tcp.c:1566:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x857750 0 00:17:41.437 [2024-10-07 11:28:22.983437] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:17:41.437 [2024-10-07 11:28:22.983481] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:17:41.437 [2024-10-07 11:28:22.983488] nvme_tcp.c:1612:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:17:41.437 [2024-10-07 11:28:22.983493] nvme_tcp.c:1613:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:17:41.437 [2024-10-07 11:28:22.983539] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.437 [2024-10-07 11:28:22.983547] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.437 [2024-10-07 11:28:22.983552] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857750) 00:17:41.437 [2024-10-07 11:28:22.983570] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:17:41.437 [2024-10-07 11:28:22.983608] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bb840, cid 0, qid 0 00:17:41.437 [2024-10-07 11:28:22.991429] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.437 [2024-10-07 11:28:22.991459] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.437 [2024-10-07 11:28:22.991465] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.437 [2024-10-07 11:28:22.991471] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bb840) on tqpair=0x857750 00:17:41.437 [2024-10-07 11:28:22.991492] nvme_fabric.c: 621:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:17:41.437 [2024-10-07 11:28:22.991509] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:17:41.437 [2024-10-07 11:28:22.991520] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:17:41.437 [2024-10-07 11:28:22.991546] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.437 [2024-10-07 11:28:22.991553] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.437 [2024-10-07 11:28:22.991557] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857750) 00:17:41.437 [2024-10-07 11:28:22.991569] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.437 [2024-10-07 11:28:22.991606] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bb840, cid 0, qid 0 00:17:41.437 [2024-10-07 11:28:22.991671] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.437 [2024-10-07 11:28:22.991680] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.437 [2024-10-07 11:28:22.991684] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.437 [2024-10-07 11:28:22.991689] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bb840) on tqpair=0x857750 00:17:41.437 [2024-10-07 11:28:22.991695] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:17:41.437 [2024-10-07 11:28:22.991704] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:17:41.437 [2024-10-07 11:28:22.991712] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.437 [2024-10-07 11:28:22.991717] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.437 [2024-10-07 11:28:22.991721] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857750) 00:17:41.437 [2024-10-07 11:28:22.991730] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.437 [2024-10-07 11:28:22.991753] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bb840, cid 0, qid 0 00:17:41.437 [2024-10-07 11:28:22.991801] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.437 [2024-10-07 11:28:22.991808] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.437 [2024-10-07 11:28:22.991812] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.437 [2024-10-07 11:28:22.991817] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bb840) on tqpair=0x857750 00:17:41.437 [2024-10-07 11:28:22.991823] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:17:41.437 [2024-10-07 11:28:22.991832] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:17:41.437 [2024-10-07 11:28:22.991840] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.437 [2024-10-07 11:28:22.991845] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.437 [2024-10-07 11:28:22.991849] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857750) 00:17:41.437 [2024-10-07 11:28:22.991856] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.437 [2024-10-07 11:28:22.991875] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bb840, cid 0, qid 0 00:17:41.437 [2024-10-07 11:28:22.991920] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.437 [2024-10-07 11:28:22.991927] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.437 [2024-10-07 11:28:22.991931] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.437 [2024-10-07 11:28:22.991936] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bb840) on tqpair=0x857750 00:17:41.437 [2024-10-07 11:28:22.991941] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:17:41.437 [2024-10-07 11:28:22.991952] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.437 [2024-10-07 11:28:22.991957] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.437 [2024-10-07 11:28:22.991961] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857750) 00:17:41.437 [2024-10-07 11:28:22.991969] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.437 [2024-10-07 11:28:22.991986] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bb840, cid 0, qid 0 00:17:41.437 [2024-10-07 11:28:22.992056] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.437 [2024-10-07 11:28:22.992063] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.437 [2024-10-07 11:28:22.992067] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.437 [2024-10-07 11:28:22.992072] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bb840) on tqpair=0x857750 00:17:41.437 [2024-10-07 11:28:22.992077] nvme_ctrlr.c:3893:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:17:41.437 [2024-10-07 11:28:22.992082] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:17:41.437 [2024-10-07 11:28:22.992091] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:17:41.437 [2024-10-07 11:28:22.992197] nvme_ctrlr.c:4091:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:17:41.437 [2024-10-07 11:28:22.992203] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:17:41.437 [2024-10-07 11:28:22.992213] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.437 [2024-10-07 11:28:22.992217] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.437 [2024-10-07 11:28:22.992222] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857750) 00:17:41.437 [2024-10-07 11:28:22.992229] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.437 [2024-10-07 11:28:22.992248] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bb840, cid 0, qid 0 00:17:41.437 [2024-10-07 11:28:22.992344] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.437 [2024-10-07 11:28:22.992360] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.437 [2024-10-07 11:28:22.992365] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.437 [2024-10-07 11:28:22.992370] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bb840) on tqpair=0x857750 00:17:41.438 [2024-10-07 11:28:22.992376] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:17:41.438 [2024-10-07 11:28:22.992387] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.992392] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.992396] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857750) 00:17:41.438 [2024-10-07 11:28:22.992417] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.438 [2024-10-07 11:28:22.992439] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bb840, cid 0, qid 0 00:17:41.438 [2024-10-07 11:28:22.992526] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.438 [2024-10-07 11:28:22.992533] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.438 [2024-10-07 11:28:22.992537] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.992542] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bb840) on tqpair=0x857750 00:17:41.438 [2024-10-07 11:28:22.992547] nvme_ctrlr.c:3928:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:17:41.438 [2024-10-07 11:28:22.992553] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:17:41.438 [2024-10-07 11:28:22.992561] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:17:41.438 [2024-10-07 11:28:22.992579] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:17:41.438 [2024-10-07 11:28:22.992593] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.992598] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857750) 00:17:41.438 [2024-10-07 11:28:22.992606] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.438 [2024-10-07 11:28:22.992627] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bb840, cid 0, qid 0 00:17:41.438 [2024-10-07 11:28:22.992767] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:41.438 [2024-10-07 11:28:22.992783] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:41.438 [2024-10-07 11:28:22.992788] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.992793] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x857750): datao=0, datal=4096, cccid=0 00:17:41.438 [2024-10-07 11:28:22.992798] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x8bb840) on tqpair(0x857750): expected_datao=0, payload_size=4096 00:17:41.438 [2024-10-07 11:28:22.992804] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.992813] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.992818] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.992827] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.438 [2024-10-07 11:28:22.992834] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.438 [2024-10-07 11:28:22.992838] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.992842] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bb840) on tqpair=0x857750 00:17:41.438 [2024-10-07 11:28:22.992853] nvme_ctrlr.c:2077:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:17:41.438 [2024-10-07 11:28:22.992858] nvme_ctrlr.c:2081:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:17:41.438 [2024-10-07 11:28:22.992864] nvme_ctrlr.c:2084:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:17:41.438 [2024-10-07 11:28:22.992869] nvme_ctrlr.c:2108:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:17:41.438 [2024-10-07 11:28:22.992875] nvme_ctrlr.c:2123:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:17:41.438 [2024-10-07 11:28:22.992880] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:17:41.438 [2024-10-07 11:28:22.992890] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:17:41.438 [2024-10-07 11:28:22.992903] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.992908] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.992912] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857750) 00:17:41.438 [2024-10-07 11:28:22.992921] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:41.438 [2024-10-07 11:28:22.992943] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bb840, cid 0, qid 0 00:17:41.438 [2024-10-07 11:28:22.993045] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.438 [2024-10-07 11:28:22.993070] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.438 [2024-10-07 11:28:22.993076] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993080] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bb840) on tqpair=0x857750 00:17:41.438 [2024-10-07 11:28:22.993089] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993094] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993098] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857750) 00:17:41.438 [2024-10-07 11:28:22.993105] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:17:41.438 [2024-10-07 11:28:22.993112] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993117] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993121] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x857750) 00:17:41.438 [2024-10-07 11:28:22.993127] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:41.438 [2024-10-07 11:28:22.993134] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993138] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993142] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x857750) 00:17:41.438 [2024-10-07 11:28:22.993149] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:41.438 [2024-10-07 11:28:22.993155] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993159] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993163] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857750) 00:17:41.438 [2024-10-07 11:28:22.993169] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:41.438 [2024-10-07 11:28:22.993175] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:17:41.438 [2024-10-07 11:28:22.993190] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:17:41.438 [2024-10-07 11:28:22.993198] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993203] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x857750) 00:17:41.438 [2024-10-07 11:28:22.993210] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.438 [2024-10-07 11:28:22.993233] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bb840, cid 0, qid 0 00:17:41.438 [2024-10-07 11:28:22.993241] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bb9c0, cid 1, qid 0 00:17:41.438 [2024-10-07 11:28:22.993246] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bbb40, cid 2, qid 0 00:17:41.438 [2024-10-07 11:28:22.993251] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bbcc0, cid 3, qid 0 00:17:41.438 [2024-10-07 11:28:22.993256] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bbe40, cid 4, qid 0 00:17:41.438 [2024-10-07 11:28:22.993389] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.438 [2024-10-07 11:28:22.993415] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.438 [2024-10-07 11:28:22.993420] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993425] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bbe40) on tqpair=0x857750 00:17:41.438 [2024-10-07 11:28:22.993431] nvme_ctrlr.c:3046:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:17:41.438 [2024-10-07 11:28:22.993437] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:17:41.438 [2024-10-07 11:28:22.993451] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993456] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x857750) 00:17:41.438 [2024-10-07 11:28:22.993464] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.438 [2024-10-07 11:28:22.993486] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bbe40, cid 4, qid 0 00:17:41.438 [2024-10-07 11:28:22.993549] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:41.438 [2024-10-07 11:28:22.993562] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:41.438 [2024-10-07 11:28:22.993566] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993570] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x857750): datao=0, datal=4096, cccid=4 00:17:41.438 [2024-10-07 11:28:22.993576] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x8bbe40) on tqpair(0x857750): expected_datao=0, payload_size=4096 00:17:41.438 [2024-10-07 11:28:22.993581] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993588] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993593] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993602] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.438 [2024-10-07 11:28:22.993608] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.438 [2024-10-07 11:28:22.993612] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993616] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bbe40) on tqpair=0x857750 00:17:41.438 [2024-10-07 11:28:22.993631] nvme_ctrlr.c:4189:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:17:41.438 [2024-10-07 11:28:22.993665] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993671] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x857750) 00:17:41.438 [2024-10-07 11:28:22.993680] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.438 [2024-10-07 11:28:22.993688] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993692] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.438 [2024-10-07 11:28:22.993696] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x857750) 00:17:41.439 [2024-10-07 11:28:22.993703] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:17:41.439 [2024-10-07 11:28:22.993729] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bbe40, cid 4, qid 0 00:17:41.439 [2024-10-07 11:28:22.993737] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bbfc0, cid 5, qid 0 00:17:41.439 [2024-10-07 11:28:22.993835] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:41.439 [2024-10-07 11:28:22.993847] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:41.439 [2024-10-07 11:28:22.993852] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:41.439 [2024-10-07 11:28:22.993856] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x857750): datao=0, datal=1024, cccid=4 00:17:41.439 [2024-10-07 11:28:22.993862] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x8bbe40) on tqpair(0x857750): expected_datao=0, payload_size=1024 00:17:41.439 [2024-10-07 11:28:22.993867] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.439 [2024-10-07 11:28:22.993874] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:41.439 [2024-10-07 11:28:22.993878] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:41.439 [2024-10-07 11:28:22.993884] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.439 [2024-10-07 11:28:22.993891] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.439 [2024-10-07 11:28:22.993895] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.439 [2024-10-07 11:28:22.993899] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bbfc0) on tqpair=0x857750 00:17:41.439 [2024-10-07 11:28:22.993918] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.439 [2024-10-07 11:28:22.993926] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.439 [2024-10-07 11:28:22.993930] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.439 [2024-10-07 11:28:22.993934] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bbe40) on tqpair=0x857750 00:17:41.439 [2024-10-07 11:28:22.993948] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.439 [2024-10-07 11:28:22.993953] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x857750) 00:17:41.439 [2024-10-07 11:28:22.993961] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.439 [2024-10-07 11:28:22.993986] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bbe40, cid 4, qid 0 00:17:41.439 [2024-10-07 11:28:22.994071] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:41.439 [2024-10-07 11:28:22.994078] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:41.439 [2024-10-07 11:28:22.994082] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:41.439 [2024-10-07 11:28:22.994086] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x857750): datao=0, datal=3072, cccid=4 00:17:41.439 [2024-10-07 11:28:22.994091] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x8bbe40) on tqpair(0x857750): expected_datao=0, payload_size=3072 00:17:41.439 [2024-10-07 11:28:22.994096] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.439 [2024-10-07 11:28:22.994103] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:41.439 [2024-10-07 11:28:22.994107] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:41.439 [2024-10-07 11:28:22.994116] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.439 [2024-10-07 11:28:22.994123] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.439 [2024-10-07 11:28:22.994126] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.439 [2024-10-07 11:28:22.994131] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bbe40) on tqpair=0x857750 00:17:41.439 [2024-10-07 11:28:22.994142] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.439 [2024-10-07 11:28:22.994147] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x857750) 00:17:41.439 [2024-10-07 11:28:22.994154] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.439 [2024-10-07 11:28:22.994179] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bbe40, cid 4, qid 0 00:17:41.439 [2024-10-07 11:28:22.994266] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:41.439 [2024-10-07 11:28:22.994278] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:41.439 [2024-10-07 11:28:22.994283] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:41.439 [2024-10-07 11:28:22.994287] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x857750): datao=0, datal=8, cccid=4 00:17:41.439 [2024-10-07 11:28:22.994292] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x8bbe40) on tqpair(0x857750): expected_datao=0, payload_size=8 00:17:41.439 [2024-10-07 11:28:22.994297] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.439 [2024-10-07 11:28:22.994304] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:41.439 [2024-10-07 11:28:22.994309] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:41.439 [2024-10-07 11:28:22.994323] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.439 [2024-10-07 11:28:22.994330] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.439 [2024-10-07 11:28:22.994334] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.439 [2024-10-07 11:28:22.994339] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bbe40) on tqpair=0x857750 00:17:41.439 ===================================================== 00:17:41.439 NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2014-08.org.nvmexpress.discovery 00:17:41.439 ===================================================== 00:17:41.439 Controller Capabilities/Features 00:17:41.439 ================================ 00:17:41.439 Vendor ID: 0000 00:17:41.439 Subsystem Vendor ID: 0000 00:17:41.439 Serial Number: .................... 00:17:41.439 Model Number: ........................................ 00:17:41.439 Firmware Version: 25.01 00:17:41.439 Recommended Arb Burst: 0 00:17:41.439 IEEE OUI Identifier: 00 00 00 00:17:41.439 Multi-path I/O 00:17:41.439 May have multiple subsystem ports: No 00:17:41.439 May have multiple controllers: No 00:17:41.439 Associated with SR-IOV VF: No 00:17:41.439 Max Data Transfer Size: 131072 00:17:41.439 Max Number of Namespaces: 0 00:17:41.439 Max Number of I/O Queues: 1024 00:17:41.439 NVMe Specification Version (VS): 1.3 00:17:41.439 NVMe Specification Version (Identify): 1.3 00:17:41.439 Maximum Queue Entries: 128 00:17:41.439 Contiguous Queues Required: Yes 00:17:41.439 Arbitration Mechanisms Supported 00:17:41.439 Weighted Round Robin: Not Supported 00:17:41.439 Vendor Specific: Not Supported 00:17:41.439 Reset Timeout: 15000 ms 00:17:41.439 Doorbell Stride: 4 bytes 00:17:41.439 NVM Subsystem Reset: Not Supported 00:17:41.439 Command Sets Supported 00:17:41.439 NVM Command Set: Supported 00:17:41.439 Boot Partition: Not Supported 00:17:41.439 Memory Page Size Minimum: 4096 bytes 00:17:41.439 Memory Page Size Maximum: 4096 bytes 00:17:41.439 Persistent Memory Region: Not Supported 00:17:41.439 Optional Asynchronous Events Supported 00:17:41.439 Namespace Attribute Notices: Not Supported 00:17:41.439 Firmware Activation Notices: Not Supported 00:17:41.439 ANA Change Notices: Not Supported 00:17:41.439 PLE Aggregate Log Change Notices: Not Supported 00:17:41.439 LBA Status Info Alert Notices: Not Supported 00:17:41.439 EGE Aggregate Log Change Notices: Not Supported 00:17:41.439 Normal NVM Subsystem Shutdown event: Not Supported 00:17:41.439 Zone Descriptor Change Notices: Not Supported 00:17:41.439 Discovery Log Change Notices: Supported 00:17:41.439 Controller Attributes 00:17:41.439 128-bit Host Identifier: Not Supported 00:17:41.439 Non-Operational Permissive Mode: Not Supported 00:17:41.439 NVM Sets: Not Supported 00:17:41.439 Read Recovery Levels: Not Supported 00:17:41.439 Endurance Groups: Not Supported 00:17:41.439 Predictable Latency Mode: Not Supported 00:17:41.439 Traffic Based Keep ALive: Not Supported 00:17:41.439 Namespace Granularity: Not Supported 00:17:41.439 SQ Associations: Not Supported 00:17:41.439 UUID List: Not Supported 00:17:41.439 Multi-Domain Subsystem: Not Supported 00:17:41.439 Fixed Capacity Management: Not Supported 00:17:41.439 Variable Capacity Management: Not Supported 00:17:41.439 Delete Endurance Group: Not Supported 00:17:41.439 Delete NVM Set: Not Supported 00:17:41.439 Extended LBA Formats Supported: Not Supported 00:17:41.439 Flexible Data Placement Supported: Not Supported 00:17:41.439 00:17:41.439 Controller Memory Buffer Support 00:17:41.439 ================================ 00:17:41.439 Supported: No 00:17:41.439 00:17:41.439 Persistent Memory Region Support 00:17:41.439 ================================ 00:17:41.439 Supported: No 00:17:41.439 00:17:41.439 Admin Command Set Attributes 00:17:41.439 ============================ 00:17:41.439 Security Send/Receive: Not Supported 00:17:41.439 Format NVM: Not Supported 00:17:41.439 Firmware Activate/Download: Not Supported 00:17:41.439 Namespace Management: Not Supported 00:17:41.439 Device Self-Test: Not Supported 00:17:41.439 Directives: Not Supported 00:17:41.439 NVMe-MI: Not Supported 00:17:41.439 Virtualization Management: Not Supported 00:17:41.439 Doorbell Buffer Config: Not Supported 00:17:41.439 Get LBA Status Capability: Not Supported 00:17:41.439 Command & Feature Lockdown Capability: Not Supported 00:17:41.439 Abort Command Limit: 1 00:17:41.439 Async Event Request Limit: 4 00:17:41.439 Number of Firmware Slots: N/A 00:17:41.439 Firmware Slot 1 Read-Only: N/A 00:17:41.439 Firmware Activation Without Reset: N/A 00:17:41.439 Multiple Update Detection Support: N/A 00:17:41.439 Firmware Update Granularity: No Information Provided 00:17:41.439 Per-Namespace SMART Log: No 00:17:41.439 Asymmetric Namespace Access Log Page: Not Supported 00:17:41.439 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:17:41.439 Command Effects Log Page: Not Supported 00:17:41.439 Get Log Page Extended Data: Supported 00:17:41.439 Telemetry Log Pages: Not Supported 00:17:41.439 Persistent Event Log Pages: Not Supported 00:17:41.439 Supported Log Pages Log Page: May Support 00:17:41.439 Commands Supported & Effects Log Page: Not Supported 00:17:41.439 Feature Identifiers & Effects Log Page:May Support 00:17:41.439 NVMe-MI Commands & Effects Log Page: May Support 00:17:41.440 Data Area 4 for Telemetry Log: Not Supported 00:17:41.440 Error Log Page Entries Supported: 128 00:17:41.440 Keep Alive: Not Supported 00:17:41.440 00:17:41.440 NVM Command Set Attributes 00:17:41.440 ========================== 00:17:41.440 Submission Queue Entry Size 00:17:41.440 Max: 1 00:17:41.440 Min: 1 00:17:41.440 Completion Queue Entry Size 00:17:41.440 Max: 1 00:17:41.440 Min: 1 00:17:41.440 Number of Namespaces: 0 00:17:41.440 Compare Command: Not Supported 00:17:41.440 Write Uncorrectable Command: Not Supported 00:17:41.440 Dataset Management Command: Not Supported 00:17:41.440 Write Zeroes Command: Not Supported 00:17:41.440 Set Features Save Field: Not Supported 00:17:41.440 Reservations: Not Supported 00:17:41.440 Timestamp: Not Supported 00:17:41.440 Copy: Not Supported 00:17:41.440 Volatile Write Cache: Not Present 00:17:41.440 Atomic Write Unit (Normal): 1 00:17:41.440 Atomic Write Unit (PFail): 1 00:17:41.440 Atomic Compare & Write Unit: 1 00:17:41.440 Fused Compare & Write: Supported 00:17:41.440 Scatter-Gather List 00:17:41.440 SGL Command Set: Supported 00:17:41.440 SGL Keyed: Supported 00:17:41.440 SGL Bit Bucket Descriptor: Not Supported 00:17:41.440 SGL Metadata Pointer: Not Supported 00:17:41.440 Oversized SGL: Not Supported 00:17:41.440 SGL Metadata Address: Not Supported 00:17:41.440 SGL Offset: Supported 00:17:41.440 Transport SGL Data Block: Not Supported 00:17:41.440 Replay Protected Memory Block: Not Supported 00:17:41.440 00:17:41.440 Firmware Slot Information 00:17:41.440 ========================= 00:17:41.440 Active slot: 0 00:17:41.440 00:17:41.440 00:17:41.440 Error Log 00:17:41.440 ========= 00:17:41.440 00:17:41.440 Active Namespaces 00:17:41.440 ================= 00:17:41.440 Discovery Log Page 00:17:41.440 ================== 00:17:41.440 Generation Counter: 2 00:17:41.440 Number of Records: 2 00:17:41.440 Record Format: 0 00:17:41.440 00:17:41.440 Discovery Log Entry 0 00:17:41.440 ---------------------- 00:17:41.440 Transport Type: 3 (TCP) 00:17:41.440 Address Family: 1 (IPv4) 00:17:41.440 Subsystem Type: 3 (Current Discovery Subsystem) 00:17:41.440 Entry Flags: 00:17:41.440 Duplicate Returned Information: 1 00:17:41.440 Explicit Persistent Connection Support for Discovery: 1 00:17:41.440 Transport Requirements: 00:17:41.440 Secure Channel: Not Required 00:17:41.440 Port ID: 0 (0x0000) 00:17:41.440 Controller ID: 65535 (0xffff) 00:17:41.440 Admin Max SQ Size: 128 00:17:41.440 Transport Service Identifier: 4420 00:17:41.440 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:17:41.440 Transport Address: 10.0.0.3 00:17:41.440 Discovery Log Entry 1 00:17:41.440 ---------------------- 00:17:41.440 Transport Type: 3 (TCP) 00:17:41.440 Address Family: 1 (IPv4) 00:17:41.440 Subsystem Type: 2 (NVM Subsystem) 00:17:41.440 Entry Flags: 00:17:41.440 Duplicate Returned Information: 0 00:17:41.440 Explicit Persistent Connection Support for Discovery: 0 00:17:41.440 Transport Requirements: 00:17:41.440 Secure Channel: Not Required 00:17:41.440 Port ID: 0 (0x0000) 00:17:41.440 Controller ID: 65535 (0xffff) 00:17:41.440 Admin Max SQ Size: 128 00:17:41.440 Transport Service Identifier: 4420 00:17:41.440 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:17:41.440 Transport Address: 10.0.0.3 [2024-10-07 11:28:22.994452] nvme_ctrlr.c:4386:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:17:41.440 [2024-10-07 11:28:22.994468] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bb840) on tqpair=0x857750 00:17:41.440 [2024-10-07 11:28:22.994476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:41.440 [2024-10-07 11:28:22.994482] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bb9c0) on tqpair=0x857750 00:17:41.440 [2024-10-07 11:28:22.994487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:41.440 [2024-10-07 11:28:22.994493] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bbb40) on tqpair=0x857750 00:17:41.440 [2024-10-07 11:28:22.994498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:41.440 [2024-10-07 11:28:22.994503] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bbcc0) on tqpair=0x857750 00:17:41.440 [2024-10-07 11:28:22.994508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:41.440 [2024-10-07 11:28:22.994518] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.440 [2024-10-07 11:28:22.994524] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.440 [2024-10-07 11:28:22.994528] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857750) 00:17:41.440 [2024-10-07 11:28:22.994536] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.440 [2024-10-07 11:28:22.994561] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bbcc0, cid 3, qid 0 00:17:41.440 [2024-10-07 11:28:22.994615] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.440 [2024-10-07 11:28:22.994623] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.440 [2024-10-07 11:28:22.994627] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.440 [2024-10-07 11:28:22.994631] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bbcc0) on tqpair=0x857750 00:17:41.440 [2024-10-07 11:28:22.994640] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.440 [2024-10-07 11:28:22.994645] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.440 [2024-10-07 11:28:22.994649] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857750) 00:17:41.440 [2024-10-07 11:28:22.994656] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.440 [2024-10-07 11:28:22.994679] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bbcc0, cid 3, qid 0 00:17:41.440 [2024-10-07 11:28:22.994749] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.440 [2024-10-07 11:28:22.994762] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.440 [2024-10-07 11:28:22.994767] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.440 [2024-10-07 11:28:22.994771] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bbcc0) on tqpair=0x857750 00:17:41.440 [2024-10-07 11:28:22.994777] nvme_ctrlr.c:1147:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:17:41.440 [2024-10-07 11:28:22.994782] nvme_ctrlr.c:1150:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:17:41.440 [2024-10-07 11:28:22.994793] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.440 [2024-10-07 11:28:22.994798] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.440 [2024-10-07 11:28:22.994802] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857750) 00:17:41.440 [2024-10-07 11:28:22.994810] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.440 [2024-10-07 11:28:22.994829] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bbcc0, cid 3, qid 0 00:17:41.440 [2024-10-07 11:28:22.994875] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.440 [2024-10-07 11:28:22.994882] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.440 [2024-10-07 11:28:22.994886] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.440 [2024-10-07 11:28:22.994890] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bbcc0) on tqpair=0x857750 00:17:41.440 [2024-10-07 11:28:22.994901] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.440 [2024-10-07 11:28:22.994906] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.440 [2024-10-07 11:28:22.994910] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857750) 00:17:41.440 [2024-10-07 11:28:22.994918] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.440 [2024-10-07 11:28:22.994936] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bbcc0, cid 3, qid 0 00:17:41.440 [2024-10-07 11:28:22.994978] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.440 [2024-10-07 11:28:22.994985] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.440 [2024-10-07 11:28:22.994989] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.440 [2024-10-07 11:28:22.994993] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bbcc0) on tqpair=0x857750 00:17:41.440 [2024-10-07 11:28:22.995004] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.440 [2024-10-07 11:28:22.995009] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.440 [2024-10-07 11:28:22.995013] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857750) 00:17:41.440 [2024-10-07 11:28:22.995020] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.440 [2024-10-07 11:28:22.995038] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bbcc0, cid 3, qid 0 00:17:41.440 [2024-10-07 11:28:22.995090] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.440 [2024-10-07 11:28:22.995101] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.440 [2024-10-07 11:28:22.995106] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.440 [2024-10-07 11:28:22.995111] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bbcc0) on tqpair=0x857750 00:17:41.440 [2024-10-07 11:28:22.995122] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.440 [2024-10-07 11:28:22.995127] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.440 [2024-10-07 11:28:22.995131] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857750) 00:17:41.440 [2024-10-07 11:28:22.995139] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.440 [2024-10-07 11:28:22.995156] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bbcc0, cid 3, qid 0 00:17:41.440 [2024-10-07 11:28:22.995211] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.441 [2024-10-07 11:28:22.995218] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.441 [2024-10-07 11:28:22.995222] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.441 [2024-10-07 11:28:22.995226] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bbcc0) on tqpair=0x857750 00:17:41.441 [2024-10-07 11:28:22.995237] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.441 [2024-10-07 11:28:22.995242] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.441 [2024-10-07 11:28:22.995246] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857750) 00:17:41.441 [2024-10-07 11:28:22.995253] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.441 [2024-10-07 11:28:22.995271] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bbcc0, cid 3, qid 0 00:17:41.441 [2024-10-07 11:28:22.995316] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.441 [2024-10-07 11:28:22.995327] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.441 [2024-10-07 11:28:22.995332] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.441 [2024-10-07 11:28:22.995337] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bbcc0) on tqpair=0x857750 00:17:41.441 [2024-10-07 11:28:22.995348] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.441 [2024-10-07 11:28:22.995353] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.441 [2024-10-07 11:28:22.995357] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857750) 00:17:41.441 [2024-10-07 11:28:22.995365] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.441 [2024-10-07 11:28:22.995383] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bbcc0, cid 3, qid 0 00:17:41.441 [2024-10-07 11:28:22.999429] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.441 [2024-10-07 11:28:22.999454] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.441 [2024-10-07 11:28:22.999460] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.441 [2024-10-07 11:28:22.999465] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bbcc0) on tqpair=0x857750 00:17:41.441 [2024-10-07 11:28:22.999482] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.441 [2024-10-07 11:28:22.999488] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.441 [2024-10-07 11:28:22.999492] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857750) 00:17:41.441 [2024-10-07 11:28:22.999502] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.441 [2024-10-07 11:28:22.999528] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bbcc0, cid 3, qid 0 00:17:41.441 [2024-10-07 11:28:22.999625] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.441 [2024-10-07 11:28:22.999632] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.441 [2024-10-07 11:28:22.999636] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.441 [2024-10-07 11:28:22.999640] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x8bbcc0) on tqpair=0x857750 00:17:41.441 [2024-10-07 11:28:22.999649] nvme_ctrlr.c:1269:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 4 milliseconds 00:17:41.441 00:17:41.441 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@45 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:17:41.441 [2024-10-07 11:28:23.040395] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:41.441 [2024-10-07 11:28:23.040479] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid74245 ] 00:17:41.702 [2024-10-07 11:28:23.183826] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:17:41.702 [2024-10-07 11:28:23.183931] nvme_tcp.c:2349:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:17:41.702 [2024-10-07 11:28:23.183943] nvme_tcp.c:2353:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:17:41.702 [2024-10-07 11:28:23.183964] nvme_tcp.c:2374:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:17:41.702 [2024-10-07 11:28:23.183981] sock.c: 373:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:17:41.702 [2024-10-07 11:28:23.188443] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:17:41.702 [2024-10-07 11:28:23.188549] nvme_tcp.c:1566:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1cbf750 0 00:17:41.702 [2024-10-07 11:28:23.188611] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:17:41.702 [2024-10-07 11:28:23.188629] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:17:41.702 [2024-10-07 11:28:23.188639] nvme_tcp.c:1612:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:17:41.702 [2024-10-07 11:28:23.188646] nvme_tcp.c:1613:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:17:41.702 [2024-10-07 11:28:23.188703] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.702 [2024-10-07 11:28:23.188719] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.702 [2024-10-07 11:28:23.188726] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1cbf750) 00:17:41.702 [2024-10-07 11:28:23.188748] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:17:41.702 [2024-10-07 11:28:23.188790] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23840, cid 0, qid 0 00:17:41.702 [2024-10-07 11:28:23.196438] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.702 [2024-10-07 11:28:23.196474] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.702 [2024-10-07 11:28:23.196483] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.702 [2024-10-07 11:28:23.196493] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23840) on tqpair=0x1cbf750 00:17:41.702 [2024-10-07 11:28:23.196511] nvme_fabric.c: 621:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:17:41.702 [2024-10-07 11:28:23.196526] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:17:41.702 [2024-10-07 11:28:23.196538] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:17:41.702 [2024-10-07 11:28:23.196566] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.702 [2024-10-07 11:28:23.196576] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.702 [2024-10-07 11:28:23.196582] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1cbf750) 00:17:41.702 [2024-10-07 11:28:23.196598] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.702 [2024-10-07 11:28:23.196644] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23840, cid 0, qid 0 00:17:41.702 [2024-10-07 11:28:23.196712] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.702 [2024-10-07 11:28:23.196727] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.702 [2024-10-07 11:28:23.196735] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.702 [2024-10-07 11:28:23.196743] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23840) on tqpair=0x1cbf750 00:17:41.702 [2024-10-07 11:28:23.196754] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:17:41.702 [2024-10-07 11:28:23.196769] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:17:41.702 [2024-10-07 11:28:23.196783] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.702 [2024-10-07 11:28:23.196791] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.702 [2024-10-07 11:28:23.196798] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1cbf750) 00:17:41.702 [2024-10-07 11:28:23.196811] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.702 [2024-10-07 11:28:23.196847] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23840, cid 0, qid 0 00:17:41.702 [2024-10-07 11:28:23.196896] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.702 [2024-10-07 11:28:23.196910] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.702 [2024-10-07 11:28:23.196916] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.702 [2024-10-07 11:28:23.196923] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23840) on tqpair=0x1cbf750 00:17:41.703 [2024-10-07 11:28:23.196933] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:17:41.703 [2024-10-07 11:28:23.196950] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:17:41.703 [2024-10-07 11:28:23.196965] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.196974] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.196981] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1cbf750) 00:17:41.703 [2024-10-07 11:28:23.196996] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.703 [2024-10-07 11:28:23.197029] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23840, cid 0, qid 0 00:17:41.703 [2024-10-07 11:28:23.197086] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.703 [2024-10-07 11:28:23.197112] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.703 [2024-10-07 11:28:23.197119] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.197128] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23840) on tqpair=0x1cbf750 00:17:41.703 [2024-10-07 11:28:23.197139] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:17:41.703 [2024-10-07 11:28:23.197159] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.197167] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.197172] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1cbf750) 00:17:41.703 [2024-10-07 11:28:23.197183] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.703 [2024-10-07 11:28:23.197213] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23840, cid 0, qid 0 00:17:41.703 [2024-10-07 11:28:23.197288] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.703 [2024-10-07 11:28:23.197304] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.703 [2024-10-07 11:28:23.197311] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.197319] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23840) on tqpair=0x1cbf750 00:17:41.703 [2024-10-07 11:28:23.197329] nvme_ctrlr.c:3893:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:17:41.703 [2024-10-07 11:28:23.197338] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:17:41.703 [2024-10-07 11:28:23.197354] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:17:41.703 [2024-10-07 11:28:23.197467] nvme_ctrlr.c:4091:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:17:41.703 [2024-10-07 11:28:23.197483] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:17:41.703 [2024-10-07 11:28:23.197502] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.197511] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.197518] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1cbf750) 00:17:41.703 [2024-10-07 11:28:23.197530] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.703 [2024-10-07 11:28:23.197568] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23840, cid 0, qid 0 00:17:41.703 [2024-10-07 11:28:23.197637] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.703 [2024-10-07 11:28:23.197653] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.703 [2024-10-07 11:28:23.197660] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.197667] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23840) on tqpair=0x1cbf750 00:17:41.703 [2024-10-07 11:28:23.197678] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:17:41.703 [2024-10-07 11:28:23.197697] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.197704] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.197710] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1cbf750) 00:17:41.703 [2024-10-07 11:28:23.197721] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.703 [2024-10-07 11:28:23.197757] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23840, cid 0, qid 0 00:17:41.703 [2024-10-07 11:28:23.197813] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.703 [2024-10-07 11:28:23.197824] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.703 [2024-10-07 11:28:23.197829] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.197835] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23840) on tqpair=0x1cbf750 00:17:41.703 [2024-10-07 11:28:23.197843] nvme_ctrlr.c:3928:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:17:41.703 [2024-10-07 11:28:23.197851] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:17:41.703 [2024-10-07 11:28:23.197864] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:17:41.703 [2024-10-07 11:28:23.197890] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:17:41.703 [2024-10-07 11:28:23.197912] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.197921] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1cbf750) 00:17:41.703 [2024-10-07 11:28:23.197935] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.703 [2024-10-07 11:28:23.197973] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23840, cid 0, qid 0 00:17:41.703 [2024-10-07 11:28:23.198096] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:41.703 [2024-10-07 11:28:23.198123] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:41.703 [2024-10-07 11:28:23.198132] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.198139] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1cbf750): datao=0, datal=4096, cccid=0 00:17:41.703 [2024-10-07 11:28:23.198148] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d23840) on tqpair(0x1cbf750): expected_datao=0, payload_size=4096 00:17:41.703 [2024-10-07 11:28:23.198157] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.198172] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.198181] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.198196] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.703 [2024-10-07 11:28:23.198207] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.703 [2024-10-07 11:28:23.198214] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.198222] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23840) on tqpair=0x1cbf750 00:17:41.703 [2024-10-07 11:28:23.198237] nvme_ctrlr.c:2077:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:17:41.703 [2024-10-07 11:28:23.198248] nvme_ctrlr.c:2081:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:17:41.703 [2024-10-07 11:28:23.198257] nvme_ctrlr.c:2084:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:17:41.703 [2024-10-07 11:28:23.198265] nvme_ctrlr.c:2108:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:17:41.703 [2024-10-07 11:28:23.198274] nvme_ctrlr.c:2123:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:17:41.703 [2024-10-07 11:28:23.198284] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:17:41.703 [2024-10-07 11:28:23.198300] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:17:41.703 [2024-10-07 11:28:23.198322] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.198332] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.198339] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1cbf750) 00:17:41.703 [2024-10-07 11:28:23.198353] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:41.703 [2024-10-07 11:28:23.198392] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23840, cid 0, qid 0 00:17:41.703 [2024-10-07 11:28:23.198470] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.703 [2024-10-07 11:28:23.198490] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.703 [2024-10-07 11:28:23.198498] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.198507] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23840) on tqpair=0x1cbf750 00:17:41.703 [2024-10-07 11:28:23.198522] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.198531] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.198539] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1cbf750) 00:17:41.703 [2024-10-07 11:28:23.198553] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:17:41.703 [2024-10-07 11:28:23.198566] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.198573] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.198579] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1cbf750) 00:17:41.703 [2024-10-07 11:28:23.198589] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:41.703 [2024-10-07 11:28:23.198600] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.198606] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.198613] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1cbf750) 00:17:41.703 [2024-10-07 11:28:23.198624] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:41.703 [2024-10-07 11:28:23.198635] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.198642] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.198650] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1cbf750) 00:17:41.703 [2024-10-07 11:28:23.198660] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:41.703 [2024-10-07 11:28:23.198671] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:17:41.703 [2024-10-07 11:28:23.198695] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:17:41.703 [2024-10-07 11:28:23.198710] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.703 [2024-10-07 11:28:23.198717] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1cbf750) 00:17:41.703 [2024-10-07 11:28:23.198730] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.704 [2024-10-07 11:28:23.198772] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23840, cid 0, qid 0 00:17:41.704 [2024-10-07 11:28:23.198786] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d239c0, cid 1, qid 0 00:17:41.704 [2024-10-07 11:28:23.198796] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23b40, cid 2, qid 0 00:17:41.704 [2024-10-07 11:28:23.198805] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23cc0, cid 3, qid 0 00:17:41.704 [2024-10-07 11:28:23.198813] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23e40, cid 4, qid 0 00:17:41.704 [2024-10-07 11:28:23.198903] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.704 [2024-10-07 11:28:23.198919] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.704 [2024-10-07 11:28:23.198927] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.198935] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23e40) on tqpair=0x1cbf750 00:17:41.704 [2024-10-07 11:28:23.198947] nvme_ctrlr.c:3046:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:17:41.704 [2024-10-07 11:28:23.198958] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:17:41.704 [2024-10-07 11:28:23.198983] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:17:41.704 [2024-10-07 11:28:23.198995] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:17:41.704 [2024-10-07 11:28:23.199007] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.199015] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.199022] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1cbf750) 00:17:41.704 [2024-10-07 11:28:23.199035] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:41.704 [2024-10-07 11:28:23.199074] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23e40, cid 4, qid 0 00:17:41.704 [2024-10-07 11:28:23.199127] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.704 [2024-10-07 11:28:23.199140] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.704 [2024-10-07 11:28:23.199145] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.199153] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23e40) on tqpair=0x1cbf750 00:17:41.704 [2024-10-07 11:28:23.199244] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:17:41.704 [2024-10-07 11:28:23.199274] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:17:41.704 [2024-10-07 11:28:23.199293] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.199302] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1cbf750) 00:17:41.704 [2024-10-07 11:28:23.199316] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.704 [2024-10-07 11:28:23.199354] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23e40, cid 4, qid 0 00:17:41.704 [2024-10-07 11:28:23.199444] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:41.704 [2024-10-07 11:28:23.199460] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:41.704 [2024-10-07 11:28:23.199468] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.199474] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1cbf750): datao=0, datal=4096, cccid=4 00:17:41.704 [2024-10-07 11:28:23.199483] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d23e40) on tqpair(0x1cbf750): expected_datao=0, payload_size=4096 00:17:41.704 [2024-10-07 11:28:23.199491] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.199504] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.199512] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.199529] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.704 [2024-10-07 11:28:23.199539] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.704 [2024-10-07 11:28:23.199545] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.199552] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23e40) on tqpair=0x1cbf750 00:17:41.704 [2024-10-07 11:28:23.199583] nvme_ctrlr.c:4722:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:17:41.704 [2024-10-07 11:28:23.199603] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:17:41.704 [2024-10-07 11:28:23.199622] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:17:41.704 [2024-10-07 11:28:23.199638] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.199645] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1cbf750) 00:17:41.704 [2024-10-07 11:28:23.199658] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.704 [2024-10-07 11:28:23.199698] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23e40, cid 4, qid 0 00:17:41.704 [2024-10-07 11:28:23.199782] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:41.704 [2024-10-07 11:28:23.199797] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:41.704 [2024-10-07 11:28:23.199804] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.199810] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1cbf750): datao=0, datal=4096, cccid=4 00:17:41.704 [2024-10-07 11:28:23.199818] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d23e40) on tqpair(0x1cbf750): expected_datao=0, payload_size=4096 00:17:41.704 [2024-10-07 11:28:23.199826] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.199839] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.199847] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.199862] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.704 [2024-10-07 11:28:23.199874] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.704 [2024-10-07 11:28:23.199881] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.199888] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23e40) on tqpair=0x1cbf750 00:17:41.704 [2024-10-07 11:28:23.199907] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:17:41.704 [2024-10-07 11:28:23.199924] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:17:41.704 [2024-10-07 11:28:23.199936] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.199944] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1cbf750) 00:17:41.704 [2024-10-07 11:28:23.199956] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.704 [2024-10-07 11:28:23.199992] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23e40, cid 4, qid 0 00:17:41.704 [2024-10-07 11:28:23.200066] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:41.704 [2024-10-07 11:28:23.200080] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:41.704 [2024-10-07 11:28:23.200087] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.200093] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1cbf750): datao=0, datal=4096, cccid=4 00:17:41.704 [2024-10-07 11:28:23.200102] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d23e40) on tqpair(0x1cbf750): expected_datao=0, payload_size=4096 00:17:41.704 [2024-10-07 11:28:23.200110] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.200123] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.200131] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.200147] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.704 [2024-10-07 11:28:23.200158] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.704 [2024-10-07 11:28:23.200165] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.200172] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23e40) on tqpair=0x1cbf750 00:17:41.704 [2024-10-07 11:28:23.200193] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:17:41.704 [2024-10-07 11:28:23.200207] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:17:41.704 [2024-10-07 11:28:23.200223] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:17:41.704 [2024-10-07 11:28:23.200234] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host behavior support feature (timeout 30000 ms) 00:17:41.704 [2024-10-07 11:28:23.200244] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:17:41.704 [2024-10-07 11:28:23.200253] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:17:41.704 [2024-10-07 11:28:23.200262] nvme_ctrlr.c:3134:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:17:41.704 [2024-10-07 11:28:23.200269] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:17:41.704 [2024-10-07 11:28:23.200278] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:17:41.704 [2024-10-07 11:28:23.200307] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.200317] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1cbf750) 00:17:41.704 [2024-10-07 11:28:23.200331] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.704 [2024-10-07 11:28:23.200344] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.200351] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.200357] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1cbf750) 00:17:41.704 [2024-10-07 11:28:23.200368] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:17:41.704 [2024-10-07 11:28:23.204414] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23e40, cid 4, qid 0 00:17:41.704 [2024-10-07 11:28:23.204442] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23fc0, cid 5, qid 0 00:17:41.704 [2024-10-07 11:28:23.204463] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.704 [2024-10-07 11:28:23.204476] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.704 [2024-10-07 11:28:23.204482] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.204490] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23e40) on tqpair=0x1cbf750 00:17:41.704 [2024-10-07 11:28:23.204502] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.704 [2024-10-07 11:28:23.204511] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.704 [2024-10-07 11:28:23.204518] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.704 [2024-10-07 11:28:23.204524] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23fc0) on tqpair=0x1cbf750 00:17:41.704 [2024-10-07 11:28:23.204546] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.204556] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1cbf750) 00:17:41.705 [2024-10-07 11:28:23.204571] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.705 [2024-10-07 11:28:23.204617] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23fc0, cid 5, qid 0 00:17:41.705 [2024-10-07 11:28:23.204683] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.705 [2024-10-07 11:28:23.204697] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.705 [2024-10-07 11:28:23.204704] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.204711] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23fc0) on tqpair=0x1cbf750 00:17:41.705 [2024-10-07 11:28:23.204730] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.204740] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1cbf750) 00:17:41.705 [2024-10-07 11:28:23.204754] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.705 [2024-10-07 11:28:23.204790] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23fc0, cid 5, qid 0 00:17:41.705 [2024-10-07 11:28:23.204843] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.705 [2024-10-07 11:28:23.204857] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.705 [2024-10-07 11:28:23.204863] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.204869] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23fc0) on tqpair=0x1cbf750 00:17:41.705 [2024-10-07 11:28:23.204889] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.204898] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1cbf750) 00:17:41.705 [2024-10-07 11:28:23.204913] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.705 [2024-10-07 11:28:23.204948] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23fc0, cid 5, qid 0 00:17:41.705 [2024-10-07 11:28:23.205005] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.705 [2024-10-07 11:28:23.205020] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.705 [2024-10-07 11:28:23.205027] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205035] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23fc0) on tqpair=0x1cbf750 00:17:41.705 [2024-10-07 11:28:23.205084] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205097] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1cbf750) 00:17:41.705 [2024-10-07 11:28:23.205111] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.705 [2024-10-07 11:28:23.205127] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205134] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1cbf750) 00:17:41.705 [2024-10-07 11:28:23.205146] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.705 [2024-10-07 11:28:23.205160] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205169] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x1cbf750) 00:17:41.705 [2024-10-07 11:28:23.205181] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.705 [2024-10-07 11:28:23.205195] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205203] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1cbf750) 00:17:41.705 [2024-10-07 11:28:23.205214] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.705 [2024-10-07 11:28:23.205253] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23fc0, cid 5, qid 0 00:17:41.705 [2024-10-07 11:28:23.205267] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23e40, cid 4, qid 0 00:17:41.705 [2024-10-07 11:28:23.205277] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d24140, cid 6, qid 0 00:17:41.705 [2024-10-07 11:28:23.205284] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d242c0, cid 7, qid 0 00:17:41.705 [2024-10-07 11:28:23.205481] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:41.705 [2024-10-07 11:28:23.205505] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:41.705 [2024-10-07 11:28:23.205514] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205521] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1cbf750): datao=0, datal=8192, cccid=5 00:17:41.705 [2024-10-07 11:28:23.205530] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d23fc0) on tqpair(0x1cbf750): expected_datao=0, payload_size=8192 00:17:41.705 [2024-10-07 11:28:23.205538] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205568] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205578] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205588] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:41.705 [2024-10-07 11:28:23.205597] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:41.705 [2024-10-07 11:28:23.205604] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205610] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1cbf750): datao=0, datal=512, cccid=4 00:17:41.705 [2024-10-07 11:28:23.205618] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d23e40) on tqpair(0x1cbf750): expected_datao=0, payload_size=512 00:17:41.705 [2024-10-07 11:28:23.205626] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205638] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205645] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205655] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:41.705 [2024-10-07 11:28:23.205664] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:41.705 [2024-10-07 11:28:23.205670] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205677] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1cbf750): datao=0, datal=512, cccid=6 00:17:41.705 [2024-10-07 11:28:23.205683] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d24140) on tqpair(0x1cbf750): expected_datao=0, payload_size=512 00:17:41.705 [2024-10-07 11:28:23.205691] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205702] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205709] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205720] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:41.705 [2024-10-07 11:28:23.205730] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:41.705 [2024-10-07 11:28:23.205737] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205744] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1cbf750): datao=0, datal=4096, cccid=7 00:17:41.705 [2024-10-07 11:28:23.205753] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d242c0) on tqpair(0x1cbf750): expected_datao=0, payload_size=4096 00:17:41.705 [2024-10-07 11:28:23.205760] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205771] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205779] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205788] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.705 [2024-10-07 11:28:23.205798] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.705 [2024-10-07 11:28:23.205804] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205812] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23fc0) on tqpair=0x1cbf750 00:17:41.705 [2024-10-07 11:28:23.205839] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.705 [2024-10-07 11:28:23.205851] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.705 [2024-10-07 11:28:23.205858] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205864] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23e40) on tqpair=0x1cbf750 00:17:41.705 [2024-10-07 11:28:23.205887] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.705 [2024-10-07 11:28:23.205899] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.705 [2024-10-07 11:28:23.205906] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.705 [2024-10-07 11:28:23.205913] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d24140) on tqpair=0x1cbf750 00:17:41.705 [2024-10-07 11:28:23.205927] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.705 ===================================================== 00:17:41.705 NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:17:41.705 ===================================================== 00:17:41.705 Controller Capabilities/Features 00:17:41.705 ================================ 00:17:41.705 Vendor ID: 8086 00:17:41.705 Subsystem Vendor ID: 8086 00:17:41.705 Serial Number: SPDK00000000000001 00:17:41.705 Model Number: SPDK bdev Controller 00:17:41.705 Firmware Version: 25.01 00:17:41.705 Recommended Arb Burst: 6 00:17:41.705 IEEE OUI Identifier: e4 d2 5c 00:17:41.705 Multi-path I/O 00:17:41.705 May have multiple subsystem ports: Yes 00:17:41.705 May have multiple controllers: Yes 00:17:41.705 Associated with SR-IOV VF: No 00:17:41.705 Max Data Transfer Size: 131072 00:17:41.705 Max Number of Namespaces: 32 00:17:41.705 Max Number of I/O Queues: 127 00:17:41.705 NVMe Specification Version (VS): 1.3 00:17:41.705 NVMe Specification Version (Identify): 1.3 00:17:41.705 Maximum Queue Entries: 128 00:17:41.705 Contiguous Queues Required: Yes 00:17:41.705 Arbitration Mechanisms Supported 00:17:41.705 Weighted Round Robin: Not Supported 00:17:41.705 Vendor Specific: Not Supported 00:17:41.705 Reset Timeout: 15000 ms 00:17:41.705 Doorbell Stride: 4 bytes 00:17:41.705 NVM Subsystem Reset: Not Supported 00:17:41.705 Command Sets Supported 00:17:41.705 NVM Command Set: Supported 00:17:41.705 Boot Partition: Not Supported 00:17:41.705 Memory Page Size Minimum: 4096 bytes 00:17:41.705 Memory Page Size Maximum: 4096 bytes 00:17:41.705 Persistent Memory Region: Not Supported 00:17:41.705 Optional Asynchronous Events Supported 00:17:41.705 Namespace Attribute Notices: Supported 00:17:41.706 Firmware Activation Notices: Not Supported 00:17:41.706 ANA Change Notices: Not Supported 00:17:41.706 PLE Aggregate Log Change Notices: Not Supported 00:17:41.706 LBA Status Info Alert Notices: Not Supported 00:17:41.706 EGE Aggregate Log Change Notices: Not Supported 00:17:41.706 Normal NVM Subsystem Shutdown event: Not Supported 00:17:41.706 Zone Descriptor Change Notices: Not Supported 00:17:41.706 Discovery Log Change Notices: Not Supported 00:17:41.706 Controller Attributes 00:17:41.706 128-bit Host Identifier: Supported 00:17:41.706 Non-Operational Permissive Mode: Not Supported 00:17:41.706 NVM Sets: Not Supported 00:17:41.706 Read Recovery Levels: Not Supported 00:17:41.706 Endurance Groups: Not Supported 00:17:41.706 Predictable Latency Mode: Not Supported 00:17:41.706 Traffic Based Keep ALive: Not Supported 00:17:41.706 Namespace Granularity: Not Supported 00:17:41.706 SQ Associations: Not Supported 00:17:41.706 UUID List: Not Supported 00:17:41.706 Multi-Domain Subsystem: Not Supported 00:17:41.706 Fixed Capacity Management: Not Supported 00:17:41.706 Variable Capacity Management: Not Supported 00:17:41.706 Delete Endurance Group: Not Supported 00:17:41.706 Delete NVM Set: Not Supported 00:17:41.706 Extended LBA Formats Supported: Not Supported 00:17:41.706 Flexible Data Placement Supported: Not Supported 00:17:41.706 00:17:41.706 Controller Memory Buffer Support 00:17:41.706 ================================ 00:17:41.706 Supported: No 00:17:41.706 00:17:41.706 Persistent Memory Region Support 00:17:41.706 ================================ 00:17:41.706 Supported: No 00:17:41.706 00:17:41.706 Admin Command Set Attributes 00:17:41.706 ============================ 00:17:41.706 Security Send/Receive: Not Supported 00:17:41.706 Format NVM: Not Supported 00:17:41.706 Firmware Activate/Download: Not Supported 00:17:41.706 Namespace Management: Not Supported 00:17:41.706 Device Self-Test: Not Supported 00:17:41.706 Directives: Not Supported 00:17:41.706 NVMe-MI: Not Supported 00:17:41.706 Virtualization Management: Not Supported 00:17:41.706 Doorbell Buffer Config: Not Supported 00:17:41.706 Get LBA Status Capability: Not Supported 00:17:41.706 Command & Feature Lockdown Capability: Not Supported 00:17:41.706 Abort Command Limit: 4 00:17:41.706 Async Event Request Limit: 4 00:17:41.706 Number of Firmware Slots: N/A 00:17:41.706 Firmware Slot 1 Read-Only: N/A 00:17:41.706 Firmware Activation Without Reset: N/A 00:17:41.706 Multiple Update Detection Support: N/A 00:17:41.706 Firmware Update Granularity: No Information Provided 00:17:41.706 Per-Namespace SMART Log: No 00:17:41.706 Asymmetric Namespace Access Log Page: Not Supported 00:17:41.706 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:17:41.706 Command Effects Log Page: Supported 00:17:41.706 Get Log Page Extended Data: Supported 00:17:41.706 Telemetry Log Pages: Not Supported 00:17:41.706 Persistent Event Log Pages: Not Supported 00:17:41.706 Supported Log Pages Log Page: May Support 00:17:41.706 Commands Supported & Effects Log Page: Not Supported 00:17:41.706 Feature Identifiers & Effects Log Page:May Support 00:17:41.706 NVMe-MI Commands & Effects Log Page: May Support 00:17:41.706 Data Area 4 for Telemetry Log: Not Supported 00:17:41.706 Error Log Page Entries Supported: 128 00:17:41.706 Keep Alive: Supported 00:17:41.706 Keep Alive Granularity: 10000 ms 00:17:41.706 00:17:41.706 NVM Command Set Attributes 00:17:41.706 ========================== 00:17:41.706 Submission Queue Entry Size 00:17:41.706 Max: 64 00:17:41.706 Min: 64 00:17:41.706 Completion Queue Entry Size 00:17:41.706 Max: 16 00:17:41.706 Min: 16 00:17:41.706 Number of Namespaces: 32 00:17:41.706 Compare Command: Supported 00:17:41.706 Write Uncorrectable Command: Not Supported 00:17:41.706 Dataset Management Command: Supported 00:17:41.706 Write Zeroes Command: Supported 00:17:41.706 Set Features Save Field: Not Supported 00:17:41.706 Reservations: Supported 00:17:41.706 Timestamp: Not Supported 00:17:41.706 Copy: Supported 00:17:41.706 Volatile Write Cache: Present 00:17:41.706 Atomic Write Unit (Normal): 1 00:17:41.706 Atomic Write Unit (PFail): 1 00:17:41.706 Atomic Compare & Write Unit: 1 00:17:41.706 Fused Compare & Write: Supported 00:17:41.706 Scatter-Gather List 00:17:41.706 SGL Command Set: Supported 00:17:41.706 SGL Keyed: Supported 00:17:41.706 SGL Bit Bucket Descriptor: Not Supported 00:17:41.706 SGL Metadata Pointer: Not Supported 00:17:41.706 Oversized SGL: Not Supported 00:17:41.706 SGL Metadata Address: Not Supported 00:17:41.706 SGL Offset: Supported 00:17:41.706 Transport SGL Data Block: Not Supported 00:17:41.706 Replay Protected Memory Block: Not Supported 00:17:41.706 00:17:41.706 Firmware Slot Information 00:17:41.706 ========================= 00:17:41.706 Active slot: 1 00:17:41.706 Slot 1 Firmware Revision: 25.01 00:17:41.706 00:17:41.706 00:17:41.706 Commands Supported and Effects 00:17:41.706 ============================== 00:17:41.706 Admin Commands 00:17:41.706 -------------- 00:17:41.706 Get Log Page (02h): Supported 00:17:41.706 Identify (06h): Supported 00:17:41.706 Abort (08h): Supported 00:17:41.706 Set Features (09h): Supported 00:17:41.706 Get Features (0Ah): Supported 00:17:41.706 Asynchronous Event Request (0Ch): Supported 00:17:41.706 Keep Alive (18h): Supported 00:17:41.706 I/O Commands 00:17:41.706 ------------ 00:17:41.706 Flush (00h): Supported LBA-Change 00:17:41.706 Write (01h): Supported LBA-Change 00:17:41.706 Read (02h): Supported 00:17:41.706 Compare (05h): Supported 00:17:41.706 Write Zeroes (08h): Supported LBA-Change 00:17:41.706 Dataset Management (09h): Supported LBA-Change 00:17:41.706 Copy (19h): Supported LBA-Change 00:17:41.706 00:17:41.706 Error Log 00:17:41.706 ========= 00:17:41.706 00:17:41.706 Arbitration 00:17:41.706 =========== 00:17:41.706 Arbitration Burst: 1 00:17:41.706 00:17:41.706 Power Management 00:17:41.706 ================ 00:17:41.706 Number of Power States: 1 00:17:41.706 Current Power State: Power State #0 00:17:41.706 Power State #0: 00:17:41.706 Max Power: 0.00 W 00:17:41.706 Non-Operational State: Operational 00:17:41.706 Entry Latency: Not Reported 00:17:41.706 Exit Latency: Not Reported 00:17:41.706 Relative Read Throughput: 0 00:17:41.706 Relative Read Latency: 0 00:17:41.706 Relative Write Throughput: 0 00:17:41.706 Relative Write Latency: 0 00:17:41.706 Idle Power: Not Reported 00:17:41.706 Active Power: Not Reported 00:17:41.706 Non-Operational Permissive Mode: Not Supported 00:17:41.706 00:17:41.706 Health Information 00:17:41.706 ================== 00:17:41.706 Critical Warnings: 00:17:41.706 Available Spare Space: OK 00:17:41.706 Temperature: OK 00:17:41.706 Device Reliability: OK 00:17:41.706 Read Only: No 00:17:41.706 Volatile Memory Backup: OK 00:17:41.706 Current Temperature: 0 Kelvin (-273 Celsius) 00:17:41.706 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:17:41.706 Available Spare: 0% 00:17:41.706 Available Spare Threshold: 0% 00:17:41.706 Life Percentage Used:[2024-10-07 11:28:23.205939] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.706 [2024-10-07 11:28:23.205946] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.706 [2024-10-07 11:28:23.205952] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d242c0) on tqpair=0x1cbf750 00:17:41.706 [2024-10-07 11:28:23.206109] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.706 [2024-10-07 11:28:23.206123] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1cbf750) 00:17:41.706 [2024-10-07 11:28:23.206136] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.706 [2024-10-07 11:28:23.206175] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d242c0, cid 7, qid 0 00:17:41.706 [2024-10-07 11:28:23.206249] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.706 [2024-10-07 11:28:23.206263] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.706 [2024-10-07 11:28:23.206270] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.706 [2024-10-07 11:28:23.206277] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d242c0) on tqpair=0x1cbf750 00:17:41.706 [2024-10-07 11:28:23.206342] nvme_ctrlr.c:4386:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:17:41.706 [2024-10-07 11:28:23.206364] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23840) on tqpair=0x1cbf750 00:17:41.706 [2024-10-07 11:28:23.206377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:41.706 [2024-10-07 11:28:23.206387] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d239c0) on tqpair=0x1cbf750 00:17:41.706 [2024-10-07 11:28:23.206396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:41.706 [2024-10-07 11:28:23.206421] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23b40) on tqpair=0x1cbf750 00:17:41.706 [2024-10-07 11:28:23.206431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:41.706 [2024-10-07 11:28:23.206440] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23cc0) on tqpair=0x1cbf750 00:17:41.706 [2024-10-07 11:28:23.206448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:41.707 [2024-10-07 11:28:23.206464] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.206473] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.206479] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1cbf750) 00:17:41.707 [2024-10-07 11:28:23.206492] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.707 [2024-10-07 11:28:23.206534] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23cc0, cid 3, qid 0 00:17:41.707 [2024-10-07 11:28:23.206591] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.707 [2024-10-07 11:28:23.206605] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.707 [2024-10-07 11:28:23.206613] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.206620] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23cc0) on tqpair=0x1cbf750 00:17:41.707 [2024-10-07 11:28:23.206635] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.206644] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.206652] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1cbf750) 00:17:41.707 [2024-10-07 11:28:23.206666] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.707 [2024-10-07 11:28:23.206706] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23cc0, cid 3, qid 0 00:17:41.707 [2024-10-07 11:28:23.206799] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.707 [2024-10-07 11:28:23.206819] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.707 [2024-10-07 11:28:23.206827] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.206836] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23cc0) on tqpair=0x1cbf750 00:17:41.707 [2024-10-07 11:28:23.206845] nvme_ctrlr.c:1147:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:17:41.707 [2024-10-07 11:28:23.206854] nvme_ctrlr.c:1150:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:17:41.707 [2024-10-07 11:28:23.206870] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.206877] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.206883] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1cbf750) 00:17:41.707 [2024-10-07 11:28:23.206895] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.707 [2024-10-07 11:28:23.206931] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23cc0, cid 3, qid 0 00:17:41.707 [2024-10-07 11:28:23.206995] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.707 [2024-10-07 11:28:23.207010] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.707 [2024-10-07 11:28:23.207017] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.207026] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23cc0) on tqpair=0x1cbf750 00:17:41.707 [2024-10-07 11:28:23.207045] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.207056] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.207061] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1cbf750) 00:17:41.707 [2024-10-07 11:28:23.207073] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.707 [2024-10-07 11:28:23.207104] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23cc0, cid 3, qid 0 00:17:41.707 [2024-10-07 11:28:23.207168] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.707 [2024-10-07 11:28:23.207182] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.707 [2024-10-07 11:28:23.207189] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.207196] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23cc0) on tqpair=0x1cbf750 00:17:41.707 [2024-10-07 11:28:23.207215] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.207225] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.207232] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1cbf750) 00:17:41.707 [2024-10-07 11:28:23.207245] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.707 [2024-10-07 11:28:23.207282] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23cc0, cid 3, qid 0 00:17:41.707 [2024-10-07 11:28:23.207339] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.707 [2024-10-07 11:28:23.207359] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.707 [2024-10-07 11:28:23.207366] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.207374] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23cc0) on tqpair=0x1cbf750 00:17:41.707 [2024-10-07 11:28:23.207395] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.207429] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.207438] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1cbf750) 00:17:41.707 [2024-10-07 11:28:23.207452] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.707 [2024-10-07 11:28:23.207484] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23cc0, cid 3, qid 0 00:17:41.707 [2024-10-07 11:28:23.207555] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.707 [2024-10-07 11:28:23.207569] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.707 [2024-10-07 11:28:23.207577] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.207584] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23cc0) on tqpair=0x1cbf750 00:17:41.707 [2024-10-07 11:28:23.207605] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.207615] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.207623] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1cbf750) 00:17:41.707 [2024-10-07 11:28:23.207637] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.707 [2024-10-07 11:28:23.207669] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23cc0, cid 3, qid 0 00:17:41.707 [2024-10-07 11:28:23.207735] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.707 [2024-10-07 11:28:23.207749] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.707 [2024-10-07 11:28:23.207756] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.207763] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23cc0) on tqpair=0x1cbf750 00:17:41.707 [2024-10-07 11:28:23.207784] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.207792] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.207797] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1cbf750) 00:17:41.707 [2024-10-07 11:28:23.207810] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.707 [2024-10-07 11:28:23.207845] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23cc0, cid 3, qid 0 00:17:41.707 [2024-10-07 11:28:23.207905] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.707 [2024-10-07 11:28:23.207920] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.707 [2024-10-07 11:28:23.207926] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.207932] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23cc0) on tqpair=0x1cbf750 00:17:41.707 [2024-10-07 11:28:23.207948] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.207955] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.207960] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1cbf750) 00:17:41.707 [2024-10-07 11:28:23.207972] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.707 [2024-10-07 11:28:23.208003] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23cc0, cid 3, qid 0 00:17:41.707 [2024-10-07 11:28:23.208062] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.707 [2024-10-07 11:28:23.208077] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.707 [2024-10-07 11:28:23.208085] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.208093] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23cc0) on tqpair=0x1cbf750 00:17:41.707 [2024-10-07 11:28:23.208112] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.208122] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.208129] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1cbf750) 00:17:41.707 [2024-10-07 11:28:23.208141] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.707 [2024-10-07 11:28:23.208172] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23cc0, cid 3, qid 0 00:17:41.707 [2024-10-07 11:28:23.208223] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.707 [2024-10-07 11:28:23.208238] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.707 [2024-10-07 11:28:23.208245] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.208251] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23cc0) on tqpair=0x1cbf750 00:17:41.707 [2024-10-07 11:28:23.208269] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.707 [2024-10-07 11:28:23.208279] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.708 [2024-10-07 11:28:23.208287] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1cbf750) 00:17:41.708 [2024-10-07 11:28:23.208299] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.708 [2024-10-07 11:28:23.208333] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23cc0, cid 3, qid 0 00:17:41.708 [2024-10-07 11:28:23.208386] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.708 [2024-10-07 11:28:23.212421] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.708 [2024-10-07 11:28:23.212447] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.708 [2024-10-07 11:28:23.212456] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23cc0) on tqpair=0x1cbf750 00:17:41.708 [2024-10-07 11:28:23.212482] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:41.708 [2024-10-07 11:28:23.212493] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:41.708 [2024-10-07 11:28:23.212500] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1cbf750) 00:17:41.708 [2024-10-07 11:28:23.212513] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:41.708 [2024-10-07 11:28:23.212554] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d23cc0, cid 3, qid 0 00:17:41.708 [2024-10-07 11:28:23.212622] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:41.708 [2024-10-07 11:28:23.212636] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:41.708 [2024-10-07 11:28:23.212643] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:41.708 [2024-10-07 11:28:23.212650] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1d23cc0) on tqpair=0x1cbf750 00:17:41.708 [2024-10-07 11:28:23.212666] nvme_ctrlr.c:1269:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 5 milliseconds 00:17:41.708 0% 00:17:41.708 Data Units Read: 0 00:17:41.708 Data Units Written: 0 00:17:41.708 Host Read Commands: 0 00:17:41.708 Host Write Commands: 0 00:17:41.708 Controller Busy Time: 0 minutes 00:17:41.708 Power Cycles: 0 00:17:41.708 Power On Hours: 0 hours 00:17:41.708 Unsafe Shutdowns: 0 00:17:41.708 Unrecoverable Media Errors: 0 00:17:41.708 Lifetime Error Log Entries: 0 00:17:41.708 Warning Temperature Time: 0 minutes 00:17:41.708 Critical Temperature Time: 0 minutes 00:17:41.708 00:17:41.708 Number of Queues 00:17:41.708 ================ 00:17:41.708 Number of I/O Submission Queues: 127 00:17:41.708 Number of I/O Completion Queues: 127 00:17:41.708 00:17:41.708 Active Namespaces 00:17:41.708 ================= 00:17:41.708 Namespace ID:1 00:17:41.708 Error Recovery Timeout: Unlimited 00:17:41.708 Command Set Identifier: NVM (00h) 00:17:41.708 Deallocate: Supported 00:17:41.708 Deallocated/Unwritten Error: Not Supported 00:17:41.708 Deallocated Read Value: Unknown 00:17:41.708 Deallocate in Write Zeroes: Not Supported 00:17:41.708 Deallocated Guard Field: 0xFFFF 00:17:41.708 Flush: Supported 00:17:41.708 Reservation: Supported 00:17:41.708 Namespace Sharing Capabilities: Multiple Controllers 00:17:41.708 Size (in LBAs): 131072 (0GiB) 00:17:41.708 Capacity (in LBAs): 131072 (0GiB) 00:17:41.708 Utilization (in LBAs): 131072 (0GiB) 00:17:41.708 NGUID: ABCDEF0123456789ABCDEF0123456789 00:17:41.708 EUI64: ABCDEF0123456789 00:17:41.708 UUID: 314b1b31-cad6-4940-87d6-b07c8c1a5127 00:17:41.708 Thin Provisioning: Not Supported 00:17:41.708 Per-NS Atomic Units: Yes 00:17:41.708 Atomic Boundary Size (Normal): 0 00:17:41.708 Atomic Boundary Size (PFail): 0 00:17:41.708 Atomic Boundary Offset: 0 00:17:41.708 Maximum Single Source Range Length: 65535 00:17:41.708 Maximum Copy Length: 65535 00:17:41.708 Maximum Source Range Count: 1 00:17:41.708 NGUID/EUI64 Never Reused: No 00:17:41.708 Namespace Write Protected: No 00:17:41.708 Number of LBA Formats: 1 00:17:41.708 Current LBA Format: LBA Format #00 00:17:41.708 LBA Format #00: Data Size: 512 Metadata Size: 0 00:17:41.708 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@51 -- # sync 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@56 -- # nvmftestfini 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@514 -- # nvmfcleanup 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@121 -- # sync 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@124 -- # set +e 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@125 -- # for i in {1..20} 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:17:41.708 rmmod nvme_tcp 00:17:41.708 rmmod nvme_fabrics 00:17:41.708 rmmod nvme_keyring 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@128 -- # set -e 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@129 -- # return 0 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@515 -- # '[' -n 74207 ']' 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@516 -- # killprocess 74207 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@950 -- # '[' -z 74207 ']' 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@954 -- # kill -0 74207 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@955 -- # uname 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 74207 00:17:41.708 killing process with pid 74207 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@968 -- # echo 'killing process with pid 74207' 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@969 -- # kill 74207 00:17:41.708 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@974 -- # wait 74207 00:17:41.966 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:17:41.966 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:17:41.966 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:17:41.966 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@297 -- # iptr 00:17:41.966 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@789 -- # iptables-save 00:17:41.966 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:17:41.966 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@789 -- # iptables-restore 00:17:41.966 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:17:41.966 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:17:41.966 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:17:41.966 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:17:41.966 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:17:41.966 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:17:41.966 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:17:41.966 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:17:41.966 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:17:41.966 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:17:41.966 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:17:42.224 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:17:42.224 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:17:42.224 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:42.224 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:42.224 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@246 -- # remove_spdk_ns 00:17:42.224 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:42.224 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:42.224 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:42.224 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@300 -- # return 0 00:17:42.224 00:17:42.224 real 0m2.957s 00:17:42.224 user 0m7.728s 00:17:42.224 sys 0m0.690s 00:17:42.224 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1126 -- # xtrace_disable 00:17:42.224 11:28:23 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:42.224 ************************************ 00:17:42.224 END TEST nvmf_identify 00:17:42.224 ************************************ 00:17:42.224 11:28:23 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@23 -- # run_test nvmf_perf /home/vagrant/spdk_repo/spdk/test/nvmf/host/perf.sh --transport=tcp 00:17:42.224 11:28:23 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:17:42.224 11:28:23 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:17:42.224 11:28:23 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:17:42.224 ************************************ 00:17:42.224 START TEST nvmf_perf 00:17:42.224 ************************************ 00:17:42.224 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/perf.sh --transport=tcp 00:17:42.224 * Looking for test storage... 00:17:42.224 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:17:42.224 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:17:42.224 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1681 -- # lcov --version 00:17:42.224 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@333 -- # local ver1 ver1_l 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@334 -- # local ver2 ver2_l 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@336 -- # IFS=.-: 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@336 -- # read -ra ver1 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@337 -- # IFS=.-: 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@337 -- # read -ra ver2 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@338 -- # local 'op=<' 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@340 -- # ver1_l=2 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@341 -- # ver2_l=1 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@344 -- # case "$op" in 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@345 -- # : 1 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@364 -- # (( v = 0 )) 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@365 -- # decimal 1 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@353 -- # local d=1 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@355 -- # echo 1 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@365 -- # ver1[v]=1 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@366 -- # decimal 2 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@353 -- # local d=2 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:42.483 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@355 -- # echo 2 00:17:42.484 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@366 -- # ver2[v]=2 00:17:42.484 11:28:23 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@368 -- # return 0 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:17:42.484 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:42.484 --rc genhtml_branch_coverage=1 00:17:42.484 --rc genhtml_function_coverage=1 00:17:42.484 --rc genhtml_legend=1 00:17:42.484 --rc geninfo_all_blocks=1 00:17:42.484 --rc geninfo_unexecuted_blocks=1 00:17:42.484 00:17:42.484 ' 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:17:42.484 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:42.484 --rc genhtml_branch_coverage=1 00:17:42.484 --rc genhtml_function_coverage=1 00:17:42.484 --rc genhtml_legend=1 00:17:42.484 --rc geninfo_all_blocks=1 00:17:42.484 --rc geninfo_unexecuted_blocks=1 00:17:42.484 00:17:42.484 ' 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:17:42.484 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:42.484 --rc genhtml_branch_coverage=1 00:17:42.484 --rc genhtml_function_coverage=1 00:17:42.484 --rc genhtml_legend=1 00:17:42.484 --rc geninfo_all_blocks=1 00:17:42.484 --rc geninfo_unexecuted_blocks=1 00:17:42.484 00:17:42.484 ' 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:17:42.484 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:42.484 --rc genhtml_branch_coverage=1 00:17:42.484 --rc genhtml_function_coverage=1 00:17:42.484 --rc genhtml_legend=1 00:17:42.484 --rc geninfo_all_blocks=1 00:17:42.484 --rc geninfo_unexecuted_blocks=1 00:17:42.484 00:17:42.484 ' 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@7 -- # uname -s 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@15 -- # shopt -s extglob 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@5 -- # export PATH 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@51 -- # : 0 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:17:42.484 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@55 -- # have_pci_nics=0 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@15 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@17 -- # nvmftestinit 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@474 -- # prepare_net_devs 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@436 -- # local -g is_hw=no 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@438 -- # remove_spdk_ns 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@458 -- # nvmf_veth_init 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:17:42.484 Cannot find device "nvmf_init_br" 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@162 -- # true 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:17:42.484 Cannot find device "nvmf_init_br2" 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@163 -- # true 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:17:42.484 Cannot find device "nvmf_tgt_br" 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@164 -- # true 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:17:42.484 Cannot find device "nvmf_tgt_br2" 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@165 -- # true 00:17:42.484 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:17:42.485 Cannot find device "nvmf_init_br" 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@166 -- # true 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:17:42.485 Cannot find device "nvmf_init_br2" 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@167 -- # true 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:17:42.485 Cannot find device "nvmf_tgt_br" 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@168 -- # true 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:17:42.485 Cannot find device "nvmf_tgt_br2" 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@169 -- # true 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:17:42.485 Cannot find device "nvmf_br" 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@170 -- # true 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:17:42.485 Cannot find device "nvmf_init_if" 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@171 -- # true 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:17:42.485 Cannot find device "nvmf_init_if2" 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@172 -- # true 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:42.485 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@173 -- # true 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:42.485 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@174 -- # true 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:17:42.485 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:17:42.743 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:17:42.743 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.094 ms 00:17:42.743 00:17:42.743 --- 10.0.0.3 ping statistics --- 00:17:42.743 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:42.743 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:17:42.743 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:17:42.743 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.080 ms 00:17:42.743 00:17:42.743 --- 10.0.0.4 ping statistics --- 00:17:42.743 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:42.743 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:17:42.743 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:42.743 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.025 ms 00:17:42.743 00:17:42.743 --- 10.0.0.1 ping statistics --- 00:17:42.743 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:42.743 rtt min/avg/max/mdev = 0.025/0.025/0.025/0.000 ms 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:17:42.743 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:42.743 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.058 ms 00:17:42.743 00:17:42.743 --- 10.0.0.2 ping statistics --- 00:17:42.743 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:42.743 rtt min/avg/max/mdev = 0.058/0.058/0.058/0.000 ms 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@459 -- # return 0 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:17:42.743 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:17:43.001 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@724 -- # xtrace_disable 00:17:43.001 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@10 -- # set +x 00:17:43.001 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@507 -- # nvmfpid=74458 00:17:43.001 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:17:43.001 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@508 -- # waitforlisten 74458 00:17:43.001 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@831 -- # '[' -z 74458 ']' 00:17:43.001 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:43.001 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:43.001 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:43.001 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:43.001 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:43.001 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@10 -- # set +x 00:17:43.001 [2024-10-07 11:28:24.514217] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:43.001 [2024-10-07 11:28:24.514310] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:43.001 [2024-10-07 11:28:24.650813] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:43.259 [2024-10-07 11:28:24.752813] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:43.259 [2024-10-07 11:28:24.753145] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:43.259 [2024-10-07 11:28:24.753322] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:43.259 [2024-10-07 11:28:24.753525] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:43.259 [2024-10-07 11:28:24.753686] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:43.259 [2024-10-07 11:28:24.754885] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:17:43.259 [2024-10-07 11:28:24.755033] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:17:43.259 [2024-10-07 11:28:24.755103] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:17:43.259 [2024-10-07 11:28:24.755112] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:17:43.259 [2024-10-07 11:28:24.794876] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:17:43.259 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:43.259 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@864 -- # return 0 00:17:43.259 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:17:43.259 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@730 -- # xtrace_disable 00:17:43.259 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@10 -- # set +x 00:17:43.259 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:43.259 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py load_subsystem_config 00:17:43.259 11:28:24 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/gen_nvme.sh 00:17:43.825 11:28:25 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:17:43.825 11:28:25 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@30 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py framework_get_config bdev 00:17:44.082 11:28:25 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@30 -- # local_nvme_trid=0000:00:10.0 00:17:44.082 11:28:25 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:44.340 11:28:25 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:17:44.340 11:28:25 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@33 -- # '[' -n 0000:00:10.0 ']' 00:17:44.340 11:28:25 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:17:44.340 11:28:25 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:17:44.340 11:28:25 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@42 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:44.597 [2024-10-07 11:28:26.240512] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:44.597 11:28:26 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@44 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:44.855 11:28:26 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@45 -- # for bdev in $bdevs 00:17:44.855 11:28:26 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:45.113 11:28:26 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@45 -- # for bdev in $bdevs 00:17:45.113 11:28:26 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:17:45.371 11:28:27 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@48 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:17:45.629 [2024-10-07 11:28:27.297789] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:17:45.629 11:28:27 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@49 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:17:46.196 11:28:27 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@52 -- # '[' -n 0000:00:10.0 ']' 00:17:46.196 11:28:27 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:00:10.0' 00:17:46.196 11:28:27 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:17:46.196 11:28:27 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@24 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:00:10.0' 00:17:47.130 Initializing NVMe Controllers 00:17:47.130 Attached to NVMe Controller at 0000:00:10.0 [1b36:0010] 00:17:47.130 Associating PCIE (0000:00:10.0) NSID 1 with lcore 0 00:17:47.130 Initialization complete. Launching workers. 00:17:47.130 ======================================================== 00:17:47.130 Latency(us) 00:17:47.130 Device Information : IOPS MiB/s Average min max 00:17:47.130 PCIE (0000:00:10.0) NSID 1 from core 0: 24544.00 95.88 1303.47 324.55 9058.14 00:17:47.130 ======================================================== 00:17:47.130 Total : 24544.00 95.88 1303.47 324.55 9058.14 00:17:47.130 00:17:47.130 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@56 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:17:48.501 Initializing NVMe Controllers 00:17:48.501 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:17:48.501 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:48.501 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:17:48.501 Initialization complete. Launching workers. 00:17:48.501 ======================================================== 00:17:48.501 Latency(us) 00:17:48.501 Device Information : IOPS MiB/s Average min max 00:17:48.501 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3290.06 12.85 302.30 112.62 5149.01 00:17:48.501 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 124.62 0.49 8087.34 5010.97 12018.31 00:17:48.502 ======================================================== 00:17:48.502 Total : 3414.68 13.34 586.43 112.62 12018.31 00:17:48.502 00:17:48.502 11:28:30 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@57 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:17:49.874 Initializing NVMe Controllers 00:17:49.874 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:17:49.874 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:49.874 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:17:49.874 Initialization complete. Launching workers. 00:17:49.874 ======================================================== 00:17:49.874 Latency(us) 00:17:49.874 Device Information : IOPS MiB/s Average min max 00:17:49.874 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8399.75 32.81 3809.83 594.65 8063.19 00:17:49.874 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 4001.16 15.63 7996.95 6012.56 14640.18 00:17:49.874 ======================================================== 00:17:49.874 Total : 12400.90 48.44 5160.81 594.65 14640.18 00:17:49.874 00:17:49.875 11:28:31 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@59 -- # [[ '' == \e\8\1\0 ]] 00:17:49.875 11:28:31 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@60 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:17:52.402 Initializing NVMe Controllers 00:17:52.402 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:17:52.402 Controller IO queue size 128, less than required. 00:17:52.402 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:52.402 Controller IO queue size 128, less than required. 00:17:52.402 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:52.402 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:52.402 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:17:52.402 Initialization complete. Launching workers. 00:17:52.402 ======================================================== 00:17:52.402 Latency(us) 00:17:52.402 Device Information : IOPS MiB/s Average min max 00:17:52.402 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1493.66 373.42 87004.43 37934.41 196654.25 00:17:52.402 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 641.78 160.45 208171.92 65290.87 341668.21 00:17:52.402 ======================================================== 00:17:52.402 Total : 2135.44 533.86 123419.81 37934.41 341668.21 00:17:52.402 00:17:52.402 11:28:34 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@64 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' -c 0xf -P 4 00:17:52.661 Initializing NVMe Controllers 00:17:52.661 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:17:52.661 Controller IO queue size 128, less than required. 00:17:52.661 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:52.661 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:17:52.661 Controller IO queue size 128, less than required. 00:17:52.661 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:52.661 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 4096. Removing this ns from test 00:17:52.661 WARNING: Some requested NVMe devices were skipped 00:17:52.661 No valid NVMe controllers or AIO or URING devices found 00:17:52.661 11:28:34 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@65 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' --transport-stat 00:17:55.187 Initializing NVMe Controllers 00:17:55.187 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:17:55.187 Controller IO queue size 128, less than required. 00:17:55.187 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:55.187 Controller IO queue size 128, less than required. 00:17:55.187 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:55.187 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:55.187 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:17:55.187 Initialization complete. Launching workers. 00:17:55.187 00:17:55.187 ==================== 00:17:55.187 lcore 0, ns TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:17:55.187 TCP transport: 00:17:55.187 polls: 8912 00:17:55.187 idle_polls: 5002 00:17:55.187 sock_completions: 3910 00:17:55.187 nvme_completions: 5995 00:17:55.187 submitted_requests: 9022 00:17:55.187 queued_requests: 1 00:17:55.187 00:17:55.187 ==================== 00:17:55.187 lcore 0, ns TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:17:55.187 TCP transport: 00:17:55.187 polls: 9001 00:17:55.187 idle_polls: 5248 00:17:55.187 sock_completions: 3753 00:17:55.187 nvme_completions: 5743 00:17:55.187 submitted_requests: 8604 00:17:55.187 queued_requests: 1 00:17:55.187 ======================================================== 00:17:55.187 Latency(us) 00:17:55.187 Device Information : IOPS MiB/s Average min max 00:17:55.187 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1498.23 374.56 86942.65 43867.85 153037.02 00:17:55.187 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1435.24 358.81 90207.28 30006.45 156335.17 00:17:55.187 ======================================================== 00:17:55.187 Total : 2933.46 733.37 88539.91 30006.45 156335.17 00:17:55.187 00:17:55.187 11:28:36 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@66 -- # sync 00:17:55.187 11:28:36 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@67 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@69 -- # '[' 0 -eq 1 ']' 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@114 -- # nvmftestfini 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@514 -- # nvmfcleanup 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@121 -- # sync 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@124 -- # set +e 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@125 -- # for i in {1..20} 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:17:55.752 rmmod nvme_tcp 00:17:55.752 rmmod nvme_fabrics 00:17:55.752 rmmod nvme_keyring 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@128 -- # set -e 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@129 -- # return 0 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@515 -- # '[' -n 74458 ']' 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@516 -- # killprocess 74458 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@950 -- # '[' -z 74458 ']' 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@954 -- # kill -0 74458 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@955 -- # uname 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 74458 00:17:55.752 killing process with pid 74458 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@968 -- # echo 'killing process with pid 74458' 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@969 -- # kill 74458 00:17:55.752 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@974 -- # wait 74458 00:17:56.317 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:17:56.317 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:17:56.317 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:17:56.317 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@297 -- # iptr 00:17:56.317 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@789 -- # iptables-save 00:17:56.317 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:17:56.317 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@789 -- # iptables-restore 00:17:56.317 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:17:56.317 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:17:56.317 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:17:56.317 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:17:56.317 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:17:56.317 11:28:37 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:17:56.317 11:28:38 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:17:56.317 11:28:38 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:17:56.317 11:28:38 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:17:56.317 11:28:38 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:17:56.317 11:28:38 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:17:56.575 11:28:38 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:17:56.575 11:28:38 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:17:56.575 11:28:38 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:56.575 11:28:38 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:56.575 11:28:38 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@246 -- # remove_spdk_ns 00:17:56.575 11:28:38 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:56.575 11:28:38 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:56.575 11:28:38 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:56.575 11:28:38 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@300 -- # return 0 00:17:56.575 00:17:56.575 real 0m14.325s 00:17:56.575 user 0m51.656s 00:17:56.575 sys 0m4.234s 00:17:56.575 ************************************ 00:17:56.575 END TEST nvmf_perf 00:17:56.575 ************************************ 00:17:56.575 11:28:38 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:17:56.575 11:28:38 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@10 -- # set +x 00:17:56.575 11:28:38 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@24 -- # run_test nvmf_fio_host /home/vagrant/spdk_repo/spdk/test/nvmf/host/fio.sh --transport=tcp 00:17:56.575 11:28:38 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:17:56.575 11:28:38 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:17:56.575 11:28:38 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:17:56.575 ************************************ 00:17:56.575 START TEST nvmf_fio_host 00:17:56.575 ************************************ 00:17:56.575 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/fio.sh --transport=tcp 00:17:56.575 * Looking for test storage... 00:17:56.575 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:17:56.575 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1681 -- # lcov --version 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@333 -- # local ver1 ver1_l 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@334 -- # local ver2 ver2_l 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@336 -- # IFS=.-: 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@336 -- # read -ra ver1 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@337 -- # IFS=.-: 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@337 -- # read -ra ver2 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@338 -- # local 'op=<' 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@340 -- # ver1_l=2 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@341 -- # ver2_l=1 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@344 -- # case "$op" in 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@345 -- # : 1 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@364 -- # (( v = 0 )) 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@365 -- # decimal 1 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@353 -- # local d=1 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@355 -- # echo 1 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@365 -- # ver1[v]=1 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@366 -- # decimal 2 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@353 -- # local d=2 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@355 -- # echo 2 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@366 -- # ver2[v]=2 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@368 -- # return 0 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:17:56.833 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:56.833 --rc genhtml_branch_coverage=1 00:17:56.833 --rc genhtml_function_coverage=1 00:17:56.833 --rc genhtml_legend=1 00:17:56.833 --rc geninfo_all_blocks=1 00:17:56.833 --rc geninfo_unexecuted_blocks=1 00:17:56.833 00:17:56.833 ' 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:17:56.833 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:56.833 --rc genhtml_branch_coverage=1 00:17:56.833 --rc genhtml_function_coverage=1 00:17:56.833 --rc genhtml_legend=1 00:17:56.833 --rc geninfo_all_blocks=1 00:17:56.833 --rc geninfo_unexecuted_blocks=1 00:17:56.833 00:17:56.833 ' 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:17:56.833 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:56.833 --rc genhtml_branch_coverage=1 00:17:56.833 --rc genhtml_function_coverage=1 00:17:56.833 --rc genhtml_legend=1 00:17:56.833 --rc geninfo_all_blocks=1 00:17:56.833 --rc geninfo_unexecuted_blocks=1 00:17:56.833 00:17:56.833 ' 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:17:56.833 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:56.833 --rc genhtml_branch_coverage=1 00:17:56.833 --rc genhtml_function_coverage=1 00:17:56.833 --rc genhtml_legend=1 00:17:56.833 --rc geninfo_all_blocks=1 00:17:56.833 --rc geninfo_unexecuted_blocks=1 00:17:56.833 00:17:56.833 ' 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@9 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:17:56.833 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@15 -- # shopt -s extglob 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@5 -- # export PATH 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@7 -- # uname -s 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@15 -- # shopt -s extglob 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@5 -- # export PATH 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@51 -- # : 0 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:17:56.834 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@55 -- # have_pci_nics=0 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@12 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@14 -- # nvmftestinit 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@474 -- # prepare_net_devs 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@436 -- # local -g is_hw=no 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@438 -- # remove_spdk_ns 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@458 -- # nvmf_veth_init 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:17:56.834 Cannot find device "nvmf_init_br" 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@162 -- # true 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:17:56.834 Cannot find device "nvmf_init_br2" 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@163 -- # true 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:17:56.834 Cannot find device "nvmf_tgt_br" 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@164 -- # true 00:17:56.834 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:17:56.834 Cannot find device "nvmf_tgt_br2" 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@165 -- # true 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:17:56.835 Cannot find device "nvmf_init_br" 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@166 -- # true 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:17:56.835 Cannot find device "nvmf_init_br2" 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@167 -- # true 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:17:56.835 Cannot find device "nvmf_tgt_br" 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@168 -- # true 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:17:56.835 Cannot find device "nvmf_tgt_br2" 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@169 -- # true 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:17:56.835 Cannot find device "nvmf_br" 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@170 -- # true 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:17:56.835 Cannot find device "nvmf_init_if" 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@171 -- # true 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:17:56.835 Cannot find device "nvmf_init_if2" 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@172 -- # true 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:56.835 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@173 -- # true 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:56.835 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@174 -- # true 00:17:56.835 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:17:57.093 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:17:57.093 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.345 ms 00:17:57.093 00:17:57.093 --- 10.0.0.3 ping statistics --- 00:17:57.093 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:57.093 rtt min/avg/max/mdev = 0.345/0.345/0.345/0.000 ms 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:17:57.093 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:17:57.093 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.060 ms 00:17:57.093 00:17:57.093 --- 10.0.0.4 ping statistics --- 00:17:57.093 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:57.093 rtt min/avg/max/mdev = 0.060/0.060/0.060/0.000 ms 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:17:57.093 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:57.093 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.027 ms 00:17:57.093 00:17:57.093 --- 10.0.0.1 ping statistics --- 00:17:57.093 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:57.093 rtt min/avg/max/mdev = 0.027/0.027/0.027/0.000 ms 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:17:57.093 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:57.093 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.073 ms 00:17:57.093 00:17:57.093 --- 10.0.0.2 ping statistics --- 00:17:57.093 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:57.093 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@459 -- # return 0 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:17:57.093 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:17:57.351 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@16 -- # [[ y != y ]] 00:17:57.351 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:17:57.351 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@724 -- # xtrace_disable 00:17:57.351 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@10 -- # set +x 00:17:57.351 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@24 -- # nvmfpid=74916 00:17:57.351 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@23 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:17:57.351 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:57.351 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@28 -- # waitforlisten 74916 00:17:57.351 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@831 -- # '[' -z 74916 ']' 00:17:57.351 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:57.351 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:57.351 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:57.351 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:57.351 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:57.351 11:28:38 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@10 -- # set +x 00:17:57.351 [2024-10-07 11:28:38.871236] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:57.351 [2024-10-07 11:28:38.871332] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:57.351 [2024-10-07 11:28:39.014097] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:57.608 [2024-10-07 11:28:39.073187] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:57.608 [2024-10-07 11:28:39.073418] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:57.608 [2024-10-07 11:28:39.073439] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:57.608 [2024-10-07 11:28:39.073449] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:57.608 [2024-10-07 11:28:39.073456] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:57.608 [2024-10-07 11:28:39.074244] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:17:57.608 [2024-10-07 11:28:39.074345] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:17:57.608 [2024-10-07 11:28:39.074864] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:17:57.608 [2024-10-07 11:28:39.074914] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:17:57.608 [2024-10-07 11:28:39.105555] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:17:57.608 11:28:39 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:57.608 11:28:39 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@864 -- # return 0 00:17:57.608 11:28:39 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@29 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:57.866 [2024-10-07 11:28:39.471466] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:57.866 11:28:39 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:17:57.866 11:28:39 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@730 -- # xtrace_disable 00:17:57.866 11:28:39 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@10 -- # set +x 00:17:57.866 11:28:39 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@32 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:17:58.124 Malloc1 00:17:58.124 11:28:39 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:58.382 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@34 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:17:58.950 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:17:58.950 [2024-10-07 11:28:40.611282] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:17:58.950 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@36 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:17:59.209 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@38 -- # PLUGIN_DIR=/home/vagrant/spdk_repo/spdk/app/fio/nvme 00:17:59.209 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@41 -- # fio_nvme /home/vagrant/spdk_repo/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 ns=1' --bs=4096 00:17:59.209 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1360 -- # fio_plugin /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme /home/vagrant/spdk_repo/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 ns=1' --bs=4096 00:17:59.209 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1337 -- # local fio_dir=/usr/src/fio 00:17:59.209 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1339 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:17:59.209 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1339 -- # local sanitizers 00:17:59.209 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1340 -- # local plugin=/home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme 00:17:59.209 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1341 -- # shift 00:17:59.209 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1343 -- # local asan_lib= 00:17:59.209 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1344 -- # for sanitizer in "${sanitizers[@]}" 00:17:59.209 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # ldd /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme 00:17:59.209 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # grep libasan 00:17:59.209 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # awk '{print $3}' 00:17:59.467 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # asan_lib= 00:17:59.468 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1346 -- # [[ -n '' ]] 00:17:59.468 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1344 -- # for sanitizer in "${sanitizers[@]}" 00:17:59.468 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # ldd /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme 00:17:59.468 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # awk '{print $3}' 00:17:59.468 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # grep libclang_rt.asan 00:17:59.468 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # asan_lib= 00:17:59.468 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1346 -- # [[ -n '' ]] 00:17:59.468 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1352 -- # LD_PRELOAD=' /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme' 00:17:59.468 11:28:40 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1352 -- # /usr/src/fio/fio /home/vagrant/spdk_repo/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 ns=1' --bs=4096 00:17:59.468 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:17:59.468 fio-3.35 00:17:59.468 Starting 1 thread 00:18:02.015 00:18:02.015 test: (groupid=0, jobs=1): err= 0: pid=74986: Mon Oct 7 11:28:43 2024 00:18:02.015 read: IOPS=8513, BW=33.3MiB/s (34.9MB/s)(66.7MiB/2007msec) 00:18:02.015 slat (usec): min=2, max=221, avg= 3.00, stdev= 2.31 00:18:02.015 clat (usec): min=1692, max=13665, avg=7809.17, stdev=572.58 00:18:02.015 lat (usec): min=1730, max=13667, avg=7812.17, stdev=572.33 00:18:02.015 clat percentiles (usec): 00:18:02.015 | 1.00th=[ 6718], 5.00th=[ 7046], 10.00th=[ 7242], 20.00th=[ 7373], 00:18:02.015 | 30.00th=[ 7570], 40.00th=[ 7701], 50.00th=[ 7767], 60.00th=[ 7898], 00:18:02.015 | 70.00th=[ 8029], 80.00th=[ 8225], 90.00th=[ 8455], 95.00th=[ 8586], 00:18:02.015 | 99.00th=[ 9241], 99.50th=[ 9765], 99.90th=[12649], 99.95th=[13042], 00:18:02.015 | 99.99th=[13566] 00:18:02.015 bw ( KiB/s): min=32960, max=34768, per=99.93%, avg=34030.00, stdev=772.11, samples=4 00:18:02.015 iops : min= 8240, max= 8692, avg=8507.50, stdev=193.03, samples=4 00:18:02.015 write: IOPS=8510, BW=33.2MiB/s (34.9MB/s)(66.7MiB/2007msec); 0 zone resets 00:18:02.015 slat (usec): min=2, max=176, avg= 3.14, stdev= 1.83 00:18:02.015 clat (usec): min=1558, max=13235, avg=7160.04, stdev=517.30 00:18:02.015 lat (usec): min=1567, max=13238, avg=7163.19, stdev=517.26 00:18:02.015 clat percentiles (usec): 00:18:02.015 | 1.00th=[ 6128], 5.00th=[ 6456], 10.00th=[ 6652], 20.00th=[ 6783], 00:18:02.015 | 30.00th=[ 6915], 40.00th=[ 7046], 50.00th=[ 7111], 60.00th=[ 7242], 00:18:02.015 | 70.00th=[ 7373], 80.00th=[ 7504], 90.00th=[ 7701], 95.00th=[ 7898], 00:18:02.015 | 99.00th=[ 8356], 99.50th=[ 8848], 99.90th=[10159], 99.95th=[12649], 00:18:02.015 | 99.99th=[13042] 00:18:02.015 bw ( KiB/s): min=33792, max=34496, per=100.00%, avg=34050.00, stdev=316.27, samples=4 00:18:02.015 iops : min= 8448, max= 8624, avg=8512.50, stdev=79.07, samples=4 00:18:02.015 lat (msec) : 2=0.04%, 4=0.13%, 10=99.58%, 20=0.26% 00:18:02.015 cpu : usr=69.04%, sys=23.53%, ctx=6, majf=0, minf=6 00:18:02.015 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:18:02.015 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:02.015 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:02.015 issued rwts: total=17086,17081,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:02.015 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:02.015 00:18:02.015 Run status group 0 (all jobs): 00:18:02.015 READ: bw=33.3MiB/s (34.9MB/s), 33.3MiB/s-33.3MiB/s (34.9MB/s-34.9MB/s), io=66.7MiB (70.0MB), run=2007-2007msec 00:18:02.015 WRITE: bw=33.2MiB/s (34.9MB/s), 33.2MiB/s-33.2MiB/s (34.9MB/s-34.9MB/s), io=66.7MiB (70.0MB), run=2007-2007msec 00:18:02.015 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@45 -- # fio_nvme /home/vagrant/spdk_repo/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 ns=1' 00:18:02.015 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1360 -- # fio_plugin /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme /home/vagrant/spdk_repo/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 ns=1' 00:18:02.015 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1337 -- # local fio_dir=/usr/src/fio 00:18:02.015 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1339 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:18:02.015 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1339 -- # local sanitizers 00:18:02.015 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1340 -- # local plugin=/home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme 00:18:02.015 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1341 -- # shift 00:18:02.015 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1343 -- # local asan_lib= 00:18:02.015 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1344 -- # for sanitizer in "${sanitizers[@]}" 00:18:02.016 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # ldd /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme 00:18:02.016 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # grep libasan 00:18:02.016 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # awk '{print $3}' 00:18:02.016 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # asan_lib= 00:18:02.016 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1346 -- # [[ -n '' ]] 00:18:02.016 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1344 -- # for sanitizer in "${sanitizers[@]}" 00:18:02.016 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # ldd /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme 00:18:02.016 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # grep libclang_rt.asan 00:18:02.016 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # awk '{print $3}' 00:18:02.016 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # asan_lib= 00:18:02.016 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1346 -- # [[ -n '' ]] 00:18:02.016 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1352 -- # LD_PRELOAD=' /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme' 00:18:02.016 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1352 -- # /usr/src/fio/fio /home/vagrant/spdk_repo/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 ns=1' 00:18:02.016 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:18:02.016 fio-3.35 00:18:02.016 Starting 1 thread 00:18:04.549 00:18:04.549 test: (groupid=0, jobs=1): err= 0: pid=75030: Mon Oct 7 11:28:45 2024 00:18:04.549 read: IOPS=7272, BW=114MiB/s (119MB/s)(228MiB/2006msec) 00:18:04.549 slat (usec): min=3, max=123, avg= 4.48, stdev= 2.72 00:18:04.549 clat (usec): min=2122, max=29364, avg=9758.98, stdev=3265.88 00:18:04.549 lat (usec): min=2125, max=29370, avg=9763.46, stdev=3266.57 00:18:04.549 clat percentiles (usec): 00:18:04.549 | 1.00th=[ 4424], 5.00th=[ 5342], 10.00th=[ 6063], 20.00th=[ 6980], 00:18:04.549 | 30.00th=[ 7767], 40.00th=[ 8586], 50.00th=[ 9372], 60.00th=[10159], 00:18:04.549 | 70.00th=[10814], 80.00th=[12125], 90.00th=[14091], 95.00th=[16057], 00:18:04.549 | 99.00th=[19006], 99.50th=[21365], 99.90th=[24773], 99.95th=[28181], 00:18:04.549 | 99.99th=[29230] 00:18:04.549 bw ( KiB/s): min=53184, max=64800, per=51.40%, avg=59808.00, stdev=4836.34, samples=4 00:18:04.549 iops : min= 3324, max= 4050, avg=3738.00, stdev=302.27, samples=4 00:18:04.549 write: IOPS=4229, BW=66.1MiB/s (69.3MB/s)(122MiB/1847msec); 0 zone resets 00:18:04.549 slat (usec): min=37, max=457, avg=41.02, stdev= 7.92 00:18:04.549 clat (usec): min=3563, max=27547, avg=13751.74, stdev=3296.19 00:18:04.549 lat (usec): min=3601, max=27597, avg=13792.76, stdev=3298.14 00:18:04.549 clat percentiles (usec): 00:18:04.549 | 1.00th=[ 7832], 5.00th=[ 9503], 10.00th=[10159], 20.00th=[11207], 00:18:04.549 | 30.00th=[11994], 40.00th=[12649], 50.00th=[13304], 60.00th=[13960], 00:18:04.549 | 70.00th=[14877], 80.00th=[15926], 90.00th=[17433], 95.00th=[20841], 00:18:04.549 | 99.00th=[24249], 99.50th=[25560], 99.90th=[26870], 99.95th=[27132], 00:18:04.549 | 99.99th=[27657] 00:18:04.549 bw ( KiB/s): min=55072, max=67360, per=91.58%, avg=61976.00, stdev=5108.81, samples=4 00:18:04.549 iops : min= 3442, max= 4210, avg=3873.50, stdev=319.30, samples=4 00:18:04.549 lat (msec) : 4=0.24%, 10=40.91%, 20=56.49%, 50=2.36% 00:18:04.549 cpu : usr=78.85%, sys=16.01%, ctx=23, majf=0, minf=11 00:18:04.549 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:18:04.549 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:04.549 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:04.549 issued rwts: total=14588,7812,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:04.549 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:04.549 00:18:04.549 Run status group 0 (all jobs): 00:18:04.549 READ: bw=114MiB/s (119MB/s), 114MiB/s-114MiB/s (119MB/s-119MB/s), io=228MiB (239MB), run=2006-2006msec 00:18:04.549 WRITE: bw=66.1MiB/s (69.3MB/s), 66.1MiB/s-66.1MiB/s (69.3MB/s-69.3MB/s), io=122MiB (128MB), run=1847-1847msec 00:18:04.549 11:28:45 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@47 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@49 -- # '[' 0 -eq 1 ']' 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@86 -- # nvmftestfini 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@514 -- # nvmfcleanup 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@121 -- # sync 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@124 -- # set +e 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@125 -- # for i in {1..20} 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:18:04.807 rmmod nvme_tcp 00:18:04.807 rmmod nvme_fabrics 00:18:04.807 rmmod nvme_keyring 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@128 -- # set -e 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@129 -- # return 0 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@515 -- # '[' -n 74916 ']' 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@516 -- # killprocess 74916 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@950 -- # '[' -z 74916 ']' 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@954 -- # kill -0 74916 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@955 -- # uname 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 74916 00:18:04.807 killing process with pid 74916 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@968 -- # echo 'killing process with pid 74916' 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@969 -- # kill 74916 00:18:04.807 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@974 -- # wait 74916 00:18:05.066 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:18:05.066 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:18:05.066 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:18:05.066 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@297 -- # iptr 00:18:05.066 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@789 -- # iptables-save 00:18:05.066 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:18:05.066 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@789 -- # iptables-restore 00:18:05.066 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:18:05.066 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:18:05.066 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:18:05.066 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:18:05.066 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:18:05.066 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:18:05.066 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:18:05.066 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:18:05.066 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:18:05.066 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:18:05.066 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:18:05.324 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:18:05.324 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:18:05.324 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:18:05.324 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:18:05.324 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@246 -- # remove_spdk_ns 00:18:05.324 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:05.324 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:18:05.324 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:05.324 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@300 -- # return 0 00:18:05.324 00:18:05.324 real 0m8.701s 00:18:05.324 user 0m34.644s 00:18:05.324 sys 0m2.511s 00:18:05.324 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1126 -- # xtrace_disable 00:18:05.324 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@10 -- # set +x 00:18:05.324 ************************************ 00:18:05.324 END TEST nvmf_fio_host 00:18:05.324 ************************************ 00:18:05.324 11:28:46 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@25 -- # run_test nvmf_failover /home/vagrant/spdk_repo/spdk/test/nvmf/host/failover.sh --transport=tcp 00:18:05.324 11:28:46 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:18:05.324 11:28:46 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:18:05.324 11:28:46 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:18:05.324 ************************************ 00:18:05.324 START TEST nvmf_failover 00:18:05.324 ************************************ 00:18:05.324 11:28:46 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/failover.sh --transport=tcp 00:18:05.324 * Looking for test storage... 00:18:05.324 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:18:05.324 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:18:05.324 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:18:05.324 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1681 -- # lcov --version 00:18:05.583 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:18:05.583 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:18:05.583 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@333 -- # local ver1 ver1_l 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@334 -- # local ver2 ver2_l 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@336 -- # IFS=.-: 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@336 -- # read -ra ver1 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@337 -- # IFS=.-: 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@337 -- # read -ra ver2 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@338 -- # local 'op=<' 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@340 -- # ver1_l=2 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@341 -- # ver2_l=1 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@344 -- # case "$op" in 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@345 -- # : 1 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@364 -- # (( v = 0 )) 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@365 -- # decimal 1 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@353 -- # local d=1 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@355 -- # echo 1 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@365 -- # ver1[v]=1 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@366 -- # decimal 2 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@353 -- # local d=2 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@355 -- # echo 2 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@366 -- # ver2[v]=2 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@368 -- # return 0 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:18:05.584 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:05.584 --rc genhtml_branch_coverage=1 00:18:05.584 --rc genhtml_function_coverage=1 00:18:05.584 --rc genhtml_legend=1 00:18:05.584 --rc geninfo_all_blocks=1 00:18:05.584 --rc geninfo_unexecuted_blocks=1 00:18:05.584 00:18:05.584 ' 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:18:05.584 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:05.584 --rc genhtml_branch_coverage=1 00:18:05.584 --rc genhtml_function_coverage=1 00:18:05.584 --rc genhtml_legend=1 00:18:05.584 --rc geninfo_all_blocks=1 00:18:05.584 --rc geninfo_unexecuted_blocks=1 00:18:05.584 00:18:05.584 ' 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:18:05.584 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:05.584 --rc genhtml_branch_coverage=1 00:18:05.584 --rc genhtml_function_coverage=1 00:18:05.584 --rc genhtml_legend=1 00:18:05.584 --rc geninfo_all_blocks=1 00:18:05.584 --rc geninfo_unexecuted_blocks=1 00:18:05.584 00:18:05.584 ' 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:18:05.584 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:05.584 --rc genhtml_branch_coverage=1 00:18:05.584 --rc genhtml_function_coverage=1 00:18:05.584 --rc genhtml_legend=1 00:18:05.584 --rc geninfo_all_blocks=1 00:18:05.584 --rc geninfo_unexecuted_blocks=1 00:18:05.584 00:18:05.584 ' 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@7 -- # uname -s 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801d435b-e3d4-4ca3-aead-ebb283315d5b 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@18 -- # NVME_HOSTID=801d435b-e3d4-4ca3-aead-ebb283315d5b 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@15 -- # shopt -s extglob 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@5 -- # export PATH 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@51 -- # : 0 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:18:05.584 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@55 -- # have_pci_nics=0 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@14 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@18 -- # nvmftestinit 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@474 -- # prepare_net_devs 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@436 -- # local -g is_hw=no 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@438 -- # remove_spdk_ns 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:18:05.584 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@458 -- # nvmf_veth_init 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:18:05.585 Cannot find device "nvmf_init_br" 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@162 -- # true 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:18:05.585 Cannot find device "nvmf_init_br2" 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@163 -- # true 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:18:05.585 Cannot find device "nvmf_tgt_br" 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@164 -- # true 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:18:05.585 Cannot find device "nvmf_tgt_br2" 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@165 -- # true 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:18:05.585 Cannot find device "nvmf_init_br" 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@166 -- # true 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:18:05.585 Cannot find device "nvmf_init_br2" 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@167 -- # true 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:18:05.585 Cannot find device "nvmf_tgt_br" 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@168 -- # true 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:18:05.585 Cannot find device "nvmf_tgt_br2" 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@169 -- # true 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:18:05.585 Cannot find device "nvmf_br" 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@170 -- # true 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:18:05.585 Cannot find device "nvmf_init_if" 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@171 -- # true 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:18:05.585 Cannot find device "nvmf_init_if2" 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@172 -- # true 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:18:05.585 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@173 -- # true 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:18:05.585 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@174 -- # true 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:18:05.585 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:18:05.843 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:18:05.843 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:18:05.843 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:18:05.843 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:18:05.843 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:18:05.843 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:18:05.843 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:18:05.843 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:18:05.843 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:18:05.844 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:18:05.844 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.112 ms 00:18:05.844 00:18:05.844 --- 10.0.0.3 ping statistics --- 00:18:05.844 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:05.844 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:18:05.844 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:18:05.844 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.089 ms 00:18:05.844 00:18:05.844 --- 10.0.0.4 ping statistics --- 00:18:05.844 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:05.844 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:18:05.844 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:05.844 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.030 ms 00:18:05.844 00:18:05.844 --- 10.0.0.1 ping statistics --- 00:18:05.844 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:05.844 rtt min/avg/max/mdev = 0.030/0.030/0.030/0.000 ms 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:18:05.844 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:05.844 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.051 ms 00:18:05.844 00:18:05.844 --- 10.0.0.2 ping statistics --- 00:18:05.844 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:05.844 rtt min/avg/max/mdev = 0.051/0.051/0.051/0.000 ms 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@459 -- # return 0 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@724 -- # xtrace_disable 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@507 -- # nvmfpid=75301 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@508 -- # waitforlisten 75301 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@831 -- # '[' -z 75301 ']' 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@836 -- # local max_retries=100 00:18:05.844 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@840 -- # xtrace_disable 00:18:05.844 11:28:47 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:18:06.103 [2024-10-07 11:28:47.598122] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:18:06.103 [2024-10-07 11:28:47.598257] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:06.103 [2024-10-07 11:28:47.740032] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:18:06.361 [2024-10-07 11:28:47.823600] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:06.361 [2024-10-07 11:28:47.823674] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:06.361 [2024-10-07 11:28:47.823691] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:06.361 [2024-10-07 11:28:47.823705] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:06.361 [2024-10-07 11:28:47.823716] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:06.361 [2024-10-07 11:28:47.824864] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:18:06.361 [2024-10-07 11:28:47.824959] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:18:06.361 [2024-10-07 11:28:47.824969] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:18:06.361 [2024-10-07 11:28:47.864193] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:18:07.296 11:28:48 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:18:07.296 11:28:48 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@864 -- # return 0 00:18:07.296 11:28:48 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:18:07.296 11:28:48 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@730 -- # xtrace_disable 00:18:07.296 11:28:48 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:18:07.296 11:28:48 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:07.296 11:28:48 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@22 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:18:07.631 [2024-10-07 11:28:49.258265] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:07.631 11:28:49 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@23 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:18:07.930 Malloc0 00:18:07.930 11:28:49 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@24 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:08.187 11:28:49 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@25 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:08.752 11:28:50 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@26 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:18:08.753 [2024-10-07 11:28:50.413533] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:18:08.753 11:28:50 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@27 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4421 00:18:09.010 [2024-10-07 11:28:50.685638] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4421 *** 00:18:09.010 11:28:50 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4422 00:18:09.268 [2024-10-07 11:28:50.965821] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4422 *** 00:18:09.526 11:28:50 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@30 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:18:09.526 11:28:50 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@31 -- # bdevperf_pid=75360 00:18:09.526 11:28:50 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:09.526 11:28:50 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@34 -- # waitforlisten 75360 /var/tmp/bdevperf.sock 00:18:09.526 11:28:50 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@831 -- # '[' -z 75360 ']' 00:18:09.526 11:28:50 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:09.526 11:28:50 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@836 -- # local max_retries=100 00:18:09.526 11:28:50 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:09.526 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:09.526 11:28:50 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@840 -- # xtrace_disable 00:18:09.526 11:28:50 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:18:09.784 11:28:51 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:18:09.784 11:28:51 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@864 -- # return 0 00:18:09.785 11:28:51 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -x failover 00:18:10.045 NVMe0n1 00:18:10.045 11:28:51 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@36 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -x failover 00:18:10.303 NVMe0n1 00:18:10.303 11:28:51 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@39 -- # run_test_pid=75376 00:18:10.303 11:28:51 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@38 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:10.303 11:28:51 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@41 -- # sleep 1 00:18:11.678 11:28:52 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@43 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:18:11.678 [2024-10-07 11:28:53.268916] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d50bb0 is same with the state(6) to be set 00:18:11.678 [2024-10-07 11:28:53.268985] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d50bb0 is same with the state(6) to be set 00:18:11.678 [2024-10-07 11:28:53.269005] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d50bb0 is same with the state(6) to be set 00:18:11.678 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@45 -- # sleep 3 00:18:14.957 11:28:56 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@47 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -x failover 00:18:15.215 NVMe0n1 00:18:15.215 11:28:56 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@48 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4421 00:18:15.782 11:28:57 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@50 -- # sleep 3 00:18:19.064 11:29:00 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:18:19.064 [2024-10-07 11:29:00.706436] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:18:19.064 11:29:00 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@55 -- # sleep 1 00:18:20.434 11:29:01 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4422 00:18:20.691 11:29:02 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@59 -- # wait 75376 00:18:25.990 { 00:18:25.990 "results": [ 00:18:25.990 { 00:18:25.990 "job": "NVMe0n1", 00:18:25.990 "core_mask": "0x1", 00:18:25.990 "workload": "verify", 00:18:25.990 "status": "finished", 00:18:25.990 "verify_range": { 00:18:25.990 "start": 0, 00:18:25.990 "length": 16384 00:18:25.990 }, 00:18:25.990 "queue_depth": 128, 00:18:25.990 "io_size": 4096, 00:18:25.990 "runtime": 15.010449, 00:18:25.990 "iops": 8319.671183720087, 00:18:25.990 "mibps": 32.49871556140659, 00:18:25.990 "io_failed": 0, 00:18:25.990 "io_timeout": 0, 00:18:25.990 "avg_latency_us": 15348.996663788797, 00:18:25.990 "min_latency_us": 1683.0836363636363, 00:18:25.990 "max_latency_us": 18588.392727272727 00:18:25.990 } 00:18:25.990 ], 00:18:25.990 "core_count": 1 00:18:25.990 } 00:18:25.990 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@61 -- # killprocess 75360 00:18:25.990 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@950 -- # '[' -z 75360 ']' 00:18:25.990 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@954 -- # kill -0 75360 00:18:25.990 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@955 -- # uname 00:18:25.990 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:18:25.990 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 75360 00:18:25.990 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:18:25.990 killing process with pid 75360 00:18:25.990 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:18:25.990 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@968 -- # echo 'killing process with pid 75360' 00:18:25.990 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@969 -- # kill 75360 00:18:25.990 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@974 -- # wait 75360 00:18:25.990 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@63 -- # cat /home/vagrant/spdk_repo/spdk/test/nvmf/host/try.txt 00:18:25.990 [2024-10-07 11:28:51.030974] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:18:25.990 [2024-10-07 11:28:51.031080] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid75360 ] 00:18:25.990 [2024-10-07 11:28:51.165165] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:25.990 [2024-10-07 11:28:51.224317] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:18:25.990 [2024-10-07 11:28:51.253318] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:18:25.990 Running I/O for 15 seconds... 00:18:25.990 7964.00 IOPS, 31.11 MiB/s [2024-10-07T11:29:07.701Z] [2024-10-07 11:28:53.269475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:75856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.990 [2024-10-07 11:28:53.269544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.990 [2024-10-07 11:28:53.269575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:75864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.990 [2024-10-07 11:28:53.269592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.990 [2024-10-07 11:28:53.269608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:75872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.990 [2024-10-07 11:28:53.269623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.990 [2024-10-07 11:28:53.269639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:75880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.990 [2024-10-07 11:28:53.269653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.990 [2024-10-07 11:28:53.269669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:76400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.990 [2024-10-07 11:28:53.269683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.990 [2024-10-07 11:28:53.269699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:76408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.990 [2024-10-07 11:28:53.269713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.990 [2024-10-07 11:28:53.269729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:76416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.990 [2024-10-07 11:28:53.269743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.990 [2024-10-07 11:28:53.269759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:76424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.990 [2024-10-07 11:28:53.269773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.990 [2024-10-07 11:28:53.269788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:76432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.990 [2024-10-07 11:28:53.269802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.990 [2024-10-07 11:28:53.269819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:76440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.990 [2024-10-07 11:28:53.269832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.990 [2024-10-07 11:28:53.269848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:76448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.990 [2024-10-07 11:28:53.269893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.990 [2024-10-07 11:28:53.269911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:76456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.990 [2024-10-07 11:28:53.269925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.990 [2024-10-07 11:28:53.269941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:75888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.990 [2024-10-07 11:28:53.269955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.990 [2024-10-07 11:28:53.269971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:75896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.990 [2024-10-07 11:28:53.269984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.990 [2024-10-07 11:28:53.270000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:75904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.990 [2024-10-07 11:28:53.270014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.990 [2024-10-07 11:28:53.270030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:75912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.990 [2024-10-07 11:28:53.270044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.990 [2024-10-07 11:28:53.270060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:75920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.990 [2024-10-07 11:28:53.270084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.990 [2024-10-07 11:28:53.270104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:75928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.990 [2024-10-07 11:28:53.270119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.990 [2024-10-07 11:28:53.270134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:75936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.990 [2024-10-07 11:28:53.270148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.990 [2024-10-07 11:28:53.270164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:75944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.990 [2024-10-07 11:28:53.270178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:75952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.270207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:75960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.270237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:75968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.270267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:75976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.270306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:75984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.270335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:75992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.270364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:76000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.270394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:76008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.270441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:76464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.991 [2024-10-07 11:28:53.270471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:76472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.991 [2024-10-07 11:28:53.270500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:76480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.991 [2024-10-07 11:28:53.270530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:76488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.991 [2024-10-07 11:28:53.270560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:76496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.991 [2024-10-07 11:28:53.270590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:76504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.991 [2024-10-07 11:28:53.270647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:76512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.991 [2024-10-07 11:28:53.270682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:76520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.991 [2024-10-07 11:28:53.270721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:76016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.270752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:76024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.270782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:76032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.270811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:76040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.270840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:76048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.270870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:76056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.270899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:76064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.270928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:76072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.270957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.270973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:76080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.270987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.271002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:76088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.271016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.271033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:76096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.271047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.271062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:76104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.271076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.271092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:76112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.271112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.271129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:76120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.271143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.271158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:76128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.271172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.271187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:76136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.271201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.271216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:76528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.991 [2024-10-07 11:28:53.271230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.271246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:76536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.991 [2024-10-07 11:28:53.271259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.271275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:76544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.991 [2024-10-07 11:28:53.271289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.271305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:76552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.991 [2024-10-07 11:28:53.271318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.271334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:76560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.991 [2024-10-07 11:28:53.271347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.271362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:76568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.991 [2024-10-07 11:28:53.271376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.271392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:76576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.991 [2024-10-07 11:28:53.271418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.271435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:76584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.991 [2024-10-07 11:28:53.271449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.271465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:76144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.991 [2024-10-07 11:28:53.271479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.991 [2024-10-07 11:28:53.271502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:76152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.271516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.271532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:76160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.271547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.271563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:76168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.271577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.271593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:76176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.271606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.271622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:76184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.271636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.271651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:76192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.271665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.271681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:76200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.271694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.271710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:76208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.271724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.271740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:76216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.271754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.271769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:76224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.271783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.271799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:76232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.271813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.271831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:76240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.271845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.271860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:76248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.271880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.271896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:76256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.271910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.271926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:76264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.271940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.271956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:76272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.271970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.271986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:76280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.272000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:76288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.272030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:76296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.272059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:76304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.272088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:76312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.272119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:76320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.272148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:76328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.272178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:76592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.992 [2024-10-07 11:28:53.272207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:76600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.992 [2024-10-07 11:28:53.272236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:76608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.992 [2024-10-07 11:28:53.272273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:76616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.992 [2024-10-07 11:28:53.272303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:76624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.992 [2024-10-07 11:28:53.272332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:76632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.992 [2024-10-07 11:28:53.272369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:76640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.992 [2024-10-07 11:28:53.272397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:76648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.992 [2024-10-07 11:28:53.272444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:76656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.992 [2024-10-07 11:28:53.272473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:76664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.992 [2024-10-07 11:28:53.272503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:76672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.992 [2024-10-07 11:28:53.272535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:76680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.992 [2024-10-07 11:28:53.272564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:76688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.992 [2024-10-07 11:28:53.272593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:76696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.992 [2024-10-07 11:28:53.272622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:76704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.992 [2024-10-07 11:28:53.272651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:76712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:25.992 [2024-10-07 11:28:53.272689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:76336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.272718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:76344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.272747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:76352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.992 [2024-10-07 11:28:53.272776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.992 [2024-10-07 11:28:53.272792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:76360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.993 [2024-10-07 11:28:53.272805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.272822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:76368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.993 [2024-10-07 11:28:53.272836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.272852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:76376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.993 [2024-10-07 11:28:53.272866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.272881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:76384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:25.993 [2024-10-07 11:28:53.272895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.272909] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x148c6e0 is same with the state(6) to be set 00:18:25.993 [2024-10-07 11:28:53.272927] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.272938] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.272949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:76392 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.272962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.272977] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.272989] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76720 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.273027] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.273036] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76728 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.273095] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.273105] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76736 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.273142] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.273152] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76744 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.273189] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.273199] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76752 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.273236] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.273246] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76760 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.273284] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.273294] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76768 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.273331] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.273341] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76776 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.273378] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.273389] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76784 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.273449] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.273459] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76792 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.273497] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.273506] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76800 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.273543] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.273553] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76808 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.273590] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.273599] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76816 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.273636] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.273646] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76824 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.273689] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.273699] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76832 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.273736] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.273746] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76840 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.273782] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.273794] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76848 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.273838] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.273848] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76856 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.273885] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.273895] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76864 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.273932] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:25.993 [2024-10-07 11:28:53.273942] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:25.993 [2024-10-07 11:28:53.273952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76872 len:8 PRP1 0x0 PRP2 0x0 00:18:25.993 [2024-10-07 11:28:53.273965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:25.993 [2024-10-07 11:28:53.274022] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x148c6e0 was disconnected and freed. reset controller. 00:18:25.993 [2024-10-07 11:28:53.275178] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.993 [2024-10-07 11:28:53.275310] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.993 [2024-10-07 11:28:53.275839] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.993 [2024-10-07 11:28:53.275877] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.994 [2024-10-07 11:28:53.275895] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.994 [2024-10-07 11:28:53.275929] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.994 [2024-10-07 11:28:53.275964] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.994 [2024-10-07 11:28:53.275981] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.994 [2024-10-07 11:28:53.275996] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.994 [2024-10-07 11:28:53.276028] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.994 [2024-10-07 11:28:53.286379] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.994 [2024-10-07 11:28:53.286723] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.994 [2024-10-07 11:28:53.286757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.994 [2024-10-07 11:28:53.286775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.994 [2024-10-07 11:28:53.286871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.994 [2024-10-07 11:28:53.286931] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.994 [2024-10-07 11:28:53.286971] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.994 [2024-10-07 11:28:53.286987] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.994 [2024-10-07 11:28:53.287036] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.994 [2024-10-07 11:28:53.297307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.994 [2024-10-07 11:28:53.297464] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.994 [2024-10-07 11:28:53.297510] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.994 [2024-10-07 11:28:53.297531] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.994 [2024-10-07 11:28:53.297564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.994 [2024-10-07 11:28:53.297596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.994 [2024-10-07 11:28:53.297612] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.994 [2024-10-07 11:28:53.297627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.994 [2024-10-07 11:28:53.297656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.994 [2024-10-07 11:28:53.307431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.994 [2024-10-07 11:28:53.308624] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.994 [2024-10-07 11:28:53.308669] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.994 [2024-10-07 11:28:53.308689] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.994 [2024-10-07 11:28:53.308908] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.994 [2024-10-07 11:28:53.309951] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.994 [2024-10-07 11:28:53.309988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.994 [2024-10-07 11:28:53.310007] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.994 [2024-10-07 11:28:53.310239] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.994 [2024-10-07 11:28:53.317535] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.994 [2024-10-07 11:28:53.317658] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.994 [2024-10-07 11:28:53.317689] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.994 [2024-10-07 11:28:53.317706] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.994 [2024-10-07 11:28:53.317737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.994 [2024-10-07 11:28:53.317767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.994 [2024-10-07 11:28:53.317784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.994 [2024-10-07 11:28:53.317798] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.994 [2024-10-07 11:28:53.317827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.994 [2024-10-07 11:28:53.328708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.994 [2024-10-07 11:28:53.328873] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.994 [2024-10-07 11:28:53.328906] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.994 [2024-10-07 11:28:53.328923] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.994 [2024-10-07 11:28:53.328954] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.994 [2024-10-07 11:28:53.328984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.994 [2024-10-07 11:28:53.329000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.994 [2024-10-07 11:28:53.329014] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.994 [2024-10-07 11:28:53.329044] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.994 [2024-10-07 11:28:53.338835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.994 [2024-10-07 11:28:53.338952] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.994 [2024-10-07 11:28:53.338982] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.994 [2024-10-07 11:28:53.338999] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.994 [2024-10-07 11:28:53.340005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.994 [2024-10-07 11:28:53.340223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.994 [2024-10-07 11:28:53.340258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.994 [2024-10-07 11:28:53.340276] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.994 [2024-10-07 11:28:53.340386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.994 [2024-10-07 11:28:53.349692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.994 [2024-10-07 11:28:53.349809] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.994 [2024-10-07 11:28:53.349841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.994 [2024-10-07 11:28:53.349859] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.994 [2024-10-07 11:28:53.349889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.994 [2024-10-07 11:28:53.350974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.994 [2024-10-07 11:28:53.351011] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.994 [2024-10-07 11:28:53.351029] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.994 [2024-10-07 11:28:53.351241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.994 [2024-10-07 11:28:53.359785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.994 [2024-10-07 11:28:53.359899] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.994 [2024-10-07 11:28:53.359930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.994 [2024-10-07 11:28:53.359946] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.994 [2024-10-07 11:28:53.359998] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.994 [2024-10-07 11:28:53.360029] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.994 [2024-10-07 11:28:53.360045] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.994 [2024-10-07 11:28:53.360059] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.994 [2024-10-07 11:28:53.360088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.994 [2024-10-07 11:28:53.370911] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.994 [2024-10-07 11:28:53.371031] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.995 [2024-10-07 11:28:53.371062] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.995 [2024-10-07 11:28:53.371080] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.995 [2024-10-07 11:28:53.371111] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.995 [2024-10-07 11:28:53.371141] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.995 [2024-10-07 11:28:53.371157] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.995 [2024-10-07 11:28:53.371171] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.995 [2024-10-07 11:28:53.371200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.995 [2024-10-07 11:28:53.381014] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.995 [2024-10-07 11:28:53.381152] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.995 [2024-10-07 11:28:53.381183] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.995 [2024-10-07 11:28:53.381200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.995 [2024-10-07 11:28:53.382211] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.995 [2024-10-07 11:28:53.382447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.995 [2024-10-07 11:28:53.382474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.995 [2024-10-07 11:28:53.382489] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.995 [2024-10-07 11:28:53.383715] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.995 [2024-10-07 11:28:53.391957] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.995 [2024-10-07 11:28:53.392081] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.995 [2024-10-07 11:28:53.392112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.995 [2024-10-07 11:28:53.392129] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.995 [2024-10-07 11:28:53.392161] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.995 [2024-10-07 11:28:53.393262] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.995 [2024-10-07 11:28:53.393299] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.995 [2024-10-07 11:28:53.393338] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.995 [2024-10-07 11:28:53.393583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.995 [2024-10-07 11:28:53.402048] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.995 [2024-10-07 11:28:53.402167] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.995 [2024-10-07 11:28:53.402198] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.995 [2024-10-07 11:28:53.402215] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.995 [2024-10-07 11:28:53.402247] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.995 [2024-10-07 11:28:53.402277] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.995 [2024-10-07 11:28:53.402293] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.995 [2024-10-07 11:28:53.402307] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.995 [2024-10-07 11:28:53.402336] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.995 [2024-10-07 11:28:53.413271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.995 [2024-10-07 11:28:53.413433] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.995 [2024-10-07 11:28:53.413466] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.995 [2024-10-07 11:28:53.413483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.995 [2024-10-07 11:28:53.413515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.995 [2024-10-07 11:28:53.413545] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.995 [2024-10-07 11:28:53.413562] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.995 [2024-10-07 11:28:53.413576] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.995 [2024-10-07 11:28:53.413605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.995 [2024-10-07 11:28:53.423372] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.995 [2024-10-07 11:28:53.423516] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.995 [2024-10-07 11:28:53.423548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.995 [2024-10-07 11:28:53.423565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.995 [2024-10-07 11:28:53.423597] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.995 [2024-10-07 11:28:53.423633] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.995 [2024-10-07 11:28:53.423649] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.995 [2024-10-07 11:28:53.423665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.995 [2024-10-07 11:28:53.424673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.995 [2024-10-07 11:28:53.434540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.995 [2024-10-07 11:28:53.434712] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.995 [2024-10-07 11:28:53.434764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.995 [2024-10-07 11:28:53.434784] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.995 [2024-10-07 11:28:53.435883] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.995 [2024-10-07 11:28:53.436125] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.995 [2024-10-07 11:28:53.436160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.995 [2024-10-07 11:28:53.436179] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.995 [2024-10-07 11:28:53.437200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.995 [2024-10-07 11:28:53.444882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.995 [2024-10-07 11:28:53.445030] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.995 [2024-10-07 11:28:53.445074] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.995 [2024-10-07 11:28:53.445095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.995 [2024-10-07 11:28:53.445127] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.995 [2024-10-07 11:28:53.445168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.995 [2024-10-07 11:28:53.445185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.995 [2024-10-07 11:28:53.445199] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.995 [2024-10-07 11:28:53.445228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.995 [2024-10-07 11:28:53.457286] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.995 [2024-10-07 11:28:53.457643] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.995 [2024-10-07 11:28:53.457697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.995 [2024-10-07 11:28:53.457731] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.995 [2024-10-07 11:28:53.457821] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.995 [2024-10-07 11:28:53.457880] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.995 [2024-10-07 11:28:53.457910] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.995 [2024-10-07 11:28:53.457935] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.995 [2024-10-07 11:28:53.457985] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.995 [2024-10-07 11:28:53.467778] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.995 [2024-10-07 11:28:53.467972] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.995 [2024-10-07 11:28:53.468016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.995 [2024-10-07 11:28:53.468045] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.995 [2024-10-07 11:28:53.468100] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.995 [2024-10-07 11:28:53.468192] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.995 [2024-10-07 11:28:53.468221] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.995 [2024-10-07 11:28:53.468248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.995 [2024-10-07 11:28:53.469345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.995 [2024-10-07 11:28:53.477913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.995 [2024-10-07 11:28:53.478815] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.995 [2024-10-07 11:28:53.478868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.995 [2024-10-07 11:28:53.478902] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.995 [2024-10-07 11:28:53.479638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.995 [2024-10-07 11:28:53.480008] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.995 [2024-10-07 11:28:53.480057] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.995 [2024-10-07 11:28:53.480089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.996 [2024-10-07 11:28:53.480196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.996 [2024-10-07 11:28:53.488300] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.996 [2024-10-07 11:28:53.488511] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.996 [2024-10-07 11:28:53.488561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.996 [2024-10-07 11:28:53.488595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.996 [2024-10-07 11:28:53.488648] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.996 [2024-10-07 11:28:53.488698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.996 [2024-10-07 11:28:53.488728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.996 [2024-10-07 11:28:53.488753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.996 [2024-10-07 11:28:53.488802] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.996 [2024-10-07 11:28:53.498937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.996 [2024-10-07 11:28:53.499138] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.996 [2024-10-07 11:28:53.499184] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.996 [2024-10-07 11:28:53.499213] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.996 [2024-10-07 11:28:53.499267] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.996 [2024-10-07 11:28:53.499327] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.996 [2024-10-07 11:28:53.499357] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.996 [2024-10-07 11:28:53.499384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.996 [2024-10-07 11:28:53.499772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.996 [2024-10-07 11:28:53.509084] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.996 [2024-10-07 11:28:53.509289] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.996 [2024-10-07 11:28:53.509334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.996 [2024-10-07 11:28:53.509364] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.996 [2024-10-07 11:28:53.510465] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.996 [2024-10-07 11:28:53.510731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.996 [2024-10-07 11:28:53.510774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.996 [2024-10-07 11:28:53.510805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.996 [2024-10-07 11:28:53.510968] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.996 [2024-10-07 11:28:53.519225] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.996 [2024-10-07 11:28:53.519419] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.996 [2024-10-07 11:28:53.519467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.996 [2024-10-07 11:28:53.519496] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.996 [2024-10-07 11:28:53.519551] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.996 [2024-10-07 11:28:53.519601] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.996 [2024-10-07 11:28:53.519629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.996 [2024-10-07 11:28:53.519655] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.996 [2024-10-07 11:28:53.519703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.996 [2024-10-07 11:28:53.529334] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.996 [2024-10-07 11:28:53.529534] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.996 [2024-10-07 11:28:53.529592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.996 [2024-10-07 11:28:53.529626] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.996 [2024-10-07 11:28:53.529680] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.996 [2024-10-07 11:28:53.529731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.996 [2024-10-07 11:28:53.529760] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.996 [2024-10-07 11:28:53.529787] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.996 [2024-10-07 11:28:53.529836] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.996 [2024-10-07 11:28:53.539606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.996 [2024-10-07 11:28:53.539775] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.996 [2024-10-07 11:28:53.539820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.996 [2024-10-07 11:28:53.539881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.996 [2024-10-07 11:28:53.539949] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.996 [2024-10-07 11:28:53.539998] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.996 [2024-10-07 11:28:53.540025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.996 [2024-10-07 11:28:53.540050] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.996 [2024-10-07 11:28:53.541151] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.996 [2024-10-07 11:28:53.549714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.996 [2024-10-07 11:28:53.549878] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.996 [2024-10-07 11:28:53.549930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.996 [2024-10-07 11:28:53.549963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.996 [2024-10-07 11:28:53.550015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.996 [2024-10-07 11:28:53.550064] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.996 [2024-10-07 11:28:53.550094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.996 [2024-10-07 11:28:53.550118] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.996 [2024-10-07 11:28:53.550979] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.996 [2024-10-07 11:28:53.560485] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.996 [2024-10-07 11:28:53.560649] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.996 [2024-10-07 11:28:53.560706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.996 [2024-10-07 11:28:53.560740] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.996 [2024-10-07 11:28:53.560793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.996 [2024-10-07 11:28:53.560843] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.996 [2024-10-07 11:28:53.560872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.996 [2024-10-07 11:28:53.560898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.996 [2024-10-07 11:28:53.560945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.996 [2024-10-07 11:28:53.571299] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.996 [2024-10-07 11:28:53.571482] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.996 [2024-10-07 11:28:53.571530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.996 [2024-10-07 11:28:53.571562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.996 [2024-10-07 11:28:53.571615] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.996 [2024-10-07 11:28:53.571664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.996 [2024-10-07 11:28:53.571730] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.996 [2024-10-07 11:28:53.571758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.996 [2024-10-07 11:28:53.571807] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.996 [2024-10-07 11:28:53.581430] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.996 [2024-10-07 11:28:53.581610] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.996 [2024-10-07 11:28:53.581656] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.996 [2024-10-07 11:28:53.581686] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.996 [2024-10-07 11:28:53.581739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.996 [2024-10-07 11:28:53.581791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.996 [2024-10-07 11:28:53.581821] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.996 [2024-10-07 11:28:53.581846] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.996 [2024-10-07 11:28:53.581895] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.996 [2024-10-07 11:28:53.591543] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.996 [2024-10-07 11:28:53.591696] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.996 [2024-10-07 11:28:53.591739] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.996 [2024-10-07 11:28:53.591770] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.996 [2024-10-07 11:28:53.593014] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.996 [2024-10-07 11:28:53.594128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.997 [2024-10-07 11:28:53.594172] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.997 [2024-10-07 11:28:53.594202] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.997 [2024-10-07 11:28:53.594358] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.997 [2024-10-07 11:28:53.601651] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.997 [2024-10-07 11:28:53.602724] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.997 [2024-10-07 11:28:53.602777] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.997 [2024-10-07 11:28:53.602809] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.997 [2024-10-07 11:28:53.603076] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.997 [2024-10-07 11:28:53.603237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.997 [2024-10-07 11:28:53.603274] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.997 [2024-10-07 11:28:53.603314] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.997 [2024-10-07 11:28:53.604477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.997 [2024-10-07 11:28:53.612805] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.997 [2024-10-07 11:28:53.613219] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.997 [2024-10-07 11:28:53.613270] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.997 [2024-10-07 11:28:53.613303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.997 [2024-10-07 11:28:53.613425] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.997 [2024-10-07 11:28:53.613491] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.997 [2024-10-07 11:28:53.613522] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.997 [2024-10-07 11:28:53.613547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.997 [2024-10-07 11:28:53.613597] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.997 [2024-10-07 11:28:53.622917] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.997 [2024-10-07 11:28:53.623086] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.997 [2024-10-07 11:28:53.623142] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.997 [2024-10-07 11:28:53.623175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.997 [2024-10-07 11:28:53.623227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.997 [2024-10-07 11:28:53.623276] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.997 [2024-10-07 11:28:53.623306] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.997 [2024-10-07 11:28:53.623330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.997 [2024-10-07 11:28:53.623380] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.997 [2024-10-07 11:28:53.633540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.997 [2024-10-07 11:28:53.633732] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.997 [2024-10-07 11:28:53.633783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.997 [2024-10-07 11:28:53.633816] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.997 [2024-10-07 11:28:53.633869] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.997 [2024-10-07 11:28:53.633919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.997 [2024-10-07 11:28:53.633950] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.997 [2024-10-07 11:28:53.633974] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.997 [2024-10-07 11:28:53.634022] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.997 [2024-10-07 11:28:53.644920] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.997 [2024-10-07 11:28:53.645336] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.997 [2024-10-07 11:28:53.645386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.997 [2024-10-07 11:28:53.645435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.997 [2024-10-07 11:28:53.645581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.997 [2024-10-07 11:28:53.645652] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.997 [2024-10-07 11:28:53.645685] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.997 [2024-10-07 11:28:53.645709] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.997 [2024-10-07 11:28:53.645759] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.997 [2024-10-07 11:28:53.657291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.997 [2024-10-07 11:28:53.657496] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.997 [2024-10-07 11:28:53.657553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.997 [2024-10-07 11:28:53.657587] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.997 [2024-10-07 11:28:53.657640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.997 [2024-10-07 11:28:53.657690] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.997 [2024-10-07 11:28:53.657720] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.997 [2024-10-07 11:28:53.657745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.997 [2024-10-07 11:28:53.657794] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.997 [2024-10-07 11:28:53.667396] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.997 [2024-10-07 11:28:53.668539] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.997 [2024-10-07 11:28:53.668591] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.997 [2024-10-07 11:28:53.668623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.997 [2024-10-07 11:28:53.668887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.997 [2024-10-07 11:28:53.669044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.997 [2024-10-07 11:28:53.669095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.997 [2024-10-07 11:28:53.669125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.997 [2024-10-07 11:28:53.670370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.997 [2024-10-07 11:28:53.678348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.997 [2024-10-07 11:28:53.678527] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.997 [2024-10-07 11:28:53.678577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.997 [2024-10-07 11:28:53.678630] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.997 [2024-10-07 11:28:53.679827] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.997 [2024-10-07 11:28:53.680137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.997 [2024-10-07 11:28:53.680178] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.997 [2024-10-07 11:28:53.680236] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.997 [2024-10-07 11:28:53.681382] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.997 [2024-10-07 11:28:53.688471] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.997 [2024-10-07 11:28:53.688661] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.997 [2024-10-07 11:28:53.688718] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.997 [2024-10-07 11:28:53.688760] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.997 [2024-10-07 11:28:53.688818] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.997 [2024-10-07 11:28:53.688900] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.997 [2024-10-07 11:28:53.688934] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.997 [2024-10-07 11:28:53.688989] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.997 [2024-10-07 11:28:53.689043] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.997 [2024-10-07 11:28:53.700107] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.997 [2024-10-07 11:28:53.700291] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.997 [2024-10-07 11:28:53.700342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.997 [2024-10-07 11:28:53.700375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.997 [2024-10-07 11:28:53.700444] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.997 [2024-10-07 11:28:53.700498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.997 [2024-10-07 11:28:53.700528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.997 [2024-10-07 11:28:53.700552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.997 [2024-10-07 11:28:53.700601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.997 [2024-10-07 11:28:53.710211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.997 [2024-10-07 11:28:53.710357] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.997 [2024-10-07 11:28:53.710427] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.997 [2024-10-07 11:28:53.710464] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.998 [2024-10-07 11:28:53.711519] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.998 [2024-10-07 11:28:53.711786] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.998 [2024-10-07 11:28:53.711828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.998 [2024-10-07 11:28:53.711862] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.998 [2024-10-07 11:28:53.712031] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.998 [2024-10-07 11:28:53.721283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.998 [2024-10-07 11:28:53.721469] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.998 [2024-10-07 11:28:53.721521] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.998 [2024-10-07 11:28:53.721554] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.998 [2024-10-07 11:28:53.722694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.998 [2024-10-07 11:28:53.722979] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.998 [2024-10-07 11:28:53.723020] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.998 [2024-10-07 11:28:53.723049] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.998 [2024-10-07 11:28:53.724114] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.998 [2024-10-07 11:28:53.731418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.998 [2024-10-07 11:28:53.731567] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.998 [2024-10-07 11:28:53.731614] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.998 [2024-10-07 11:28:53.731645] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.998 [2024-10-07 11:28:53.731696] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.998 [2024-10-07 11:28:53.731746] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.998 [2024-10-07 11:28:53.731774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.998 [2024-10-07 11:28:53.731797] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.998 [2024-10-07 11:28:53.731844] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.998 [2024-10-07 11:28:53.743536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.998 [2024-10-07 11:28:53.743775] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.998 [2024-10-07 11:28:53.743826] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.998 [2024-10-07 11:28:53.743860] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.998 [2024-10-07 11:28:53.744676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.998 [2024-10-07 11:28:53.745626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.998 [2024-10-07 11:28:53.745672] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.998 [2024-10-07 11:28:53.745703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.998 [2024-10-07 11:28:53.745862] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.998 [2024-10-07 11:28:53.754546] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.998 [2024-10-07 11:28:53.754724] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.998 [2024-10-07 11:28:53.754784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.998 [2024-10-07 11:28:53.754830] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.998 [2024-10-07 11:28:53.756125] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.998 [2024-10-07 11:28:53.757374] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.998 [2024-10-07 11:28:53.757428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.998 [2024-10-07 11:28:53.757459] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.998 [2024-10-07 11:28:53.757723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.998 [2024-10-07 11:28:53.765778] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.998 [2024-10-07 11:28:53.766942] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.998 [2024-10-07 11:28:53.766995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.998 [2024-10-07 11:28:53.767027] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.998 [2024-10-07 11:28:53.767287] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.998 [2024-10-07 11:28:53.767385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.998 [2024-10-07 11:28:53.767435] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.998 [2024-10-07 11:28:53.767462] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.998 [2024-10-07 11:28:53.767519] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.998 [2024-10-07 11:28:53.776693] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.998 [2024-10-07 11:28:53.776878] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.998 [2024-10-07 11:28:53.776924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.998 [2024-10-07 11:28:53.776956] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.998 [2024-10-07 11:28:53.777006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.998 [2024-10-07 11:28:53.777068] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.998 [2024-10-07 11:28:53.777100] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.998 [2024-10-07 11:28:53.777124] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.998 [2024-10-07 11:28:53.777184] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.998 [2024-10-07 11:28:53.787825] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.998 [2024-10-07 11:28:53.788262] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.998 [2024-10-07 11:28:53.788315] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.998 [2024-10-07 11:28:53.788347] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.998 [2024-10-07 11:28:53.788474] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.998 [2024-10-07 11:28:53.788560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.998 [2024-10-07 11:28:53.788593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.998 [2024-10-07 11:28:53.788648] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.998 [2024-10-07 11:28:53.788725] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.998 [2024-10-07 11:28:53.799963] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.998 [2024-10-07 11:28:53.800147] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.998 [2024-10-07 11:28:53.800201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.998 [2024-10-07 11:28:53.800234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.998 [2024-10-07 11:28:53.800287] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.998 [2024-10-07 11:28:53.800337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.998 [2024-10-07 11:28:53.800366] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.998 [2024-10-07 11:28:53.800391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.998 [2024-10-07 11:28:53.800460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.998 [2024-10-07 11:28:53.810067] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.998 [2024-10-07 11:28:53.810227] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.998 [2024-10-07 11:28:53.810286] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.998 [2024-10-07 11:28:53.810320] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.998 [2024-10-07 11:28:53.811392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.998 [2024-10-07 11:28:53.811674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.998 [2024-10-07 11:28:53.811716] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.999 [2024-10-07 11:28:53.811745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.999 [2024-10-07 11:28:53.811895] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.999 [2024-10-07 11:28:53.821085] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.999 [2024-10-07 11:28:53.821255] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.999 [2024-10-07 11:28:53.821310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.999 [2024-10-07 11:28:53.821344] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.999 [2024-10-07 11:28:53.822513] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.999 [2024-10-07 11:28:53.822773] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.999 [2024-10-07 11:28:53.822813] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.999 [2024-10-07 11:28:53.822842] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.999 [2024-10-07 11:28:53.823907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.999 [2024-10-07 11:28:53.831198] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.999 [2024-10-07 11:28:53.831352] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.999 [2024-10-07 11:28:53.831442] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.999 [2024-10-07 11:28:53.831476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.999 [2024-10-07 11:28:53.831530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.999 [2024-10-07 11:28:53.831580] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.999 [2024-10-07 11:28:53.831609] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.999 [2024-10-07 11:28:53.831634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.999 [2024-10-07 11:28:53.831680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.999 [2024-10-07 11:28:53.842597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.999 [2024-10-07 11:28:53.842794] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.999 [2024-10-07 11:28:53.842842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.999 [2024-10-07 11:28:53.842874] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.999 [2024-10-07 11:28:53.842929] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.999 [2024-10-07 11:28:53.842979] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.999 [2024-10-07 11:28:53.843006] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.999 [2024-10-07 11:28:53.843030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.999 [2024-10-07 11:28:53.843078] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.999 [2024-10-07 11:28:53.852730] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.999 [2024-10-07 11:28:53.852893] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.999 [2024-10-07 11:28:53.852950] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.999 [2024-10-07 11:28:53.852985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.999 [2024-10-07 11:28:53.854068] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.999 [2024-10-07 11:28:53.854352] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.999 [2024-10-07 11:28:53.854394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.999 [2024-10-07 11:28:53.854447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.999 [2024-10-07 11:28:53.854602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.999 [2024-10-07 11:28:53.863904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.999 [2024-10-07 11:28:53.864061] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.999 [2024-10-07 11:28:53.864117] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.999 [2024-10-07 11:28:53.864152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.999 [2024-10-07 11:28:53.865311] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.999 [2024-10-07 11:28:53.865620] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.999 [2024-10-07 11:28:53.865661] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.999 [2024-10-07 11:28:53.865691] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.999 [2024-10-07 11:28:53.866764] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.999 [2024-10-07 11:28:53.874008] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.999 [2024-10-07 11:28:53.874158] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.999 [2024-10-07 11:28:53.874214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.999 [2024-10-07 11:28:53.874248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.999 [2024-10-07 11:28:53.874301] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.999 [2024-10-07 11:28:53.874349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.999 [2024-10-07 11:28:53.874378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.999 [2024-10-07 11:28:53.874421] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.999 [2024-10-07 11:28:53.874474] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.999 [2024-10-07 11:28:53.885329] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.999 [2024-10-07 11:28:53.885495] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.999 [2024-10-07 11:28:53.885549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.999 [2024-10-07 11:28:53.885582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.999 [2024-10-07 11:28:53.885635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.999 [2024-10-07 11:28:53.885685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.999 [2024-10-07 11:28:53.885714] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.999 [2024-10-07 11:28:53.885737] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.999 [2024-10-07 11:28:53.885785] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.999 [2024-10-07 11:28:53.895445] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.999 [2024-10-07 11:28:53.896565] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.999 [2024-10-07 11:28:53.896616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.999 [2024-10-07 11:28:53.896647] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.999 [2024-10-07 11:28:53.896920] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.999 [2024-10-07 11:28:53.897091] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.999 [2024-10-07 11:28:53.897129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.999 [2024-10-07 11:28:53.897158] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.999 [2024-10-07 11:28:53.898442] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.999 [2024-10-07 11:28:53.906321] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.999 [2024-10-07 11:28:53.906484] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.999 [2024-10-07 11:28:53.906540] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.999 [2024-10-07 11:28:53.906573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.999 [2024-10-07 11:28:53.907709] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.999 [2024-10-07 11:28:53.907969] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.999 [2024-10-07 11:28:53.908010] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.999 [2024-10-07 11:28:53.908039] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.999 [2024-10-07 11:28:53.909121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.999 [2024-10-07 11:28:53.916435] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.999 [2024-10-07 11:28:53.916595] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.999 [2024-10-07 11:28:53.916648] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.999 [2024-10-07 11:28:53.916681] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:25.999 [2024-10-07 11:28:53.916732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:25.999 [2024-10-07 11:28:53.916782] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:25.999 [2024-10-07 11:28:53.916810] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:25.999 [2024-10-07 11:28:53.916836] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:25.999 [2024-10-07 11:28:53.916881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:25.999 [2024-10-07 11:28:53.927762] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:25.999 [2024-10-07 11:28:53.927908] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:25.999 [2024-10-07 11:28:53.927963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:25.999 [2024-10-07 11:28:53.927997] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.000 [2024-10-07 11:28:53.928051] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.000 [2024-10-07 11:28:53.928100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.000 [2024-10-07 11:28:53.928130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.000 [2024-10-07 11:28:53.928153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.000 [2024-10-07 11:28:53.928201] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.000 [2024-10-07 11:28:53.937859] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.000 [2024-10-07 11:28:53.938000] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.000 [2024-10-07 11:28:53.938055] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.000 [2024-10-07 11:28:53.938119] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.000 [2024-10-07 11:28:53.939180] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.000 [2024-10-07 11:28:53.939485] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.000 [2024-10-07 11:28:53.939526] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.000 [2024-10-07 11:28:53.939554] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.000 [2024-10-07 11:28:53.939704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.000 [2024-10-07 11:28:53.948848] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.000 [2024-10-07 11:28:53.948994] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.000 [2024-10-07 11:28:53.949046] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.000 [2024-10-07 11:28:53.949093] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.000 [2024-10-07 11:28:53.950243] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.000 [2024-10-07 11:28:53.950544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.000 [2024-10-07 11:28:53.950585] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.000 [2024-10-07 11:28:53.950614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.000 [2024-10-07 11:28:53.951675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.000 [2024-10-07 11:28:53.958951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.000 [2024-10-07 11:28:53.959099] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.000 [2024-10-07 11:28:53.959154] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.000 [2024-10-07 11:28:53.959195] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.000 [2024-10-07 11:28:53.959248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.000 [2024-10-07 11:28:53.959298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.000 [2024-10-07 11:28:53.959328] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.000 [2024-10-07 11:28:53.959353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.000 [2024-10-07 11:28:53.959414] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.000 [2024-10-07 11:28:53.970331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.000 [2024-10-07 11:28:53.970547] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.000 [2024-10-07 11:28:53.970605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.000 [2024-10-07 11:28:53.970640] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.000 [2024-10-07 11:28:53.970695] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.000 [2024-10-07 11:28:53.970746] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.000 [2024-10-07 11:28:53.970806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.000 [2024-10-07 11:28:53.970833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.000 [2024-10-07 11:28:53.970885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.000 [2024-10-07 11:28:53.980488] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.000 [2024-10-07 11:28:53.980704] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.000 [2024-10-07 11:28:53.980749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.000 [2024-10-07 11:28:53.980779] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.000 [2024-10-07 11:28:53.981872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.000 [2024-10-07 11:28:53.982180] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.000 [2024-10-07 11:28:53.982223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.000 [2024-10-07 11:28:53.982254] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.000 [2024-10-07 11:28:53.982425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.000 [2024-10-07 11:28:53.991600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.000 [2024-10-07 11:28:53.991752] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.000 [2024-10-07 11:28:53.991808] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.000 [2024-10-07 11:28:53.991842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.000 [2024-10-07 11:28:53.992978] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.000 [2024-10-07 11:28:53.993273] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.000 [2024-10-07 11:28:53.993314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.000 [2024-10-07 11:28:53.993343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.000 [2024-10-07 11:28:53.994421] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.000 [2024-10-07 11:28:54.001705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.000 [2024-10-07 11:28:54.001916] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.000 [2024-10-07 11:28:54.001993] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.000 [2024-10-07 11:28:54.002051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.000 [2024-10-07 11:28:54.002139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.000 [2024-10-07 11:28:54.002198] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.000 [2024-10-07 11:28:54.002229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.000 [2024-10-07 11:28:54.002254] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.000 [2024-10-07 11:28:54.002303] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.000 [2024-10-07 11:28:54.013146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.000 [2024-10-07 11:28:54.013306] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.000 [2024-10-07 11:28:54.013359] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.000 [2024-10-07 11:28:54.013393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.000 [2024-10-07 11:28:54.013463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.000 [2024-10-07 11:28:54.013513] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.000 [2024-10-07 11:28:54.013543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.000 [2024-10-07 11:28:54.013575] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.000 [2024-10-07 11:28:54.013625] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.000 [2024-10-07 11:28:54.023246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.000 [2024-10-07 11:28:54.023397] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.000 [2024-10-07 11:28:54.023468] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.000 [2024-10-07 11:28:54.023502] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.000 [2024-10-07 11:28:54.024561] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.000 [2024-10-07 11:28:54.024824] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.000 [2024-10-07 11:28:54.024866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.000 [2024-10-07 11:28:54.024895] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.000 [2024-10-07 11:28:54.025045] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.000 [2024-10-07 11:28:54.033356] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.000 [2024-10-07 11:28:54.033542] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.000 [2024-10-07 11:28:54.033587] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.000 [2024-10-07 11:28:54.033616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.000 [2024-10-07 11:28:54.034604] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.000 [2024-10-07 11:28:54.034853] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.000 [2024-10-07 11:28:54.034894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.000 [2024-10-07 11:28:54.034925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.000 [2024-10-07 11:28:54.035035] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.001 [2024-10-07 11:28:54.044573] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.001 [2024-10-07 11:28:54.044755] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.001 [2024-10-07 11:28:54.044814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.001 [2024-10-07 11:28:54.044849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.001 [2024-10-07 11:28:54.045200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.001 [2024-10-07 11:28:54.045319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.001 [2024-10-07 11:28:54.045355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.001 [2024-10-07 11:28:54.045383] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.001 [2024-10-07 11:28:54.045451] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.001 [2024-10-07 11:28:54.054699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.001 [2024-10-07 11:28:54.054854] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.001 [2024-10-07 11:28:54.054919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.001 [2024-10-07 11:28:54.054954] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.001 [2024-10-07 11:28:54.056200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.001 [2024-10-07 11:28:54.057459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.001 [2024-10-07 11:28:54.057502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.001 [2024-10-07 11:28:54.057532] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.001 [2024-10-07 11:28:54.057821] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.001 [2024-10-07 11:28:54.065289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.001 [2024-10-07 11:28:54.066563] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.001 [2024-10-07 11:28:54.066615] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.001 [2024-10-07 11:28:54.066649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.001 [2024-10-07 11:28:54.066916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.001 [2024-10-07 11:28:54.068010] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.001 [2024-10-07 11:28:54.068054] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.001 [2024-10-07 11:28:54.068085] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.001 [2024-10-07 11:28:54.068380] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.001 [2024-10-07 11:28:54.075423] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.001 [2024-10-07 11:28:54.075589] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.001 [2024-10-07 11:28:54.075642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.001 [2024-10-07 11:28:54.075687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.001 [2024-10-07 11:28:54.075741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.001 [2024-10-07 11:28:54.075790] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.001 [2024-10-07 11:28:54.075820] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.001 [2024-10-07 11:28:54.075875] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.001 [2024-10-07 11:28:54.075925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.001 [2024-10-07 11:28:54.086634] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.001 [2024-10-07 11:28:54.086844] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.001 [2024-10-07 11:28:54.086898] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.001 [2024-10-07 11:28:54.086932] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.001 [2024-10-07 11:28:54.086985] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.001 [2024-10-07 11:28:54.087036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.001 [2024-10-07 11:28:54.087065] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.001 [2024-10-07 11:28:54.087092] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.001 [2024-10-07 11:28:54.087138] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.001 [2024-10-07 11:28:54.099377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.001 8270.50 IOPS, 32.31 MiB/s [2024-10-07T11:29:07.712Z] [2024-10-07 11:28:54.099773] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.001 [2024-10-07 11:28:54.099824] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.001 [2024-10-07 11:28:54.099856] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.001 [2024-10-07 11:28:54.100010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.001 [2024-10-07 11:28:54.101271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.001 [2024-10-07 11:28:54.101314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.001 [2024-10-07 11:28:54.101343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.001 [2024-10-07 11:28:54.102572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.001 [2024-10-07 11:28:54.109601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.001 [2024-10-07 11:28:54.110753] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.001 [2024-10-07 11:28:54.110805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.001 [2024-10-07 11:28:54.110838] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.001 [2024-10-07 11:28:54.111109] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.001 [2024-10-07 11:28:54.111207] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.001 [2024-10-07 11:28:54.111244] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.001 [2024-10-07 11:28:54.111270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.001 [2024-10-07 11:28:54.111322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.001 [2024-10-07 11:28:54.120467] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.001 [2024-10-07 11:28:54.120674] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.001 [2024-10-07 11:28:54.120725] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.001 [2024-10-07 11:28:54.120757] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.001 [2024-10-07 11:28:54.120811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.001 [2024-10-07 11:28:54.120861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.001 [2024-10-07 11:28:54.120891] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.001 [2024-10-07 11:28:54.120920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.001 [2024-10-07 11:28:54.120969] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.001 [2024-10-07 11:28:54.131558] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.001 [2024-10-07 11:28:54.131952] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.001 [2024-10-07 11:28:54.132002] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.001 [2024-10-07 11:28:54.132034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.001 [2024-10-07 11:28:54.132139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.001 [2024-10-07 11:28:54.132216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.001 [2024-10-07 11:28:54.132249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.001 [2024-10-07 11:28:54.132275] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.001 [2024-10-07 11:28:54.132322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.001 [2024-10-07 11:28:54.143489] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.001 [2024-10-07 11:28:54.143778] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.001 [2024-10-07 11:28:54.143829] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.001 [2024-10-07 11:28:54.143861] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.001 [2024-10-07 11:28:54.143946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.001 [2024-10-07 11:28:54.144001] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.001 [2024-10-07 11:28:54.144030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.001 [2024-10-07 11:28:54.144054] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.001 [2024-10-07 11:28:54.144103] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.001 [2024-10-07 11:28:54.153599] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.001 [2024-10-07 11:28:54.153749] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.001 [2024-10-07 11:28:54.153805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.001 [2024-10-07 11:28:54.153839] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.001 [2024-10-07 11:28:54.154932] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.001 [2024-10-07 11:28:54.155182] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.001 [2024-10-07 11:28:54.155222] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.002 [2024-10-07 11:28:54.155252] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.002 [2024-10-07 11:28:54.155437] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.002 [2024-10-07 11:28:54.164755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.002 [2024-10-07 11:28:54.164912] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.002 [2024-10-07 11:28:54.164957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.002 [2024-10-07 11:28:54.164988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.002 [2024-10-07 11:28:54.166144] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.002 [2024-10-07 11:28:54.166466] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.002 [2024-10-07 11:28:54.166506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.002 [2024-10-07 11:28:54.166537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.002 [2024-10-07 11:28:54.167601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.002 [2024-10-07 11:28:54.174862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.002 [2024-10-07 11:28:54.175011] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.002 [2024-10-07 11:28:54.175066] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.002 [2024-10-07 11:28:54.175100] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.002 [2024-10-07 11:28:54.175152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.002 [2024-10-07 11:28:54.175201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.002 [2024-10-07 11:28:54.175229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.002 [2024-10-07 11:28:54.175254] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.002 [2024-10-07 11:28:54.175301] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.002 [2024-10-07 11:28:54.186116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.002 [2024-10-07 11:28:54.186322] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.002 [2024-10-07 11:28:54.186380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.002 [2024-10-07 11:28:54.186433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.002 [2024-10-07 11:28:54.186489] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.002 [2024-10-07 11:28:54.186540] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.002 [2024-10-07 11:28:54.186570] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.002 [2024-10-07 11:28:54.186626] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.002 [2024-10-07 11:28:54.186677] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.002 [2024-10-07 11:28:54.196229] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.002 [2024-10-07 11:28:54.196391] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.002 [2024-10-07 11:28:54.196450] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.002 [2024-10-07 11:28:54.196481] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.002 [2024-10-07 11:28:54.197554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.002 [2024-10-07 11:28:54.197827] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.002 [2024-10-07 11:28:54.197868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.002 [2024-10-07 11:28:54.197898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.002 [2024-10-07 11:28:54.198051] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.002 [2024-10-07 11:28:54.207297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.002 [2024-10-07 11:28:54.207468] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.002 [2024-10-07 11:28:54.207523] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.002 [2024-10-07 11:28:54.207557] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.002 [2024-10-07 11:28:54.208705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.002 [2024-10-07 11:28:54.209018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.002 [2024-10-07 11:28:54.209069] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.002 [2024-10-07 11:28:54.209100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.002 [2024-10-07 11:28:54.210167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.002 [2024-10-07 11:28:54.217420] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.002 [2024-10-07 11:28:54.217589] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.002 [2024-10-07 11:28:54.217642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.002 [2024-10-07 11:28:54.217677] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.002 [2024-10-07 11:28:54.217730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.002 [2024-10-07 11:28:54.217781] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.002 [2024-10-07 11:28:54.217812] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.002 [2024-10-07 11:28:54.217836] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.002 [2024-10-07 11:28:54.217885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.002 [2024-10-07 11:28:54.229106] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.002 [2024-10-07 11:28:54.229413] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.002 [2024-10-07 11:28:54.229491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.002 [2024-10-07 11:28:54.229525] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.002 [2024-10-07 11:28:54.229597] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.002 [2024-10-07 11:28:54.229650] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.002 [2024-10-07 11:28:54.229679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.002 [2024-10-07 11:28:54.229704] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.002 [2024-10-07 11:28:54.229755] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.002 [2024-10-07 11:28:54.239216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.002 [2024-10-07 11:28:54.239367] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.002 [2024-10-07 11:28:54.239433] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.002 [2024-10-07 11:28:54.239469] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.002 [2024-10-07 11:28:54.239522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.002 [2024-10-07 11:28:54.240585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.002 [2024-10-07 11:28:54.240628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.002 [2024-10-07 11:28:54.240658] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.002 [2024-10-07 11:28:54.240910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.002 [2024-10-07 11:28:54.249321] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.002 [2024-10-07 11:28:54.250364] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.002 [2024-10-07 11:28:54.250432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.002 [2024-10-07 11:28:54.250468] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.002 [2024-10-07 11:28:54.250705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.002 [2024-10-07 11:28:54.250862] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.002 [2024-10-07 11:28:54.250914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.002 [2024-10-07 11:28:54.250943] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.002 [2024-10-07 11:28:54.252087] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.002 [2024-10-07 11:28:54.259828] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.002 [2024-10-07 11:28:54.260210] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.002 [2024-10-07 11:28:54.260260] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.002 [2024-10-07 11:28:54.260292] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.002 [2024-10-07 11:28:54.260396] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.002 [2024-10-07 11:28:54.260519] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.002 [2024-10-07 11:28:54.260552] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.002 [2024-10-07 11:28:54.260582] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.002 [2024-10-07 11:28:54.260631] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.002 [2024-10-07 11:28:54.271825] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.002 [2024-10-07 11:28:54.272016] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.002 [2024-10-07 11:28:54.272060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.002 [2024-10-07 11:28:54.272089] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.002 [2024-10-07 11:28:54.272141] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.003 [2024-10-07 11:28:54.272190] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.003 [2024-10-07 11:28:54.272218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.003 [2024-10-07 11:28:54.272241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.003 [2024-10-07 11:28:54.272288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.003 [2024-10-07 11:28:54.281927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.003 [2024-10-07 11:28:54.282080] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.003 [2024-10-07 11:28:54.282132] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.003 [2024-10-07 11:28:54.282165] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.003 [2024-10-07 11:28:54.283223] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.003 [2024-10-07 11:28:54.283488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.003 [2024-10-07 11:28:54.283527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.003 [2024-10-07 11:28:54.283557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.003 [2024-10-07 11:28:54.283704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.003 [2024-10-07 11:28:54.292891] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.003 [2024-10-07 11:28:54.293046] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.003 [2024-10-07 11:28:54.293115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.003 [2024-10-07 11:28:54.293149] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.003 [2024-10-07 11:28:54.294294] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.003 [2024-10-07 11:28:54.294600] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.003 [2024-10-07 11:28:54.294642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.003 [2024-10-07 11:28:54.294672] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.003 [2024-10-07 11:28:54.295757] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.003 [2024-10-07 11:28:54.302992] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.003 [2024-10-07 11:28:54.303151] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.003 [2024-10-07 11:28:54.303207] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.003 [2024-10-07 11:28:54.303240] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.003 [2024-10-07 11:28:54.303292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.003 [2024-10-07 11:28:54.303343] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.003 [2024-10-07 11:28:54.303372] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.003 [2024-10-07 11:28:54.303398] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.003 [2024-10-07 11:28:54.303468] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.003 [2024-10-07 11:28:54.314270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.003 [2024-10-07 11:28:54.314468] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.003 [2024-10-07 11:28:54.314513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.003 [2024-10-07 11:28:54.314544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.003 [2024-10-07 11:28:54.314600] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.003 [2024-10-07 11:28:54.314651] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.003 [2024-10-07 11:28:54.314680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.003 [2024-10-07 11:28:54.314707] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.003 [2024-10-07 11:28:54.314756] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.003 [2024-10-07 11:28:54.324393] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.003 [2024-10-07 11:28:54.324588] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.003 [2024-10-07 11:28:54.324639] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.003 [2024-10-07 11:28:54.324672] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.003 [2024-10-07 11:28:54.325755] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.003 [2024-10-07 11:28:54.326010] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.003 [2024-10-07 11:28:54.326050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.003 [2024-10-07 11:28:54.326082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.003 [2024-10-07 11:28:54.326236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.003 [2024-10-07 11:28:54.335561] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.003 [2024-10-07 11:28:54.335747] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.003 [2024-10-07 11:28:54.335793] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.003 [2024-10-07 11:28:54.335856] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.003 [2024-10-07 11:28:54.337005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.003 [2024-10-07 11:28:54.337309] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.003 [2024-10-07 11:28:54.337350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.003 [2024-10-07 11:28:54.337381] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.003 [2024-10-07 11:28:54.338462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.003 [2024-10-07 11:28:54.345685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.003 [2024-10-07 11:28:54.345868] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.003 [2024-10-07 11:28:54.345926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.003 [2024-10-07 11:28:54.345961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.003 [2024-10-07 11:28:54.346283] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.003 [2024-10-07 11:28:54.346418] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.003 [2024-10-07 11:28:54.346461] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.003 [2024-10-07 11:28:54.346491] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.003 [2024-10-07 11:28:54.346546] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.003 [2024-10-07 11:28:54.356385] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.003 [2024-10-07 11:28:54.356583] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.003 [2024-10-07 11:28:54.356628] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.003 [2024-10-07 11:28:54.356659] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.003 [2024-10-07 11:28:54.357925] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.003 [2024-10-07 11:28:54.359153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.003 [2024-10-07 11:28:54.359196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.003 [2024-10-07 11:28:54.359227] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.003 [2024-10-07 11:28:54.359549] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.003 [2024-10-07 11:28:54.366516] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.003 [2024-10-07 11:28:54.367769] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.003 [2024-10-07 11:28:54.367823] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.003 [2024-10-07 11:28:54.367855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.003 [2024-10-07 11:28:54.368139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.003 [2024-10-07 11:28:54.369223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.003 [2024-10-07 11:28:54.369288] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.003 [2024-10-07 11:28:54.369321] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.003 [2024-10-07 11:28:54.369642] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.004 [2024-10-07 11:28:54.376627] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.004 [2024-10-07 11:28:54.376790] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.004 [2024-10-07 11:28:54.376847] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.004 [2024-10-07 11:28:54.376880] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.004 [2024-10-07 11:28:54.376933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.004 [2024-10-07 11:28:54.376984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.004 [2024-10-07 11:28:54.377013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.004 [2024-10-07 11:28:54.377037] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.004 [2024-10-07 11:28:54.377101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.004 [2024-10-07 11:28:54.389123] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.004 [2024-10-07 11:28:54.389468] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.004 [2024-10-07 11:28:54.389521] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.004 [2024-10-07 11:28:54.389555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.004 [2024-10-07 11:28:54.389644] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.004 [2024-10-07 11:28:54.389702] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.004 [2024-10-07 11:28:54.389733] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.004 [2024-10-07 11:28:54.389758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.004 [2024-10-07 11:28:54.389808] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.004 [2024-10-07 11:28:54.399365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.004 [2024-10-07 11:28:54.399562] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.004 [2024-10-07 11:28:54.399610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.004 [2024-10-07 11:28:54.399642] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.004 [2024-10-07 11:28:54.399694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.004 [2024-10-07 11:28:54.399744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.004 [2024-10-07 11:28:54.399773] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.004 [2024-10-07 11:28:54.399798] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.004 [2024-10-07 11:28:54.399852] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.004 [2024-10-07 11:28:54.409497] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.004 [2024-10-07 11:28:54.409665] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.004 [2024-10-07 11:28:54.409725] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.004 [2024-10-07 11:28:54.409759] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.004 [2024-10-07 11:28:54.410750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.004 [2024-10-07 11:28:54.411017] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.004 [2024-10-07 11:28:54.411058] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.004 [2024-10-07 11:28:54.411087] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.004 [2024-10-07 11:28:54.411237] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.004 [2024-10-07 11:28:54.420088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.004 [2024-10-07 11:28:54.420523] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.004 [2024-10-07 11:28:54.420574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.004 [2024-10-07 11:28:54.420607] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.004 [2024-10-07 11:28:54.420715] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.004 [2024-10-07 11:28:54.420773] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.004 [2024-10-07 11:28:54.420803] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.004 [2024-10-07 11:28:54.420828] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.004 [2024-10-07 11:28:54.420887] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.004 [2024-10-07 11:28:54.432108] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.004 [2024-10-07 11:28:54.432323] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.004 [2024-10-07 11:28:54.432379] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.004 [2024-10-07 11:28:54.432428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.004 [2024-10-07 11:28:54.432485] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.004 [2024-10-07 11:28:54.432534] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.004 [2024-10-07 11:28:54.432563] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.004 [2024-10-07 11:28:54.432589] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.004 [2024-10-07 11:28:54.432638] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.004 [2024-10-07 11:28:54.443201] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.004 [2024-10-07 11:28:54.443553] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.004 [2024-10-07 11:28:54.443603] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.004 [2024-10-07 11:28:54.443635] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.004 [2024-10-07 11:28:54.443819] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.004 [2024-10-07 11:28:54.445083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.004 [2024-10-07 11:28:54.445125] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.004 [2024-10-07 11:28:54.445155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.004 [2024-10-07 11:28:54.446376] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.004 [2024-10-07 11:28:54.454538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.004 [2024-10-07 11:28:54.455700] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.004 [2024-10-07 11:28:54.455760] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.004 [2024-10-07 11:28:54.455793] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.004 [2024-10-07 11:28:54.456058] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.004 [2024-10-07 11:28:54.456157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.004 [2024-10-07 11:28:54.456194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.004 [2024-10-07 11:28:54.456223] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.004 [2024-10-07 11:28:54.457310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.004 [2024-10-07 11:28:54.464662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.004 [2024-10-07 11:28:54.464849] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.004 [2024-10-07 11:28:54.464896] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.004 [2024-10-07 11:28:54.464927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.004 [2024-10-07 11:28:54.464981] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.004 [2024-10-07 11:28:54.465031] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.004 [2024-10-07 11:28:54.465073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.004 [2024-10-07 11:28:54.465102] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.004 [2024-10-07 11:28:54.465959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.004 [2024-10-07 11:28:54.475345] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.004 [2024-10-07 11:28:54.475573] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.004 [2024-10-07 11:28:54.475624] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.004 [2024-10-07 11:28:54.475657] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.004 [2024-10-07 11:28:54.475712] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.004 [2024-10-07 11:28:54.475763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.004 [2024-10-07 11:28:54.475792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.004 [2024-10-07 11:28:54.475859] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.004 [2024-10-07 11:28:54.475911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.004 [2024-10-07 11:28:54.485484] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.004 [2024-10-07 11:28:54.486663] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.004 [2024-10-07 11:28:54.486716] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.004 [2024-10-07 11:28:54.486748] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.004 [2024-10-07 11:28:54.487019] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.004 [2024-10-07 11:28:54.487179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.004 [2024-10-07 11:28:54.487218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.005 [2024-10-07 11:28:54.487248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.005 [2024-10-07 11:28:54.488507] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.005 [2024-10-07 11:28:54.495607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.005 [2024-10-07 11:28:54.495775] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.005 [2024-10-07 11:28:54.495831] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.005 [2024-10-07 11:28:54.495867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.005 [2024-10-07 11:28:54.495919] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.005 [2024-10-07 11:28:54.496911] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.005 [2024-10-07 11:28:54.496954] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.005 [2024-10-07 11:28:54.496984] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.005 [2024-10-07 11:28:54.497297] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.005 [2024-10-07 11:28:54.506374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.005 [2024-10-07 11:28:54.506820] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.005 [2024-10-07 11:28:54.506872] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.005 [2024-10-07 11:28:54.506905] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.005 [2024-10-07 11:28:54.507014] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.005 [2024-10-07 11:28:54.507090] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.005 [2024-10-07 11:28:54.507136] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.005 [2024-10-07 11:28:54.507168] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.005 [2024-10-07 11:28:54.507221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.005 [2024-10-07 11:28:54.518374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.005 [2024-10-07 11:28:54.518633] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.005 [2024-10-07 11:28:54.518691] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.005 [2024-10-07 11:28:54.518726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.005 [2024-10-07 11:28:54.518780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.005 [2024-10-07 11:28:54.518830] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.005 [2024-10-07 11:28:54.518859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.005 [2024-10-07 11:28:54.518883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.005 [2024-10-07 11:28:54.518933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.005 [2024-10-07 11:28:54.529707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.005 [2024-10-07 11:28:54.529876] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.005 [2024-10-07 11:28:54.529929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.005 [2024-10-07 11:28:54.529962] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.005 [2024-10-07 11:28:54.531208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.005 [2024-10-07 11:28:54.532470] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.005 [2024-10-07 11:28:54.532512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.005 [2024-10-07 11:28:54.532543] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.005 [2024-10-07 11:28:54.532821] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.005 [2024-10-07 11:28:54.540791] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.005 [2024-10-07 11:28:54.541961] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.005 [2024-10-07 11:28:54.542014] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.005 [2024-10-07 11:28:54.542047] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.005 [2024-10-07 11:28:54.542300] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.005 [2024-10-07 11:28:54.542397] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.005 [2024-10-07 11:28:54.542450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.005 [2024-10-07 11:28:54.542476] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.005 [2024-10-07 11:28:54.542530] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.005 [2024-10-07 11:28:54.551699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.005 [2024-10-07 11:28:54.551907] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.005 [2024-10-07 11:28:54.551958] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.005 [2024-10-07 11:28:54.551992] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.005 [2024-10-07 11:28:54.552076] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.005 [2024-10-07 11:28:54.552150] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.005 [2024-10-07 11:28:54.552183] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.005 [2024-10-07 11:28:54.552209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.005 [2024-10-07 11:28:54.552256] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.005 [2024-10-07 11:28:54.562774] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.005 [2024-10-07 11:28:54.563193] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.005 [2024-10-07 11:28:54.563245] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.005 [2024-10-07 11:28:54.563278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.005 [2024-10-07 11:28:54.563383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.005 [2024-10-07 11:28:54.563460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.005 [2024-10-07 11:28:54.563492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.005 [2024-10-07 11:28:54.563517] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.005 [2024-10-07 11:28:54.563565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.005 [2024-10-07 11:28:54.574883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.005 [2024-10-07 11:28:54.575104] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.005 [2024-10-07 11:28:54.575161] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.005 [2024-10-07 11:28:54.575195] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.005 [2024-10-07 11:28:54.575250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.005 [2024-10-07 11:28:54.575301] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.005 [2024-10-07 11:28:54.575329] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.005 [2024-10-07 11:28:54.575354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.005 [2024-10-07 11:28:54.575420] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.005 [2024-10-07 11:28:54.585007] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.005 [2024-10-07 11:28:54.585202] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.005 [2024-10-07 11:28:54.585255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.005 [2024-10-07 11:28:54.585288] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.005 [2024-10-07 11:28:54.586362] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.005 [2024-10-07 11:28:54.586647] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.005 [2024-10-07 11:28:54.586689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.005 [2024-10-07 11:28:54.586757] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.005 [2024-10-07 11:28:54.586910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.005 [2024-10-07 11:28:54.596095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.005 [2024-10-07 11:28:54.596279] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.005 [2024-10-07 11:28:54.596336] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.005 [2024-10-07 11:28:54.596372] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.005 [2024-10-07 11:28:54.597554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.005 [2024-10-07 11:28:54.597820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.005 [2024-10-07 11:28:54.597861] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.005 [2024-10-07 11:28:54.597891] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.005 [2024-10-07 11:28:54.598970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.005 [2024-10-07 11:28:54.606219] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.005 [2024-10-07 11:28:54.606446] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.005 [2024-10-07 11:28:54.606505] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.005 [2024-10-07 11:28:54.606541] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.005 [2024-10-07 11:28:54.606597] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.006 [2024-10-07 11:28:54.606650] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.006 [2024-10-07 11:28:54.606682] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.006 [2024-10-07 11:28:54.606708] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.006 [2024-10-07 11:28:54.606757] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.006 [2024-10-07 11:28:54.618785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.006 [2024-10-07 11:28:54.619098] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.006 [2024-10-07 11:28:54.619148] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.006 [2024-10-07 11:28:54.619170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.006 [2024-10-07 11:28:54.619228] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.006 [2024-10-07 11:28:54.619266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.006 [2024-10-07 11:28:54.619283] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.006 [2024-10-07 11:28:54.619299] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.006 [2024-10-07 11:28:54.619331] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.006 [2024-10-07 11:28:54.629358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.006 [2024-10-07 11:28:54.629539] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.006 [2024-10-07 11:28:54.629600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.006 [2024-10-07 11:28:54.629621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.006 [2024-10-07 11:28:54.629656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.006 [2024-10-07 11:28:54.629687] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.006 [2024-10-07 11:28:54.629704] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.006 [2024-10-07 11:28:54.629719] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.006 [2024-10-07 11:28:54.629749] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.006 [2024-10-07 11:28:54.639503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.006 [2024-10-07 11:28:54.639679] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.006 [2024-10-07 11:28:54.639714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.006 [2024-10-07 11:28:54.639733] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.006 [2024-10-07 11:28:54.639767] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.006 [2024-10-07 11:28:54.639797] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.006 [2024-10-07 11:28:54.639814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.006 [2024-10-07 11:28:54.639830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.006 [2024-10-07 11:28:54.639860] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.006 [2024-10-07 11:28:54.649647] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.006 [2024-10-07 11:28:54.649835] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.006 [2024-10-07 11:28:54.649869] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.006 [2024-10-07 11:28:54.649888] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.006 [2024-10-07 11:28:54.649922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.006 [2024-10-07 11:28:54.649953] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.006 [2024-10-07 11:28:54.649970] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.006 [2024-10-07 11:28:54.649986] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.006 [2024-10-07 11:28:54.650016] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.006 [2024-10-07 11:28:54.660336] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.006 [2024-10-07 11:28:54.660550] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.006 [2024-10-07 11:28:54.660587] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.006 [2024-10-07 11:28:54.660605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.006 [2024-10-07 11:28:54.660640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.006 [2024-10-07 11:28:54.660701] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.006 [2024-10-07 11:28:54.660719] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.006 [2024-10-07 11:28:54.660734] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.006 [2024-10-07 11:28:54.660765] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.006 [2024-10-07 11:28:54.671138] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.006 [2024-10-07 11:28:54.671349] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.006 [2024-10-07 11:28:54.671398] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.006 [2024-10-07 11:28:54.671437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.006 [2024-10-07 11:28:54.671475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.006 [2024-10-07 11:28:54.671506] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.006 [2024-10-07 11:28:54.671523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.006 [2024-10-07 11:28:54.671539] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.006 [2024-10-07 11:28:54.671570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.006 [2024-10-07 11:28:54.682551] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.006 [2024-10-07 11:28:54.682977] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.006 [2024-10-07 11:28:54.683024] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.006 [2024-10-07 11:28:54.683046] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.006 [2024-10-07 11:28:54.683133] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.006 [2024-10-07 11:28:54.683171] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.006 [2024-10-07 11:28:54.683189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.006 [2024-10-07 11:28:54.683205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.006 [2024-10-07 11:28:54.683236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.006 [2024-10-07 11:28:54.692824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.006 [2024-10-07 11:28:54.693014] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.006 [2024-10-07 11:28:54.693049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.006 [2024-10-07 11:28:54.693085] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.006 [2024-10-07 11:28:54.693131] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.006 [2024-10-07 11:28:54.693164] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.006 [2024-10-07 11:28:54.693182] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.006 [2024-10-07 11:28:54.693197] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.006 [2024-10-07 11:28:54.693260] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.006 [2024-10-07 11:28:54.702982] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.006 [2024-10-07 11:28:54.704130] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.006 [2024-10-07 11:28:54.704190] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.006 [2024-10-07 11:28:54.704213] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.006 [2024-10-07 11:28:54.704431] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.006 [2024-10-07 11:28:54.704530] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.006 [2024-10-07 11:28:54.704561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.006 [2024-10-07 11:28:54.704579] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.006 [2024-10-07 11:28:54.704616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.006 [2024-10-07 11:28:54.713129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.006 [2024-10-07 11:28:54.714019] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.006 [2024-10-07 11:28:54.714078] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.006 [2024-10-07 11:28:54.714100] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.006 [2024-10-07 11:28:54.714750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.006 [2024-10-07 11:28:54.715092] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.006 [2024-10-07 11:28:54.715133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.006 [2024-10-07 11:28:54.715152] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.006 [2024-10-07 11:28:54.715228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.006 [2024-10-07 11:28:54.723277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.006 [2024-10-07 11:28:54.723484] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.006 [2024-10-07 11:28:54.723521] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.007 [2024-10-07 11:28:54.723540] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.007 [2024-10-07 11:28:54.724563] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.007 [2024-10-07 11:28:54.724800] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.007 [2024-10-07 11:28:54.724835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.007 [2024-10-07 11:28:54.724854] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.007 [2024-10-07 11:28:54.724916] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.007 [2024-10-07 11:28:54.733455] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.007 [2024-10-07 11:28:54.733624] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.007 [2024-10-07 11:28:54.733660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.007 [2024-10-07 11:28:54.733709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.007 [2024-10-07 11:28:54.733983] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.007 [2024-10-07 11:28:54.734082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.007 [2024-10-07 11:28:54.734111] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.007 [2024-10-07 11:28:54.734128] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.007 [2024-10-07 11:28:54.734162] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.007 [2024-10-07 11:28:54.744730] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.007 [2024-10-07 11:28:54.744957] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.007 [2024-10-07 11:28:54.745003] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.007 [2024-10-07 11:28:54.745022] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.007 [2024-10-07 11:28:54.745070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.007 [2024-10-07 11:28:54.745105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.007 [2024-10-07 11:28:54.745122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.007 [2024-10-07 11:28:54.745137] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.007 [2024-10-07 11:28:54.745168] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.007 [2024-10-07 11:28:54.755189] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.007 [2024-10-07 11:28:54.755391] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.007 [2024-10-07 11:28:54.755442] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.007 [2024-10-07 11:28:54.755462] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.007 [2024-10-07 11:28:54.755497] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.007 [2024-10-07 11:28:54.755528] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.007 [2024-10-07 11:28:54.755546] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.007 [2024-10-07 11:28:54.755561] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.007 [2024-10-07 11:28:54.755592] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.007 [2024-10-07 11:28:54.766038] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.007 [2024-10-07 11:28:54.766220] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.007 [2024-10-07 11:28:54.766266] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.007 [2024-10-07 11:28:54.766284] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.007 [2024-10-07 11:28:54.766495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.007 [2024-10-07 11:28:54.766650] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.007 [2024-10-07 11:28:54.766716] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.007 [2024-10-07 11:28:54.766736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.007 [2024-10-07 11:28:54.766795] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.007 [2024-10-07 11:28:54.776847] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.007 [2024-10-07 11:28:54.777039] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.007 [2024-10-07 11:28:54.777090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.007 [2024-10-07 11:28:54.777109] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.007 [2024-10-07 11:28:54.777145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.007 [2024-10-07 11:28:54.777176] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.007 [2024-10-07 11:28:54.777195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.007 [2024-10-07 11:28:54.777210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.007 [2024-10-07 11:28:54.777241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.007 [2024-10-07 11:28:54.787001] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.007 [2024-10-07 11:28:54.787182] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.007 [2024-10-07 11:28:54.787217] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.007 [2024-10-07 11:28:54.787235] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.007 [2024-10-07 11:28:54.787526] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.007 [2024-10-07 11:28:54.787607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.007 [2024-10-07 11:28:54.787632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.007 [2024-10-07 11:28:54.787648] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.007 [2024-10-07 11:28:54.787680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.007 [2024-10-07 11:28:54.797145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.007 [2024-10-07 11:28:54.797312] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.007 [2024-10-07 11:28:54.797347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.007 [2024-10-07 11:28:54.797365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.007 [2024-10-07 11:28:54.797415] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.007 [2024-10-07 11:28:54.797451] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.007 [2024-10-07 11:28:54.797468] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.007 [2024-10-07 11:28:54.797483] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.007 [2024-10-07 11:28:54.797513] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.007 [2024-10-07 11:28:54.807274] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.007 [2024-10-07 11:28:54.807510] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.007 [2024-10-07 11:28:54.807548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.007 [2024-10-07 11:28:54.807567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.007 [2024-10-07 11:28:54.807602] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.007 [2024-10-07 11:28:54.807634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.007 [2024-10-07 11:28:54.807650] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.007 [2024-10-07 11:28:54.807665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.007 [2024-10-07 11:28:54.807696] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.007 [2024-10-07 11:28:54.819479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.007 [2024-10-07 11:28:54.819680] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.007 [2024-10-07 11:28:54.819717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.007 [2024-10-07 11:28:54.819735] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.008 [2024-10-07 11:28:54.819934] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.008 [2024-10-07 11:28:54.820136] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.008 [2024-10-07 11:28:54.820189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.008 [2024-10-07 11:28:54.820212] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.008 [2024-10-07 11:28:54.820295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.008 [2024-10-07 11:28:54.830593] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.008 [2024-10-07 11:28:54.830820] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.008 [2024-10-07 11:28:54.830869] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.008 [2024-10-07 11:28:54.830897] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.008 [2024-10-07 11:28:54.831976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.008 [2024-10-07 11:28:54.832205] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.008 [2024-10-07 11:28:54.832237] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.008 [2024-10-07 11:28:54.832256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.008 [2024-10-07 11:28:54.832319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.008 [2024-10-07 11:28:54.840898] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.008 [2024-10-07 11:28:54.841189] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.008 [2024-10-07 11:28:54.841242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.008 [2024-10-07 11:28:54.841277] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.008 [2024-10-07 11:28:54.841365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.008 [2024-10-07 11:28:54.841435] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.008 [2024-10-07 11:28:54.841462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.008 [2024-10-07 11:28:54.841489] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.008 [2024-10-07 11:28:54.841532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.008 [2024-10-07 11:28:54.851660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.008 [2024-10-07 11:28:54.851848] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.008 [2024-10-07 11:28:54.851885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.008 [2024-10-07 11:28:54.851903] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.008 [2024-10-07 11:28:54.851938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.008 [2024-10-07 11:28:54.851969] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.008 [2024-10-07 11:28:54.851986] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.008 [2024-10-07 11:28:54.852001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.008 [2024-10-07 11:28:54.852031] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.008 [2024-10-07 11:28:54.861802] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.008 [2024-10-07 11:28:54.861980] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.008 [2024-10-07 11:28:54.862014] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.008 [2024-10-07 11:28:54.862032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.008 [2024-10-07 11:28:54.862066] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.008 [2024-10-07 11:28:54.862098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.008 [2024-10-07 11:28:54.862115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.008 [2024-10-07 11:28:54.862131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.008 [2024-10-07 11:28:54.862161] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.008 [2024-10-07 11:28:54.872036] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.008 [2024-10-07 11:28:54.872230] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.008 [2024-10-07 11:28:54.872265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.008 [2024-10-07 11:28:54.872283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.008 [2024-10-07 11:28:54.872318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.008 [2024-10-07 11:28:54.872349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.008 [2024-10-07 11:28:54.872367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.008 [2024-10-07 11:28:54.872440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.008 [2024-10-07 11:28:54.872476] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.008 [2024-10-07 11:28:54.883337] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.008 [2024-10-07 11:28:54.883515] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.008 [2024-10-07 11:28:54.883551] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.008 [2024-10-07 11:28:54.883569] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.008 [2024-10-07 11:28:54.883603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.008 [2024-10-07 11:28:54.883634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.008 [2024-10-07 11:28:54.883651] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.008 [2024-10-07 11:28:54.883666] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.008 [2024-10-07 11:28:54.884680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.008 [2024-10-07 11:28:54.893481] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.008 [2024-10-07 11:28:54.893647] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.008 [2024-10-07 11:28:54.893682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.008 [2024-10-07 11:28:54.893699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.008 [2024-10-07 11:28:54.893758] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.008 [2024-10-07 11:28:54.893792] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.008 [2024-10-07 11:28:54.893809] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.008 [2024-10-07 11:28:54.893825] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.008 [2024-10-07 11:28:54.893855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.008 [2024-10-07 11:28:54.904164] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.008 [2024-10-07 11:28:54.904336] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.008 [2024-10-07 11:28:54.904372] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.008 [2024-10-07 11:28:54.904391] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.008 [2024-10-07 11:28:54.904445] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.008 [2024-10-07 11:28:54.904477] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.008 [2024-10-07 11:28:54.904494] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.008 [2024-10-07 11:28:54.904511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.008 [2024-10-07 11:28:54.904541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.008 [2024-10-07 11:28:54.914299] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.008 [2024-10-07 11:28:54.914530] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.008 [2024-10-07 11:28:54.914568] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.008 [2024-10-07 11:28:54.914593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.008 [2024-10-07 11:28:54.914630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.008 [2024-10-07 11:28:54.914661] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.008 [2024-10-07 11:28:54.914678] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.008 [2024-10-07 11:28:54.914692] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.008 [2024-10-07 11:28:54.914724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.008 [2024-10-07 11:28:54.925037] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.008 [2024-10-07 11:28:54.925226] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.008 [2024-10-07 11:28:54.925262] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.008 [2024-10-07 11:28:54.925281] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.008 [2024-10-07 11:28:54.925495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.008 [2024-10-07 11:28:54.925652] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.008 [2024-10-07 11:28:54.925685] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.008 [2024-10-07 11:28:54.925703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.008 [2024-10-07 11:28:54.925758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.008 [2024-10-07 11:28:54.935652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.008 [2024-10-07 11:28:54.935841] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.008 [2024-10-07 11:28:54.935877] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.009 [2024-10-07 11:28:54.935896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.009 [2024-10-07 11:28:54.936921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.009 [2024-10-07 11:28:54.937172] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.009 [2024-10-07 11:28:54.937201] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.009 [2024-10-07 11:28:54.937217] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.009 [2024-10-07 11:28:54.937277] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.009 [2024-10-07 11:28:54.945827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.009 [2024-10-07 11:28:54.946009] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.009 [2024-10-07 11:28:54.946044] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.009 [2024-10-07 11:28:54.946062] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.009 [2024-10-07 11:28:54.946096] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.009 [2024-10-07 11:28:54.946162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.009 [2024-10-07 11:28:54.946181] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.009 [2024-10-07 11:28:54.946196] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.009 [2024-10-07 11:28:54.946226] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.009 [2024-10-07 11:28:54.956199] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.009 [2024-10-07 11:28:54.956387] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.009 [2024-10-07 11:28:54.956439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.009 [2024-10-07 11:28:54.956458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.009 [2024-10-07 11:28:54.956494] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.009 [2024-10-07 11:28:54.956525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.009 [2024-10-07 11:28:54.956542] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.009 [2024-10-07 11:28:54.956557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.009 [2024-10-07 11:28:54.956587] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.009 [2024-10-07 11:28:54.966349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.009 [2024-10-07 11:28:54.966569] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.009 [2024-10-07 11:28:54.966608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.009 [2024-10-07 11:28:54.966628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.009 [2024-10-07 11:28:54.967575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.009 [2024-10-07 11:28:54.967815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.009 [2024-10-07 11:28:54.967843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.009 [2024-10-07 11:28:54.967859] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.009 [2024-10-07 11:28:54.967939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.009 [2024-10-07 11:28:54.976512] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.009 [2024-10-07 11:28:54.976692] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.009 [2024-10-07 11:28:54.976726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.009 [2024-10-07 11:28:54.976744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.009 [2024-10-07 11:28:54.976778] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.009 [2024-10-07 11:28:54.976809] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.009 [2024-10-07 11:28:54.976826] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.009 [2024-10-07 11:28:54.976842] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.009 [2024-10-07 11:28:54.976905] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.009 [2024-10-07 11:28:54.986693] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.009 [2024-10-07 11:28:54.986884] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.009 [2024-10-07 11:28:54.986920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.009 [2024-10-07 11:28:54.986940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.009 [2024-10-07 11:28:54.987965] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.009 [2024-10-07 11:28:54.988199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.009 [2024-10-07 11:28:54.988235] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.009 [2024-10-07 11:28:54.988255] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.009 [2024-10-07 11:28:54.988316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.009 [2024-10-07 11:28:54.996842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.009 [2024-10-07 11:28:54.997019] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.009 [2024-10-07 11:28:54.997068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.009 [2024-10-07 11:28:54.997090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.009 [2024-10-07 11:28:54.997143] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.009 [2024-10-07 11:28:54.997178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.009 [2024-10-07 11:28:54.997195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.009 [2024-10-07 11:28:54.997210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.009 [2024-10-07 11:28:54.997241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.009 [2024-10-07 11:28:55.006980] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.009 [2024-10-07 11:28:55.007161] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.009 [2024-10-07 11:28:55.007196] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.009 [2024-10-07 11:28:55.007214] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.009 [2024-10-07 11:28:55.008246] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.009 [2024-10-07 11:28:55.008480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.009 [2024-10-07 11:28:55.008515] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.009 [2024-10-07 11:28:55.008534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.009 [2024-10-07 11:28:55.008605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.009 [2024-10-07 11:28:55.017129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.009 [2024-10-07 11:28:55.017327] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.009 [2024-10-07 11:28:55.017364] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.009 [2024-10-07 11:28:55.017436] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.009 [2024-10-07 11:28:55.017475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.009 [2024-10-07 11:28:55.017507] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.009 [2024-10-07 11:28:55.017524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.009 [2024-10-07 11:28:55.017539] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.009 [2024-10-07 11:28:55.017569] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.009 [2024-10-07 11:28:55.027289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.009 [2024-10-07 11:28:55.027495] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.009 [2024-10-07 11:28:55.027531] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.009 [2024-10-07 11:28:55.027549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.009 [2024-10-07 11:28:55.027584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.009 [2024-10-07 11:28:55.027615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.009 [2024-10-07 11:28:55.027633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.009 [2024-10-07 11:28:55.027648] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.009 [2024-10-07 11:28:55.028853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.009 [2024-10-07 11:28:55.037632] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.009 [2024-10-07 11:28:55.037818] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.009 [2024-10-07 11:28:55.037854] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.009 [2024-10-07 11:28:55.037871] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.009 [2024-10-07 11:28:55.037906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.009 [2024-10-07 11:28:55.037937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.009 [2024-10-07 11:28:55.037954] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.009 [2024-10-07 11:28:55.037969] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.009 [2024-10-07 11:28:55.037999] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.009 [2024-10-07 11:28:55.048624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.010 [2024-10-07 11:28:55.048811] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.010 [2024-10-07 11:28:55.048847] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.010 [2024-10-07 11:28:55.048865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.010 [2024-10-07 11:28:55.048899] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.010 [2024-10-07 11:28:55.048961] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.010 [2024-10-07 11:28:55.048981] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.010 [2024-10-07 11:28:55.048996] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.010 [2024-10-07 11:28:55.049026] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.010 [2024-10-07 11:28:55.059708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.010 [2024-10-07 11:28:55.059898] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.010 [2024-10-07 11:28:55.059935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.010 [2024-10-07 11:28:55.059953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.010 [2024-10-07 11:28:55.060979] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.010 [2024-10-07 11:28:55.061231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.010 [2024-10-07 11:28:55.061270] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.010 [2024-10-07 11:28:55.061289] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.010 [2024-10-07 11:28:55.061351] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.010 [2024-10-07 11:28:55.069855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.010 [2024-10-07 11:28:55.070049] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.010 [2024-10-07 11:28:55.070086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.010 [2024-10-07 11:28:55.070104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.010 [2024-10-07 11:28:55.070374] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.010 [2024-10-07 11:28:55.070482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.010 [2024-10-07 11:28:55.070517] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.010 [2024-10-07 11:28:55.070542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.010 [2024-10-07 11:28:55.070577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.010 [2024-10-07 11:28:55.079986] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.010 [2024-10-07 11:28:55.080156] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.010 [2024-10-07 11:28:55.080190] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.010 [2024-10-07 11:28:55.080209] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.010 [2024-10-07 11:28:55.080242] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.010 [2024-10-07 11:28:55.080284] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.010 [2024-10-07 11:28:55.080300] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.010 [2024-10-07 11:28:55.080315] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.010 [2024-10-07 11:28:55.080345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.010 [2024-10-07 11:28:55.090114] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.010 [2024-10-07 11:28:55.090290] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.010 [2024-10-07 11:28:55.090326] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.010 [2024-10-07 11:28:55.090344] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.010 [2024-10-07 11:28:55.090378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.010 [2024-10-07 11:28:55.090426] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.010 [2024-10-07 11:28:55.090447] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.010 [2024-10-07 11:28:55.090477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.010 [2024-10-07 11:28:55.090524] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.010 8238.33 IOPS, 32.18 MiB/s [2024-10-07T11:29:07.721Z] [2024-10-07 11:28:55.101077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.010 [2024-10-07 11:28:55.101248] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.010 [2024-10-07 11:28:55.101284] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.010 [2024-10-07 11:28:55.101302] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.010 [2024-10-07 11:28:55.101336] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.010 [2024-10-07 11:28:55.101367] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.010 [2024-10-07 11:28:55.101384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.010 [2024-10-07 11:28:55.101415] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.010 [2024-10-07 11:28:55.101450] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.010 [2024-10-07 11:28:55.112041] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.010 [2024-10-07 11:28:55.112279] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.010 [2024-10-07 11:28:55.112316] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.010 [2024-10-07 11:28:55.112334] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.010 [2024-10-07 11:28:55.112370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.010 [2024-10-07 11:28:55.112417] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.010 [2024-10-07 11:28:55.112439] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.010 [2024-10-07 11:28:55.112454] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.010 [2024-10-07 11:28:55.112486] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.010 [2024-10-07 11:28:55.123580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.010 [2024-10-07 11:28:55.123778] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.010 [2024-10-07 11:28:55.123814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.010 [2024-10-07 11:28:55.123865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.010 [2024-10-07 11:28:55.123902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.010 [2024-10-07 11:28:55.123936] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.010 [2024-10-07 11:28:55.123963] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.010 [2024-10-07 11:28:55.123979] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.010 [2024-10-07 11:28:55.124011] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.010 [2024-10-07 11:28:55.134417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.010 [2024-10-07 11:28:55.134633] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.010 [2024-10-07 11:28:55.134671] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.010 [2024-10-07 11:28:55.134690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.010 [2024-10-07 11:28:55.134724] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.010 [2024-10-07 11:28:55.134756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.010 [2024-10-07 11:28:55.134774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.010 [2024-10-07 11:28:55.134789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.010 [2024-10-07 11:28:55.134819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.010 [2024-10-07 11:28:55.144592] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.010 [2024-10-07 11:28:55.144783] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.010 [2024-10-07 11:28:55.144817] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.010 [2024-10-07 11:28:55.144836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.010 [2024-10-07 11:28:55.144871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.010 [2024-10-07 11:28:55.144915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.010 [2024-10-07 11:28:55.144933] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.010 [2024-10-07 11:28:55.144949] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.010 [2024-10-07 11:28:55.144978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.010 [2024-10-07 11:28:55.155980] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.010 [2024-10-07 11:28:55.156177] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.010 [2024-10-07 11:28:55.156214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.010 [2024-10-07 11:28:55.156232] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.010 [2024-10-07 11:28:55.156267] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.010 [2024-10-07 11:28:55.156298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.010 [2024-10-07 11:28:55.156348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.011 [2024-10-07 11:28:55.156366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.011 [2024-10-07 11:28:55.156398] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.011 [2024-10-07 11:28:55.166135] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.011 [2024-10-07 11:28:55.166330] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.011 [2024-10-07 11:28:55.166367] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.011 [2024-10-07 11:28:55.166385] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.011 [2024-10-07 11:28:55.166438] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.011 [2024-10-07 11:28:55.166473] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.011 [2024-10-07 11:28:55.166491] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.011 [2024-10-07 11:28:55.166506] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.011 [2024-10-07 11:28:55.166536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.011 [2024-10-07 11:28:55.177759] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.011 [2024-10-07 11:28:55.177979] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.011 [2024-10-07 11:28:55.178016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.011 [2024-10-07 11:28:55.178035] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.011 [2024-10-07 11:28:55.178070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.011 [2024-10-07 11:28:55.178102] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.011 [2024-10-07 11:28:55.178119] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.011 [2024-10-07 11:28:55.178135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.011 [2024-10-07 11:28:55.178170] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.011 [2024-10-07 11:28:55.187915] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.011 [2024-10-07 11:28:55.188094] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.011 [2024-10-07 11:28:55.188129] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.011 [2024-10-07 11:28:55.188147] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.011 [2024-10-07 11:28:55.189200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.011 [2024-10-07 11:28:55.189441] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.011 [2024-10-07 11:28:55.189476] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.011 [2024-10-07 11:28:55.189501] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.011 [2024-10-07 11:28:55.189615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.011 [2024-10-07 11:28:55.198981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.011 [2024-10-07 11:28:55.199159] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.011 [2024-10-07 11:28:55.199195] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.011 [2024-10-07 11:28:55.199214] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.011 [2024-10-07 11:28:55.200320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.011 [2024-10-07 11:28:55.200576] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.011 [2024-10-07 11:28:55.200616] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.011 [2024-10-07 11:28:55.200635] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.011 [2024-10-07 11:28:55.201703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.011 [2024-10-07 11:28:55.209125] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.011 [2024-10-07 11:28:55.209311] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.011 [2024-10-07 11:28:55.209347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.011 [2024-10-07 11:28:55.209365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.011 [2024-10-07 11:28:55.209414] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.011 [2024-10-07 11:28:55.209450] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.011 [2024-10-07 11:28:55.209468] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.011 [2024-10-07 11:28:55.209483] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.011 [2024-10-07 11:28:55.209514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.011 [2024-10-07 11:28:55.220430] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.011 [2024-10-07 11:28:55.220652] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.011 [2024-10-07 11:28:55.220690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.011 [2024-10-07 11:28:55.220708] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.011 [2024-10-07 11:28:55.220743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.011 [2024-10-07 11:28:55.220775] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.011 [2024-10-07 11:28:55.220792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.011 [2024-10-07 11:28:55.220808] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.011 [2024-10-07 11:28:55.220839] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.011 [2024-10-07 11:28:55.230601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.011 [2024-10-07 11:28:55.231784] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.011 [2024-10-07 11:28:55.231835] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.011 [2024-10-07 11:28:55.231857] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.011 [2024-10-07 11:28:55.232089] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.011 [2024-10-07 11:28:55.232219] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.011 [2024-10-07 11:28:55.232248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.011 [2024-10-07 11:28:55.232267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.011 [2024-10-07 11:28:55.233510] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.011 [2024-10-07 11:28:55.241686] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.011 [2024-10-07 11:28:55.241869] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.011 [2024-10-07 11:28:55.241905] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.011 [2024-10-07 11:28:55.241923] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.011 [2024-10-07 11:28:55.243034] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.011 [2024-10-07 11:28:55.243272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.011 [2024-10-07 11:28:55.243307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.011 [2024-10-07 11:28:55.243326] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.011 [2024-10-07 11:28:55.244342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.011 [2024-10-07 11:28:55.251824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.011 [2024-10-07 11:28:55.252009] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.011 [2024-10-07 11:28:55.252045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.011 [2024-10-07 11:28:55.252063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.011 [2024-10-07 11:28:55.252097] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.011 [2024-10-07 11:28:55.252128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.011 [2024-10-07 11:28:55.252145] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.011 [2024-10-07 11:28:55.252162] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.011 [2024-10-07 11:28:55.252203] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.011 [2024-10-07 11:28:55.263268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.011 [2024-10-07 11:28:55.263481] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.012 [2024-10-07 11:28:55.263518] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.012 [2024-10-07 11:28:55.263537] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.012 [2024-10-07 11:28:55.263573] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.012 [2024-10-07 11:28:55.263604] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.012 [2024-10-07 11:28:55.263623] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.012 [2024-10-07 11:28:55.263671] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.012 [2024-10-07 11:28:55.263705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.012 [2024-10-07 11:28:55.273438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.012 [2024-10-07 11:28:55.274644] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.012 [2024-10-07 11:28:55.274692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.012 [2024-10-07 11:28:55.274714] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.012 [2024-10-07 11:28:55.274915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.012 [2024-10-07 11:28:55.275034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.012 [2024-10-07 11:28:55.275074] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.012 [2024-10-07 11:28:55.275092] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.012 [2024-10-07 11:28:55.276295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.012 [2024-10-07 11:28:55.284418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.012 [2024-10-07 11:28:55.284627] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.012 [2024-10-07 11:28:55.284664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.012 [2024-10-07 11:28:55.284683] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.012 [2024-10-07 11:28:55.285815] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.012 [2024-10-07 11:28:55.286048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.012 [2024-10-07 11:28:55.286084] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.012 [2024-10-07 11:28:55.286104] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.012 [2024-10-07 11:28:55.287135] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.012 [2024-10-07 11:28:55.294591] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.012 [2024-10-07 11:28:55.294772] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.012 [2024-10-07 11:28:55.294807] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.012 [2024-10-07 11:28:55.294825] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.012 [2024-10-07 11:28:55.294859] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.012 [2024-10-07 11:28:55.294890] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.012 [2024-10-07 11:28:55.294907] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.012 [2024-10-07 11:28:55.294933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.012 [2024-10-07 11:28:55.294965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.012 [2024-10-07 11:28:55.305983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.012 [2024-10-07 11:28:55.306209] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.012 [2024-10-07 11:28:55.306250] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.012 [2024-10-07 11:28:55.306269] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.012 [2024-10-07 11:28:55.306303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.012 [2024-10-07 11:28:55.306334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.012 [2024-10-07 11:28:55.306351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.012 [2024-10-07 11:28:55.306367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.012 [2024-10-07 11:28:55.306415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.012 [2024-10-07 11:28:55.316171] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.012 [2024-10-07 11:28:55.317392] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.012 [2024-10-07 11:28:55.317455] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.012 [2024-10-07 11:28:55.317477] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.012 [2024-10-07 11:28:55.317682] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.012 [2024-10-07 11:28:55.317804] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.012 [2024-10-07 11:28:55.317831] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.012 [2024-10-07 11:28:55.317849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.012 [2024-10-07 11:28:55.319059] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.012 [2024-10-07 11:28:55.327230] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.012 [2024-10-07 11:28:55.327452] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.012 [2024-10-07 11:28:55.327490] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.012 [2024-10-07 11:28:55.327508] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.012 [2024-10-07 11:28:55.328639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.012 [2024-10-07 11:28:55.328878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.012 [2024-10-07 11:28:55.328906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.012 [2024-10-07 11:28:55.328923] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.012 [2024-10-07 11:28:55.329962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.012 [2024-10-07 11:28:55.337395] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.012 [2024-10-07 11:28:55.337610] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.012 [2024-10-07 11:28:55.337647] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.012 [2024-10-07 11:28:55.337666] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.012 [2024-10-07 11:28:55.337701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.012 [2024-10-07 11:28:55.337761] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.012 [2024-10-07 11:28:55.337778] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.012 [2024-10-07 11:28:55.337795] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.012 [2024-10-07 11:28:55.337826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.012 [2024-10-07 11:28:55.348798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.012 [2024-10-07 11:28:55.349000] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.012 [2024-10-07 11:28:55.349036] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.012 [2024-10-07 11:28:55.349069] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.012 [2024-10-07 11:28:55.349110] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.012 [2024-10-07 11:28:55.349142] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.012 [2024-10-07 11:28:55.349159] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.012 [2024-10-07 11:28:55.349175] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.012 [2024-10-07 11:28:55.349206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.012 [2024-10-07 11:28:55.359953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.012 [2024-10-07 11:28:55.360315] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.012 [2024-10-07 11:28:55.360355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.012 [2024-10-07 11:28:55.360374] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.012 [2024-10-07 11:28:55.360530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.012 [2024-10-07 11:28:55.361772] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.012 [2024-10-07 11:28:55.361809] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.012 [2024-10-07 11:28:55.361830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.012 [2024-10-07 11:28:55.363000] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.012 [2024-10-07 11:28:55.371380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.012 [2024-10-07 11:28:55.372589] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.012 [2024-10-07 11:28:55.372638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.012 [2024-10-07 11:28:55.372660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.012 [2024-10-07 11:28:55.372910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.012 [2024-10-07 11:28:55.372951] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.012 [2024-10-07 11:28:55.372969] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.012 [2024-10-07 11:28:55.372986] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.012 [2024-10-07 11:28:55.373051] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.013 [2024-10-07 11:28:55.382343] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.013 [2024-10-07 11:28:55.382585] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.013 [2024-10-07 11:28:55.382623] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.013 [2024-10-07 11:28:55.382642] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.013 [2024-10-07 11:28:55.382676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.013 [2024-10-07 11:28:55.382725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.013 [2024-10-07 11:28:55.382745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.013 [2024-10-07 11:28:55.382761] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.013 [2024-10-07 11:28:55.382793] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.013 [2024-10-07 11:28:55.393478] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.013 [2024-10-07 11:28:55.393909] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.013 [2024-10-07 11:28:55.393957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.013 [2024-10-07 11:28:55.393979] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.013 [2024-10-07 11:28:55.394053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.013 [2024-10-07 11:28:55.394090] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.013 [2024-10-07 11:28:55.394108] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.013 [2024-10-07 11:28:55.394125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.013 [2024-10-07 11:28:55.394156] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.013 [2024-10-07 11:28:55.405592] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.013 [2024-10-07 11:28:55.405808] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.013 [2024-10-07 11:28:55.405845] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.013 [2024-10-07 11:28:55.405863] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.013 [2024-10-07 11:28:55.405899] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.013 [2024-10-07 11:28:55.405931] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.013 [2024-10-07 11:28:55.405948] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.013 [2024-10-07 11:28:55.405963] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.013 [2024-10-07 11:28:55.405994] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.013 [2024-10-07 11:28:55.415746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.013 [2024-10-07 11:28:55.416958] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.013 [2024-10-07 11:28:55.417041] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.013 [2024-10-07 11:28:55.417082] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.013 [2024-10-07 11:28:55.417308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.013 [2024-10-07 11:28:55.417446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.013 [2024-10-07 11:28:55.417469] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.013 [2024-10-07 11:28:55.417486] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.013 [2024-10-07 11:28:55.418696] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.013 [2024-10-07 11:28:55.426834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.013 [2024-10-07 11:28:55.427033] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.013 [2024-10-07 11:28:55.427069] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.013 [2024-10-07 11:28:55.427087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.013 [2024-10-07 11:28:55.428208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.013 [2024-10-07 11:28:55.428458] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.013 [2024-10-07 11:28:55.428497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.013 [2024-10-07 11:28:55.428522] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.013 [2024-10-07 11:28:55.429570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.013 [2024-10-07 11:28:55.436992] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.013 [2024-10-07 11:28:55.437241] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.013 [2024-10-07 11:28:55.437299] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.013 [2024-10-07 11:28:55.437335] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.013 [2024-10-07 11:28:55.437382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.013 [2024-10-07 11:28:55.437460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.013 [2024-10-07 11:28:55.437492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.013 [2024-10-07 11:28:55.437521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.013 [2024-10-07 11:28:55.437574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.013 [2024-10-07 11:28:55.448588] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.013 [2024-10-07 11:28:55.448814] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.013 [2024-10-07 11:28:55.448851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.013 [2024-10-07 11:28:55.448870] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.013 [2024-10-07 11:28:55.448907] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.013 [2024-10-07 11:28:55.448967] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.013 [2024-10-07 11:28:55.448986] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.013 [2024-10-07 11:28:55.449002] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.013 [2024-10-07 11:28:55.449033] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.013 [2024-10-07 11:28:55.458750] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.013 [2024-10-07 11:28:55.458944] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.013 [2024-10-07 11:28:55.458980] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.013 [2024-10-07 11:28:55.458998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.013 [2024-10-07 11:28:55.460027] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.013 [2024-10-07 11:28:55.460264] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.013 [2024-10-07 11:28:55.460299] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.013 [2024-10-07 11:28:55.460319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.013 [2024-10-07 11:28:55.460447] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.013 [2024-10-07 11:28:55.469917] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.013 [2024-10-07 11:28:55.470111] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.013 [2024-10-07 11:28:55.470146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.013 [2024-10-07 11:28:55.470165] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.013 [2024-10-07 11:28:55.471274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.013 [2024-10-07 11:28:55.471517] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.013 [2024-10-07 11:28:55.471551] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.013 [2024-10-07 11:28:55.471570] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.013 [2024-10-07 11:28:55.472599] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.013 [2024-10-07 11:28:55.480067] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.013 [2024-10-07 11:28:55.480248] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.013 [2024-10-07 11:28:55.480285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.013 [2024-10-07 11:28:55.480303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.013 [2024-10-07 11:28:55.480338] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.013 [2024-10-07 11:28:55.480369] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.013 [2024-10-07 11:28:55.480386] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.013 [2024-10-07 11:28:55.480415] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.013 [2024-10-07 11:28:55.480453] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.013 [2024-10-07 11:28:55.491555] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.013 [2024-10-07 11:28:55.491760] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.013 [2024-10-07 11:28:55.491796] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.013 [2024-10-07 11:28:55.491815] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.013 [2024-10-07 11:28:55.491850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.013 [2024-10-07 11:28:55.491881] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.014 [2024-10-07 11:28:55.491898] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.014 [2024-10-07 11:28:55.491914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.014 [2024-10-07 11:28:55.491945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.014 [2024-10-07 11:28:55.501722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.014 [2024-10-07 11:28:55.502944] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.014 [2024-10-07 11:28:55.503013] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.014 [2024-10-07 11:28:55.503052] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.014 [2024-10-07 11:28:55.503320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.014 [2024-10-07 11:28:55.503474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.014 [2024-10-07 11:28:55.503502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.014 [2024-10-07 11:28:55.503520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.014 [2024-10-07 11:28:55.504736] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.014 [2024-10-07 11:28:55.512846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.014 [2024-10-07 11:28:55.513021] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.014 [2024-10-07 11:28:55.513069] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.014 [2024-10-07 11:28:55.513090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.014 [2024-10-07 11:28:55.514197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.014 [2024-10-07 11:28:55.514442] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.014 [2024-10-07 11:28:55.514476] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.014 [2024-10-07 11:28:55.514495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.014 [2024-10-07 11:28:55.515510] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.014 [2024-10-07 11:28:55.522976] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.014 [2024-10-07 11:28:55.523128] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.014 [2024-10-07 11:28:55.523162] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.014 [2024-10-07 11:28:55.523210] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.014 [2024-10-07 11:28:55.523246] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.014 [2024-10-07 11:28:55.523277] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.014 [2024-10-07 11:28:55.523294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.014 [2024-10-07 11:28:55.523309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.014 [2024-10-07 11:28:55.523339] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.014 [2024-10-07 11:28:55.534332] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.014 [2024-10-07 11:28:55.534503] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.014 [2024-10-07 11:28:55.534537] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.014 [2024-10-07 11:28:55.534555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.014 [2024-10-07 11:28:55.534589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.014 [2024-10-07 11:28:55.534621] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.014 [2024-10-07 11:28:55.534637] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.014 [2024-10-07 11:28:55.534652] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.014 [2024-10-07 11:28:55.534682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.014 [2024-10-07 11:28:55.544472] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.014 [2024-10-07 11:28:55.545617] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.014 [2024-10-07 11:28:55.545664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.014 [2024-10-07 11:28:55.545685] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.014 [2024-10-07 11:28:55.545895] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.014 [2024-10-07 11:28:55.547160] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.014 [2024-10-07 11:28:55.547199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.014 [2024-10-07 11:28:55.547218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.014 [2024-10-07 11:28:55.548384] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.014 [2024-10-07 11:28:55.555522] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.014 [2024-10-07 11:28:55.555671] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.014 [2024-10-07 11:28:55.555705] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.014 [2024-10-07 11:28:55.555723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.014 [2024-10-07 11:28:55.556833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.014 [2024-10-07 11:28:55.557092] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.014 [2024-10-07 11:28:55.557154] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.014 [2024-10-07 11:28:55.557174] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.014 [2024-10-07 11:28:55.558190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.014 [2024-10-07 11:28:55.565635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.014 [2024-10-07 11:28:55.565777] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.014 [2024-10-07 11:28:55.565811] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.014 [2024-10-07 11:28:55.565838] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.014 [2024-10-07 11:28:55.565871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.014 [2024-10-07 11:28:55.565901] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.014 [2024-10-07 11:28:55.565918] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.014 [2024-10-07 11:28:55.565933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.014 [2024-10-07 11:28:55.565962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.014 [2024-10-07 11:28:55.577164] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.014 [2024-10-07 11:28:55.577369] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.014 [2024-10-07 11:28:55.577420] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.014 [2024-10-07 11:28:55.577442] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.014 [2024-10-07 11:28:55.577490] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.014 [2024-10-07 11:28:55.577533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.014 [2024-10-07 11:28:55.577551] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.014 [2024-10-07 11:28:55.577567] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.014 [2024-10-07 11:28:55.577598] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.014 [2024-10-07 11:28:55.589271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.014 [2024-10-07 11:28:55.590995] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.014 [2024-10-07 11:28:55.591048] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.014 [2024-10-07 11:28:55.591070] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.014 [2024-10-07 11:28:55.592210] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.014 [2024-10-07 11:28:55.592463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.014 [2024-10-07 11:28:55.592500] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.014 [2024-10-07 11:28:55.592520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.014 [2024-10-07 11:28:55.592582] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.014 [2024-10-07 11:28:55.602495] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.014 [2024-10-07 11:28:55.603716] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.014 [2024-10-07 11:28:55.603764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.014 [2024-10-07 11:28:55.603786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.014 [2024-10-07 11:28:55.605262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.014 [2024-10-07 11:28:55.606440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.014 [2024-10-07 11:28:55.606478] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.014 [2024-10-07 11:28:55.606499] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.014 [2024-10-07 11:28:55.606753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.014 [2024-10-07 11:28:55.614255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.014 [2024-10-07 11:28:55.615661] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.014 [2024-10-07 11:28:55.615714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.014 [2024-10-07 11:28:55.615737] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.015 [2024-10-07 11:28:55.616964] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.015 [2024-10-07 11:28:55.617219] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.015 [2024-10-07 11:28:55.617257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.015 [2024-10-07 11:28:55.617277] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.015 [2024-10-07 11:28:55.618312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.015 [2024-10-07 11:28:55.624485] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.015 [2024-10-07 11:28:55.624688] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.015 [2024-10-07 11:28:55.624725] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.015 [2024-10-07 11:28:55.624744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.015 [2024-10-07 11:28:55.624779] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.015 [2024-10-07 11:28:55.624811] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.015 [2024-10-07 11:28:55.624827] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.015 [2024-10-07 11:28:55.624844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.015 [2024-10-07 11:28:55.624874] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.015 [2024-10-07 11:28:55.636002] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.015 [2024-10-07 11:28:55.636312] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.015 [2024-10-07 11:28:55.636349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.015 [2024-10-07 11:28:55.636368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.015 [2024-10-07 11:28:55.636486] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.015 [2024-10-07 11:28:55.636525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.015 [2024-10-07 11:28:55.636543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.015 [2024-10-07 11:28:55.636559] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.015 [2024-10-07 11:28:55.636591] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.015 [2024-10-07 11:28:55.646160] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.015 [2024-10-07 11:28:55.646354] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.015 [2024-10-07 11:28:55.646392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.015 [2024-10-07 11:28:55.646428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.015 [2024-10-07 11:28:55.646466] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.015 [2024-10-07 11:28:55.646497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.015 [2024-10-07 11:28:55.646514] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.015 [2024-10-07 11:28:55.646530] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.015 [2024-10-07 11:28:55.646560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.015 [2024-10-07 11:28:55.656311] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.015 [2024-10-07 11:28:55.656513] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.015 [2024-10-07 11:28:55.656548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.015 [2024-10-07 11:28:55.656567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.015 [2024-10-07 11:28:55.657526] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.015 [2024-10-07 11:28:55.657745] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.015 [2024-10-07 11:28:55.657774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.015 [2024-10-07 11:28:55.657791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.015 [2024-10-07 11:28:55.657870] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.015 [2024-10-07 11:28:55.667161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.015 [2024-10-07 11:28:55.667620] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.015 [2024-10-07 11:28:55.667660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.015 [2024-10-07 11:28:55.667680] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.015 [2024-10-07 11:28:55.667753] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.015 [2024-10-07 11:28:55.667810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.015 [2024-10-07 11:28:55.667830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.015 [2024-10-07 11:28:55.667876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.015 [2024-10-07 11:28:55.667910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.015 [2024-10-07 11:28:55.679311] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.015 [2024-10-07 11:28:55.679650] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.015 [2024-10-07 11:28:55.679699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.015 [2024-10-07 11:28:55.679721] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.015 [2024-10-07 11:28:55.679778] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.015 [2024-10-07 11:28:55.679814] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.015 [2024-10-07 11:28:55.679832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.015 [2024-10-07 11:28:55.679848] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.015 [2024-10-07 11:28:55.679880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.015 [2024-10-07 11:28:55.689818] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.015 [2024-10-07 11:28:55.691031] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.015 [2024-10-07 11:28:55.691081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.015 [2024-10-07 11:28:55.691103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.015 [2024-10-07 11:28:55.691305] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.015 [2024-10-07 11:28:55.691453] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.015 [2024-10-07 11:28:55.691496] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.015 [2024-10-07 11:28:55.691518] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.015 [2024-10-07 11:28:55.692818] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.015 [2024-10-07 11:28:55.700854] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.015 [2024-10-07 11:28:55.701049] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.015 [2024-10-07 11:28:55.701102] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.015 [2024-10-07 11:28:55.701121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.015 [2024-10-07 11:28:55.702254] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.015 [2024-10-07 11:28:55.702509] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.015 [2024-10-07 11:28:55.702547] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.015 [2024-10-07 11:28:55.702567] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.015 [2024-10-07 11:28:55.703611] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.015 [2024-10-07 11:28:55.711011] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.015 [2024-10-07 11:28:55.711204] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.015 [2024-10-07 11:28:55.711270] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.015 [2024-10-07 11:28:55.711291] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.015 [2024-10-07 11:28:55.711328] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.015 [2024-10-07 11:28:55.711359] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.015 [2024-10-07 11:28:55.711377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.015 [2024-10-07 11:28:55.711392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.015 [2024-10-07 11:28:55.711442] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.015 [2024-10-07 11:28:55.723583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.015 [2024-10-07 11:28:55.723891] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.015 [2024-10-07 11:28:55.723935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.015 [2024-10-07 11:28:55.723955] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.015 [2024-10-07 11:28:55.724012] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.015 [2024-10-07 11:28:55.724049] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.015 [2024-10-07 11:28:55.724067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.015 [2024-10-07 11:28:55.724083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.015 [2024-10-07 11:28:55.724116] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.016 [2024-10-07 11:28:55.733734] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.016 [2024-10-07 11:28:55.733920] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.016 [2024-10-07 11:28:55.733955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.016 [2024-10-07 11:28:55.733973] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.016 [2024-10-07 11:28:55.734008] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.016 [2024-10-07 11:28:55.734038] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.016 [2024-10-07 11:28:55.734055] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.016 [2024-10-07 11:28:55.734070] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.016 [2024-10-07 11:28:55.735095] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.016 [2024-10-07 11:28:55.743881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.016 [2024-10-07 11:28:55.744970] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.016 [2024-10-07 11:28:55.745018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.016 [2024-10-07 11:28:55.745039] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.016 [2024-10-07 11:28:55.745252] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.016 [2024-10-07 11:28:55.746446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.016 [2024-10-07 11:28:55.746484] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.016 [2024-10-07 11:28:55.746503] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.016 [2024-10-07 11:28:55.746735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.016 [2024-10-07 11:28:55.754513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.016 [2024-10-07 11:28:55.754933] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.016 [2024-10-07 11:28:55.754980] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.016 [2024-10-07 11:28:55.755002] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.016 [2024-10-07 11:28:55.755075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.016 [2024-10-07 11:28:55.755130] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.016 [2024-10-07 11:28:55.755150] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.016 [2024-10-07 11:28:55.755165] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.016 [2024-10-07 11:28:55.755197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.016 [2024-10-07 11:28:55.766633] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.016 [2024-10-07 11:28:55.766934] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.016 [2024-10-07 11:28:55.766989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.016 [2024-10-07 11:28:55.767010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.016 [2024-10-07 11:28:55.767067] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.016 [2024-10-07 11:28:55.767102] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.016 [2024-10-07 11:28:55.767120] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.016 [2024-10-07 11:28:55.767137] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.016 [2024-10-07 11:28:55.767167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.016 [2024-10-07 11:28:55.776783] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.016 [2024-10-07 11:28:55.776958] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.016 [2024-10-07 11:28:55.776992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.016 [2024-10-07 11:28:55.777010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.016 [2024-10-07 11:28:55.777043] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.016 [2024-10-07 11:28:55.778080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.016 [2024-10-07 11:28:55.778117] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.016 [2024-10-07 11:28:55.778137] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.016 [2024-10-07 11:28:55.778367] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.016 [2024-10-07 11:28:55.786916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.016 [2024-10-07 11:28:55.787983] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.016 [2024-10-07 11:28:55.788030] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.016 [2024-10-07 11:28:55.788051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.016 [2024-10-07 11:28:55.788248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.016 [2024-10-07 11:28:55.788377] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.016 [2024-10-07 11:28:55.788420] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.016 [2024-10-07 11:28:55.788440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.016 [2024-10-07 11:28:55.789551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.016 [2024-10-07 11:28:55.797465] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.016 [2024-10-07 11:28:55.797861] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.016 [2024-10-07 11:28:55.797906] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.016 [2024-10-07 11:28:55.797927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.016 [2024-10-07 11:28:55.797999] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.016 [2024-10-07 11:28:55.798053] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.016 [2024-10-07 11:28:55.798072] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.016 [2024-10-07 11:28:55.798088] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.016 [2024-10-07 11:28:55.798118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.016 [2024-10-07 11:28:55.808745] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.016 [2024-10-07 11:28:55.810073] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.016 [2024-10-07 11:28:55.810121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.016 [2024-10-07 11:28:55.810142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.016 [2024-10-07 11:28:55.810358] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.016 [2024-10-07 11:28:55.810449] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.016 [2024-10-07 11:28:55.810474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.016 [2024-10-07 11:28:55.810490] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.016 [2024-10-07 11:28:55.810523] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.016 [2024-10-07 11:28:55.819950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.016 [2024-10-07 11:28:55.820109] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.016 [2024-10-07 11:28:55.820143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.016 [2024-10-07 11:28:55.820189] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.016 [2024-10-07 11:28:55.820225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.016 [2024-10-07 11:28:55.820256] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.016 [2024-10-07 11:28:55.820273] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.016 [2024-10-07 11:28:55.820288] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.016 [2024-10-07 11:28:55.820319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.016 [2024-10-07 11:28:55.830076] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.016 [2024-10-07 11:28:55.830247] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.016 [2024-10-07 11:28:55.830281] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.016 [2024-10-07 11:28:55.830298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.016 [2024-10-07 11:28:55.831237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.016 [2024-10-07 11:28:55.831473] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.017 [2024-10-07 11:28:55.831502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.017 [2024-10-07 11:28:55.831519] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.017 [2024-10-07 11:28:55.832659] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.017 [2024-10-07 11:28:55.841019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.017 [2024-10-07 11:28:55.841174] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.017 [2024-10-07 11:28:55.841208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.017 [2024-10-07 11:28:55.841226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.017 [2024-10-07 11:28:55.841502] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.017 [2024-10-07 11:28:55.841582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.017 [2024-10-07 11:28:55.841605] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.017 [2024-10-07 11:28:55.841622] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.017 [2024-10-07 11:28:55.841669] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.017 [2024-10-07 11:28:55.853446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.017 [2024-10-07 11:28:55.853748] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.017 [2024-10-07 11:28:55.853790] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.017 [2024-10-07 11:28:55.853810] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.017 [2024-10-07 11:28:55.853850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.017 [2024-10-07 11:28:55.853882] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.017 [2024-10-07 11:28:55.853930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.017 [2024-10-07 11:28:55.853947] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.017 [2024-10-07 11:28:55.854681] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.017 [2024-10-07 11:28:55.863851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.017 [2024-10-07 11:28:55.864046] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.017 [2024-10-07 11:28:55.864083] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.017 [2024-10-07 11:28:55.864101] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.017 [2024-10-07 11:28:55.865170] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.017 [2024-10-07 11:28:55.865425] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.017 [2024-10-07 11:28:55.865464] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.017 [2024-10-07 11:28:55.865495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.017 [2024-10-07 11:28:55.865618] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.017 [2024-10-07 11:28:55.875043] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.017 [2024-10-07 11:28:55.875225] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.017 [2024-10-07 11:28:55.875261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.017 [2024-10-07 11:28:55.875279] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.017 [2024-10-07 11:28:55.876390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.017 [2024-10-07 11:28:55.876676] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.017 [2024-10-07 11:28:55.876717] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.017 [2024-10-07 11:28:55.876736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.017 [2024-10-07 11:28:55.877776] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.017 [2024-10-07 11:28:55.885183] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.017 [2024-10-07 11:28:55.885335] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.017 [2024-10-07 11:28:55.885369] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.017 [2024-10-07 11:28:55.885390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.017 [2024-10-07 11:28:55.885455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.017 [2024-10-07 11:28:55.885489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.017 [2024-10-07 11:28:55.885506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.017 [2024-10-07 11:28:55.885521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.017 [2024-10-07 11:28:55.885551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.017 [2024-10-07 11:28:55.897126] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.017 [2024-10-07 11:28:55.897438] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.017 [2024-10-07 11:28:55.897476] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.017 [2024-10-07 11:28:55.897495] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.017 [2024-10-07 11:28:55.897563] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.017 [2024-10-07 11:28:55.897600] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.017 [2024-10-07 11:28:55.897617] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.017 [2024-10-07 11:28:55.897633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.017 [2024-10-07 11:28:55.897665] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.017 [2024-10-07 11:28:55.908218] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.017 [2024-10-07 11:28:55.908419] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.017 [2024-10-07 11:28:55.908455] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.017 [2024-10-07 11:28:55.908474] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.017 [2024-10-07 11:28:55.908510] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.017 [2024-10-07 11:28:55.908541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.017 [2024-10-07 11:28:55.908557] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.017 [2024-10-07 11:28:55.908573] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.017 [2024-10-07 11:28:55.908603] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.017 [2024-10-07 11:28:55.918474] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.017 [2024-10-07 11:28:55.918650] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.017 [2024-10-07 11:28:55.918684] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.017 [2024-10-07 11:28:55.918703] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.017 [2024-10-07 11:28:55.918737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.017 [2024-10-07 11:28:55.918768] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.017 [2024-10-07 11:28:55.918786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.017 [2024-10-07 11:28:55.918801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.017 [2024-10-07 11:28:55.918831] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.017 [2024-10-07 11:28:55.928628] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.017 [2024-10-07 11:28:55.928826] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.017 [2024-10-07 11:28:55.928864] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.017 [2024-10-07 11:28:55.928915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.017 [2024-10-07 11:28:55.928953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.017 [2024-10-07 11:28:55.928999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.017 [2024-10-07 11:28:55.929022] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.017 [2024-10-07 11:28:55.929038] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.017 [2024-10-07 11:28:55.929087] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.017 [2024-10-07 11:28:55.939838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.017 [2024-10-07 11:28:55.940047] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.017 [2024-10-07 11:28:55.940084] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.017 [2024-10-07 11:28:55.940103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.017 [2024-10-07 11:28:55.940138] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.017 [2024-10-07 11:28:55.940170] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.017 [2024-10-07 11:28:55.940187] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.017 [2024-10-07 11:28:55.940203] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.017 [2024-10-07 11:28:55.940253] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.017 [2024-10-07 11:28:55.950336] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.017 [2024-10-07 11:28:55.950583] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.017 [2024-10-07 11:28:55.950622] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.018 [2024-10-07 11:28:55.950641] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.018 [2024-10-07 11:28:55.950676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.018 [2024-10-07 11:28:55.950707] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.018 [2024-10-07 11:28:55.950724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.018 [2024-10-07 11:28:55.950740] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.018 [2024-10-07 11:28:55.950771] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.018 [2024-10-07 11:28:55.960507] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.018 [2024-10-07 11:28:55.960685] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.018 [2024-10-07 11:28:55.960720] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.018 [2024-10-07 11:28:55.960739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.018 [2024-10-07 11:28:55.961489] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.018 [2024-10-07 11:28:55.962146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.018 [2024-10-07 11:28:55.962209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.018 [2024-10-07 11:28:55.962232] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.018 [2024-10-07 11:28:55.962589] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.018 [2024-10-07 11:28:55.971572] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.018 [2024-10-07 11:28:55.971766] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.018 [2024-10-07 11:28:55.971808] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.018 [2024-10-07 11:28:55.971826] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.018 [2024-10-07 11:28:55.973037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.018 [2024-10-07 11:28:55.974355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.018 [2024-10-07 11:28:55.974414] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.018 [2024-10-07 11:28:55.974438] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.018 [2024-10-07 11:28:55.974701] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.018 [2024-10-07 11:28:55.981718] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.018 [2024-10-07 11:28:55.982978] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.018 [2024-10-07 11:28:55.983027] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.018 [2024-10-07 11:28:55.983049] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.018 [2024-10-07 11:28:55.983268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.018 [2024-10-07 11:28:55.984296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.018 [2024-10-07 11:28:55.984334] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.018 [2024-10-07 11:28:55.984353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.018 [2024-10-07 11:28:55.984633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.018 [2024-10-07 11:28:55.991850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.018 [2024-10-07 11:28:55.992032] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.018 [2024-10-07 11:28:55.992066] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.018 [2024-10-07 11:28:55.992084] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.018 [2024-10-07 11:28:55.992118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.018 [2024-10-07 11:28:55.992149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.018 [2024-10-07 11:28:55.992166] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.018 [2024-10-07 11:28:55.992180] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.018 [2024-10-07 11:28:55.992211] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.018 [2024-10-07 11:28:56.003343] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.018 [2024-10-07 11:28:56.003611] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.018 [2024-10-07 11:28:56.003649] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.018 [2024-10-07 11:28:56.003667] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.018 [2024-10-07 11:28:56.003702] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.018 [2024-10-07 11:28:56.003734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.018 [2024-10-07 11:28:56.003752] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.018 [2024-10-07 11:28:56.003767] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.018 [2024-10-07 11:28:56.003798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.018 [2024-10-07 11:28:56.013547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.018 [2024-10-07 11:28:56.013752] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.018 [2024-10-07 11:28:56.013789] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.018 [2024-10-07 11:28:56.013808] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.018 [2024-10-07 11:28:56.013843] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.018 [2024-10-07 11:28:56.013875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.018 [2024-10-07 11:28:56.013892] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.018 [2024-10-07 11:28:56.013907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.018 [2024-10-07 11:28:56.014942] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.018 [2024-10-07 11:28:56.023700] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.018 [2024-10-07 11:28:56.023881] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.018 [2024-10-07 11:28:56.023916] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.018 [2024-10-07 11:28:56.023934] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.018 [2024-10-07 11:28:56.023969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.018 [2024-10-07 11:28:56.023999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.018 [2024-10-07 11:28:56.024017] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.018 [2024-10-07 11:28:56.024032] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.018 [2024-10-07 11:28:56.024063] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.018 [2024-10-07 11:28:56.034962] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.018 [2024-10-07 11:28:56.035418] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.018 [2024-10-07 11:28:56.035459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.018 [2024-10-07 11:28:56.035478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.018 [2024-10-07 11:28:56.035590] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.018 [2024-10-07 11:28:56.035649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.018 [2024-10-07 11:28:56.035670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.018 [2024-10-07 11:28:56.035686] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.018 [2024-10-07 11:28:56.035726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.018 [2024-10-07 11:28:56.047245] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.018 [2024-10-07 11:28:56.047478] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.018 [2024-10-07 11:28:56.047514] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.018 [2024-10-07 11:28:56.047540] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.018 [2024-10-07 11:28:56.047576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.018 [2024-10-07 11:28:56.047608] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.018 [2024-10-07 11:28:56.047625] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.018 [2024-10-07 11:28:56.047641] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.018 [2024-10-07 11:28:56.047672] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.018 [2024-10-07 11:28:56.057424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.018 [2024-10-07 11:28:56.057626] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.018 [2024-10-07 11:28:56.057663] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.018 [2024-10-07 11:28:56.057681] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.018 [2024-10-07 11:28:56.057716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.018 [2024-10-07 11:28:56.058744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.018 [2024-10-07 11:28:56.058783] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.018 [2024-10-07 11:28:56.058803] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.018 [2024-10-07 11:28:56.059011] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.018 [2024-10-07 11:28:56.067583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.019 [2024-10-07 11:28:56.067775] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.019 [2024-10-07 11:28:56.067811] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.019 [2024-10-07 11:28:56.067829] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.019 [2024-10-07 11:28:56.067862] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.019 [2024-10-07 11:28:56.067893] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.019 [2024-10-07 11:28:56.067910] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.019 [2024-10-07 11:28:56.067958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.019 [2024-10-07 11:28:56.068904] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.019 [2024-10-07 11:28:56.078537] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.019 [2024-10-07 11:28:56.078968] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.019 [2024-10-07 11:28:56.079018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.019 [2024-10-07 11:28:56.079039] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.019 [2024-10-07 11:28:56.079113] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.019 [2024-10-07 11:28:56.079168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.019 [2024-10-07 11:28:56.079188] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.019 [2024-10-07 11:28:56.079204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.019 [2024-10-07 11:28:56.079236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.019 [2024-10-07 11:28:56.090735] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.019 [2024-10-07 11:28:56.090933] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.019 [2024-10-07 11:28:56.090968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.019 [2024-10-07 11:28:56.090987] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.019 [2024-10-07 11:28:56.091022] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.019 [2024-10-07 11:28:56.091055] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.019 [2024-10-07 11:28:56.091072] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.019 [2024-10-07 11:28:56.091087] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.019 [2024-10-07 11:28:56.091118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.019 8349.75 IOPS, 32.62 MiB/s [2024-10-07T11:29:07.730Z] [2024-10-07 11:28:56.103008] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.019 [2024-10-07 11:28:56.103360] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.019 [2024-10-07 11:28:56.103418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.019 [2024-10-07 11:28:56.103441] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.019 [2024-10-07 11:28:56.104642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.019 [2024-10-07 11:28:56.105863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.019 [2024-10-07 11:28:56.105902] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.019 [2024-10-07 11:28:56.105922] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.019 [2024-10-07 11:28:56.106159] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.019 [2024-10-07 11:28:56.113127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.019 [2024-10-07 11:28:56.114481] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.019 [2024-10-07 11:28:56.114533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.019 [2024-10-07 11:28:56.114555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.019 [2024-10-07 11:28:56.114776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.019 [2024-10-07 11:28:56.115858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.019 [2024-10-07 11:28:56.115899] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.019 [2024-10-07 11:28:56.115919] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.019 [2024-10-07 11:28:56.116167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.019 [2024-10-07 11:28:56.123288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.019 [2024-10-07 11:28:56.123427] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.019 [2024-10-07 11:28:56.123460] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.019 [2024-10-07 11:28:56.123478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.019 [2024-10-07 11:28:56.123511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.019 [2024-10-07 11:28:56.123541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.019 [2024-10-07 11:28:56.123557] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.019 [2024-10-07 11:28:56.123571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.019 [2024-10-07 11:28:56.123601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.019 [2024-10-07 11:28:56.134724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.019 [2024-10-07 11:28:56.134949] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.019 [2024-10-07 11:28:56.134986] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.019 [2024-10-07 11:28:56.135004] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.019 [2024-10-07 11:28:56.135040] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.019 [2024-10-07 11:28:56.135072] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.019 [2024-10-07 11:28:56.135089] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.019 [2024-10-07 11:28:56.135105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.019 [2024-10-07 11:28:56.135135] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.019 [2024-10-07 11:28:56.144875] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.019 [2024-10-07 11:28:56.145077] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.019 [2024-10-07 11:28:56.145113] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.019 [2024-10-07 11:28:56.145131] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.019 [2024-10-07 11:28:56.145167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.019 [2024-10-07 11:28:56.145235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.019 [2024-10-07 11:28:56.145253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.019 [2024-10-07 11:28:56.145268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.019 [2024-10-07 11:28:56.145299] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.019 [2024-10-07 11:28:56.155023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.019 [2024-10-07 11:28:56.155211] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.019 [2024-10-07 11:28:56.155246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.019 [2024-10-07 11:28:56.155264] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.019 [2024-10-07 11:28:56.156220] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.019 [2024-10-07 11:28:56.156471] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.019 [2024-10-07 11:28:56.156512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.019 [2024-10-07 11:28:56.156532] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.019 [2024-10-07 11:28:56.156612] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.019 [2024-10-07 11:28:56.165899] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.019 [2024-10-07 11:28:56.166312] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.019 [2024-10-07 11:28:56.166358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.019 [2024-10-07 11:28:56.166379] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.019 [2024-10-07 11:28:56.166470] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.019 [2024-10-07 11:28:56.166510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.019 [2024-10-07 11:28:56.166527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.019 [2024-10-07 11:28:56.166542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.019 [2024-10-07 11:28:56.166572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.019 [2024-10-07 11:28:56.178009] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.019 [2024-10-07 11:28:56.178316] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.019 [2024-10-07 11:28:56.178353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.019 [2024-10-07 11:28:56.178371] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.019 [2024-10-07 11:28:56.178447] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.019 [2024-10-07 11:28:56.178488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.019 [2024-10-07 11:28:56.178506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.020 [2024-10-07 11:28:56.178521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.020 [2024-10-07 11:28:56.178584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.020 [2024-10-07 11:28:56.188159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.020 [2024-10-07 11:28:56.188342] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.020 [2024-10-07 11:28:56.188377] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.020 [2024-10-07 11:28:56.188395] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.020 [2024-10-07 11:28:56.189444] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.020 [2024-10-07 11:28:56.189662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.020 [2024-10-07 11:28:56.189697] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.020 [2024-10-07 11:28:56.189716] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.020 [2024-10-07 11:28:56.189784] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.020 [2024-10-07 11:28:56.199385] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.020 [2024-10-07 11:28:56.199577] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.020 [2024-10-07 11:28:56.199610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.020 [2024-10-07 11:28:56.199628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.020 [2024-10-07 11:28:56.200732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.020 [2024-10-07 11:28:56.200958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.020 [2024-10-07 11:28:56.200985] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.020 [2024-10-07 11:28:56.201000] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.020 [2024-10-07 11:28:56.202023] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.020 [2024-10-07 11:28:56.209535] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.020 [2024-10-07 11:28:56.209707] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.020 [2024-10-07 11:28:56.209743] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.020 [2024-10-07 11:28:56.209761] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.020 [2024-10-07 11:28:56.209795] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.020 [2024-10-07 11:28:56.209826] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.020 [2024-10-07 11:28:56.209842] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.020 [2024-10-07 11:28:56.209858] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.020 [2024-10-07 11:28:56.209887] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.020 [2024-10-07 11:28:56.220973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.020 [2024-10-07 11:28:56.221188] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.020 [2024-10-07 11:28:56.221223] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.020 [2024-10-07 11:28:56.221274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.020 [2024-10-07 11:28:56.221311] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.020 [2024-10-07 11:28:56.221342] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.020 [2024-10-07 11:28:56.221359] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.020 [2024-10-07 11:28:56.221374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.020 [2024-10-07 11:28:56.221420] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.020 [2024-10-07 11:28:56.231127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.020 [2024-10-07 11:28:56.231305] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.020 [2024-10-07 11:28:56.231340] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.020 [2024-10-07 11:28:56.231358] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.020 [2024-10-07 11:28:56.232378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.020 [2024-10-07 11:28:56.232606] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.020 [2024-10-07 11:28:56.232637] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.020 [2024-10-07 11:28:56.232655] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.020 [2024-10-07 11:28:56.233892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.020 [2024-10-07 11:28:56.242314] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.020 [2024-10-07 11:28:56.242503] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.020 [2024-10-07 11:28:56.242538] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.020 [2024-10-07 11:28:56.242556] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.020 [2024-10-07 11:28:56.242599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.020 [2024-10-07 11:28:56.243704] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.020 [2024-10-07 11:28:56.243741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.020 [2024-10-07 11:28:56.243759] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.020 [2024-10-07 11:28:56.243966] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.020 [2024-10-07 11:28:56.252705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.020 [2024-10-07 11:28:56.252887] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.020 [2024-10-07 11:28:56.252921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.020 [2024-10-07 11:28:56.252939] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.020 [2024-10-07 11:28:56.252974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.020 [2024-10-07 11:28:56.253005] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.020 [2024-10-07 11:28:56.253048] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.020 [2024-10-07 11:28:56.253079] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.020 [2024-10-07 11:28:56.253113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.020 [2024-10-07 11:28:56.265338] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.020 [2024-10-07 11:28:56.265676] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.020 [2024-10-07 11:28:56.265725] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.020 [2024-10-07 11:28:56.265747] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.020 [2024-10-07 11:28:56.265807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.020 [2024-10-07 11:28:56.265846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.020 [2024-10-07 11:28:56.265876] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.020 [2024-10-07 11:28:56.265896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.020 [2024-10-07 11:28:56.265931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.020 [2024-10-07 11:28:56.275508] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.020 [2024-10-07 11:28:56.275744] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.020 [2024-10-07 11:28:56.275785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.020 [2024-10-07 11:28:56.275804] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.020 [2024-10-07 11:28:56.275842] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.020 [2024-10-07 11:28:56.275892] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.020 [2024-10-07 11:28:56.275914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.020 [2024-10-07 11:28:56.275930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.020 [2024-10-07 11:28:56.276971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.020 [2024-10-07 11:28:56.285667] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.020 [2024-10-07 11:28:56.285871] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.020 [2024-10-07 11:28:56.285911] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.021 [2024-10-07 11:28:56.285929] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.021 [2024-10-07 11:28:56.285967] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.021 [2024-10-07 11:28:56.286922] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.021 [2024-10-07 11:28:56.286963] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.021 [2024-10-07 11:28:56.286984] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.021 [2024-10-07 11:28:56.287190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.021 [2024-10-07 11:28:56.296604] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.021 [2024-10-07 11:28:56.297030] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.021 [2024-10-07 11:28:56.297094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.021 [2024-10-07 11:28:56.297117] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.021 [2024-10-07 11:28:56.297192] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.021 [2024-10-07 11:28:56.297232] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.021 [2024-10-07 11:28:56.297249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.021 [2024-10-07 11:28:56.297265] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.021 [2024-10-07 11:28:56.297296] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.021 [2024-10-07 11:28:56.308907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.021 [2024-10-07 11:28:56.309219] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.021 [2024-10-07 11:28:56.309267] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.021 [2024-10-07 11:28:56.309289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.021 [2024-10-07 11:28:56.309348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.021 [2024-10-07 11:28:56.309384] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.021 [2024-10-07 11:28:56.309418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.021 [2024-10-07 11:28:56.309436] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.021 [2024-10-07 11:28:56.309469] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.021 [2024-10-07 11:28:56.319052] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.021 [2024-10-07 11:28:56.319232] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.021 [2024-10-07 11:28:56.319266] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.021 [2024-10-07 11:28:56.319285] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.021 [2024-10-07 11:28:56.319318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.021 [2024-10-07 11:28:56.319349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.021 [2024-10-07 11:28:56.319365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.021 [2024-10-07 11:28:56.319380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.021 [2024-10-07 11:28:56.319426] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.021 [2024-10-07 11:28:56.329186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.021 [2024-10-07 11:28:56.329361] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.021 [2024-10-07 11:28:56.329395] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.021 [2024-10-07 11:28:56.329458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.021 [2024-10-07 11:28:56.330394] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.021 [2024-10-07 11:28:56.330627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.021 [2024-10-07 11:28:56.330662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.021 [2024-10-07 11:28:56.330681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.021 [2024-10-07 11:28:56.330761] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.021 [2024-10-07 11:28:56.339952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.021 [2024-10-07 11:28:56.340364] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.021 [2024-10-07 11:28:56.340425] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.021 [2024-10-07 11:28:56.340448] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.021 [2024-10-07 11:28:56.340520] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.021 [2024-10-07 11:28:56.340557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.021 [2024-10-07 11:28:56.340575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.021 [2024-10-07 11:28:56.340590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.021 [2024-10-07 11:28:56.340622] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.021 [2024-10-07 11:28:56.352232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.021 [2024-10-07 11:28:56.352458] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.021 [2024-10-07 11:28:56.352495] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.021 [2024-10-07 11:28:56.352514] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.021 [2024-10-07 11:28:56.352550] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.021 [2024-10-07 11:28:56.352581] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.021 [2024-10-07 11:28:56.352598] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.021 [2024-10-07 11:28:56.352614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.021 [2024-10-07 11:28:56.352645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.021 [2024-10-07 11:28:56.362377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.021 [2024-10-07 11:28:56.362572] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.021 [2024-10-07 11:28:56.362607] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.021 [2024-10-07 11:28:56.362625] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.021 [2024-10-07 11:28:56.363651] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.021 [2024-10-07 11:28:56.363888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.021 [2024-10-07 11:28:56.363955] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.021 [2024-10-07 11:28:56.363976] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.021 [2024-10-07 11:28:56.364092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.021 [2024-10-07 11:28:56.373583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.021 [2024-10-07 11:28:56.373769] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.021 [2024-10-07 11:28:56.373806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.021 [2024-10-07 11:28:56.373824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.021 [2024-10-07 11:28:56.374937] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.021 [2024-10-07 11:28:56.375166] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.021 [2024-10-07 11:28:56.375201] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.021 [2024-10-07 11:28:56.375220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.021 [2024-10-07 11:28:56.376243] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.021 [2024-10-07 11:28:56.383728] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.021 [2024-10-07 11:28:56.383924] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.021 [2024-10-07 11:28:56.383960] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.021 [2024-10-07 11:28:56.383978] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.021 [2024-10-07 11:28:56.384012] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.021 [2024-10-07 11:28:56.384044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.021 [2024-10-07 11:28:56.384060] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.021 [2024-10-07 11:28:56.384075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.021 [2024-10-07 11:28:56.384106] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.021 [2024-10-07 11:28:56.395280] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.021 [2024-10-07 11:28:56.395509] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.021 [2024-10-07 11:28:56.395546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.021 [2024-10-07 11:28:56.395564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.021 [2024-10-07 11:28:56.395598] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.021 [2024-10-07 11:28:56.395630] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.021 [2024-10-07 11:28:56.395647] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.021 [2024-10-07 11:28:56.395662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.021 [2024-10-07 11:28:56.395693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.021 [2024-10-07 11:28:56.405449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.022 [2024-10-07 11:28:56.405676] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.022 [2024-10-07 11:28:56.405714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.022 [2024-10-07 11:28:56.405732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.022 [2024-10-07 11:28:56.406770] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.022 [2024-10-07 11:28:56.407027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.022 [2024-10-07 11:28:56.407063] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.022 [2024-10-07 11:28:56.407083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.022 [2024-10-07 11:28:56.407199] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.022 [2024-10-07 11:28:56.415634] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.022 [2024-10-07 11:28:56.416730] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.022 [2024-10-07 11:28:56.416779] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.022 [2024-10-07 11:28:56.416800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.022 [2024-10-07 11:28:56.417000] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.022 [2024-10-07 11:28:56.417145] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.022 [2024-10-07 11:28:56.417175] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.022 [2024-10-07 11:28:56.417194] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.022 [2024-10-07 11:28:56.418298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.022 [2024-10-07 11:28:56.426249] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.022 [2024-10-07 11:28:56.426687] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.022 [2024-10-07 11:28:56.426735] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.022 [2024-10-07 11:28:56.426755] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.022 [2024-10-07 11:28:56.426828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.022 [2024-10-07 11:28:56.426865] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.022 [2024-10-07 11:28:56.426882] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.022 [2024-10-07 11:28:56.426898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.022 [2024-10-07 11:28:56.426928] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.022 [2024-10-07 11:28:56.438499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.022 [2024-10-07 11:28:56.438709] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.022 [2024-10-07 11:28:56.438746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.022 [2024-10-07 11:28:56.438765] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.022 [2024-10-07 11:28:56.438831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.022 [2024-10-07 11:28:56.438863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.022 [2024-10-07 11:28:56.438880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.022 [2024-10-07 11:28:56.438895] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.022 [2024-10-07 11:28:56.438926] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.022 [2024-10-07 11:28:56.448648] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.022 [2024-10-07 11:28:56.448830] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.022 [2024-10-07 11:28:56.448865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.022 [2024-10-07 11:28:56.448883] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.022 [2024-10-07 11:28:56.449923] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.022 [2024-10-07 11:28:56.450161] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.022 [2024-10-07 11:28:56.450197] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.022 [2024-10-07 11:28:56.450216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.022 [2024-10-07 11:28:56.451475] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.022 [2024-10-07 11:28:56.459878] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.022 [2024-10-07 11:28:56.460061] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.022 [2024-10-07 11:28:56.460096] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.022 [2024-10-07 11:28:56.460115] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.022 [2024-10-07 11:28:56.461239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.022 [2024-10-07 11:28:56.461497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.022 [2024-10-07 11:28:56.461533] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.022 [2024-10-07 11:28:56.461553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.022 [2024-10-07 11:28:56.462568] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.022 [2024-10-07 11:28:56.470026] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.022 [2024-10-07 11:28:56.470240] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.022 [2024-10-07 11:28:56.470278] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.022 [2024-10-07 11:28:56.470297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.022 [2024-10-07 11:28:56.470332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.022 [2024-10-07 11:28:56.470363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.022 [2024-10-07 11:28:56.470380] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.022 [2024-10-07 11:28:56.470436] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.022 [2024-10-07 11:28:56.470471] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.022 [2024-10-07 11:28:56.481937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.022 [2024-10-07 11:28:56.482242] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.022 [2024-10-07 11:28:56.482292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.022 [2024-10-07 11:28:56.482314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.022 [2024-10-07 11:28:56.482372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.022 [2024-10-07 11:28:56.482424] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.022 [2024-10-07 11:28:56.482445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.022 [2024-10-07 11:28:56.482461] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.022 [2024-10-07 11:28:56.482492] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.022 [2024-10-07 11:28:56.493768] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.022 [2024-10-07 11:28:56.495369] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.022 [2024-10-07 11:28:56.495432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.022 [2024-10-07 11:28:56.495456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.022 [2024-10-07 11:28:56.496662] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.022 [2024-10-07 11:28:56.497131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.022 [2024-10-07 11:28:56.497194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.022 [2024-10-07 11:28:56.497226] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.022 [2024-10-07 11:28:56.497481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.022 [2024-10-07 11:28:56.504529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.022 [2024-10-07 11:28:56.505842] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.022 [2024-10-07 11:28:56.505915] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.022 [2024-10-07 11:28:56.505953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.022 [2024-10-07 11:28:56.506244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.022 [2024-10-07 11:28:56.507584] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.022 [2024-10-07 11:28:56.507653] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.022 [2024-10-07 11:28:56.507690] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.022 [2024-10-07 11:28:56.509051] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.022 [2024-10-07 11:28:56.514688] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.022 [2024-10-07 11:28:56.514884] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.022 [2024-10-07 11:28:56.514962] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.022 [2024-10-07 11:28:56.514986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.022 [2024-10-07 11:28:56.515025] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.022 [2024-10-07 11:28:56.515057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.022 [2024-10-07 11:28:56.515075] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.023 [2024-10-07 11:28:56.515090] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.023 [2024-10-07 11:28:56.515121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.023 [2024-10-07 11:28:56.526301] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.023 [2024-10-07 11:28:56.526534] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.023 [2024-10-07 11:28:56.526581] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.023 [2024-10-07 11:28:56.526603] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.023 [2024-10-07 11:28:56.526638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.023 [2024-10-07 11:28:56.526670] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.023 [2024-10-07 11:28:56.526688] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.023 [2024-10-07 11:28:56.526703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.023 [2024-10-07 11:28:56.526734] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.023 [2024-10-07 11:28:56.536464] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.023 [2024-10-07 11:28:56.536650] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.023 [2024-10-07 11:28:56.536686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.023 [2024-10-07 11:28:56.536704] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.023 [2024-10-07 11:28:56.536737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.023 [2024-10-07 11:28:56.536768] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.023 [2024-10-07 11:28:56.536784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.023 [2024-10-07 11:28:56.536799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.023 [2024-10-07 11:28:56.536829] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.023 [2024-10-07 11:28:56.546630] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.023 [2024-10-07 11:28:56.546816] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.023 [2024-10-07 11:28:56.546849] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.023 [2024-10-07 11:28:56.546868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.023 [2024-10-07 11:28:56.546900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.023 [2024-10-07 11:28:56.546965] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.023 [2024-10-07 11:28:56.546983] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.023 [2024-10-07 11:28:56.546999] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.023 [2024-10-07 11:28:56.547029] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.023 [2024-10-07 11:28:56.557788] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.023 [2024-10-07 11:28:56.558199] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.023 [2024-10-07 11:28:56.558247] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.023 [2024-10-07 11:28:56.558268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.023 [2024-10-07 11:28:56.558340] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.023 [2024-10-07 11:28:56.558394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.023 [2024-10-07 11:28:56.558429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.023 [2024-10-07 11:28:56.558446] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.023 [2024-10-07 11:28:56.558479] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.023 [2024-10-07 11:28:56.569874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.023 [2024-10-07 11:28:56.570158] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.023 [2024-10-07 11:28:56.570204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.023 [2024-10-07 11:28:56.570226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.023 [2024-10-07 11:28:56.570282] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.023 [2024-10-07 11:28:56.570318] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.023 [2024-10-07 11:28:56.570336] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.023 [2024-10-07 11:28:56.570352] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.023 [2024-10-07 11:28:56.570383] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.023 [2024-10-07 11:28:56.580006] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.023 [2024-10-07 11:28:56.580174] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.023 [2024-10-07 11:28:56.580209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.023 [2024-10-07 11:28:56.580227] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.023 [2024-10-07 11:28:56.580261] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.023 [2024-10-07 11:28:56.580292] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.023 [2024-10-07 11:28:56.580309] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.023 [2024-10-07 11:28:56.580324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.023 [2024-10-07 11:28:56.581391] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.023 [2024-10-07 11:28:56.590133] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.023 [2024-10-07 11:28:56.591216] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.023 [2024-10-07 11:28:56.591264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.023 [2024-10-07 11:28:56.591285] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.023 [2024-10-07 11:28:56.591502] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.023 [2024-10-07 11:28:56.591588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.023 [2024-10-07 11:28:56.591609] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.023 [2024-10-07 11:28:56.591626] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.023 [2024-10-07 11:28:56.592728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.023 [2024-10-07 11:28:56.600852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.023 [2024-10-07 11:28:56.601296] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.023 [2024-10-07 11:28:56.601345] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.023 [2024-10-07 11:28:56.601366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.023 [2024-10-07 11:28:56.601455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.023 [2024-10-07 11:28:56.601512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.023 [2024-10-07 11:28:56.601534] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.023 [2024-10-07 11:28:56.601550] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.023 [2024-10-07 11:28:56.601582] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.023 [2024-10-07 11:28:56.613547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.023 [2024-10-07 11:28:56.613833] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.023 [2024-10-07 11:28:56.613884] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.023 [2024-10-07 11:28:56.613915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.023 [2024-10-07 11:28:56.614817] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.023 [2024-10-07 11:28:56.615943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.023 [2024-10-07 11:28:56.615988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.023 [2024-10-07 11:28:56.616020] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.023 [2024-10-07 11:28:56.616161] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.023 [2024-10-07 11:28:56.624663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.023 [2024-10-07 11:28:56.624850] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.023 [2024-10-07 11:28:56.624888] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.023 [2024-10-07 11:28:56.624938] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.023 [2024-10-07 11:28:56.626168] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.023 [2024-10-07 11:28:56.627419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.023 [2024-10-07 11:28:56.627460] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.023 [2024-10-07 11:28:56.627480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.023 [2024-10-07 11:28:56.627732] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.023 [2024-10-07 11:28:56.637086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.023 [2024-10-07 11:28:56.637486] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.023 [2024-10-07 11:28:56.637536] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.023 [2024-10-07 11:28:56.637559] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.023 [2024-10-07 11:28:56.637625] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.024 [2024-10-07 11:28:56.637660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.024 [2024-10-07 11:28:56.637678] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.024 [2024-10-07 11:28:56.637693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.024 [2024-10-07 11:28:56.637726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.024 [2024-10-07 11:28:56.647232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.024 [2024-10-07 11:28:56.647442] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.024 [2024-10-07 11:28:56.647478] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.024 [2024-10-07 11:28:56.647498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.024 [2024-10-07 11:28:56.647533] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.024 [2024-10-07 11:28:56.647564] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.024 [2024-10-07 11:28:56.647580] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.024 [2024-10-07 11:28:56.647595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.024 [2024-10-07 11:28:56.647626] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.024 [2024-10-07 11:28:56.658815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.024 [2024-10-07 11:28:56.659049] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.024 [2024-10-07 11:28:56.659087] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.024 [2024-10-07 11:28:56.659106] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.024 [2024-10-07 11:28:56.659142] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.024 [2024-10-07 11:28:56.659174] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.024 [2024-10-07 11:28:56.659223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.024 [2024-10-07 11:28:56.659240] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.024 [2024-10-07 11:28:56.659274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.024 [2024-10-07 11:28:56.670828] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.024 [2024-10-07 11:28:56.671146] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.024 [2024-10-07 11:28:56.671190] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.024 [2024-10-07 11:28:56.671214] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.024 [2024-10-07 11:28:56.671288] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.024 [2024-10-07 11:28:56.671327] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.024 [2024-10-07 11:28:56.671345] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.024 [2024-10-07 11:28:56.671361] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.024 [2024-10-07 11:28:56.671393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.024 [2024-10-07 11:28:56.680984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.024 [2024-10-07 11:28:56.681191] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.024 [2024-10-07 11:28:56.681228] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.024 [2024-10-07 11:28:56.681247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.024 [2024-10-07 11:28:56.681281] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.024 [2024-10-07 11:28:56.681312] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.024 [2024-10-07 11:28:56.681329] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.024 [2024-10-07 11:28:56.681345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.024 [2024-10-07 11:28:56.682371] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.024 [2024-10-07 11:28:56.691141] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.024 [2024-10-07 11:28:56.692228] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.024 [2024-10-07 11:28:56.692276] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.024 [2024-10-07 11:28:56.692298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.024 [2024-10-07 11:28:56.692527] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.024 [2024-10-07 11:28:56.693697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.024 [2024-10-07 11:28:56.693735] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.024 [2024-10-07 11:28:56.693755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.024 [2024-10-07 11:28:56.693963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.024 [2024-10-07 11:28:56.701772] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.024 [2024-10-07 11:28:56.702163] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.024 [2024-10-07 11:28:56.702208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.024 [2024-10-07 11:28:56.702229] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.024 [2024-10-07 11:28:56.702300] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.024 [2024-10-07 11:28:56.702338] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.024 [2024-10-07 11:28:56.702356] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.024 [2024-10-07 11:28:56.702371] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.024 [2024-10-07 11:28:56.702417] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.024 [2024-10-07 11:28:56.713996] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.024 [2024-10-07 11:28:56.714211] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.024 [2024-10-07 11:28:56.714247] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.024 [2024-10-07 11:28:56.714266] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.024 [2024-10-07 11:28:56.714300] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.024 [2024-10-07 11:28:56.714332] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.024 [2024-10-07 11:28:56.714348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.024 [2024-10-07 11:28:56.714364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.024 [2024-10-07 11:28:56.714395] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.024 [2024-10-07 11:28:56.724143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.024 [2024-10-07 11:28:56.724328] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.024 [2024-10-07 11:28:56.724365] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.024 [2024-10-07 11:28:56.724383] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.024 [2024-10-07 11:28:56.725427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.024 [2024-10-07 11:28:56.725646] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.024 [2024-10-07 11:28:56.725681] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.024 [2024-10-07 11:28:56.725701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.024 [2024-10-07 11:28:56.725815] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.024 [2024-10-07 11:28:56.735331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.024 [2024-10-07 11:28:56.735521] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.024 [2024-10-07 11:28:56.735557] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.024 [2024-10-07 11:28:56.735575] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.024 [2024-10-07 11:28:56.736718] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.025 [2024-10-07 11:28:56.736947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.025 [2024-10-07 11:28:56.736980] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.025 [2024-10-07 11:28:56.736998] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.025 [2024-10-07 11:28:56.738024] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.025 [2024-10-07 11:28:56.745485] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.025 [2024-10-07 11:28:56.745675] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.025 [2024-10-07 11:28:56.745710] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.025 [2024-10-07 11:28:56.745728] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.025 [2024-10-07 11:28:56.745761] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.025 [2024-10-07 11:28:56.745792] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.025 [2024-10-07 11:28:56.745809] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.025 [2024-10-07 11:28:56.745825] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.025 [2024-10-07 11:28:56.745855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.025 [2024-10-07 11:28:56.756913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.025 [2024-10-07 11:28:56.757232] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.025 [2024-10-07 11:28:56.757270] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.025 [2024-10-07 11:28:56.757289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.025 [2024-10-07 11:28:56.757346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.025 [2024-10-07 11:28:56.757382] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.025 [2024-10-07 11:28:56.757414] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.025 [2024-10-07 11:28:56.757434] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.025 [2024-10-07 11:28:56.757468] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.025 [2024-10-07 11:28:56.767061] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.025 [2024-10-07 11:28:56.767252] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.025 [2024-10-07 11:28:56.767288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.025 [2024-10-07 11:28:56.767306] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.025 [2024-10-07 11:28:56.767341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.025 [2024-10-07 11:28:56.767371] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.025 [2024-10-07 11:28:56.767388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.025 [2024-10-07 11:28:56.767453] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.025 [2024-10-07 11:28:56.768480] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.025 [2024-10-07 11:28:56.777214] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.025 [2024-10-07 11:28:56.778304] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.025 [2024-10-07 11:28:56.778352] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.025 [2024-10-07 11:28:56.778373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.025 [2024-10-07 11:28:56.778601] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.025 [2024-10-07 11:28:56.779754] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.025 [2024-10-07 11:28:56.779791] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.025 [2024-10-07 11:28:56.779810] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.025 [2024-10-07 11:28:56.780018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.025 [2024-10-07 11:28:56.788616] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.025 [2024-10-07 11:28:56.788771] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.025 [2024-10-07 11:28:56.788806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.025 [2024-10-07 11:28:56.788824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.025 [2024-10-07 11:28:56.788872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.025 [2024-10-07 11:28:56.788906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.025 [2024-10-07 11:28:56.788923] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.025 [2024-10-07 11:28:56.788938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.025 [2024-10-07 11:28:56.788969] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.025 [2024-10-07 11:28:56.800126] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.025 [2024-10-07 11:28:56.800340] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.025 [2024-10-07 11:28:56.800375] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.025 [2024-10-07 11:28:56.800393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.025 [2024-10-07 11:28:56.800448] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.025 [2024-10-07 11:28:56.800480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.025 [2024-10-07 11:28:56.800498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.025 [2024-10-07 11:28:56.800514] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.025 [2024-10-07 11:28:56.800545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.025 [2024-10-07 11:28:56.810984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.025 [2024-10-07 11:28:56.812543] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.025 [2024-10-07 11:28:56.812599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.025 [2024-10-07 11:28:56.812623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.025 [2024-10-07 11:28:56.812865] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.025 [2024-10-07 11:28:56.813037] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.025 [2024-10-07 11:28:56.813082] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.025 [2024-10-07 11:28:56.813100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.025 [2024-10-07 11:28:56.814471] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.025 [2024-10-07 11:28:56.821342] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.025 [2024-10-07 11:28:56.821629] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.025 [2024-10-07 11:28:56.821683] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.025 [2024-10-07 11:28:56.821719] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.025 [2024-10-07 11:28:56.822922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.025 [2024-10-07 11:28:56.823236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.025 [2024-10-07 11:28:56.823303] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.025 [2024-10-07 11:28:56.823335] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.025 [2024-10-07 11:28:56.823511] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.025 [2024-10-07 11:28:56.832650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.025 [2024-10-07 11:28:56.833104] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.025 [2024-10-07 11:28:56.833154] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.025 [2024-10-07 11:28:56.833178] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.025 [2024-10-07 11:28:56.833314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.025 [2024-10-07 11:28:56.833362] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.025 [2024-10-07 11:28:56.833381] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.025 [2024-10-07 11:28:56.833396] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.025 [2024-10-07 11:28:56.833449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.025 [2024-10-07 11:28:56.845360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.025 [2024-10-07 11:28:56.845597] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.025 [2024-10-07 11:28:56.845634] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.025 [2024-10-07 11:28:56.845652] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.025 [2024-10-07 11:28:56.845715] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.025 [2024-10-07 11:28:56.845748] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.025 [2024-10-07 11:28:56.845776] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.025 [2024-10-07 11:28:56.845792] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.025 [2024-10-07 11:28:56.846531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.025 [2024-10-07 11:28:56.855532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.025 [2024-10-07 11:28:56.856713] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.025 [2024-10-07 11:28:56.856763] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.026 [2024-10-07 11:28:56.856785] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.026 [2024-10-07 11:28:56.857050] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.026 [2024-10-07 11:28:56.857199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.026 [2024-10-07 11:28:56.857228] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.026 [2024-10-07 11:28:56.857246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.026 [2024-10-07 11:28:56.858466] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.026 [2024-10-07 11:28:56.867426] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.026 [2024-10-07 11:28:56.868668] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.026 [2024-10-07 11:28:56.868717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.026 [2024-10-07 11:28:56.868739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.026 [2024-10-07 11:28:56.869956] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.026 [2024-10-07 11:28:56.870235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.026 [2024-10-07 11:28:56.870271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.026 [2024-10-07 11:28:56.870290] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.026 [2024-10-07 11:28:56.871412] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.026 [2024-10-07 11:28:56.877618] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.026 [2024-10-07 11:28:56.877902] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.026 [2024-10-07 11:28:56.877956] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.026 [2024-10-07 11:28:56.877988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.026 [2024-10-07 11:28:56.878047] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.026 [2024-10-07 11:28:56.878106] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.026 [2024-10-07 11:28:56.878136] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.026 [2024-10-07 11:28:56.878197] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.026 [2024-10-07 11:28:56.878259] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.026 [2024-10-07 11:28:56.888987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.026 [2024-10-07 11:28:56.889204] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.026 [2024-10-07 11:28:56.889240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.026 [2024-10-07 11:28:56.889259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.026 [2024-10-07 11:28:56.889299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.026 [2024-10-07 11:28:56.889334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.026 [2024-10-07 11:28:56.889351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.026 [2024-10-07 11:28:56.889367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.026 [2024-10-07 11:28:56.889418] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.026 [2024-10-07 11:28:56.900846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.026 [2024-10-07 11:28:56.901268] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.026 [2024-10-07 11:28:56.901315] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.026 [2024-10-07 11:28:56.901337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.026 [2024-10-07 11:28:56.902569] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.026 [2024-10-07 11:28:56.903784] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.026 [2024-10-07 11:28:56.903824] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.026 [2024-10-07 11:28:56.903844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.026 [2024-10-07 11:28:56.904079] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.026 [2024-10-07 11:28:56.911040] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.026 [2024-10-07 11:28:56.911214] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.026 [2024-10-07 11:28:56.911248] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.026 [2024-10-07 11:28:56.911267] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.026 [2024-10-07 11:28:56.912375] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.026 [2024-10-07 11:28:56.912618] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.026 [2024-10-07 11:28:56.912655] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.026 [2024-10-07 11:28:56.912674] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.026 [2024-10-07 11:28:56.913710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.026 [2024-10-07 11:28:56.921182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.026 [2024-10-07 11:28:56.921375] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.026 [2024-10-07 11:28:56.921447] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.026 [2024-10-07 11:28:56.921481] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.026 [2024-10-07 11:28:56.921521] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.026 [2024-10-07 11:28:56.921558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.026 [2024-10-07 11:28:56.921575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.026 [2024-10-07 11:28:56.921591] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.026 [2024-10-07 11:28:56.921626] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.026 [2024-10-07 11:28:56.933257] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.026 [2024-10-07 11:28:56.933481] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.026 [2024-10-07 11:28:56.933524] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.026 [2024-10-07 11:28:56.933545] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.026 [2024-10-07 11:28:56.933587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.026 [2024-10-07 11:28:56.933623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.026 [2024-10-07 11:28:56.933640] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.026 [2024-10-07 11:28:56.933656] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.026 [2024-10-07 11:28:56.933692] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.026 [2024-10-07 11:28:56.943521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.026 [2024-10-07 11:28:56.948706] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.026 [2024-10-07 11:28:56.948763] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.026 [2024-10-07 11:28:56.948786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.026 [2024-10-07 11:28:56.949051] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.026 [2024-10-07 11:28:56.949210] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.026 [2024-10-07 11:28:56.949238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.026 [2024-10-07 11:28:56.949255] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.026 [2024-10-07 11:28:56.950488] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.026 [2024-10-07 11:28:56.958419] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.026 [2024-10-07 11:28:56.958628] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.026 [2024-10-07 11:28:56.958665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.026 [2024-10-07 11:28:56.958683] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.026 [2024-10-07 11:28:56.958722] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.026 [2024-10-07 11:28:56.958849] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.026 [2024-10-07 11:28:56.958874] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.026 [2024-10-07 11:28:56.958889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.026 [2024-10-07 11:28:56.958925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.026 [2024-10-07 11:28:56.968579] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.026 [2024-10-07 11:28:56.968776] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.026 [2024-10-07 11:28:56.968812] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.026 [2024-10-07 11:28:56.968831] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.026 [2024-10-07 11:28:56.968870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.026 [2024-10-07 11:28:56.968942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.026 [2024-10-07 11:28:56.968963] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.026 [2024-10-07 11:28:56.968978] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.026 [2024-10-07 11:28:56.969941] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.026 [2024-10-07 11:28:56.979603] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.027 [2024-10-07 11:28:56.980022] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.027 [2024-10-07 11:28:56.980067] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.027 [2024-10-07 11:28:56.980088] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.027 [2024-10-07 11:28:56.980165] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.027 [2024-10-07 11:28:56.980206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.027 [2024-10-07 11:28:56.980223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.027 [2024-10-07 11:28:56.980238] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.027 [2024-10-07 11:28:56.980273] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.027 [2024-10-07 11:28:56.992306] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.027 [2024-10-07 11:28:56.992550] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.027 [2024-10-07 11:28:56.992588] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.027 [2024-10-07 11:28:56.992606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.027 [2024-10-07 11:28:56.992645] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.027 [2024-10-07 11:28:56.992681] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.027 [2024-10-07 11:28:56.992698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.027 [2024-10-07 11:28:56.992714] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.027 [2024-10-07 11:28:56.993489] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.027 [2024-10-07 11:28:57.003680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.027 [2024-10-07 11:28:57.003893] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.027 [2024-10-07 11:28:57.003931] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.027 [2024-10-07 11:28:57.003951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.027 [2024-10-07 11:28:57.005192] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.027 [2024-10-07 11:28:57.006447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.027 [2024-10-07 11:28:57.006487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.027 [2024-10-07 11:28:57.006507] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.027 [2024-10-07 11:28:57.006726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.027 [2024-10-07 11:28:57.015092] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.027 [2024-10-07 11:28:57.016273] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.027 [2024-10-07 11:28:57.016320] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.027 [2024-10-07 11:28:57.016341] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.027 [2024-10-07 11:28:57.016603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.027 [2024-10-07 11:28:57.016658] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.027 [2024-10-07 11:28:57.016679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.027 [2024-10-07 11:28:57.016695] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.027 [2024-10-07 11:28:57.016733] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.027 [2024-10-07 11:28:57.026212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.027 [2024-10-07 11:28:57.026438] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.027 [2024-10-07 11:28:57.026474] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.027 [2024-10-07 11:28:57.026493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.027 [2024-10-07 11:28:57.026554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.027 [2024-10-07 11:28:57.026593] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.027 [2024-10-07 11:28:57.026610] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.027 [2024-10-07 11:28:57.026625] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.027 [2024-10-07 11:28:57.026661] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.027 [2024-10-07 11:28:57.037439] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.027 [2024-10-07 11:28:57.037850] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.027 [2024-10-07 11:28:57.037895] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.027 [2024-10-07 11:28:57.037945] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.027 [2024-10-07 11:28:57.038028] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.027 [2024-10-07 11:28:57.038071] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.027 [2024-10-07 11:28:57.038090] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.027 [2024-10-07 11:28:57.038105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.027 [2024-10-07 11:28:57.038141] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.027 [2024-10-07 11:28:57.051100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.027 [2024-10-07 11:28:57.052599] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.027 [2024-10-07 11:28:57.052677] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.027 [2024-10-07 11:28:57.052719] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.027 [2024-10-07 11:28:57.053875] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.027 [2024-10-07 11:28:57.054034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.027 [2024-10-07 11:28:57.054069] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.027 [2024-10-07 11:28:57.054090] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.027 [2024-10-07 11:28:57.054134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.027 [2024-10-07 11:28:57.061656] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.027 [2024-10-07 11:28:57.063018] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.027 [2024-10-07 11:28:57.063068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.027 [2024-10-07 11:28:57.063090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.027 [2024-10-07 11:28:57.064273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.027 [2024-10-07 11:28:57.064531] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.027 [2024-10-07 11:28:57.064581] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.027 [2024-10-07 11:28:57.064602] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.027 [2024-10-07 11:28:57.064666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.027 [2024-10-07 11:28:57.072147] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.027 [2024-10-07 11:28:57.073447] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.027 [2024-10-07 11:28:57.073497] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.027 [2024-10-07 11:28:57.073519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.027 [2024-10-07 11:28:57.074719] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.027 [2024-10-07 11:28:57.074977] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.027 [2024-10-07 11:28:57.075043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.027 [2024-10-07 11:28:57.075065] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.027 [2024-10-07 11:28:57.075117] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.027 [2024-10-07 11:28:57.082307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.027 [2024-10-07 11:28:57.082542] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.027 [2024-10-07 11:28:57.082594] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.027 [2024-10-07 11:28:57.082619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.027 [2024-10-07 11:28:57.082662] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.027 [2024-10-07 11:28:57.082698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.027 [2024-10-07 11:28:57.082716] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.027 [2024-10-07 11:28:57.082732] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.027 [2024-10-07 11:28:57.082768] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.027 [2024-10-07 11:28:57.093781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.027 [2024-10-07 11:28:57.093972] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.027 [2024-10-07 11:28:57.094007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.027 [2024-10-07 11:28:57.094026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.027 [2024-10-07 11:28:57.094064] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.027 [2024-10-07 11:28:57.094100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.027 [2024-10-07 11:28:57.094117] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.028 [2024-10-07 11:28:57.094133] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.028 [2024-10-07 11:28:57.094168] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.028 8441.80 IOPS, 32.98 MiB/s [2024-10-07T11:29:07.739Z] [2024-10-07 11:28:57.104017] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.028 [2024-10-07 11:28:57.104190] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.028 [2024-10-07 11:28:57.104227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.028 [2024-10-07 11:28:57.104245] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.028 [2024-10-07 11:28:57.105289] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.028 [2024-10-07 11:28:57.105544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.028 [2024-10-07 11:28:57.105580] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.028 [2024-10-07 11:28:57.105600] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.028 [2024-10-07 11:28:57.105719] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.028 [2024-10-07 11:28:57.114162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.028 [2024-10-07 11:28:57.114330] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.028 [2024-10-07 11:28:57.114365] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.028 [2024-10-07 11:28:57.114384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.028 [2024-10-07 11:28:57.114440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.028 [2024-10-07 11:28:57.114479] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.028 [2024-10-07 11:28:57.114496] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.028 [2024-10-07 11:28:57.114511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.028 [2024-10-07 11:28:57.114546] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.028 [2024-10-07 11:28:57.124366] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.028 [2024-10-07 11:28:57.124566] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.028 [2024-10-07 11:28:57.124601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.028 [2024-10-07 11:28:57.124620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.028 [2024-10-07 11:28:57.124657] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.028 [2024-10-07 11:28:57.124693] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.028 [2024-10-07 11:28:57.124710] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.028 [2024-10-07 11:28:57.124725] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.028 [2024-10-07 11:28:57.124759] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.028 [2024-10-07 11:28:57.134850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.028 [2024-10-07 11:28:57.135034] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.028 [2024-10-07 11:28:57.135070] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.028 [2024-10-07 11:28:57.135088] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.028 [2024-10-07 11:28:57.135125] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.028 [2024-10-07 11:28:57.135160] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.028 [2024-10-07 11:28:57.135177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.028 [2024-10-07 11:28:57.135193] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.028 [2024-10-07 11:28:57.135228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.028 [2024-10-07 11:28:57.145000] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.028 [2024-10-07 11:28:57.145202] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.028 [2024-10-07 11:28:57.145239] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.028 [2024-10-07 11:28:57.145292] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.028 [2024-10-07 11:28:57.145333] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.028 [2024-10-07 11:28:57.146280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.028 [2024-10-07 11:28:57.146320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.028 [2024-10-07 11:28:57.146341] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.028 [2024-10-07 11:28:57.146564] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.028 [2024-10-07 11:28:57.156823] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.028 [2024-10-07 11:28:57.157071] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.028 [2024-10-07 11:28:57.157110] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.028 [2024-10-07 11:28:57.157129] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.028 [2024-10-07 11:28:57.157170] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.028 [2024-10-07 11:28:57.157206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.028 [2024-10-07 11:28:57.157223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.028 [2024-10-07 11:28:57.157239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.028 [2024-10-07 11:28:57.157275] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.028 [2024-10-07 11:28:57.168913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.028 [2024-10-07 11:28:57.169243] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.028 [2024-10-07 11:28:57.169288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.028 [2024-10-07 11:28:57.169308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.028 [2024-10-07 11:28:57.169369] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.028 [2024-10-07 11:28:57.169424] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.028 [2024-10-07 11:28:57.169445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.028 [2024-10-07 11:28:57.169461] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.028 [2024-10-07 11:28:57.169498] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.028 [2024-10-07 11:28:57.179538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.028 [2024-10-07 11:28:57.179730] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.028 [2024-10-07 11:28:57.179777] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.028 [2024-10-07 11:28:57.179796] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.028 [2024-10-07 11:28:57.179834] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.028 [2024-10-07 11:28:57.179869] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.028 [2024-10-07 11:28:57.179886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.028 [2024-10-07 11:28:57.179933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.028 [2024-10-07 11:28:57.179971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.028 [2024-10-07 11:28:57.189848] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.028 [2024-10-07 11:28:57.190087] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.028 [2024-10-07 11:28:57.190127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.028 [2024-10-07 11:28:57.190146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.028 [2024-10-07 11:28:57.191121] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.028 [2024-10-07 11:28:57.191380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.028 [2024-10-07 11:28:57.191432] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.028 [2024-10-07 11:28:57.191474] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.028 [2024-10-07 11:28:57.191601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.028 [2024-10-07 11:28:57.200079] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.028 [2024-10-07 11:28:57.200381] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.028 [2024-10-07 11:28:57.200452] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.029 [2024-10-07 11:28:57.200483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.029 [2024-10-07 11:28:57.200583] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.029 [2024-10-07 11:28:57.200662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.029 [2024-10-07 11:28:57.200704] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.029 [2024-10-07 11:28:57.200736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.029 [2024-10-07 11:28:57.201661] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.029 [2024-10-07 11:28:57.210374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.029 [2024-10-07 11:28:57.211588] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.029 [2024-10-07 11:28:57.211638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.029 [2024-10-07 11:28:57.211660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.029 [2024-10-07 11:28:57.211890] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.029 [2024-10-07 11:28:57.212039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.029 [2024-10-07 11:28:57.212074] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.029 [2024-10-07 11:28:57.212093] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.029 [2024-10-07 11:28:57.213372] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.029 [2024-10-07 11:28:57.220555] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.029 [2024-10-07 11:28:57.220769] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.029 [2024-10-07 11:28:57.220805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.029 [2024-10-07 11:28:57.220824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.029 [2024-10-07 11:28:57.220868] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.029 [2024-10-07 11:28:57.220915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.029 [2024-10-07 11:28:57.220933] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.029 [2024-10-07 11:28:57.220949] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.029 [2024-10-07 11:28:57.220985] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.029 [2024-10-07 11:28:57.231809] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.029 [2024-10-07 11:28:57.232248] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.029 [2024-10-07 11:28:57.232295] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.029 [2024-10-07 11:28:57.232317] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.029 [2024-10-07 11:28:57.232394] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.029 [2024-10-07 11:28:57.232474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.029 [2024-10-07 11:28:57.232496] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.029 [2024-10-07 11:28:57.232512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.029 [2024-10-07 11:28:57.232548] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.029 [2024-10-07 11:28:57.243941] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.029 [2024-10-07 11:28:57.245498] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.029 [2024-10-07 11:28:57.245552] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.029 [2024-10-07 11:28:57.245575] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.029 [2024-10-07 11:28:57.246495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.029 [2024-10-07 11:28:57.247393] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.029 [2024-10-07 11:28:57.247446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.029 [2024-10-07 11:28:57.247467] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.029 [2024-10-07 11:28:57.247586] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.029 [2024-10-07 11:28:57.254350] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.029 [2024-10-07 11:28:57.254529] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.029 [2024-10-07 11:28:57.254565] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.029 [2024-10-07 11:28:57.254583] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.029 [2024-10-07 11:28:57.254657] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.029 [2024-10-07 11:28:57.254694] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.029 [2024-10-07 11:28:57.254710] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.029 [2024-10-07 11:28:57.254725] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.029 [2024-10-07 11:28:57.254760] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.029 [2024-10-07 11:28:57.264622] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.029 [2024-10-07 11:28:57.264806] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.029 [2024-10-07 11:28:57.264842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.029 [2024-10-07 11:28:57.264860] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.029 [2024-10-07 11:28:57.264898] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.029 [2024-10-07 11:28:57.264934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.029 [2024-10-07 11:28:57.264950] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.029 [2024-10-07 11:28:57.264965] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.029 [2024-10-07 11:28:57.264999] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.029 [2024-10-07 11:28:57.276061] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.029 [2024-10-07 11:28:57.276485] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.029 [2024-10-07 11:28:57.276521] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.029 [2024-10-07 11:28:57.276540] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.029 [2024-10-07 11:28:57.276639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.029 [2024-10-07 11:28:57.276681] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.029 [2024-10-07 11:28:57.276699] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.029 [2024-10-07 11:28:57.276714] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.029 [2024-10-07 11:28:57.276750] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.029 [2024-10-07 11:28:57.287082] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:18:26.029 [2024-10-07 11:28:57.287177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.029 [2024-10-07 11:28:57.287198] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:26.029 [2024-10-07 11:28:57.287213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.029 [2024-10-07 11:28:57.287228] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:26.029 [2024-10-07 11:28:57.287241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.029 [2024-10-07 11:28:57.287282] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:26.029 [2024-10-07 11:28:57.287298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.029 [2024-10-07 11:28:57.287311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.029 [2024-10-07 11:28:57.287415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:88608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.029 [2024-10-07 11:28:57.287442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.029 [2024-10-07 11:28:57.287467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:88616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.029 [2024-10-07 11:28:57.287483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.029 [2024-10-07 11:28:57.287500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:88624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.029 [2024-10-07 11:28:57.287514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.029 [2024-10-07 11:28:57.287530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:88632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.029 [2024-10-07 11:28:57.287543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.029 [2024-10-07 11:28:57.287559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:88640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.029 [2024-10-07 11:28:57.287573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.029 [2024-10-07 11:28:57.287589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:88648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.029 [2024-10-07 11:28:57.287603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.029 [2024-10-07 11:28:57.287618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:88656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.029 [2024-10-07 11:28:57.287632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.287648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:88664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.030 [2024-10-07 11:28:57.287662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.287678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:88672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.030 [2024-10-07 11:28:57.287693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.287708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:88680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.030 [2024-10-07 11:28:57.287722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.287738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:88688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.030 [2024-10-07 11:28:57.287752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.287768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:88696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.030 [2024-10-07 11:28:57.287794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.287811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:88704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.030 [2024-10-07 11:28:57.287826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.287842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:89032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.287857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.287873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:89040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.287887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.287903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:89048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.287918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.287934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:89056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.287948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.287964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:89064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.287979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.287996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:89072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:89080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:89088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:89096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:89104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:89112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:89120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:89128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:89136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:89144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:89152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:89160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:89168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:89176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:89184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:88712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.030 [2024-10-07 11:28:57.288491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:88720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.030 [2024-10-07 11:28:57.288521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:88728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.030 [2024-10-07 11:28:57.288551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:88736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.030 [2024-10-07 11:28:57.288589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:88744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.030 [2024-10-07 11:28:57.288620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:88752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.030 [2024-10-07 11:28:57.288650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:88760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.030 [2024-10-07 11:28:57.288680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:88768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.030 [2024-10-07 11:28:57.288711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:89192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:89200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:89208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:89216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:89224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:89232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:89240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.288979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.030 [2024-10-07 11:28:57.288996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:89248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.030 [2024-10-07 11:28:57.289010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:89256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:89264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:89272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:89280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:89288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:89296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:89304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:89312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:89320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:89328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:88776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.031 [2024-10-07 11:28:57.289371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:88784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.031 [2024-10-07 11:28:57.289415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:88792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.031 [2024-10-07 11:28:57.289451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:88800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.031 [2024-10-07 11:28:57.289491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:88808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.031 [2024-10-07 11:28:57.289521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:88816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.031 [2024-10-07 11:28:57.289551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:88824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.031 [2024-10-07 11:28:57.289581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:88832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.031 [2024-10-07 11:28:57.289612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:89336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:89344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:89352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:89360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:89368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:89376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:89384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:89392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:89400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:89408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.031 [2024-10-07 11:28:57.289942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:89416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.031 [2024-10-07 11:28:57.289957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.289974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:89424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.289999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:89432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:89440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:89448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:89456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:89464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:89472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:88840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.032 [2024-10-07 11:28:57.290210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:88848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.032 [2024-10-07 11:28:57.290239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:88856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.032 [2024-10-07 11:28:57.290277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:88864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.032 [2024-10-07 11:28:57.290307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:88872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.032 [2024-10-07 11:28:57.290337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:88880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.032 [2024-10-07 11:28:57.290367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:88888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.032 [2024-10-07 11:28:57.290397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:88896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.032 [2024-10-07 11:28:57.290441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:89480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:89488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:89496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:89504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:89512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:89520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:89528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:89536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:89544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:89552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:89560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:89568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:89576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:89584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:89592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:89600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:89608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.290979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:89616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.290994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.291010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:89624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.032 [2024-10-07 11:28:57.291024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.291041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:88904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.032 [2024-10-07 11:28:57.291061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.291078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:88912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.032 [2024-10-07 11:28:57.291092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.291108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:88920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.032 [2024-10-07 11:28:57.291122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.291147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:88928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.032 [2024-10-07 11:28:57.291161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.291176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:88936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.032 [2024-10-07 11:28:57.291190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.291206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:88944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.032 [2024-10-07 11:28:57.291220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.291236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:88952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.032 [2024-10-07 11:28:57.291249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.032 [2024-10-07 11:28:57.291265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:88960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.033 [2024-10-07 11:28:57.291279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.033 [2024-10-07 11:28:57.291295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:88968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.033 [2024-10-07 11:28:57.291309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.033 [2024-10-07 11:28:57.291325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:88976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.033 [2024-10-07 11:28:57.291339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.033 [2024-10-07 11:28:57.291355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:88984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.033 [2024-10-07 11:28:57.291369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.033 [2024-10-07 11:28:57.291385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:88992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.033 [2024-10-07 11:28:57.291409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.033 [2024-10-07 11:28:57.291427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:89000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.033 [2024-10-07 11:28:57.291442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.033 [2024-10-07 11:28:57.291466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:89008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.033 [2024-10-07 11:28:57.291482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.033 [2024-10-07 11:28:57.291498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:89016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.033 [2024-10-07 11:28:57.291512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.033 [2024-10-07 11:28:57.291586] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.033 [2024-10-07 11:28:57.291603] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.033 [2024-10-07 11:28:57.291615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:89024 len:8 PRP1 0x0 PRP2 0x0 00:18:26.033 [2024-10-07 11:28:57.291629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.033 [2024-10-07 11:28:57.291686] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1490020 was disconnected and freed. reset controller. 00:18:26.033 [2024-10-07 11:28:57.292846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.033 [2024-10-07 11:28:57.292884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.033 [2024-10-07 11:28:57.292913] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.033 [2024-10-07 11:28:57.293168] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.033 [2024-10-07 11:28:57.293200] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.033 [2024-10-07 11:28:57.293217] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.033 [2024-10-07 11:28:57.293430] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.033 [2024-10-07 11:28:57.293460] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.033 [2024-10-07 11:28:57.293477] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.033 [2024-10-07 11:28:57.293495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.033 [2024-10-07 11:28:57.293736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.033 [2024-10-07 11:28:57.293766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.033 [2024-10-07 11:28:57.293781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.033 [2024-10-07 11:28:57.293797] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.033 [2024-10-07 11:28:57.293849] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.033 [2024-10-07 11:28:57.293871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.033 [2024-10-07 11:28:57.293886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.033 [2024-10-07 11:28:57.293900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.033 [2024-10-07 11:28:57.293929] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.033 [2024-10-07 11:28:57.303443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.033 [2024-10-07 11:28:57.303598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.033 [2024-10-07 11:28:57.303736] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.033 [2024-10-07 11:28:57.303772] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.033 [2024-10-07 11:28:57.303791] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.033 [2024-10-07 11:28:57.304976] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.033 [2024-10-07 11:28:57.305023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.033 [2024-10-07 11:28:57.305043] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.033 [2024-10-07 11:28:57.305082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.033 [2024-10-07 11:28:57.305326] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.033 [2024-10-07 11:28:57.305366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.033 [2024-10-07 11:28:57.305385] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.033 [2024-10-07 11:28:57.305413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.033 [2024-10-07 11:28:57.306463] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.033 [2024-10-07 11:28:57.306502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.033 [2024-10-07 11:28:57.306519] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.033 [2024-10-07 11:28:57.306534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.033 [2024-10-07 11:28:57.306820] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.033 [2024-10-07 11:28:57.313631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.033 [2024-10-07 11:28:57.313855] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.033 [2024-10-07 11:28:57.313892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.033 [2024-10-07 11:28:57.313911] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.033 [2024-10-07 11:28:57.313965] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.033 [2024-10-07 11:28:57.314004] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.033 [2024-10-07 11:28:57.314034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.033 [2024-10-07 11:28:57.314050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.033 [2024-10-07 11:28:57.314067] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.033 [2024-10-07 11:28:57.314096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.033 [2024-10-07 11:28:57.314151] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.033 [2024-10-07 11:28:57.314176] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.033 [2024-10-07 11:28:57.314192] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.033 [2024-10-07 11:28:57.314248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.033 [2024-10-07 11:28:57.314280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.033 [2024-10-07 11:28:57.314297] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.033 [2024-10-07 11:28:57.314311] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.033 [2024-10-07 11:28:57.314339] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.033 [2024-10-07 11:28:57.325729] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.033 [2024-10-07 11:28:57.325808] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.034 [2024-10-07 11:28:57.325966] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.034 [2024-10-07 11:28:57.326002] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.034 [2024-10-07 11:28:57.326021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.034 [2024-10-07 11:28:57.326069] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.034 [2024-10-07 11:28:57.326092] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.034 [2024-10-07 11:28:57.326108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.034 [2024-10-07 11:28:57.326142] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.034 [2024-10-07 11:28:57.326164] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.034 [2024-10-07 11:28:57.326190] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.034 [2024-10-07 11:28:57.326207] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.034 [2024-10-07 11:28:57.326222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.034 [2024-10-07 11:28:57.326239] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.034 [2024-10-07 11:28:57.326253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.034 [2024-10-07 11:28:57.326266] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.034 [2024-10-07 11:28:57.326296] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.034 [2024-10-07 11:28:57.326313] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.034 [2024-10-07 11:28:57.335900] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.034 [2024-10-07 11:28:57.336016] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.034 [2024-10-07 11:28:57.336127] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.034 [2024-10-07 11:28:57.336159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.034 [2024-10-07 11:28:57.336176] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.034 [2024-10-07 11:28:57.337265] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.034 [2024-10-07 11:28:57.337307] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.034 [2024-10-07 11:28:57.337327] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.034 [2024-10-07 11:28:57.337372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.034 [2024-10-07 11:28:57.337596] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.034 [2024-10-07 11:28:57.337626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.034 [2024-10-07 11:28:57.337641] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.034 [2024-10-07 11:28:57.337656] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.034 [2024-10-07 11:28:57.337769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.034 [2024-10-07 11:28:57.337789] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.034 [2024-10-07 11:28:57.337802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.034 [2024-10-07 11:28:57.337816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.034 [2024-10-07 11:28:57.339012] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.034 [2024-10-07 11:28:57.346049] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.034 [2024-10-07 11:28:57.346222] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.034 [2024-10-07 11:28:57.346257] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.034 [2024-10-07 11:28:57.346275] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.034 [2024-10-07 11:28:57.347237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.034 [2024-10-07 11:28:57.347479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.034 [2024-10-07 11:28:57.347529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.034 [2024-10-07 11:28:57.347549] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.034 [2024-10-07 11:28:57.347565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.034 [2024-10-07 11:28:57.347677] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.034 [2024-10-07 11:28:57.347755] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.034 [2024-10-07 11:28:57.347783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.034 [2024-10-07 11:28:57.347799] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.034 [2024-10-07 11:28:57.348918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.034 [2024-10-07 11:28:57.350176] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.034 [2024-10-07 11:28:57.350218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.034 [2024-10-07 11:28:57.350238] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.034 [2024-10-07 11:28:57.350482] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.034 [2024-10-07 11:28:57.356907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.034 [2024-10-07 11:28:57.357335] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.034 [2024-10-07 11:28:57.357422] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.034 [2024-10-07 11:28:57.357455] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.034 [2024-10-07 11:28:57.357532] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.034 [2024-10-07 11:28:57.357591] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.034 [2024-10-07 11:28:57.357612] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.034 [2024-10-07 11:28:57.357627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.034 [2024-10-07 11:28:57.357670] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.034 [2024-10-07 11:28:57.357702] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.034 [2024-10-07 11:28:57.357784] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.034 [2024-10-07 11:28:57.357812] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.034 [2024-10-07 11:28:57.357828] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.034 [2024-10-07 11:28:57.357858] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.034 [2024-10-07 11:28:57.357888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.034 [2024-10-07 11:28:57.357904] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.034 [2024-10-07 11:28:57.357917] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.034 [2024-10-07 11:28:57.357945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.034 [2024-10-07 11:28:57.369161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.034 [2024-10-07 11:28:57.369249] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.034 [2024-10-07 11:28:57.369512] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.034 [2024-10-07 11:28:57.369548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.034 [2024-10-07 11:28:57.369566] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.034 [2024-10-07 11:28:57.369615] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.034 [2024-10-07 11:28:57.369637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.034 [2024-10-07 11:28:57.369652] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.034 [2024-10-07 11:28:57.369707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.034 [2024-10-07 11:28:57.369734] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.034 [2024-10-07 11:28:57.369761] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.034 [2024-10-07 11:28:57.369778] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.034 [2024-10-07 11:28:57.369793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.034 [2024-10-07 11:28:57.369811] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.034 [2024-10-07 11:28:57.369848] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.034 [2024-10-07 11:28:57.369863] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.034 [2024-10-07 11:28:57.369894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.034 [2024-10-07 11:28:57.369911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.034 [2024-10-07 11:28:57.379468] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.034 [2024-10-07 11:28:57.379572] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.034 [2024-10-07 11:28:57.379707] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.034 [2024-10-07 11:28:57.379742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.034 [2024-10-07 11:28:57.379760] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.034 [2024-10-07 11:28:57.379807] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.034 [2024-10-07 11:28:57.379829] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.034 [2024-10-07 11:28:57.379845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.035 [2024-10-07 11:28:57.379879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.035 [2024-10-07 11:28:57.379902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.035 [2024-10-07 11:28:57.380924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.035 [2024-10-07 11:28:57.380962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.035 [2024-10-07 11:28:57.380981] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.035 [2024-10-07 11:28:57.380999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.035 [2024-10-07 11:28:57.381012] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.035 [2024-10-07 11:28:57.381026] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.035 [2024-10-07 11:28:57.381262] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.035 [2024-10-07 11:28:57.381288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.035 [2024-10-07 11:28:57.389663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.035 [2024-10-07 11:28:57.389764] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.035 [2024-10-07 11:28:57.389867] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.035 [2024-10-07 11:28:57.389898] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.035 [2024-10-07 11:28:57.389922] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.035 [2024-10-07 11:28:57.391146] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.035 [2024-10-07 11:28:57.391219] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.035 [2024-10-07 11:28:57.391258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.035 [2024-10-07 11:28:57.391299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.035 [2024-10-07 11:28:57.391678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.035 [2024-10-07 11:28:57.391745] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.035 [2024-10-07 11:28:57.391779] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.035 [2024-10-07 11:28:57.391808] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.035 [2024-10-07 11:28:57.392005] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.035 [2024-10-07 11:28:57.392047] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.035 [2024-10-07 11:28:57.392076] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.035 [2024-10-07 11:28:57.392105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.035 [2024-10-07 11:28:57.393633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.035 [2024-10-07 11:28:57.402378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.035 [2024-10-07 11:28:57.402538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.035 [2024-10-07 11:28:57.402859] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.035 [2024-10-07 11:28:57.402924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.035 [2024-10-07 11:28:57.402960] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.035 [2024-10-07 11:28:57.403052] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.035 [2024-10-07 11:28:57.403093] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.035 [2024-10-07 11:28:57.403124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.035 [2024-10-07 11:28:57.404231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.035 [2024-10-07 11:28:57.404304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.035 [2024-10-07 11:28:57.404605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.035 [2024-10-07 11:28:57.404664] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.035 [2024-10-07 11:28:57.404698] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.035 [2024-10-07 11:28:57.404737] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.035 [2024-10-07 11:28:57.404769] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.035 [2024-10-07 11:28:57.404799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.035 [2024-10-07 11:28:57.406029] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.035 [2024-10-07 11:28:57.406077] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.035 [2024-10-07 11:28:57.414097] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.035 [2024-10-07 11:28:57.414239] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.035 [2024-10-07 11:28:57.415369] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.035 [2024-10-07 11:28:57.415519] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.035 [2024-10-07 11:28:57.415558] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.035 [2024-10-07 11:28:57.415644] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.035 [2024-10-07 11:28:57.415689] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.035 [2024-10-07 11:28:57.415723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.035 [2024-10-07 11:28:57.416851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.035 [2024-10-07 11:28:57.416933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.035 [2024-10-07 11:28:57.417132] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.035 [2024-10-07 11:28:57.417186] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.035 [2024-10-07 11:28:57.417221] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.035 [2024-10-07 11:28:57.417263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.035 [2024-10-07 11:28:57.417294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.035 [2024-10-07 11:28:57.417320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.035 [2024-10-07 11:28:57.417380] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.035 [2024-10-07 11:28:57.417444] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.035 [2024-10-07 11:28:57.425388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.035 [2024-10-07 11:28:57.425554] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.035 [2024-10-07 11:28:57.426994] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.035 [2024-10-07 11:28:57.427049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.035 [2024-10-07 11:28:57.427073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.035 [2024-10-07 11:28:57.427131] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.035 [2024-10-07 11:28:57.427155] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.035 [2024-10-07 11:28:57.427171] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.035 [2024-10-07 11:28:57.428232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.035 [2024-10-07 11:28:57.428282] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.035 [2024-10-07 11:28:57.428622] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.035 [2024-10-07 11:28:57.428663] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.035 [2024-10-07 11:28:57.428684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.035 [2024-10-07 11:28:57.428709] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.035 [2024-10-07 11:28:57.428723] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.035 [2024-10-07 11:28:57.428765] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.035 [2024-10-07 11:28:57.428917] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.035 [2024-10-07 11:28:57.428944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.035 [2024-10-07 11:28:57.435837] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.035 [2024-10-07 11:28:57.435953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.035 [2024-10-07 11:28:57.436105] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.035 [2024-10-07 11:28:57.436143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.035 [2024-10-07 11:28:57.436162] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.035 [2024-10-07 11:28:57.436211] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.035 [2024-10-07 11:28:57.436234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.035 [2024-10-07 11:28:57.436250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.035 [2024-10-07 11:28:57.436284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.035 [2024-10-07 11:28:57.436307] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.035 [2024-10-07 11:28:57.436356] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.035 [2024-10-07 11:28:57.436376] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.036 [2024-10-07 11:28:57.436393] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.036 [2024-10-07 11:28:57.436426] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.036 [2024-10-07 11:28:57.436443] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.036 [2024-10-07 11:28:57.436456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.036 [2024-10-07 11:28:57.436487] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.036 [2024-10-07 11:28:57.436505] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.036 [2024-10-07 11:28:57.447330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.036 [2024-10-07 11:28:57.447440] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.036 [2024-10-07 11:28:57.447696] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.036 [2024-10-07 11:28:57.447743] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.036 [2024-10-07 11:28:57.447764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.036 [2024-10-07 11:28:57.447815] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.036 [2024-10-07 11:28:57.447838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.036 [2024-10-07 11:28:57.447854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.036 [2024-10-07 11:28:57.447910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.036 [2024-10-07 11:28:57.447964] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.036 [2024-10-07 11:28:57.447994] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.036 [2024-10-07 11:28:57.448012] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.036 [2024-10-07 11:28:57.448027] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.036 [2024-10-07 11:28:57.448045] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.036 [2024-10-07 11:28:57.448059] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.036 [2024-10-07 11:28:57.448073] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.036 [2024-10-07 11:28:57.448103] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.036 [2024-10-07 11:28:57.448119] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.036 [2024-10-07 11:28:57.457624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.036 [2024-10-07 11:28:57.457708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.036 [2024-10-07 11:28:57.457834] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.036 [2024-10-07 11:28:57.457868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.036 [2024-10-07 11:28:57.457885] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.036 [2024-10-07 11:28:57.457933] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.036 [2024-10-07 11:28:57.457956] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.036 [2024-10-07 11:28:57.457972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.036 [2024-10-07 11:28:57.458005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.036 [2024-10-07 11:28:57.458028] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.036 [2024-10-07 11:28:57.458053] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.036 [2024-10-07 11:28:57.458070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.036 [2024-10-07 11:28:57.458085] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.036 [2024-10-07 11:28:57.458101] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.036 [2024-10-07 11:28:57.458115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.036 [2024-10-07 11:28:57.458128] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.036 [2024-10-07 11:28:57.459154] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.036 [2024-10-07 11:28:57.459192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.036 [2024-10-07 11:28:57.467798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.036 [2024-10-07 11:28:57.467904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.036 [2024-10-07 11:28:57.468009] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.036 [2024-10-07 11:28:57.468040] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.036 [2024-10-07 11:28:57.468093] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.036 [2024-10-07 11:28:57.469091] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.036 [2024-10-07 11:28:57.469135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.036 [2024-10-07 11:28:57.469155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.036 [2024-10-07 11:28:57.469176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.036 [2024-10-07 11:28:57.469373] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.036 [2024-10-07 11:28:57.469441] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.036 [2024-10-07 11:28:57.469464] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.036 [2024-10-07 11:28:57.469479] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.036 [2024-10-07 11:28:57.469598] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.036 [2024-10-07 11:28:57.469619] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.036 [2024-10-07 11:28:57.469632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.036 [2024-10-07 11:28:57.469646] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.036 [2024-10-07 11:28:57.470755] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.036 [2024-10-07 11:28:57.477941] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.036 [2024-10-07 11:28:57.478817] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.036 [2024-10-07 11:28:57.478863] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.036 [2024-10-07 11:28:57.478884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.036 [2024-10-07 11:28:57.479741] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.036 [2024-10-07 11:28:57.479797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.036 [2024-10-07 11:28:57.479952] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.036 [2024-10-07 11:28:57.479982] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.036 [2024-10-07 11:28:57.479999] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.036 [2024-10-07 11:28:57.480013] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.036 [2024-10-07 11:28:57.480027] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.036 [2024-10-07 11:28:57.480042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.036 [2024-10-07 11:28:57.480096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.036 [2024-10-07 11:28:57.480120] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.036 [2024-10-07 11:28:57.480148] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.036 [2024-10-07 11:28:57.480165] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.036 [2024-10-07 11:28:57.480208] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.036 [2024-10-07 11:28:57.480239] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.036 [2024-10-07 11:28:57.488936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.036 [2024-10-07 11:28:57.489123] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.036 [2024-10-07 11:28:57.489157] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.036 [2024-10-07 11:28:57.489175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.036 [2024-10-07 11:28:57.490385] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.036 [2024-10-07 11:28:57.491465] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.036 [2024-10-07 11:28:57.491503] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.036 [2024-10-07 11:28:57.491523] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.036 [2024-10-07 11:28:57.491793] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.036 [2024-10-07 11:28:57.491825] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.036 [2024-10-07 11:28:57.492027] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.037 [2024-10-07 11:28:57.492060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.037 [2024-10-07 11:28:57.492077] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.037 [2024-10-07 11:28:57.492161] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.037 [2024-10-07 11:28:57.492228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.037 [2024-10-07 11:28:57.492262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.037 [2024-10-07 11:28:57.492286] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.037 [2024-10-07 11:28:57.492336] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.037 [2024-10-07 11:28:57.499075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.037 [2024-10-07 11:28:57.499226] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.037 [2024-10-07 11:28:57.499261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.037 [2024-10-07 11:28:57.499280] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.037 [2024-10-07 11:28:57.499315] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.037 [2024-10-07 11:28:57.500543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.037 [2024-10-07 11:28:57.500594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.037 [2024-10-07 11:28:57.500624] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.037 [2024-10-07 11:28:57.500926] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.037 [2024-10-07 11:28:57.504305] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.037 [2024-10-07 11:28:57.504560] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.037 [2024-10-07 11:28:57.504610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.037 [2024-10-07 11:28:57.504633] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.037 [2024-10-07 11:28:57.505705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.037 [2024-10-07 11:28:57.505963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.037 [2024-10-07 11:28:57.506012] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.037 [2024-10-07 11:28:57.506048] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.037 [2024-10-07 11:28:57.506214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.037 [2024-10-07 11:28:57.509209] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.037 [2024-10-07 11:28:57.509480] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.037 [2024-10-07 11:28:57.509543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.037 [2024-10-07 11:28:57.509580] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.037 [2024-10-07 11:28:57.510511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.037 [2024-10-07 11:28:57.511573] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.037 [2024-10-07 11:28:57.511619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.037 [2024-10-07 11:28:57.511641] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.037 [2024-10-07 11:28:57.511764] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.037 [2024-10-07 11:28:57.514796] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.037 [2024-10-07 11:28:57.514945] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.037 [2024-10-07 11:28:57.514991] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.037 [2024-10-07 11:28:57.515012] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.037 [2024-10-07 11:28:57.515046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.037 [2024-10-07 11:28:57.515078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.037 [2024-10-07 11:28:57.515094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.037 [2024-10-07 11:28:57.515110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.037 [2024-10-07 11:28:57.515140] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.037 [2024-10-07 11:28:57.519445] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.037 [2024-10-07 11:28:57.519578] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.037 [2024-10-07 11:28:57.519617] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.037 [2024-10-07 11:28:57.519636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.037 [2024-10-07 11:28:57.519669] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.037 [2024-10-07 11:28:57.519730] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.037 [2024-10-07 11:28:57.519747] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.037 [2024-10-07 11:28:57.519762] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.037 [2024-10-07 11:28:57.519792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.037 [2024-10-07 11:28:57.526068] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.037 [2024-10-07 11:28:57.526476] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.037 [2024-10-07 11:28:57.526520] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.037 [2024-10-07 11:28:57.526542] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.037 [2024-10-07 11:28:57.526615] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.037 [2024-10-07 11:28:57.526652] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.037 [2024-10-07 11:28:57.526670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.037 [2024-10-07 11:28:57.526686] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.037 [2024-10-07 11:28:57.526717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.037 [2024-10-07 11:28:57.529541] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.037 [2024-10-07 11:28:57.529665] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.037 [2024-10-07 11:28:57.529697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.037 [2024-10-07 11:28:57.529714] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.037 [2024-10-07 11:28:57.529745] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.037 [2024-10-07 11:28:57.529775] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.037 [2024-10-07 11:28:57.529791] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.037 [2024-10-07 11:28:57.529806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.037 [2024-10-07 11:28:57.529836] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.037 [2024-10-07 11:28:57.538353] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.037 [2024-10-07 11:28:57.538539] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.037 [2024-10-07 11:28:57.538584] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.037 [2024-10-07 11:28:57.538606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.037 [2024-10-07 11:28:57.538640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.037 [2024-10-07 11:28:57.538672] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.037 [2024-10-07 11:28:57.538689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.037 [2024-10-07 11:28:57.538704] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.037 [2024-10-07 11:28:57.538767] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.037 [2024-10-07 11:28:57.540444] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.037 [2024-10-07 11:28:57.540788] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.037 [2024-10-07 11:28:57.540830] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.037 [2024-10-07 11:28:57.540851] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.037 [2024-10-07 11:28:57.540921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.037 [2024-10-07 11:28:57.540958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.037 [2024-10-07 11:28:57.540975] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.037 [2024-10-07 11:28:57.540989] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.037 [2024-10-07 11:28:57.541039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.037 [2024-10-07 11:28:57.548485] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.037 [2024-10-07 11:28:57.548646] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.038 [2024-10-07 11:28:57.548681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.038 [2024-10-07 11:28:57.548700] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.038 [2024-10-07 11:28:57.548733] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.038 [2024-10-07 11:28:57.548764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.038 [2024-10-07 11:28:57.548781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.038 [2024-10-07 11:28:57.548797] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.038 [2024-10-07 11:28:57.548827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.038 [2024-10-07 11:28:57.552909] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.038 [2024-10-07 11:28:57.553197] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.038 [2024-10-07 11:28:57.553247] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.038 [2024-10-07 11:28:57.553267] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.038 [2024-10-07 11:28:57.553334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.038 [2024-10-07 11:28:57.553370] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.038 [2024-10-07 11:28:57.553388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.038 [2024-10-07 11:28:57.553420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.038 [2024-10-07 11:28:57.553455] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.038 [2024-10-07 11:28:57.558682] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.038 [2024-10-07 11:28:57.558877] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.038 [2024-10-07 11:28:57.558948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.038 [2024-10-07 11:28:57.558969] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.038 [2024-10-07 11:28:57.559006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.038 [2024-10-07 11:28:57.559037] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.038 [2024-10-07 11:28:57.559054] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.038 [2024-10-07 11:28:57.559069] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.038 [2024-10-07 11:28:57.559099] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.038 [2024-10-07 11:28:57.563370] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.038 [2024-10-07 11:28:57.563582] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.038 [2024-10-07 11:28:57.563618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.038 [2024-10-07 11:28:57.563636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.038 [2024-10-07 11:28:57.563671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.038 [2024-10-07 11:28:57.563702] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.038 [2024-10-07 11:28:57.563719] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.038 [2024-10-07 11:28:57.563734] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.038 [2024-10-07 11:28:57.563775] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.038 [2024-10-07 11:28:57.568846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.038 [2024-10-07 11:28:57.569784] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.038 [2024-10-07 11:28:57.569834] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.038 [2024-10-07 11:28:57.569855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.038 [2024-10-07 11:28:57.570729] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.038 [2024-10-07 11:28:57.570863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.038 [2024-10-07 11:28:57.570891] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.038 [2024-10-07 11:28:57.570907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.038 [2024-10-07 11:28:57.570943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.038 [2024-10-07 11:28:57.573665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.038 [2024-10-07 11:28:57.573864] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.038 [2024-10-07 11:28:57.573900] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.038 [2024-10-07 11:28:57.573919] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.038 [2024-10-07 11:28:57.573955] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.038 [2024-10-07 11:28:57.574028] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.038 [2024-10-07 11:28:57.574046] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.038 [2024-10-07 11:28:57.574063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.038 [2024-10-07 11:28:57.574094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.038 [2024-10-07 11:28:57.580180] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.038 [2024-10-07 11:28:57.580422] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.038 [2024-10-07 11:28:57.580460] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.038 [2024-10-07 11:28:57.580479] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.038 [2024-10-07 11:28:57.581739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.038 [2024-10-07 11:28:57.582977] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.038 [2024-10-07 11:28:57.583022] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.038 [2024-10-07 11:28:57.583044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.038 [2024-10-07 11:28:57.583279] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.038 [2024-10-07 11:28:57.585205] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.038 [2024-10-07 11:28:57.585633] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.038 [2024-10-07 11:28:57.585681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.038 [2024-10-07 11:28:57.585703] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.038 [2024-10-07 11:28:57.585792] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.038 [2024-10-07 11:28:57.585830] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.038 [2024-10-07 11:28:57.585847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.038 [2024-10-07 11:28:57.585864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.038 [2024-10-07 11:28:57.585896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.038 [2024-10-07 11:28:57.590361] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.038 [2024-10-07 11:28:57.591663] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.038 [2024-10-07 11:28:57.591718] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.038 [2024-10-07 11:28:57.591740] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.038 [2024-10-07 11:28:57.591967] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.038 [2024-10-07 11:28:57.593037] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.038 [2024-10-07 11:28:57.593095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.038 [2024-10-07 11:28:57.593116] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.038 [2024-10-07 11:28:57.593415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.038 [2024-10-07 11:28:57.597742] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.038 [2024-10-07 11:28:57.597986] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.038 [2024-10-07 11:28:57.598022] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.038 [2024-10-07 11:28:57.598041] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.038 [2024-10-07 11:28:57.598077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.038 [2024-10-07 11:28:57.598110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.038 [2024-10-07 11:28:57.598126] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.038 [2024-10-07 11:28:57.598142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.038 [2024-10-07 11:28:57.598173] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.039 [2024-10-07 11:28:57.600524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.039 [2024-10-07 11:28:57.600669] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.039 [2024-10-07 11:28:57.600703] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.039 [2024-10-07 11:28:57.600721] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.039 [2024-10-07 11:28:57.600755] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.039 [2024-10-07 11:28:57.600786] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.039 [2024-10-07 11:28:57.600803] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.039 [2024-10-07 11:28:57.600818] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.039 [2024-10-07 11:28:57.600847] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.039 [2024-10-07 11:28:57.607919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.039 [2024-10-07 11:28:57.608115] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.039 [2024-10-07 11:28:57.608151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.039 [2024-10-07 11:28:57.608169] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.039 [2024-10-07 11:28:57.608204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.039 [2024-10-07 11:28:57.609283] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.039 [2024-10-07 11:28:57.609326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.039 [2024-10-07 11:28:57.609346] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.039 [2024-10-07 11:28:57.609565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.039 [2024-10-07 11:28:57.612345] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.039 [2024-10-07 11:28:57.612564] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.039 [2024-10-07 11:28:57.612600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.039 [2024-10-07 11:28:57.612650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.039 [2024-10-07 11:28:57.612689] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.039 [2024-10-07 11:28:57.612720] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.039 [2024-10-07 11:28:57.612738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.039 [2024-10-07 11:28:57.612753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.039 [2024-10-07 11:28:57.612785] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.039 [2024-10-07 11:28:57.618085] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.039 [2024-10-07 11:28:57.618315] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.039 [2024-10-07 11:28:57.618353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.039 [2024-10-07 11:28:57.618372] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.039 [2024-10-07 11:28:57.619332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.039 [2024-10-07 11:28:57.619589] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.039 [2024-10-07 11:28:57.619625] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.039 [2024-10-07 11:28:57.619644] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.039 [2024-10-07 11:28:57.619724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.039 [2024-10-07 11:28:57.622481] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.039 [2024-10-07 11:28:57.622614] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.039 [2024-10-07 11:28:57.622647] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.039 [2024-10-07 11:28:57.622664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.039 [2024-10-07 11:28:57.622696] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.039 [2024-10-07 11:28:57.622725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.039 [2024-10-07 11:28:57.622742] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.039 [2024-10-07 11:28:57.622757] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.039 [2024-10-07 11:28:57.622786] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.039 [2024-10-07 11:28:57.629161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.039 [2024-10-07 11:28:57.629666] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.039 [2024-10-07 11:28:57.629715] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.039 [2024-10-07 11:28:57.629736] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.039 [2024-10-07 11:28:57.629813] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.039 [2024-10-07 11:28:57.629852] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.039 [2024-10-07 11:28:57.629906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.039 [2024-10-07 11:28:57.629924] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.039 [2024-10-07 11:28:57.629958] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.039 [2024-10-07 11:28:57.632936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.039 [2024-10-07 11:28:57.633202] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.039 [2024-10-07 11:28:57.633239] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.039 [2024-10-07 11:28:57.633258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.039 [2024-10-07 11:28:57.633294] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.039 [2024-10-07 11:28:57.633325] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.039 [2024-10-07 11:28:57.633342] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.039 [2024-10-07 11:28:57.633358] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.039 [2024-10-07 11:28:57.633390] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.039 [2024-10-07 11:28:57.639521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.039 [2024-10-07 11:28:57.639779] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.039 [2024-10-07 11:28:57.639820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.039 [2024-10-07 11:28:57.639839] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.039 [2024-10-07 11:28:57.641123] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.039 [2024-10-07 11:28:57.642371] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.039 [2024-10-07 11:28:57.642429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.039 [2024-10-07 11:28:57.642452] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.039 [2024-10-07 11:28:57.642725] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.039 [2024-10-07 11:28:57.643788] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.039 [2024-10-07 11:28:57.644554] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.039 [2024-10-07 11:28:57.644601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.039 [2024-10-07 11:28:57.644622] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.039 [2024-10-07 11:28:57.644968] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.039 [2024-10-07 11:28:57.645088] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.039 [2024-10-07 11:28:57.645123] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.039 [2024-10-07 11:28:57.645139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.039 [2024-10-07 11:28:57.645175] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.039 [2024-10-07 11:28:57.649720] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.039 [2024-10-07 11:28:57.651082] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.039 [2024-10-07 11:28:57.651135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.039 [2024-10-07 11:28:57.651157] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.039 [2024-10-07 11:28:57.651417] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.039 [2024-10-07 11:28:57.652465] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.040 [2024-10-07 11:28:57.652502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.040 [2024-10-07 11:28:57.652523] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.040 [2024-10-07 11:28:57.652786] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.040 [2024-10-07 11:28:57.654292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.040 [2024-10-07 11:28:57.654459] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.040 [2024-10-07 11:28:57.654495] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.040 [2024-10-07 11:28:57.654513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.040 [2024-10-07 11:28:57.655872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.040 [2024-10-07 11:28:57.657335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.040 [2024-10-07 11:28:57.657394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.040 [2024-10-07 11:28:57.657432] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.040 [2024-10-07 11:28:57.657684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.040 [2024-10-07 11:28:57.659968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.040 [2024-10-07 11:28:57.660158] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.040 [2024-10-07 11:28:57.660194] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.040 [2024-10-07 11:28:57.660213] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.040 [2024-10-07 11:28:57.660250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.040 [2024-10-07 11:28:57.660282] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.040 [2024-10-07 11:28:57.660299] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.040 [2024-10-07 11:28:57.660315] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.040 [2024-10-07 11:28:57.660346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.040 [2024-10-07 11:28:57.664547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.040 [2024-10-07 11:28:57.664765] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.040 [2024-10-07 11:28:57.664800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.040 [2024-10-07 11:28:57.664819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.040 [2024-10-07 11:28:57.666039] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.040 [2024-10-07 11:28:57.666300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.040 [2024-10-07 11:28:57.666336] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.040 [2024-10-07 11:28:57.666356] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.040 [2024-10-07 11:28:57.667388] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.040 [2024-10-07 11:28:57.671819] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.040 [2024-10-07 11:28:57.672041] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.040 [2024-10-07 11:28:57.672081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.040 [2024-10-07 11:28:57.672100] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.040 [2024-10-07 11:28:57.672306] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.040 [2024-10-07 11:28:57.672500] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.040 [2024-10-07 11:28:57.672527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.040 [2024-10-07 11:28:57.672544] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.040 [2024-10-07 11:28:57.672601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.040 [2024-10-07 11:28:57.674907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.040 [2024-10-07 11:28:57.675317] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.040 [2024-10-07 11:28:57.675363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.040 [2024-10-07 11:28:57.675385] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.040 [2024-10-07 11:28:57.675472] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.040 [2024-10-07 11:28:57.675513] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.040 [2024-10-07 11:28:57.675530] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.040 [2024-10-07 11:28:57.675546] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.040 [2024-10-07 11:28:57.675577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.040 [2024-10-07 11:28:57.682945] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.040 [2024-10-07 11:28:57.683145] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.040 [2024-10-07 11:28:57.683180] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.040 [2024-10-07 11:28:57.683198] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.040 [2024-10-07 11:28:57.683232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.040 [2024-10-07 11:28:57.683263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.040 [2024-10-07 11:28:57.683280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.040 [2024-10-07 11:28:57.683330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.040 [2024-10-07 11:28:57.683364] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.040 [2024-10-07 11:28:57.687516] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.040 [2024-10-07 11:28:57.687716] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.040 [2024-10-07 11:28:57.687752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.040 [2024-10-07 11:28:57.687771] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.040 [2024-10-07 11:28:57.687805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.040 [2024-10-07 11:28:57.687837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.040 [2024-10-07 11:28:57.687854] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.040 [2024-10-07 11:28:57.687869] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.040 [2024-10-07 11:28:57.687900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.040 [2024-10-07 11:28:57.693114] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.040 [2024-10-07 11:28:57.693281] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.040 [2024-10-07 11:28:57.693314] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.040 [2024-10-07 11:28:57.693333] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.040 [2024-10-07 11:28:57.693366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.040 [2024-10-07 11:28:57.693396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.040 [2024-10-07 11:28:57.693430] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.040 [2024-10-07 11:28:57.693446] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.040 [2024-10-07 11:28:57.693477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.040 [2024-10-07 11:28:57.697649] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.040 [2024-10-07 11:28:57.697805] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.040 [2024-10-07 11:28:57.697838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.040 [2024-10-07 11:28:57.697858] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.040 [2024-10-07 11:28:57.697908] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.040 [2024-10-07 11:28:57.698980] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.040 [2024-10-07 11:28:57.699019] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.040 [2024-10-07 11:28:57.699038] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.040 [2024-10-07 11:28:57.699257] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.040 [2024-10-07 11:28:57.704171] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.040 [2024-10-07 11:28:57.704658] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.040 [2024-10-07 11:28:57.704741] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.040 [2024-10-07 11:28:57.704764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.040 [2024-10-07 11:28:57.704849] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.040 [2024-10-07 11:28:57.704888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.040 [2024-10-07 11:28:57.704905] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.040 [2024-10-07 11:28:57.704920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.040 [2024-10-07 11:28:57.704951] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.040 [2024-10-07 11:28:57.707766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.040 [2024-10-07 11:28:57.707888] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.041 [2024-10-07 11:28:57.707919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.041 [2024-10-07 11:28:57.707937] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.041 [2024-10-07 11:28:57.707968] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.041 [2024-10-07 11:28:57.708011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.041 [2024-10-07 11:28:57.708030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.041 [2024-10-07 11:28:57.708044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.041 [2024-10-07 11:28:57.708984] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.041 [2024-10-07 11:28:57.716518] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.041 [2024-10-07 11:28:57.716825] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.041 [2024-10-07 11:28:57.716868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.041 [2024-10-07 11:28:57.716889] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.041 [2024-10-07 11:28:57.716947] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.041 [2024-10-07 11:28:57.716985] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.041 [2024-10-07 11:28:57.717002] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.041 [2024-10-07 11:28:57.717018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.041 [2024-10-07 11:28:57.717049] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.041 [2024-10-07 11:28:57.718775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.041 [2024-10-07 11:28:57.719120] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.041 [2024-10-07 11:28:57.719162] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.041 [2024-10-07 11:28:57.719182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.041 [2024-10-07 11:28:57.719251] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.041 [2024-10-07 11:28:57.719318] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.041 [2024-10-07 11:28:57.719337] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.041 [2024-10-07 11:28:57.719351] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.041 [2024-10-07 11:28:57.719381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.041 [2024-10-07 11:28:57.726679] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.041 [2024-10-07 11:28:57.726873] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.041 [2024-10-07 11:28:57.726908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.041 [2024-10-07 11:28:57.726927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.041 [2024-10-07 11:28:57.726961] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.041 [2024-10-07 11:28:57.726992] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.041 [2024-10-07 11:28:57.727009] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.041 [2024-10-07 11:28:57.727024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.041 [2024-10-07 11:28:57.727054] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.041 [2024-10-07 11:28:57.728873] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.041 [2024-10-07 11:28:57.729002] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.041 [2024-10-07 11:28:57.729035] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.041 [2024-10-07 11:28:57.729068] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.041 [2024-10-07 11:28:57.730327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.041 [2024-10-07 11:28:57.731602] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.041 [2024-10-07 11:28:57.731644] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.041 [2024-10-07 11:28:57.731664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.041 [2024-10-07 11:28:57.731892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.041 [2024-10-07 11:28:57.737586] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.041 [2024-10-07 11:28:57.737779] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.041 [2024-10-07 11:28:57.737816] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.041 [2024-10-07 11:28:57.737834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.041 [2024-10-07 11:28:57.737877] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.041 [2024-10-07 11:28:57.737925] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.041 [2024-10-07 11:28:57.737945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.041 [2024-10-07 11:28:57.737960] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.041 [2024-10-07 11:28:57.738015] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.041 [2024-10-07 11:28:57.739471] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.041 [2024-10-07 11:28:57.739593] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.041 [2024-10-07 11:28:57.739625] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.041 [2024-10-07 11:28:57.739642] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.041 [2024-10-07 11:28:57.740782] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.041 [2024-10-07 11:28:57.741120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.041 [2024-10-07 11:28:57.741178] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.041 [2024-10-07 11:28:57.741213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.041 [2024-10-07 11:28:57.742375] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.041 [2024-10-07 11:28:57.749124] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.041 [2024-10-07 11:28:57.749595] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.041 [2024-10-07 11:28:57.749642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.041 [2024-10-07 11:28:57.749665] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.041 [2024-10-07 11:28:57.749741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.041 [2024-10-07 11:28:57.749798] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.041 [2024-10-07 11:28:57.749819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.041 [2024-10-07 11:28:57.749835] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.041 [2024-10-07 11:28:57.749874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.041 [2024-10-07 11:28:57.749908] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.041 [2024-10-07 11:28:57.750008] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.041 [2024-10-07 11:28:57.750039] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.041 [2024-10-07 11:28:57.750056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.041 [2024-10-07 11:28:57.750087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.041 [2024-10-07 11:28:57.750117] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.041 [2024-10-07 11:28:57.750135] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.041 [2024-10-07 11:28:57.750149] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.041 [2024-10-07 11:28:57.750178] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.041 [2024-10-07 11:28:57.761532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.041 [2024-10-07 11:28:57.761626] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.041 [2024-10-07 11:28:57.761948] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.041 [2024-10-07 11:28:57.761991] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.041 [2024-10-07 11:28:57.762011] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.041 [2024-10-07 11:28:57.762065] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.041 [2024-10-07 11:28:57.762089] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.041 [2024-10-07 11:28:57.762104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.041 [2024-10-07 11:28:57.762161] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.042 [2024-10-07 11:28:57.762189] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.042 [2024-10-07 11:28:57.762217] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.042 [2024-10-07 11:28:57.762234] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.042 [2024-10-07 11:28:57.762249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.042 [2024-10-07 11:28:57.762267] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.042 [2024-10-07 11:28:57.762281] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.042 [2024-10-07 11:28:57.762294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.042 [2024-10-07 11:28:57.763021] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.042 [2024-10-07 11:28:57.763058] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.042 [2024-10-07 11:28:57.771774] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.042 [2024-10-07 11:28:57.771915] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.042 [2024-10-07 11:28:57.772037] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.042 [2024-10-07 11:28:57.772071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.042 [2024-10-07 11:28:57.772090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.042 [2024-10-07 11:28:57.772156] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.042 [2024-10-07 11:28:57.772182] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.042 [2024-10-07 11:28:57.772197] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.042 [2024-10-07 11:28:57.772218] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.042 [2024-10-07 11:28:57.773284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.042 [2024-10-07 11:28:57.773329] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.042 [2024-10-07 11:28:57.773348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.042 [2024-10-07 11:28:57.773364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.042 [2024-10-07 11:28:57.773585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.042 [2024-10-07 11:28:57.773611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.042 [2024-10-07 11:28:57.773655] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.042 [2024-10-07 11:28:57.773670] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.042 [2024-10-07 11:28:57.773783] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.042 [2024-10-07 11:28:57.782012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.042 [2024-10-07 11:28:57.782171] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.042 [2024-10-07 11:28:57.782310] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.042 [2024-10-07 11:28:57.782349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.042 [2024-10-07 11:28:57.782369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.042 [2024-10-07 11:28:57.782456] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.042 [2024-10-07 11:28:57.782484] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.042 [2024-10-07 11:28:57.782500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.042 [2024-10-07 11:28:57.782523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.042 [2024-10-07 11:28:57.782558] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.042 [2024-10-07 11:28:57.782578] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.042 [2024-10-07 11:28:57.782592] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.042 [2024-10-07 11:28:57.782609] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.042 [2024-10-07 11:28:57.783584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.042 [2024-10-07 11:28:57.783625] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.042 [2024-10-07 11:28:57.783642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.042 [2024-10-07 11:28:57.783657] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.042 [2024-10-07 11:28:57.783898] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.042 [2024-10-07 11:28:57.793503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.042 [2024-10-07 11:28:57.793600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.042 [2024-10-07 11:28:57.793998] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.042 [2024-10-07 11:28:57.794048] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.042 [2024-10-07 11:28:57.794070] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.042 [2024-10-07 11:28:57.794124] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.042 [2024-10-07 11:28:57.794147] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.042 [2024-10-07 11:28:57.794163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.042 [2024-10-07 11:28:57.794238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.042 [2024-10-07 11:28:57.794295] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.042 [2024-10-07 11:28:57.794326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.042 [2024-10-07 11:28:57.794343] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.042 [2024-10-07 11:28:57.794359] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.042 [2024-10-07 11:28:57.794376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.042 [2024-10-07 11:28:57.794390] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.042 [2024-10-07 11:28:57.794420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.042 [2024-10-07 11:28:57.794454] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.042 [2024-10-07 11:28:57.794471] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.042 [2024-10-07 11:28:57.805748] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.042 [2024-10-07 11:28:57.805839] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.042 [2024-10-07 11:28:57.806106] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.042 [2024-10-07 11:28:57.806143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.042 [2024-10-07 11:28:57.806162] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.042 [2024-10-07 11:28:57.806211] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.042 [2024-10-07 11:28:57.806234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.042 [2024-10-07 11:28:57.806250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.042 [2024-10-07 11:28:57.806307] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.042 [2024-10-07 11:28:57.806335] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.042 [2024-10-07 11:28:57.806362] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.042 [2024-10-07 11:28:57.806379] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.042 [2024-10-07 11:28:57.806394] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.043 [2024-10-07 11:28:57.806429] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.043 [2024-10-07 11:28:57.806445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.043 [2024-10-07 11:28:57.806458] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.043 [2024-10-07 11:28:57.806490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.043 [2024-10-07 11:28:57.806506] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.043 [2024-10-07 11:28:57.815943] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.043 [2024-10-07 11:28:57.816058] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.043 [2024-10-07 11:28:57.816169] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.043 [2024-10-07 11:28:57.816202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.043 [2024-10-07 11:28:57.816251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.043 [2024-10-07 11:28:57.817339] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.043 [2024-10-07 11:28:57.817383] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.043 [2024-10-07 11:28:57.817416] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.043 [2024-10-07 11:28:57.817441] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.043 [2024-10-07 11:28:57.817640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.043 [2024-10-07 11:28:57.817676] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.043 [2024-10-07 11:28:57.817694] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.043 [2024-10-07 11:28:57.817709] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.043 [2024-10-07 11:28:57.817822] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.043 [2024-10-07 11:28:57.817842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.043 [2024-10-07 11:28:57.817860] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.043 [2024-10-07 11:28:57.817883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.043 [2024-10-07 11:28:57.819123] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.043 [2024-10-07 11:28:57.826098] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.043 [2024-10-07 11:28:57.827224] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.043 [2024-10-07 11:28:57.827273] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.043 [2024-10-07 11:28:57.827295] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.043 [2024-10-07 11:28:57.827532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.043 [2024-10-07 11:28:57.827586] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.043 [2024-10-07 11:28:57.827712] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.043 [2024-10-07 11:28:57.827750] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.043 [2024-10-07 11:28:57.827769] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.043 [2024-10-07 11:28:57.827785] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.043 [2024-10-07 11:28:57.827798] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.043 [2024-10-07 11:28:57.827813] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.043 [2024-10-07 11:28:57.828919] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.043 [2024-10-07 11:28:57.828961] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.043 [2024-10-07 11:28:57.829185] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.043 [2024-10-07 11:28:57.829242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.043 [2024-10-07 11:28:57.829261] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.043 [2024-10-07 11:28:57.830306] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.043 [2024-10-07 11:28:57.837658] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.043 [2024-10-07 11:28:57.837935] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.043 [2024-10-07 11:28:57.837976] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.043 [2024-10-07 11:28:57.837996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.043 [2024-10-07 11:28:57.838035] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.043 [2024-10-07 11:28:57.838072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.043 [2024-10-07 11:28:57.838144] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.043 [2024-10-07 11:28:57.838171] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.043 [2024-10-07 11:28:57.838187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.043 [2024-10-07 11:28:57.838202] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.043 [2024-10-07 11:28:57.838216] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.043 [2024-10-07 11:28:57.838231] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.043 [2024-10-07 11:28:57.838264] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.043 [2024-10-07 11:28:57.838285] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.043 [2024-10-07 11:28:57.838311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.043 [2024-10-07 11:28:57.838328] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.043 [2024-10-07 11:28:57.838341] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.043 [2024-10-07 11:28:57.838368] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.043 [2024-10-07 11:28:57.850118] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.043 [2024-10-07 11:28:57.850216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.043 [2024-10-07 11:28:57.850479] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.043 [2024-10-07 11:28:57.850516] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.043 [2024-10-07 11:28:57.850534] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.043 [2024-10-07 11:28:57.850584] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.043 [2024-10-07 11:28:57.850607] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.043 [2024-10-07 11:28:57.850623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.043 [2024-10-07 11:28:57.850679] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.043 [2024-10-07 11:28:57.850707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.043 [2024-10-07 11:28:57.850768] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.043 [2024-10-07 11:28:57.850786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.043 [2024-10-07 11:28:57.850802] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.043 [2024-10-07 11:28:57.850819] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.043 [2024-10-07 11:28:57.850833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.043 [2024-10-07 11:28:57.850847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.043 [2024-10-07 11:28:57.850891] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.043 [2024-10-07 11:28:57.850911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.043 [2024-10-07 11:28:57.862631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.043 [2024-10-07 11:28:57.862729] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.044 [2024-10-07 11:28:57.862957] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.044 [2024-10-07 11:28:57.863004] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.044 [2024-10-07 11:28:57.863025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.044 [2024-10-07 11:28:57.863077] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.044 [2024-10-07 11:28:57.863101] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.044 [2024-10-07 11:28:57.863117] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.044 [2024-10-07 11:28:57.864496] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.044 [2024-10-07 11:28:57.864566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.044 [2024-10-07 11:28:57.865786] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.044 [2024-10-07 11:28:57.865831] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.044 [2024-10-07 11:28:57.865853] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.044 [2024-10-07 11:28:57.865885] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.044 [2024-10-07 11:28:57.865907] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.044 [2024-10-07 11:28:57.865920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.044 [2024-10-07 11:28:57.866825] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.044 [2024-10-07 11:28:57.866875] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.044 [2024-10-07 11:28:57.874024] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.044 [2024-10-07 11:28:57.874117] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.044 [2024-10-07 11:28:57.875377] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.044 [2024-10-07 11:28:57.875467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.044 [2024-10-07 11:28:57.875544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.044 [2024-10-07 11:28:57.875640] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.044 [2024-10-07 11:28:57.875692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.044 [2024-10-07 11:28:57.875722] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.044 [2024-10-07 11:28:57.876024] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.044 [2024-10-07 11:28:57.876095] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.044 [2024-10-07 11:28:57.877428] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.044 [2024-10-07 11:28:57.877493] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.044 [2024-10-07 11:28:57.877526] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.044 [2024-10-07 11:28:57.877551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.044 [2024-10-07 11:28:57.877567] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.044 [2024-10-07 11:28:57.877580] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.044 [2024-10-07 11:28:57.879066] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.044 [2024-10-07 11:28:57.879110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.044 [2024-10-07 11:28:57.884225] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.044 [2024-10-07 11:28:57.884338] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.044 [2024-10-07 11:28:57.884468] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.044 [2024-10-07 11:28:57.884503] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.044 [2024-10-07 11:28:57.884522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.044 [2024-10-07 11:28:57.884610] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.044 [2024-10-07 11:28:57.884638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.044 [2024-10-07 11:28:57.884654] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.044 [2024-10-07 11:28:57.884674] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.044 [2024-10-07 11:28:57.884707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.044 [2024-10-07 11:28:57.884726] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.044 [2024-10-07 11:28:57.884741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.044 [2024-10-07 11:28:57.884756] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.044 [2024-10-07 11:28:57.884787] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.044 [2024-10-07 11:28:57.884805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.044 [2024-10-07 11:28:57.884818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.044 [2024-10-07 11:28:57.884872] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.044 [2024-10-07 11:28:57.884913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.044 [2024-10-07 11:28:57.896173] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.044 [2024-10-07 11:28:57.896267] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.044 [2024-10-07 11:28:57.896532] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.044 [2024-10-07 11:28:57.896576] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.044 [2024-10-07 11:28:57.896594] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.044 [2024-10-07 11:28:57.896643] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.044 [2024-10-07 11:28:57.896666] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.044 [2024-10-07 11:28:57.896682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.044 [2024-10-07 11:28:57.896738] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.044 [2024-10-07 11:28:57.896766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.044 [2024-10-07 11:28:57.896793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.044 [2024-10-07 11:28:57.896811] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.044 [2024-10-07 11:28:57.896826] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.044 [2024-10-07 11:28:57.896844] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.044 [2024-10-07 11:28:57.896864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.044 [2024-10-07 11:28:57.896889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.044 [2024-10-07 11:28:57.896936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.044 [2024-10-07 11:28:57.896955] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.044 [2024-10-07 11:28:57.907364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.044 [2024-10-07 11:28:57.907673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.044 [2024-10-07 11:28:57.907790] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.044 [2024-10-07 11:28:57.907833] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.044 [2024-10-07 11:28:57.907854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.044 [2024-10-07 11:28:57.907953] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.044 [2024-10-07 11:28:57.907987] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.044 [2024-10-07 11:28:57.908004] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.044 [2024-10-07 11:28:57.908024] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.044 [2024-10-07 11:28:57.908057] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.044 [2024-10-07 11:28:57.908103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.044 [2024-10-07 11:28:57.908119] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.044 [2024-10-07 11:28:57.908134] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.044 [2024-10-07 11:28:57.908167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.044 [2024-10-07 11:28:57.908185] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.044 [2024-10-07 11:28:57.908198] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.044 [2024-10-07 11:28:57.908211] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.044 [2024-10-07 11:28:57.909248] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.044 [2024-10-07 11:28:57.917539] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.044 [2024-10-07 11:28:57.917730] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.044 [2024-10-07 11:28:57.917765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.044 [2024-10-07 11:28:57.917783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.044 [2024-10-07 11:28:57.917818] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.045 [2024-10-07 11:28:57.917883] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.045 [2024-10-07 11:28:57.917906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.045 [2024-10-07 11:28:57.917921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.045 [2024-10-07 11:28:57.917953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.045 [2024-10-07 11:28:57.917975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.045 [2024-10-07 11:28:57.918045] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.045 [2024-10-07 11:28:57.918072] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.045 [2024-10-07 11:28:57.918088] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.045 [2024-10-07 11:28:57.918118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.045 [2024-10-07 11:28:57.918148] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.045 [2024-10-07 11:28:57.918164] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.045 [2024-10-07 11:28:57.918177] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.045 [2024-10-07 11:28:57.918205] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.045 [2024-10-07 11:28:57.929231] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.045 [2024-10-07 11:28:57.929482] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.045 [2024-10-07 11:28:57.929610] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.045 [2024-10-07 11:28:57.929642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.045 [2024-10-07 11:28:57.929659] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.045 [2024-10-07 11:28:57.929782] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.045 [2024-10-07 11:28:57.929811] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.045 [2024-10-07 11:28:57.929828] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.045 [2024-10-07 11:28:57.929848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.045 [2024-10-07 11:28:57.929881] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.045 [2024-10-07 11:28:57.929901] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.045 [2024-10-07 11:28:57.929915] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.045 [2024-10-07 11:28:57.929930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.045 [2024-10-07 11:28:57.929961] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.045 [2024-10-07 11:28:57.929978] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.045 [2024-10-07 11:28:57.929991] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.045 [2024-10-07 11:28:57.930005] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.045 [2024-10-07 11:28:57.930031] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.045 [2024-10-07 11:28:57.939552] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.045 [2024-10-07 11:28:57.939759] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.045 [2024-10-07 11:28:57.939793] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.045 [2024-10-07 11:28:57.939812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.045 [2024-10-07 11:28:57.940845] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.045 [2024-10-07 11:28:57.940901] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.045 [2024-10-07 11:28:57.941159] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.045 [2024-10-07 11:28:57.941199] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.045 [2024-10-07 11:28:57.941219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.045 [2024-10-07 11:28:57.941236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.045 [2024-10-07 11:28:57.941250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.045 [2024-10-07 11:28:57.941265] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.045 [2024-10-07 11:28:57.941327] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.045 [2024-10-07 11:28:57.941350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.045 [2024-10-07 11:28:57.941377] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.045 [2024-10-07 11:28:57.941394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.045 [2024-10-07 11:28:57.941435] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.045 [2024-10-07 11:28:57.941510] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.045 [2024-10-07 11:28:57.949708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.045 [2024-10-07 11:28:57.949895] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.045 [2024-10-07 11:28:57.949929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.045 [2024-10-07 11:28:57.949947] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.045 [2024-10-07 11:28:57.949981] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.045 [2024-10-07 11:28:57.950800] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.045 [2024-10-07 11:28:57.950836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.045 [2024-10-07 11:28:57.950856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.045 [2024-10-07 11:28:57.951052] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.045 [2024-10-07 11:28:57.951261] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.045 [2024-10-07 11:28:57.951366] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.045 [2024-10-07 11:28:57.951395] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.045 [2024-10-07 11:28:57.951428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.045 [2024-10-07 11:28:57.951461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.045 [2024-10-07 11:28:57.951491] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.045 [2024-10-07 11:28:57.951508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.045 [2024-10-07 11:28:57.951522] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.045 [2024-10-07 11:28:57.951551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.045 [2024-10-07 11:28:57.960349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.045 [2024-10-07 11:28:57.960579] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.045 [2024-10-07 11:28:57.960616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.045 [2024-10-07 11:28:57.960634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.045 [2024-10-07 11:28:57.960669] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.045 [2024-10-07 11:28:57.960700] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.045 [2024-10-07 11:28:57.960717] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.045 [2024-10-07 11:28:57.960732] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.045 [2024-10-07 11:28:57.960762] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.045 [2024-10-07 11:28:57.962589] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.045 [2024-10-07 11:28:57.962931] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.045 [2024-10-07 11:28:57.962973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.045 [2024-10-07 11:28:57.963023] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.045 [2024-10-07 11:28:57.963096] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.045 [2024-10-07 11:28:57.963146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.045 [2024-10-07 11:28:57.963164] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.045 [2024-10-07 11:28:57.963179] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.045 [2024-10-07 11:28:57.963208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.045 [2024-10-07 11:28:57.970524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.045 [2024-10-07 11:28:57.970705] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.045 [2024-10-07 11:28:57.970738] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.045 [2024-10-07 11:28:57.970756] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.045 [2024-10-07 11:28:57.970791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.045 [2024-10-07 11:28:57.970822] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.045 [2024-10-07 11:28:57.970839] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.045 [2024-10-07 11:28:57.970854] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.045 [2024-10-07 11:28:57.970884] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.045 [2024-10-07 11:28:57.974871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.045 [2024-10-07 11:28:57.975116] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.046 [2024-10-07 11:28:57.975159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.046 [2024-10-07 11:28:57.975180] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.046 [2024-10-07 11:28:57.975235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.046 [2024-10-07 11:28:57.975271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.046 [2024-10-07 11:28:57.975289] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.046 [2024-10-07 11:28:57.975304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.046 [2024-10-07 11:28:57.975333] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.046 [2024-10-07 11:28:57.980665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.046 [2024-10-07 11:28:57.980823] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.046 [2024-10-07 11:28:57.980855] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.046 [2024-10-07 11:28:57.980873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.046 [2024-10-07 11:28:57.980906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.046 [2024-10-07 11:28:57.980937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.046 [2024-10-07 11:28:57.980988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.046 [2024-10-07 11:28:57.981003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.046 [2024-10-07 11:28:57.981960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.046 [2024-10-07 11:28:57.984985] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.046 [2024-10-07 11:28:57.985125] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.046 [2024-10-07 11:28:57.985158] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.046 [2024-10-07 11:28:57.985174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.046 [2024-10-07 11:28:57.985207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.046 [2024-10-07 11:28:57.985238] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.046 [2024-10-07 11:28:57.985255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.046 [2024-10-07 11:28:57.985269] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.046 [2024-10-07 11:28:57.985298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.046 [2024-10-07 11:28:57.991624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.046 [2024-10-07 11:28:57.992024] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.046 [2024-10-07 11:28:57.992069] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.046 [2024-10-07 11:28:57.992091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.046 [2024-10-07 11:28:57.992164] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.046 [2024-10-07 11:28:57.992221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.046 [2024-10-07 11:28:57.992242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.046 [2024-10-07 11:28:57.992257] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.046 [2024-10-07 11:28:57.992289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.046 [2024-10-07 11:28:57.995083] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.046 [2024-10-07 11:28:57.995207] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.046 [2024-10-07 11:28:57.995238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.046 [2024-10-07 11:28:57.995254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.046 [2024-10-07 11:28:57.995286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.046 [2024-10-07 11:28:57.995316] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.046 [2024-10-07 11:28:57.995333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.046 [2024-10-07 11:28:57.995347] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.046 [2024-10-07 11:28:57.995375] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.046 [2024-10-07 11:28:58.002517] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.046 [2024-10-07 11:28:58.002698] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.046 [2024-10-07 11:28:58.002732] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.046 [2024-10-07 11:28:58.002749] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.046 [2024-10-07 11:28:58.003955] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.046 [2024-10-07 11:28:58.005028] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.046 [2024-10-07 11:28:58.005080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.046 [2024-10-07 11:28:58.005100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.046 [2024-10-07 11:28:58.005389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.046 [2024-10-07 11:28:58.005619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.046 [2024-10-07 11:28:58.005733] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.046 [2024-10-07 11:28:58.005769] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.046 [2024-10-07 11:28:58.005788] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.046 [2024-10-07 11:28:58.005820] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.046 [2024-10-07 11:28:58.005850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.046 [2024-10-07 11:28:58.005868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.046 [2024-10-07 11:28:58.005882] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.046 [2024-10-07 11:28:58.005911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.046 [2024-10-07 11:28:58.012786] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.046 [2024-10-07 11:28:58.012962] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.046 [2024-10-07 11:28:58.012995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.046 [2024-10-07 11:28:58.013013] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.046 [2024-10-07 11:28:58.014134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.046 [2024-10-07 11:28:58.014396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.046 [2024-10-07 11:28:58.014444] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.046 [2024-10-07 11:28:58.014463] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.046 [2024-10-07 11:28:58.014524] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.046 [2024-10-07 11:28:58.015864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.046 [2024-10-07 11:28:58.015979] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.046 [2024-10-07 11:28:58.016009] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.046 [2024-10-07 11:28:58.016026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.046 [2024-10-07 11:28:58.016081] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.046 [2024-10-07 11:28:58.016112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.046 [2024-10-07 11:28:58.016128] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.046 [2024-10-07 11:28:58.016142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.046 [2024-10-07 11:28:58.016171] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.046 [2024-10-07 11:28:58.022932] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.046 [2024-10-07 11:28:58.023125] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.046 [2024-10-07 11:28:58.023162] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.046 [2024-10-07 11:28:58.023180] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.046 [2024-10-07 11:28:58.023918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.046 [2024-10-07 11:28:58.024588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.046 [2024-10-07 11:28:58.024648] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.046 [2024-10-07 11:28:58.024669] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.046 [2024-10-07 11:28:58.024788] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.046 [2024-10-07 11:28:58.025955] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.046 [2024-10-07 11:28:58.026075] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.046 [2024-10-07 11:28:58.026107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.046 [2024-10-07 11:28:58.026124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.046 [2024-10-07 11:28:58.026156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.046 [2024-10-07 11:28:58.026206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.046 [2024-10-07 11:28:58.026238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.046 [2024-10-07 11:28:58.026259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.046 [2024-10-07 11:28:58.026292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.047 [2024-10-07 11:28:58.033093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.047 [2024-10-07 11:28:58.033274] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.047 [2024-10-07 11:28:58.033310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.047 [2024-10-07 11:28:58.033329] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.047 [2024-10-07 11:28:58.034466] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.047 [2024-10-07 11:28:58.034738] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.047 [2024-10-07 11:28:58.034795] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.047 [2024-10-07 11:28:58.034874] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.047 [2024-10-07 11:28:58.034983] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.047 [2024-10-07 11:28:58.036633] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.047 [2024-10-07 11:28:58.036785] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.047 [2024-10-07 11:28:58.036825] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.047 [2024-10-07 11:28:58.036845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.047 [2024-10-07 11:28:58.036877] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.047 [2024-10-07 11:28:58.036909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.047 [2024-10-07 11:28:58.036926] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.047 [2024-10-07 11:28:58.036940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.047 [2024-10-07 11:28:58.036971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.047 [2024-10-07 11:28:58.043247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.047 [2024-10-07 11:28:58.043449] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.047 [2024-10-07 11:28:58.043486] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.047 [2024-10-07 11:28:58.043505] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.047 [2024-10-07 11:28:58.043539] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.047 [2024-10-07 11:28:58.044263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.047 [2024-10-07 11:28:58.044303] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.047 [2024-10-07 11:28:58.044323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.047 [2024-10-07 11:28:58.044970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.047 [2024-10-07 11:28:58.046745] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.047 [2024-10-07 11:28:58.046869] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.047 [2024-10-07 11:28:58.046902] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.047 [2024-10-07 11:28:58.046919] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.047 [2024-10-07 11:28:58.046951] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.047 [2024-10-07 11:28:58.046982] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.047 [2024-10-07 11:28:58.046999] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.047 [2024-10-07 11:28:58.047013] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.047 [2024-10-07 11:28:58.047043] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.047 [2024-10-07 11:28:58.054373] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.047 [2024-10-07 11:28:58.054606] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.047 [2024-10-07 11:28:58.054642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.047 [2024-10-07 11:28:58.054660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.047 [2024-10-07 11:28:58.054695] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.047 [2024-10-07 11:28:58.054727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.047 [2024-10-07 11:28:58.054743] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.047 [2024-10-07 11:28:58.054759] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.047 [2024-10-07 11:28:58.054789] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.047 [2024-10-07 11:28:58.058862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.047 [2024-10-07 11:28:58.059132] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.047 [2024-10-07 11:28:58.059178] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.047 [2024-10-07 11:28:58.059199] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.047 [2024-10-07 11:28:58.059256] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.047 [2024-10-07 11:28:58.059294] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.047 [2024-10-07 11:28:58.059312] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.047 [2024-10-07 11:28:58.059327] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.047 [2024-10-07 11:28:58.059359] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.047 [2024-10-07 11:28:58.064562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.047 [2024-10-07 11:28:58.064731] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.047 [2024-10-07 11:28:58.064765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.047 [2024-10-07 11:28:58.064783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.047 [2024-10-07 11:28:58.064817] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.047 [2024-10-07 11:28:58.064848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.047 [2024-10-07 11:28:58.064864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.047 [2024-10-07 11:28:58.064880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.047 [2024-10-07 11:28:58.064910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.047 [2024-10-07 11:28:58.069124] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.047 [2024-10-07 11:28:58.069293] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.047 [2024-10-07 11:28:58.069327] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.047 [2024-10-07 11:28:58.069345] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.047 [2024-10-07 11:28:58.069396] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.047 [2024-10-07 11:28:58.069464] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.047 [2024-10-07 11:28:58.069483] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.047 [2024-10-07 11:28:58.069498] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.047 [2024-10-07 11:28:58.069528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.047 [2024-10-07 11:28:58.075366] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.047 [2024-10-07 11:28:58.076171] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.047 [2024-10-07 11:28:58.076220] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.047 [2024-10-07 11:28:58.076242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.047 [2024-10-07 11:28:58.076600] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.047 [2024-10-07 11:28:58.076692] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.047 [2024-10-07 11:28:58.076717] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.047 [2024-10-07 11:28:58.076733] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.047 [2024-10-07 11:28:58.076766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.048 [2024-10-07 11:28:58.079567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.048 [2024-10-07 11:28:58.079734] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.048 [2024-10-07 11:28:58.079768] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.048 [2024-10-07 11:28:58.079786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.048 [2024-10-07 11:28:58.079818] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.048 [2024-10-07 11:28:58.079850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.048 [2024-10-07 11:28:58.079867] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.048 [2024-10-07 11:28:58.079881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.048 [2024-10-07 11:28:58.079911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.048 [2024-10-07 11:28:58.086130] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.048 [2024-10-07 11:28:58.086354] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.048 [2024-10-07 11:28:58.086390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.048 [2024-10-07 11:28:58.086424] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.048 [2024-10-07 11:28:58.087649] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.048 [2024-10-07 11:28:58.088729] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.048 [2024-10-07 11:28:58.088769] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.048 [2024-10-07 11:28:58.088827] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.048 [2024-10-07 11:28:58.089137] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.048 [2024-10-07 11:28:58.089676] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.048 [2024-10-07 11:28:58.089817] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.048 [2024-10-07 11:28:58.089861] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.048 [2024-10-07 11:28:58.089882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.048 [2024-10-07 11:28:58.089916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.048 [2024-10-07 11:28:58.089964] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.048 [2024-10-07 11:28:58.089984] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.048 [2024-10-07 11:28:58.089998] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.048 [2024-10-07 11:28:58.090729] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.048 [2024-10-07 11:28:58.096602] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.048 [2024-10-07 11:28:58.096791] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.048 [2024-10-07 11:28:58.096826] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.048 [2024-10-07 11:28:58.096844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.048 [2024-10-07 11:28:58.097980] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.048 8429.00 IOPS, 32.93 MiB/s [2024-10-07T11:29:07.759Z] [2024-10-07 11:28:58.099903] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.048 [2024-10-07 11:28:58.099937] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.048 [2024-10-07 11:28:58.099956] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.048 [2024-10-07 11:28:58.101039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.048 [2024-10-07 11:28:58.102263] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.048 [2024-10-07 11:28:58.102598] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.048 [2024-10-07 11:28:58.102644] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.048 [2024-10-07 11:28:58.102665] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.048 [2024-10-07 11:28:58.102785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.048 [2024-10-07 11:28:58.104002] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.048 [2024-10-07 11:28:58.104039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.048 [2024-10-07 11:28:58.104057] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.048 [2024-10-07 11:28:58.105250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.048 [2024-10-07 11:28:58.107150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.048 [2024-10-07 11:28:58.107289] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.048 [2024-10-07 11:28:58.107361] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.048 [2024-10-07 11:28:58.107384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.048 [2024-10-07 11:28:58.107434] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.048 [2024-10-07 11:28:58.107468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.048 [2024-10-07 11:28:58.107485] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.048 [2024-10-07 11:28:58.107500] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.048 [2024-10-07 11:28:58.107530] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.048 [2024-10-07 11:28:58.113069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.048 [2024-10-07 11:28:58.114237] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.048 [2024-10-07 11:28:58.114289] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.048 [2024-10-07 11:28:58.114310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.048 [2024-10-07 11:28:58.114531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.048 [2024-10-07 11:28:58.114598] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.048 [2024-10-07 11:28:58.114618] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.048 [2024-10-07 11:28:58.114633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.048 [2024-10-07 11:28:58.114667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.048 [2024-10-07 11:28:58.118823] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.048 [2024-10-07 11:28:58.119101] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.048 [2024-10-07 11:28:58.119146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.048 [2024-10-07 11:28:58.119167] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.048 [2024-10-07 11:28:58.119223] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.048 [2024-10-07 11:28:58.119260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.048 [2024-10-07 11:28:58.119277] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.048 [2024-10-07 11:28:58.119293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.048 [2024-10-07 11:28:58.119325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.048 [2024-10-07 11:28:58.123197] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.048 [2024-10-07 11:28:58.123351] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.048 [2024-10-07 11:28:58.123384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.048 [2024-10-07 11:28:58.123417] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.048 [2024-10-07 11:28:58.124232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.048 [2024-10-07 11:28:58.124489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.048 [2024-10-07 11:28:58.124524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.048 [2024-10-07 11:28:58.124544] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.048 [2024-10-07 11:28:58.124689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.048 [2024-10-07 11:28:58.129210] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.048 [2024-10-07 11:28:58.129384] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.048 [2024-10-07 11:28:58.129433] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.048 [2024-10-07 11:28:58.129455] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.048 [2024-10-07 11:28:58.129492] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.048 [2024-10-07 11:28:58.129524] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.048 [2024-10-07 11:28:58.129541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.048 [2024-10-07 11:28:58.129556] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.048 [2024-10-07 11:28:58.129586] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.048 [2024-10-07 11:28:58.133791] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.048 [2024-10-07 11:28:58.133972] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.048 [2024-10-07 11:28:58.134009] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.048 [2024-10-07 11:28:58.134028] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.048 [2024-10-07 11:28:58.134062] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.049 [2024-10-07 11:28:58.134093] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.049 [2024-10-07 11:28:58.134110] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.049 [2024-10-07 11:28:58.134125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.049 [2024-10-07 11:28:58.134156] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.049 [2024-10-07 11:28:58.139355] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.049 [2024-10-07 11:28:58.139538] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.049 [2024-10-07 11:28:58.139573] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.049 [2024-10-07 11:28:58.139591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.049 [2024-10-07 11:28:58.139645] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.049 [2024-10-07 11:28:58.139679] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.049 [2024-10-07 11:28:58.139695] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.049 [2024-10-07 11:28:58.139710] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.049 [2024-10-07 11:28:58.139772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.049 [2024-10-07 11:28:58.144062] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.049 [2024-10-07 11:28:58.144219] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.049 [2024-10-07 11:28:58.144253] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.049 [2024-10-07 11:28:58.144271] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.049 [2024-10-07 11:28:58.144304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.049 [2024-10-07 11:28:58.144335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.049 [2024-10-07 11:28:58.144351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.049 [2024-10-07 11:28:58.144367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.049 [2024-10-07 11:28:58.144396] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.049 [2024-10-07 11:28:58.150197] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.049 [2024-10-07 11:28:58.151044] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.049 [2024-10-07 11:28:58.151095] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.049 [2024-10-07 11:28:58.151117] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.049 [2024-10-07 11:28:58.151471] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.049 [2024-10-07 11:28:58.151562] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.049 [2024-10-07 11:28:58.151587] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.049 [2024-10-07 11:28:58.151603] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.049 [2024-10-07 11:28:58.151641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.049 [2024-10-07 11:28:58.154184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.049 [2024-10-07 11:28:58.154348] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.049 [2024-10-07 11:28:58.154383] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.049 [2024-10-07 11:28:58.154418] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.049 [2024-10-07 11:28:58.154457] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.049 [2024-10-07 11:28:58.154488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.049 [2024-10-07 11:28:58.154506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.049 [2024-10-07 11:28:58.154521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.049 [2024-10-07 11:28:58.154551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.049 [2024-10-07 11:28:58.160580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.049 [2024-10-07 11:28:58.160806] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.049 [2024-10-07 11:28:58.160847] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.049 [2024-10-07 11:28:58.160909] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.049 [2024-10-07 11:28:58.162175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.049 [2024-10-07 11:28:58.163466] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.049 [2024-10-07 11:28:58.163511] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.049 [2024-10-07 11:28:58.163530] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.049 [2024-10-07 11:28:58.163760] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.049 [2024-10-07 11:28:58.165523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.049 [2024-10-07 11:28:58.165922] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.049 [2024-10-07 11:28:58.165972] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.049 [2024-10-07 11:28:58.165994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.049 [2024-10-07 11:28:58.166070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.049 [2024-10-07 11:28:58.166108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.049 [2024-10-07 11:28:58.166126] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.049 [2024-10-07 11:28:58.166141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.049 [2024-10-07 11:28:58.166172] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.049 [2024-10-07 11:28:58.170755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.049 [2024-10-07 11:28:58.172076] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.049 [2024-10-07 11:28:58.172133] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.049 [2024-10-07 11:28:58.172156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.049 [2024-10-07 11:28:58.172384] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.049 [2024-10-07 11:28:58.173468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.049 [2024-10-07 11:28:58.173508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.049 [2024-10-07 11:28:58.173528] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.049 [2024-10-07 11:28:58.173789] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.049 [2024-10-07 11:28:58.177939] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.049 [2024-10-07 11:28:58.178270] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.049 [2024-10-07 11:28:58.178309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.049 [2024-10-07 11:28:58.178327] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.049 [2024-10-07 11:28:58.178385] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.049 [2024-10-07 11:28:58.178440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.049 [2024-10-07 11:28:58.178486] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.049 [2024-10-07 11:28:58.178504] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.049 [2024-10-07 11:28:58.178537] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.049 [2024-10-07 11:28:58.180918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.049 [2024-10-07 11:28:58.181093] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.049 [2024-10-07 11:28:58.181127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.049 [2024-10-07 11:28:58.181145] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.049 [2024-10-07 11:28:58.181179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.049 [2024-10-07 11:28:58.181210] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.049 [2024-10-07 11:28:58.181227] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.049 [2024-10-07 11:28:58.181242] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.049 [2024-10-07 11:28:58.181273] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.049 [2024-10-07 11:28:58.188203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.049 [2024-10-07 11:28:58.188420] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.049 [2024-10-07 11:28:58.188456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.049 [2024-10-07 11:28:58.188476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.049 [2024-10-07 11:28:58.188513] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.049 [2024-10-07 11:28:58.188544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.049 [2024-10-07 11:28:58.188562] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.049 [2024-10-07 11:28:58.188578] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.049 [2024-10-07 11:28:58.188608] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.049 [2024-10-07 11:28:58.192650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.049 [2024-10-07 11:28:58.192982] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.049 [2024-10-07 11:28:58.193020] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.049 [2024-10-07 11:28:58.193039] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.050 [2024-10-07 11:28:58.193117] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.050 [2024-10-07 11:28:58.193156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.050 [2024-10-07 11:28:58.193173] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.050 [2024-10-07 11:28:58.193189] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.050 [2024-10-07 11:28:58.193219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.050 [2024-10-07 11:28:58.198371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.050 [2024-10-07 11:28:58.198607] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.050 [2024-10-07 11:28:58.198645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.050 [2024-10-07 11:28:58.198665] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.050 [2024-10-07 11:28:58.198700] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.050 [2024-10-07 11:28:58.199712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.050 [2024-10-07 11:28:58.199771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.050 [2024-10-07 11:28:58.199793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.050 [2024-10-07 11:28:58.200015] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.050 [2024-10-07 11:28:58.202818] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.050 [2024-10-07 11:28:58.203019] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.050 [2024-10-07 11:28:58.203056] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.050 [2024-10-07 11:28:58.203075] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.050 [2024-10-07 11:28:58.203111] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.050 [2024-10-07 11:28:58.203144] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.050 [2024-10-07 11:28:58.203160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.050 [2024-10-07 11:28:58.203178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.050 [2024-10-07 11:28:58.203208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.050 [2024-10-07 11:28:58.208562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.050 [2024-10-07 11:28:58.208775] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.050 [2024-10-07 11:28:58.208811] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.050 [2024-10-07 11:28:58.208830] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.050 [2024-10-07 11:28:58.209581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.050 [2024-10-07 11:28:58.210357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.050 [2024-10-07 11:28:58.210455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.050 [2024-10-07 11:28:58.210491] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.050 [2024-10-07 11:28:58.210667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.050 [2024-10-07 11:28:58.212964] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.050 [2024-10-07 11:28:58.213142] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.050 [2024-10-07 11:28:58.213196] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.050 [2024-10-07 11:28:58.213231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.050 [2024-10-07 11:28:58.213308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.050 [2024-10-07 11:28:58.213340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.050 [2024-10-07 11:28:58.213357] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.050 [2024-10-07 11:28:58.213372] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.050 [2024-10-07 11:28:58.214199] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.050 [2024-10-07 11:28:58.218774] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.050 [2024-10-07 11:28:58.218971] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.050 [2024-10-07 11:28:58.219007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.050 [2024-10-07 11:28:58.219026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.050 [2024-10-07 11:28:58.219060] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.050 [2024-10-07 11:28:58.219092] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.050 [2024-10-07 11:28:58.219110] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.050 [2024-10-07 11:28:58.219126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.050 [2024-10-07 11:28:58.220173] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.050 [2024-10-07 11:28:58.223100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.050 [2024-10-07 11:28:58.223305] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.050 [2024-10-07 11:28:58.223340] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.050 [2024-10-07 11:28:58.223358] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.050 [2024-10-07 11:28:58.224598] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.050 [2024-10-07 11:28:58.225682] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.050 [2024-10-07 11:28:58.225722] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.050 [2024-10-07 11:28:58.225742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.050 [2024-10-07 11:28:58.225873] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.050 [2024-10-07 11:28:58.228947] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.050 [2024-10-07 11:28:58.229127] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.050 [2024-10-07 11:28:58.229164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.050 [2024-10-07 11:28:58.229182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.050 [2024-10-07 11:28:58.229220] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.050 [2024-10-07 11:28:58.229266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.050 [2024-10-07 11:28:58.229285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.050 [2024-10-07 11:28:58.229331] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.050 [2024-10-07 11:28:58.229365] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.050 [2024-10-07 11:28:58.233251] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.050 [2024-10-07 11:28:58.233442] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.050 [2024-10-07 11:28:58.233476] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.050 [2024-10-07 11:28:58.233494] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.050 [2024-10-07 11:28:58.233529] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.050 [2024-10-07 11:28:58.233561] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.050 [2024-10-07 11:28:58.233578] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.050 [2024-10-07 11:28:58.233593] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.050 [2024-10-07 11:28:58.233623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.050 [2024-10-07 11:28:58.239070] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.050 [2024-10-07 11:28:58.239253] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.050 [2024-10-07 11:28:58.239287] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.050 [2024-10-07 11:28:58.239305] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.050 [2024-10-07 11:28:58.239361] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.050 [2024-10-07 11:28:58.239396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.050 [2024-10-07 11:28:58.239431] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.050 [2024-10-07 11:28:58.239447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.050 [2024-10-07 11:28:58.239479] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.050 [2024-10-07 11:28:58.244145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.050 [2024-10-07 11:28:58.244314] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.050 [2024-10-07 11:28:58.244348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.050 [2024-10-07 11:28:58.244366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.050 [2024-10-07 11:28:58.244421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.050 [2024-10-07 11:28:58.244477] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.050 [2024-10-07 11:28:58.244505] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.050 [2024-10-07 11:28:58.244521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.050 [2024-10-07 11:28:58.244724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.050 [2024-10-07 11:28:58.249227] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.050 [2024-10-07 11:28:58.249488] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.051 [2024-10-07 11:28:58.249526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.051 [2024-10-07 11:28:58.249546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.051 [2024-10-07 11:28:58.249584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.051 [2024-10-07 11:28:58.249615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.051 [2024-10-07 11:28:58.249633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.051 [2024-10-07 11:28:58.249648] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.051 [2024-10-07 11:28:58.249680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.051 [2024-10-07 11:28:58.254377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.051 [2024-10-07 11:28:58.254616] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.051 [2024-10-07 11:28:58.254656] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.051 [2024-10-07 11:28:58.254675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.051 [2024-10-07 11:28:58.254713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.051 [2024-10-07 11:28:58.254744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.051 [2024-10-07 11:28:58.254761] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.051 [2024-10-07 11:28:58.254778] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.051 [2024-10-07 11:28:58.254809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.051 [2024-10-07 11:28:58.260134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.051 [2024-10-07 11:28:58.260340] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.051 [2024-10-07 11:28:58.260374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.051 [2024-10-07 11:28:58.260393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.051 [2024-10-07 11:28:58.260451] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.051 [2024-10-07 11:28:58.260484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.051 [2024-10-07 11:28:58.260501] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.051 [2024-10-07 11:28:58.260516] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.051 [2024-10-07 11:28:58.260547] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.051 [2024-10-07 11:28:58.264560] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.051 [2024-10-07 11:28:58.264723] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.051 [2024-10-07 11:28:58.264756] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.051 [2024-10-07 11:28:58.264774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.051 [2024-10-07 11:28:58.265549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.051 [2024-10-07 11:28:58.266199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.051 [2024-10-07 11:28:58.266237] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.051 [2024-10-07 11:28:58.266256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.051 [2024-10-07 11:28:58.266595] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.051 [2024-10-07 11:28:58.271167] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.051 [2024-10-07 11:28:58.271342] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.051 [2024-10-07 11:28:58.271377] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.051 [2024-10-07 11:28:58.271396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.051 [2024-10-07 11:28:58.271449] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.051 [2024-10-07 11:28:58.272555] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.051 [2024-10-07 11:28:58.272593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.051 [2024-10-07 11:28:58.272613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.051 [2024-10-07 11:28:58.272861] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.051 [2024-10-07 11:28:58.275807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.051 [2024-10-07 11:28:58.275954] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.051 [2024-10-07 11:28:58.275987] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.051 [2024-10-07 11:28:58.276005] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.051 [2024-10-07 11:28:58.276039] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.051 [2024-10-07 11:28:58.277271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.051 [2024-10-07 11:28:58.277309] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.051 [2024-10-07 11:28:58.277328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.051 [2024-10-07 11:28:58.278545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.051 [2024-10-07 11:28:58.281318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.051 [2024-10-07 11:28:58.281471] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.051 [2024-10-07 11:28:58.281517] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.051 [2024-10-07 11:28:58.281538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.051 [2024-10-07 11:28:58.281573] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.051 [2024-10-07 11:28:58.281604] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.051 [2024-10-07 11:28:58.281620] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.051 [2024-10-07 11:28:58.281644] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.051 [2024-10-07 11:28:58.281689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.051 [2024-10-07 11:28:58.285916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.051 [2024-10-07 11:28:58.287134] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.051 [2024-10-07 11:28:58.287180] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.051 [2024-10-07 11:28:58.287201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.051 [2024-10-07 11:28:58.287424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.051 [2024-10-07 11:28:58.288451] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.051 [2024-10-07 11:28:58.288487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.051 [2024-10-07 11:28:58.288506] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.051 [2024-10-07 11:28:58.288749] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.051 [2024-10-07 11:28:58.293089] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.051 [2024-10-07 11:28:58.293260] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.051 [2024-10-07 11:28:58.293294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.051 [2024-10-07 11:28:58.293312] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.051 [2024-10-07 11:28:58.293346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.051 [2024-10-07 11:28:58.293377] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.051 [2024-10-07 11:28:58.293394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.051 [2024-10-07 11:28:58.293430] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.051 [2024-10-07 11:28:58.293465] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.051 [2024-10-07 11:28:58.296028] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.051 [2024-10-07 11:28:58.296145] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.051 [2024-10-07 11:28:58.296177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.051 [2024-10-07 11:28:58.296194] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.052 [2024-10-07 11:28:58.296225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.052 [2024-10-07 11:28:58.296255] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.052 [2024-10-07 11:28:58.296271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.052 [2024-10-07 11:28:58.296285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.052 [2024-10-07 11:28:58.296315] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.052 [2024-10-07 11:28:58.304111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.052 [2024-10-07 11:28:58.304276] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.052 [2024-10-07 11:28:58.304337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.052 [2024-10-07 11:28:58.304358] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.052 [2024-10-07 11:28:58.304392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.052 [2024-10-07 11:28:58.304453] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.052 [2024-10-07 11:28:58.304471] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.052 [2024-10-07 11:28:58.304487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.052 [2024-10-07 11:28:58.304518] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.052 [2024-10-07 11:28:58.306394] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.052 [2024-10-07 11:28:58.306523] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.052 [2024-10-07 11:28:58.306554] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.052 [2024-10-07 11:28:58.306571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.052 [2024-10-07 11:28:58.306602] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.052 [2024-10-07 11:28:58.306649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.052 [2024-10-07 11:28:58.306668] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.052 [2024-10-07 11:28:58.306682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.052 [2024-10-07 11:28:58.306712] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.052 [2024-10-07 11:28:58.314953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.052 [2024-10-07 11:28:58.315154] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.052 [2024-10-07 11:28:58.315189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.052 [2024-10-07 11:28:58.315208] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.052 [2024-10-07 11:28:58.315258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.052 [2024-10-07 11:28:58.315292] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.052 [2024-10-07 11:28:58.315310] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.052 [2024-10-07 11:28:58.315325] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.052 [2024-10-07 11:28:58.315355] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.052 [2024-10-07 11:28:58.316779] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.052 [2024-10-07 11:28:58.316887] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.052 [2024-10-07 11:28:58.316917] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.052 [2024-10-07 11:28:58.316934] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.052 [2024-10-07 11:28:58.316966] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.052 [2024-10-07 11:28:58.318120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.052 [2024-10-07 11:28:58.318158] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.052 [2024-10-07 11:28:58.318177] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.052 [2024-10-07 11:28:58.318386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.052 [2024-10-07 11:28:58.326238] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.052 [2024-10-07 11:28:58.326680] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.052 [2024-10-07 11:28:58.326728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.052 [2024-10-07 11:28:58.326749] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.052 [2024-10-07 11:28:58.326828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.052 [2024-10-07 11:28:58.326867] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.052 [2024-10-07 11:28:58.326884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.052 [2024-10-07 11:28:58.326900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.052 [2024-10-07 11:28:58.326944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.052 [2024-10-07 11:28:58.326978] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.052 [2024-10-07 11:28:58.327058] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.052 [2024-10-07 11:28:58.327087] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.052 [2024-10-07 11:28:58.327103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.052 [2024-10-07 11:28:58.327133] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.052 [2024-10-07 11:28:58.327163] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.052 [2024-10-07 11:28:58.327178] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.052 [2024-10-07 11:28:58.327192] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.052 [2024-10-07 11:28:58.327221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.052 [2024-10-07 11:28:58.338567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.052 [2024-10-07 11:28:58.338663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.052 [2024-10-07 11:28:58.338817] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.052 [2024-10-07 11:28:58.338854] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.052 [2024-10-07 11:28:58.338872] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.052 [2024-10-07 11:28:58.338922] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.052 [2024-10-07 11:28:58.338945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.052 [2024-10-07 11:28:58.338961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.052 [2024-10-07 11:28:58.339026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.052 [2024-10-07 11:28:58.339051] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.052 [2024-10-07 11:28:58.339077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.052 [2024-10-07 11:28:58.339095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.052 [2024-10-07 11:28:58.339110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.052 [2024-10-07 11:28:58.339127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.052 [2024-10-07 11:28:58.339141] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.052 [2024-10-07 11:28:58.339154] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.052 [2024-10-07 11:28:58.339183] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.052 [2024-10-07 11:28:58.339200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.052 [2024-10-07 11:28:58.348762] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.052 [2024-10-07 11:28:58.349882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.052 [2024-10-07 11:28:58.350014] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.052 [2024-10-07 11:28:58.350049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.052 [2024-10-07 11:28:58.350068] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.052 [2024-10-07 11:28:58.350318] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.052 [2024-10-07 11:28:58.350358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.052 [2024-10-07 11:28:58.350377] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.052 [2024-10-07 11:28:58.350416] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.052 [2024-10-07 11:28:58.350538] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.052 [2024-10-07 11:28:58.350560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.052 [2024-10-07 11:28:58.350574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.052 [2024-10-07 11:28:58.350590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.052 [2024-10-07 11:28:58.351804] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.052 [2024-10-07 11:28:58.351841] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.052 [2024-10-07 11:28:58.351858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.052 [2024-10-07 11:28:58.351873] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.052 [2024-10-07 11:28:58.353009] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.053 [2024-10-07 11:28:58.359995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.053 [2024-10-07 11:28:58.360177] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.053 [2024-10-07 11:28:58.360212] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.053 [2024-10-07 11:28:58.360256] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.053 [2024-10-07 11:28:58.361378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.053 [2024-10-07 11:28:58.361450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.053 [2024-10-07 11:28:58.361704] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.053 [2024-10-07 11:28:58.361744] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.053 [2024-10-07 11:28:58.361764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.053 [2024-10-07 11:28:58.361780] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.053 [2024-10-07 11:28:58.361793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.053 [2024-10-07 11:28:58.361808] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.053 [2024-10-07 11:28:58.362830] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.053 [2024-10-07 11:28:58.362870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.053 [2024-10-07 11:28:58.363134] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.053 [2024-10-07 11:28:58.363169] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.053 [2024-10-07 11:28:58.363186] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.053 [2024-10-07 11:28:58.363219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.053 [2024-10-07 11:28:58.370121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.053 [2024-10-07 11:28:58.370286] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.053 [2024-10-07 11:28:58.370319] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.053 [2024-10-07 11:28:58.370337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.053 [2024-10-07 11:28:58.370371] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.053 [2024-10-07 11:28:58.370416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.053 [2024-10-07 11:28:58.370436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.053 [2024-10-07 11:28:58.370451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.053 [2024-10-07 11:28:58.370482] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.053 [2024-10-07 11:28:58.372479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.053 [2024-10-07 11:28:58.372615] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.053 [2024-10-07 11:28:58.372661] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.053 [2024-10-07 11:28:58.372680] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.053 [2024-10-07 11:28:58.372712] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.053 [2024-10-07 11:28:58.372742] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.053 [2024-10-07 11:28:58.372782] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.053 [2024-10-07 11:28:58.372797] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.053 [2024-10-07 11:28:58.372828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.053 [2024-10-07 11:28:58.381566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.053 [2024-10-07 11:28:58.381745] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.053 [2024-10-07 11:28:58.381780] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.053 [2024-10-07 11:28:58.381798] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.053 [2024-10-07 11:28:58.381832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.053 [2024-10-07 11:28:58.381863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.053 [2024-10-07 11:28:58.381879] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.053 [2024-10-07 11:28:58.381894] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.053 [2024-10-07 11:28:58.381923] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.053 [2024-10-07 11:28:58.383635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.053 [2024-10-07 11:28:58.383983] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.053 [2024-10-07 11:28:58.384024] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.053 [2024-10-07 11:28:58.384044] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.053 [2024-10-07 11:28:58.384114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.053 [2024-10-07 11:28:58.384151] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.053 [2024-10-07 11:28:58.384168] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.053 [2024-10-07 11:28:58.384182] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.053 [2024-10-07 11:28:58.384230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.053 [2024-10-07 11:28:58.391717] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.053 [2024-10-07 11:28:58.391901] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.053 [2024-10-07 11:28:58.391936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.053 [2024-10-07 11:28:58.391954] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.053 [2024-10-07 11:28:58.392983] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.053 [2024-10-07 11:28:58.393238] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.053 [2024-10-07 11:28:58.393274] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.053 [2024-10-07 11:28:58.393293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.053 [2024-10-07 11:28:58.393428] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.053 [2024-10-07 11:28:58.395990] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.053 [2024-10-07 11:28:58.396158] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.053 [2024-10-07 11:28:58.396195] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.053 [2024-10-07 11:28:58.396214] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.053 [2024-10-07 11:28:58.396247] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.053 [2024-10-07 11:28:58.396278] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.053 [2024-10-07 11:28:58.396294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.053 [2024-10-07 11:28:58.396308] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.053 [2024-10-07 11:28:58.396338] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.053 [2024-10-07 11:28:58.401867] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.053 [2024-10-07 11:28:58.402962] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.053 [2024-10-07 11:28:58.403007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.053 [2024-10-07 11:28:58.403029] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.053 [2024-10-07 11:28:58.403229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.053 [2024-10-07 11:28:58.404385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.053 [2024-10-07 11:28:58.404437] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.053 [2024-10-07 11:28:58.404457] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.053 [2024-10-07 11:28:58.404666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.053 [2024-10-07 11:28:58.406098] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.053 [2024-10-07 11:28:58.406224] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.053 [2024-10-07 11:28:58.406255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.053 [2024-10-07 11:28:58.406272] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.053 [2024-10-07 11:28:58.406303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.053 [2024-10-07 11:28:58.406334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.053 [2024-10-07 11:28:58.406350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.053 [2024-10-07 11:28:58.406364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.053 [2024-10-07 11:28:58.407380] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.053 [2024-10-07 11:28:58.412546] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.053 [2024-10-07 11:28:58.413215] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.053 [2024-10-07 11:28:58.413261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.053 [2024-10-07 11:28:58.413282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.054 [2024-10-07 11:28:58.413435] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.054 [2024-10-07 11:28:58.413477] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.054 [2024-10-07 11:28:58.413494] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.054 [2024-10-07 11:28:58.413509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.054 [2024-10-07 11:28:58.413540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.054 [2024-10-07 11:28:58.417233] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.054 [2024-10-07 11:28:58.417380] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.054 [2024-10-07 11:28:58.417426] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.054 [2024-10-07 11:28:58.417446] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.054 [2024-10-07 11:28:58.417480] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.054 [2024-10-07 11:28:58.417510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.054 [2024-10-07 11:28:58.417527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.054 [2024-10-07 11:28:58.417542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.054 [2024-10-07 11:28:58.417572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.054 [2024-10-07 11:28:58.423662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.054 [2024-10-07 11:28:58.423818] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.054 [2024-10-07 11:28:58.423851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.054 [2024-10-07 11:28:58.423869] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.054 [2024-10-07 11:28:58.425085] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.054 [2024-10-07 11:28:58.426298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.054 [2024-10-07 11:28:58.426337] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.054 [2024-10-07 11:28:58.426356] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.054 [2024-10-07 11:28:58.426575] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.054 [2024-10-07 11:28:58.428556] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.054 [2024-10-07 11:28:58.428909] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.054 [2024-10-07 11:28:58.428952] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.054 [2024-10-07 11:28:58.428972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.054 [2024-10-07 11:28:58.429042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.054 [2024-10-07 11:28:58.429094] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.054 [2024-10-07 11:28:58.429113] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.054 [2024-10-07 11:28:58.429151] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.054 [2024-10-07 11:28:58.429183] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.054 [2024-10-07 11:28:58.435040] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.054 [2024-10-07 11:28:58.436207] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.054 [2024-10-07 11:28:58.436254] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.054 [2024-10-07 11:28:58.436276] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.054 [2024-10-07 11:28:58.436524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.054 [2024-10-07 11:28:58.436602] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.054 [2024-10-07 11:28:58.436623] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.054 [2024-10-07 11:28:58.436638] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.054 [2024-10-07 11:28:58.436670] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.054 [2024-10-07 11:28:58.440672] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.054 [2024-10-07 11:28:58.440918] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.054 [2024-10-07 11:28:58.440961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.054 [2024-10-07 11:28:58.440982] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.054 [2024-10-07 11:28:58.441037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.054 [2024-10-07 11:28:58.441088] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.054 [2024-10-07 11:28:58.441107] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.054 [2024-10-07 11:28:58.441121] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.054 [2024-10-07 11:28:58.441151] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.054 [2024-10-07 11:28:58.446012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.054 [2024-10-07 11:28:58.446177] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.054 [2024-10-07 11:28:58.446209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.054 [2024-10-07 11:28:58.446228] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.054 [2024-10-07 11:28:58.446260] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.054 [2024-10-07 11:28:58.446304] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.054 [2024-10-07 11:28:58.446323] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.054 [2024-10-07 11:28:58.446337] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.054 [2024-10-07 11:28:58.446367] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.054 [2024-10-07 11:28:58.450785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.054 [2024-10-07 11:28:58.450959] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.054 [2024-10-07 11:28:58.450993] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.054 [2024-10-07 11:28:58.451010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.054 [2024-10-07 11:28:58.451042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.054 [2024-10-07 11:28:58.451072] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.054 [2024-10-07 11:28:58.451089] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.054 [2024-10-07 11:28:58.451104] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.054 [2024-10-07 11:28:58.452121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.054 [2024-10-07 11:28:58.456127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.054 [2024-10-07 11:28:58.456985] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.054 [2024-10-07 11:28:58.457032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.054 [2024-10-07 11:28:58.457066] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.054 [2024-10-07 11:28:58.457728] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.054 [2024-10-07 11:28:58.457858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.054 [2024-10-07 11:28:58.457884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.054 [2024-10-07 11:28:58.457900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.054 [2024-10-07 11:28:58.457934] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.054 [2024-10-07 11:28:58.461586] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.054 [2024-10-07 11:28:58.461755] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.054 [2024-10-07 11:28:58.461794] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.054 [2024-10-07 11:28:58.461812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.054 [2024-10-07 11:28:58.461844] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.054 [2024-10-07 11:28:58.461895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.054 [2024-10-07 11:28:58.461915] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.054 [2024-10-07 11:28:58.461929] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.054 [2024-10-07 11:28:58.461959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.054 [2024-10-07 11:28:58.466272] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.054 [2024-10-07 11:28:58.466425] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.054 [2024-10-07 11:28:58.466458] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.054 [2024-10-07 11:28:58.466475] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.054 [2024-10-07 11:28:58.466541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.054 [2024-10-07 11:28:58.466574] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.054 [2024-10-07 11:28:58.466591] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.054 [2024-10-07 11:28:58.466606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.055 [2024-10-07 11:28:58.466635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.055 [2024-10-07 11:28:58.472967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.055 [2024-10-07 11:28:58.473456] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.055 [2024-10-07 11:28:58.473502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.055 [2024-10-07 11:28:58.473523] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.055 [2024-10-07 11:28:58.473596] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.055 [2024-10-07 11:28:58.473635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.055 [2024-10-07 11:28:58.473652] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.055 [2024-10-07 11:28:58.473667] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.055 [2024-10-07 11:28:58.473698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.055 [2024-10-07 11:28:58.476378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.055 [2024-10-07 11:28:58.476533] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.055 [2024-10-07 11:28:58.476565] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.055 [2024-10-07 11:28:58.476582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.055 [2024-10-07 11:28:58.476615] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.055 [2024-10-07 11:28:58.476645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.055 [2024-10-07 11:28:58.476662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.055 [2024-10-07 11:28:58.476675] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.055 [2024-10-07 11:28:58.476705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.055 [2024-10-07 11:28:58.485277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.055 [2024-10-07 11:28:58.485493] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.055 [2024-10-07 11:28:58.485529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.055 [2024-10-07 11:28:58.485546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.055 [2024-10-07 11:28:58.485581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.055 [2024-10-07 11:28:58.485611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.055 [2024-10-07 11:28:58.485629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.055 [2024-10-07 11:28:58.485669] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.055 [2024-10-07 11:28:58.485702] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.055 [2024-10-07 11:28:58.487376] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.055 [2024-10-07 11:28:58.487727] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.055 [2024-10-07 11:28:58.487768] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.055 [2024-10-07 11:28:58.487787] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.055 [2024-10-07 11:28:58.487856] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.055 [2024-10-07 11:28:58.487893] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.055 [2024-10-07 11:28:58.487910] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.055 [2024-10-07 11:28:58.487924] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.055 [2024-10-07 11:28:58.487974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.055 [2024-10-07 11:28:58.495441] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.055 [2024-10-07 11:28:58.495624] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.055 [2024-10-07 11:28:58.495659] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.055 [2024-10-07 11:28:58.495677] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.055 [2024-10-07 11:28:58.496715] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.055 [2024-10-07 11:28:58.496961] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.055 [2024-10-07 11:28:58.496997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.055 [2024-10-07 11:28:58.497017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.055 [2024-10-07 11:28:58.497147] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.055 [2024-10-07 11:28:58.499684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.055 [2024-10-07 11:28:58.499848] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.055 [2024-10-07 11:28:58.499888] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.055 [2024-10-07 11:28:58.499907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.055 [2024-10-07 11:28:58.499941] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.055 [2024-10-07 11:28:58.499972] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.055 [2024-10-07 11:28:58.499989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.055 [2024-10-07 11:28:58.500004] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.055 [2024-10-07 11:28:58.500034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.055 [2024-10-07 11:28:58.505587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.055 [2024-10-07 11:28:58.505761] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.055 [2024-10-07 11:28:58.505818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.055 [2024-10-07 11:28:58.505837] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.055 [2024-10-07 11:28:58.505872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.055 [2024-10-07 11:28:58.505904] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.055 [2024-10-07 11:28:58.505921] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.055 [2024-10-07 11:28:58.505936] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.055 [2024-10-07 11:28:58.505966] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.055 [2024-10-07 11:28:58.510758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.055 [2024-10-07 11:28:58.510909] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.055 [2024-10-07 11:28:58.510941] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.055 [2024-10-07 11:28:58.510958] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.055 [2024-10-07 11:28:58.510991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.055 [2024-10-07 11:28:58.511022] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.055 [2024-10-07 11:28:58.511038] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.055 [2024-10-07 11:28:58.511053] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.055 [2024-10-07 11:28:58.511083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.055 [2024-10-07 11:28:58.515724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.055 [2024-10-07 11:28:58.515875] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.055 [2024-10-07 11:28:58.515908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.055 [2024-10-07 11:28:58.515926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.055 [2024-10-07 11:28:58.515959] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.056 [2024-10-07 11:28:58.515989] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.056 [2024-10-07 11:28:58.516006] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.056 [2024-10-07 11:28:58.516021] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.056 [2024-10-07 11:28:58.516051] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.056 [2024-10-07 11:28:58.520875] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.056 [2024-10-07 11:28:58.521027] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.056 [2024-10-07 11:28:58.521073] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.056 [2024-10-07 11:28:58.521093] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.056 [2024-10-07 11:28:58.521126] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.056 [2024-10-07 11:28:58.521190] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.056 [2024-10-07 11:28:58.521208] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.056 [2024-10-07 11:28:58.521224] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.056 [2024-10-07 11:28:58.521253] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.056 [2024-10-07 11:28:58.525838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.056 [2024-10-07 11:28:58.526972] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.056 [2024-10-07 11:28:58.527018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.056 [2024-10-07 11:28:58.527038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.056 [2024-10-07 11:28:58.527254] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.056 [2024-10-07 11:28:58.527374] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.056 [2024-10-07 11:28:58.527413] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.056 [2024-10-07 11:28:58.527433] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.056 [2024-10-07 11:28:58.528640] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.056 [2024-10-07 11:28:58.532002] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.056 [2024-10-07 11:28:58.532378] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.056 [2024-10-07 11:28:58.532437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.056 [2024-10-07 11:28:58.532459] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.056 [2024-10-07 11:28:58.532532] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.056 [2024-10-07 11:28:58.532576] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.056 [2024-10-07 11:28:58.532593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.056 [2024-10-07 11:28:58.532608] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.056 [2024-10-07 11:28:58.532638] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.056 [2024-10-07 11:28:58.536935] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.056 [2024-10-07 11:28:58.537099] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.056 [2024-10-07 11:28:58.537132] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.056 [2024-10-07 11:28:58.537150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.056 [2024-10-07 11:28:58.538262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.056 [2024-10-07 11:28:58.538503] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.056 [2024-10-07 11:28:58.538538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.056 [2024-10-07 11:28:58.538557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.056 [2024-10-07 11:28:58.539609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.056 [2024-10-07 11:28:58.542112] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.056 [2024-10-07 11:28:58.542266] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.056 [2024-10-07 11:28:58.542306] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.056 [2024-10-07 11:28:58.542325] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.056 [2024-10-07 11:28:58.542360] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.056 [2024-10-07 11:28:58.542391] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.056 [2024-10-07 11:28:58.542423] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.056 [2024-10-07 11:28:58.542440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.056 [2024-10-07 11:28:58.542471] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.056 [2024-10-07 11:28:58.547490] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.056 [2024-10-07 11:28:58.547899] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.056 [2024-10-07 11:28:58.547945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.056 [2024-10-07 11:28:58.547966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.056 [2024-10-07 11:28:58.548058] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.056 [2024-10-07 11:28:58.548097] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.056 [2024-10-07 11:28:58.548115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.056 [2024-10-07 11:28:58.548131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.056 [2024-10-07 11:28:58.548162] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.056 [2024-10-07 11:28:58.552523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.056 [2024-10-07 11:28:58.552686] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.056 [2024-10-07 11:28:58.552720] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.056 [2024-10-07 11:28:58.552738] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.056 [2024-10-07 11:28:58.553862] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.056 [2024-10-07 11:28:58.554092] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.056 [2024-10-07 11:28:58.554127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.056 [2024-10-07 11:28:58.554146] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.056 [2024-10-07 11:28:58.555162] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.056 [2024-10-07 11:28:58.559825] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.056 [2024-10-07 11:28:58.560084] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.056 [2024-10-07 11:28:58.560130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.056 [2024-10-07 11:28:58.560182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.056 [2024-10-07 11:28:58.560242] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.056 [2024-10-07 11:28:58.560279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.056 [2024-10-07 11:28:58.560296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.056 [2024-10-07 11:28:58.560311] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.056 [2024-10-07 11:28:58.560342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.056 [2024-10-07 11:28:58.562639] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.056 [2024-10-07 11:28:58.562747] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.056 [2024-10-07 11:28:58.562777] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.056 [2024-10-07 11:28:58.562794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.056 [2024-10-07 11:28:58.562824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.056 [2024-10-07 11:28:58.562854] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.056 [2024-10-07 11:28:58.562870] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.056 [2024-10-07 11:28:58.562884] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.056 [2024-10-07 11:28:58.562913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.056 [2024-10-07 11:28:58.569964] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.056 [2024-10-07 11:28:58.570133] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.056 [2024-10-07 11:28:58.570166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.056 [2024-10-07 11:28:58.570184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.056 [2024-10-07 11:28:58.570218] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.056 [2024-10-07 11:28:58.570249] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.056 [2024-10-07 11:28:58.570266] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.057 [2024-10-07 11:28:58.570282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.057 [2024-10-07 11:28:58.570312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.057 [2024-10-07 11:28:58.574421] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.057 [2024-10-07 11:28:58.574596] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.057 [2024-10-07 11:28:58.574629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.057 [2024-10-07 11:28:58.574646] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.057 [2024-10-07 11:28:58.574679] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.057 [2024-10-07 11:28:58.574709] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.057 [2024-10-07 11:28:58.574756] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.057 [2024-10-07 11:28:58.574773] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.057 [2024-10-07 11:28:58.574805] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.057 [2024-10-07 11:28:58.580193] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.057 [2024-10-07 11:28:58.580350] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.057 [2024-10-07 11:28:58.580382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.057 [2024-10-07 11:28:58.580415] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.057 [2024-10-07 11:28:58.580453] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.057 [2024-10-07 11:28:58.580497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.057 [2024-10-07 11:28:58.580515] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.057 [2024-10-07 11:28:58.580530] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.057 [2024-10-07 11:28:58.580560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.057 [2024-10-07 11:28:58.584775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.057 [2024-10-07 11:28:58.584909] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.057 [2024-10-07 11:28:58.584940] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.057 [2024-10-07 11:28:58.584957] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.057 [2024-10-07 11:28:58.584990] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.057 [2024-10-07 11:28:58.585020] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.057 [2024-10-07 11:28:58.585036] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.057 [2024-10-07 11:28:58.585051] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.057 [2024-10-07 11:28:58.585097] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.057 [2024-10-07 11:28:58.591415] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.057 [2024-10-07 11:28:58.591829] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.057 [2024-10-07 11:28:58.591875] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.057 [2024-10-07 11:28:58.591896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.057 [2024-10-07 11:28:58.591969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.057 [2024-10-07 11:28:58.592007] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.057 [2024-10-07 11:28:58.592025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.057 [2024-10-07 11:28:58.592040] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.057 [2024-10-07 11:28:58.592070] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.057 [2024-10-07 11:28:58.594876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.057 [2024-10-07 11:28:58.594998] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.057 [2024-10-07 11:28:58.595029] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.057 [2024-10-07 11:28:58.595046] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.057 [2024-10-07 11:28:58.595078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.057 [2024-10-07 11:28:58.595108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.057 [2024-10-07 11:28:58.595124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.057 [2024-10-07 11:28:58.595138] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.057 [2024-10-07 11:28:58.595167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.057 [2024-10-07 11:28:58.603580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.057 [2024-10-07 11:28:58.603767] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.057 [2024-10-07 11:28:58.603802] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.057 [2024-10-07 11:28:58.603820] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.057 [2024-10-07 11:28:58.603855] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.057 [2024-10-07 11:28:58.603886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.057 [2024-10-07 11:28:58.603903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.057 [2024-10-07 11:28:58.603918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.057 [2024-10-07 11:28:58.603950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.057 [2024-10-07 11:28:58.605684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.057 [2024-10-07 11:28:58.606022] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.057 [2024-10-07 11:28:58.606063] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.057 [2024-10-07 11:28:58.606083] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.057 [2024-10-07 11:28:58.606152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.057 [2024-10-07 11:28:58.606189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.057 [2024-10-07 11:28:58.606206] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.057 [2024-10-07 11:28:58.606220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.057 [2024-10-07 11:28:58.606249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.057 [2024-10-07 11:28:58.613707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.057 [2024-10-07 11:28:58.613871] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.057 [2024-10-07 11:28:58.613904] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.057 [2024-10-07 11:28:58.613921] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.057 [2024-10-07 11:28:58.614980] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.057 [2024-10-07 11:28:58.615216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.057 [2024-10-07 11:28:58.615252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.057 [2024-10-07 11:28:58.615270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.057 [2024-10-07 11:28:58.615385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.057 [2024-10-07 11:28:58.617919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.057 [2024-10-07 11:28:58.618058] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.057 [2024-10-07 11:28:58.618090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.057 [2024-10-07 11:28:58.618108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.057 [2024-10-07 11:28:58.618140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.057 [2024-10-07 11:28:58.618169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.057 [2024-10-07 11:28:58.618185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.057 [2024-10-07 11:28:58.618199] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.057 [2024-10-07 11:28:58.618229] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.057 [2024-10-07 11:28:58.624889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.057 [2024-10-07 11:28:58.625078] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.057 [2024-10-07 11:28:58.625112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.057 [2024-10-07 11:28:58.625130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.057 [2024-10-07 11:28:58.626239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.057 [2024-10-07 11:28:58.626482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.057 [2024-10-07 11:28:58.626517] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.057 [2024-10-07 11:28:58.626535] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.057 [2024-10-07 11:28:58.627551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.057 [2024-10-07 11:28:58.628015] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.057 [2024-10-07 11:28:58.628123] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.057 [2024-10-07 11:28:58.628154] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.057 [2024-10-07 11:28:58.628171] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.057 [2024-10-07 11:28:58.629204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.058 [2024-10-07 11:28:58.629454] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.058 [2024-10-07 11:28:58.629489] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.058 [2024-10-07 11:28:58.629537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.058 [2024-10-07 11:28:58.630768] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.058 [2024-10-07 11:28:58.635025] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.058 [2024-10-07 11:28:58.635163] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.058 [2024-10-07 11:28:58.635195] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.058 [2024-10-07 11:28:58.635213] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.058 [2024-10-07 11:28:58.635246] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.058 [2024-10-07 11:28:58.635276] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.058 [2024-10-07 11:28:58.635293] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.058 [2024-10-07 11:28:58.635308] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.058 [2024-10-07 11:28:58.635337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.058 [2024-10-07 11:28:58.638097] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.058 [2024-10-07 11:28:58.639113] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.058 [2024-10-07 11:28:58.639155] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.058 [2024-10-07 11:28:58.639175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.058 [2024-10-07 11:28:58.639370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.058 [2024-10-07 11:28:58.639477] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.058 [2024-10-07 11:28:58.639506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.058 [2024-10-07 11:28:58.639522] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.058 [2024-10-07 11:28:58.640704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.058 [2024-10-07 11:28:58.646693] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.058 [2024-10-07 11:28:58.646873] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.058 [2024-10-07 11:28:58.646923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.058 [2024-10-07 11:28:58.646945] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.058 [2024-10-07 11:28:58.646980] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.058 [2024-10-07 11:28:58.647011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.058 [2024-10-07 11:28:58.647029] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.058 [2024-10-07 11:28:58.647044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.058 [2024-10-07 11:28:58.647075] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.058 [2024-10-07 11:28:58.648842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.058 [2024-10-07 11:28:58.648984] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.058 [2024-10-07 11:28:58.649020] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.058 [2024-10-07 11:28:58.649038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.058 [2024-10-07 11:28:58.649318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.058 [2024-10-07 11:28:58.649422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.058 [2024-10-07 11:28:58.649447] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.058 [2024-10-07 11:28:58.649462] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.058 [2024-10-07 11:28:58.649493] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.058 [2024-10-07 11:28:58.656822] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.058 [2024-10-07 11:28:58.656996] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.058 [2024-10-07 11:28:58.657032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.058 [2024-10-07 11:28:58.657050] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.058 [2024-10-07 11:28:58.657098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.058 [2024-10-07 11:28:58.657130] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.058 [2024-10-07 11:28:58.657148] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.058 [2024-10-07 11:28:58.657163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.058 [2024-10-07 11:28:58.658186] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.058 [2024-10-07 11:28:58.658958] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.058 [2024-10-07 11:28:58.660237] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.058 [2024-10-07 11:28:58.660281] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.058 [2024-10-07 11:28:58.660302] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.058 [2024-10-07 11:28:58.661374] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.058 [2024-10-07 11:28:58.661677] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.058 [2024-10-07 11:28:58.661714] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.058 [2024-10-07 11:28:58.661733] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.058 [2024-10-07 11:28:58.661878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.058 [2024-10-07 11:28:58.667321] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.058 [2024-10-07 11:28:58.667526] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.058 [2024-10-07 11:28:58.667572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.058 [2024-10-07 11:28:58.667593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.058 [2024-10-07 11:28:58.667629] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.058 [2024-10-07 11:28:58.667695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.058 [2024-10-07 11:28:58.667713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.058 [2024-10-07 11:28:58.667728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.058 [2024-10-07 11:28:58.667759] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.058 [2024-10-07 11:28:58.669184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.058 [2024-10-07 11:28:58.669298] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.058 [2024-10-07 11:28:58.669337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.058 [2024-10-07 11:28:58.669357] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.058 [2024-10-07 11:28:58.670464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.058 [2024-10-07 11:28:58.670690] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.058 [2024-10-07 11:28:58.670724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.058 [2024-10-07 11:28:58.670742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.058 [2024-10-07 11:28:58.671769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.058 [2024-10-07 11:28:58.679189] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.058 [2024-10-07 11:28:58.679429] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.058 [2024-10-07 11:28:58.679469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.058 [2024-10-07 11:28:58.679488] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.058 [2024-10-07 11:28:58.679542] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.058 [2024-10-07 11:28:58.679584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.058 [2024-10-07 11:28:58.679615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.058 [2024-10-07 11:28:58.679632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.058 [2024-10-07 11:28:58.679647] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.058 [2024-10-07 11:28:58.679677] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.058 [2024-10-07 11:28:58.679735] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.058 [2024-10-07 11:28:58.679760] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.058 [2024-10-07 11:28:58.679776] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.058 [2024-10-07 11:28:58.679807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.058 [2024-10-07 11:28:58.679837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.058 [2024-10-07 11:28:58.679854] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.058 [2024-10-07 11:28:58.679867] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.058 [2024-10-07 11:28:58.679920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.059 [2024-10-07 11:28:58.690979] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.059 [2024-10-07 11:28:58.691154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.059 [2024-10-07 11:28:58.691308] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.059 [2024-10-07 11:28:58.691375] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.059 [2024-10-07 11:28:58.691416] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.059 [2024-10-07 11:28:58.691510] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.059 [2024-10-07 11:28:58.691554] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.059 [2024-10-07 11:28:58.691585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.059 [2024-10-07 11:28:58.691623] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.059 [2024-10-07 11:28:58.692382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.059 [2024-10-07 11:28:58.692443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.059 [2024-10-07 11:28:58.692462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.059 [2024-10-07 11:28:58.692478] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.059 [2024-10-07 11:28:58.693356] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.059 [2024-10-07 11:28:58.693395] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.059 [2024-10-07 11:28:58.693428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.059 [2024-10-07 11:28:58.693443] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.059 [2024-10-07 11:28:58.693553] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.059 [2024-10-07 11:28:58.701139] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.059 [2024-10-07 11:28:58.702325] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.059 [2024-10-07 11:28:58.702374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.059 [2024-10-07 11:28:58.702396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.059 [2024-10-07 11:28:58.702630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.059 [2024-10-07 11:28:58.702779] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.059 [2024-10-07 11:28:58.702824] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.059 [2024-10-07 11:28:58.702843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.059 [2024-10-07 11:28:58.702858] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.059 [2024-10-07 11:28:58.704058] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.059 [2024-10-07 11:28:58.704146] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.059 [2024-10-07 11:28:58.704174] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.059 [2024-10-07 11:28:58.704217] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.059 [2024-10-07 11:28:58.705386] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.059 [2024-10-07 11:28:58.705635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.059 [2024-10-07 11:28:58.705671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.059 [2024-10-07 11:28:58.705690] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.059 [2024-10-07 11:28:58.705747] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.059 [2024-10-07 11:28:58.712149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.059 [2024-10-07 11:28:58.712321] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.059 [2024-10-07 11:28:58.712365] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.059 [2024-10-07 11:28:58.712383] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.059 [2024-10-07 11:28:58.713518] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.059 [2024-10-07 11:28:58.713775] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.059 [2024-10-07 11:28:58.713812] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.059 [2024-10-07 11:28:58.713831] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.059 [2024-10-07 11:28:58.714851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.059 [2024-10-07 11:28:58.714893] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.059 [2024-10-07 11:28:58.715192] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.059 [2024-10-07 11:28:58.715233] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.059 [2024-10-07 11:28:58.715253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.059 [2024-10-07 11:28:58.715302] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.059 [2024-10-07 11:28:58.715335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.059 [2024-10-07 11:28:58.715352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.059 [2024-10-07 11:28:58.715366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.059 [2024-10-07 11:28:58.716395] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.059 [2024-10-07 11:28:58.722288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.059 [2024-10-07 11:28:58.722475] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.059 [2024-10-07 11:28:58.722510] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.059 [2024-10-07 11:28:58.722528] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.059 [2024-10-07 11:28:58.722564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.059 [2024-10-07 11:28:58.722626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.059 [2024-10-07 11:28:58.722645] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.059 [2024-10-07 11:28:58.722660] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.059 [2024-10-07 11:28:58.722691] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.059 [2024-10-07 11:28:58.724958] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.059 [2024-10-07 11:28:58.725096] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.059 [2024-10-07 11:28:58.725128] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.059 [2024-10-07 11:28:58.725146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.059 [2024-10-07 11:28:58.725178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.059 [2024-10-07 11:28:58.725209] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.059 [2024-10-07 11:28:58.725225] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.059 [2024-10-07 11:28:58.725239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.059 [2024-10-07 11:28:58.725269] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.059 [2024-10-07 11:28:58.733773] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.059 [2024-10-07 11:28:58.733978] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.059 [2024-10-07 11:28:58.734013] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.059 [2024-10-07 11:28:58.734032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.059 [2024-10-07 11:28:58.734066] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.059 [2024-10-07 11:28:58.734098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.059 [2024-10-07 11:28:58.734115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.059 [2024-10-07 11:28:58.734131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.059 [2024-10-07 11:28:58.734161] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.059 [2024-10-07 11:28:58.735800] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.059 [2024-10-07 11:28:58.736134] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.059 [2024-10-07 11:28:58.736175] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.059 [2024-10-07 11:28:58.736195] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.059 [2024-10-07 11:28:58.736264] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.059 [2024-10-07 11:28:58.736300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.059 [2024-10-07 11:28:58.736317] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.059 [2024-10-07 11:28:58.736331] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.059 [2024-10-07 11:28:58.736360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.059 [2024-10-07 11:28:58.743914] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.059 [2024-10-07 11:28:58.745071] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.059 [2024-10-07 11:28:58.745118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.059 [2024-10-07 11:28:58.745139] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.059 [2024-10-07 11:28:58.745338] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.059 [2024-10-07 11:28:58.745480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.060 [2024-10-07 11:28:58.745510] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.060 [2024-10-07 11:28:58.745529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.060 [2024-10-07 11:28:58.746739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.060 [2024-10-07 11:28:58.748116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.060 [2024-10-07 11:28:58.748258] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.060 [2024-10-07 11:28:58.748298] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.060 [2024-10-07 11:28:58.748318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.060 [2024-10-07 11:28:58.748351] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.060 [2024-10-07 11:28:58.748382] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.060 [2024-10-07 11:28:58.748412] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.060 [2024-10-07 11:28:58.748430] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.060 [2024-10-07 11:28:58.748461] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.060 [2024-10-07 11:28:58.755018] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.060 [2024-10-07 11:28:58.755159] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.060 [2024-10-07 11:28:58.755192] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.060 [2024-10-07 11:28:58.755209] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.060 [2024-10-07 11:28:58.756308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.060 [2024-10-07 11:28:58.756543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.060 [2024-10-07 11:28:58.756578] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.060 [2024-10-07 11:28:58.756595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.060 [2024-10-07 11:28:58.757623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.060 [2024-10-07 11:28:58.758208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.060 [2024-10-07 11:28:58.759296] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.060 [2024-10-07 11:28:58.759339] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.060 [2024-10-07 11:28:58.759381] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.060 [2024-10-07 11:28:58.759611] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.060 [2024-10-07 11:28:58.760851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.060 [2024-10-07 11:28:58.760888] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.060 [2024-10-07 11:28:58.760906] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.060 [2024-10-07 11:28:58.762081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.060 [2024-10-07 11:28:58.765127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.060 [2024-10-07 11:28:58.765262] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.060 [2024-10-07 11:28:58.765295] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.060 [2024-10-07 11:28:58.765313] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.060 [2024-10-07 11:28:58.765345] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.060 [2024-10-07 11:28:58.765376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.060 [2024-10-07 11:28:58.765392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.060 [2024-10-07 11:28:58.765425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.060 [2024-10-07 11:28:58.765458] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.060 [2024-10-07 11:28:58.769200] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.060 [2024-10-07 11:28:58.769312] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.060 [2024-10-07 11:28:58.769342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.060 [2024-10-07 11:28:58.769359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.060 [2024-10-07 11:28:58.769391] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.060 [2024-10-07 11:28:58.770502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.060 [2024-10-07 11:28:58.770538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.060 [2024-10-07 11:28:58.770556] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.060 [2024-10-07 11:28:58.770759] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.060 [2024-10-07 11:28:58.776460] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.060 [2024-10-07 11:28:58.776610] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.060 [2024-10-07 11:28:58.776643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.060 [2024-10-07 11:28:58.776662] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.060 [2024-10-07 11:28:58.776695] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.060 [2024-10-07 11:28:58.776726] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.060 [2024-10-07 11:28:58.776770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.060 [2024-10-07 11:28:58.776786] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.060 [2024-10-07 11:28:58.776817] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.060 [2024-10-07 11:28:58.779289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.060 [2024-10-07 11:28:58.779414] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.060 [2024-10-07 11:28:58.779445] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.060 [2024-10-07 11:28:58.779463] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.060 [2024-10-07 11:28:58.779494] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.060 [2024-10-07 11:28:58.779524] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.060 [2024-10-07 11:28:58.779540] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.060 [2024-10-07 11:28:58.779555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.060 [2024-10-07 11:28:58.779584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.060 [2024-10-07 11:28:58.786567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.060 [2024-10-07 11:28:58.786734] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.060 [2024-10-07 11:28:58.786768] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.060 [2024-10-07 11:28:58.786786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.060 [2024-10-07 11:28:58.787863] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.060 [2024-10-07 11:28:58.788104] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.060 [2024-10-07 11:28:58.788146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.060 [2024-10-07 11:28:58.788179] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.060 [2024-10-07 11:28:58.788334] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.060 [2024-10-07 11:28:58.791137] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.060 [2024-10-07 11:28:58.791342] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.060 [2024-10-07 11:28:58.791418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.060 [2024-10-07 11:28:58.791451] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.060 [2024-10-07 11:28:58.792208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.060 [2024-10-07 11:28:58.792878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.060 [2024-10-07 11:28:58.792917] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.060 [2024-10-07 11:28:58.792936] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.060 [2024-10-07 11:28:58.793269] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.061 [2024-10-07 11:28:58.796698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.061 [2024-10-07 11:28:58.796876] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.061 [2024-10-07 11:28:58.796911] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.061 [2024-10-07 11:28:58.796928] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.061 [2024-10-07 11:28:58.796962] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.061 [2024-10-07 11:28:58.796993] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.061 [2024-10-07 11:28:58.797009] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.061 [2024-10-07 11:28:58.797024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.061 [2024-10-07 11:28:58.797067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.061 [2024-10-07 11:28:58.801427] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.061 [2024-10-07 11:28:58.801556] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.061 [2024-10-07 11:28:58.801587] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.061 [2024-10-07 11:28:58.801605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.061 [2024-10-07 11:28:58.801641] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.061 [2024-10-07 11:28:58.801689] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.061 [2024-10-07 11:28:58.801711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.061 [2024-10-07 11:28:58.801726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.061 [2024-10-07 11:28:58.801756] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.061 [2024-10-07 11:28:58.808415] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.061 [2024-10-07 11:28:58.808708] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.061 [2024-10-07 11:28:58.808755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.061 [2024-10-07 11:28:58.808776] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.061 [2024-10-07 11:28:58.808833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.061 [2024-10-07 11:28:58.808870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.061 [2024-10-07 11:28:58.808887] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.061 [2024-10-07 11:28:58.808903] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.061 [2024-10-07 11:28:58.808934] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.061 [2024-10-07 11:28:58.811534] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.061 [2024-10-07 11:28:58.811650] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.061 [2024-10-07 11:28:58.811681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.061 [2024-10-07 11:28:58.811698] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.061 [2024-10-07 11:28:58.811761] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.061 [2024-10-07 11:28:58.811793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.061 [2024-10-07 11:28:58.811810] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.061 [2024-10-07 11:28:58.811824] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.061 [2024-10-07 11:28:58.811853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.061 [2024-10-07 11:28:58.818673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.061 [2024-10-07 11:28:58.818852] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.061 [2024-10-07 11:28:58.818887] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.061 [2024-10-07 11:28:58.818905] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.061 [2024-10-07 11:28:58.818940] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.061 [2024-10-07 11:28:58.818971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.061 [2024-10-07 11:28:58.818987] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.061 [2024-10-07 11:28:58.819002] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.061 [2024-10-07 11:28:58.819032] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.061 [2024-10-07 11:28:58.823122] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.061 [2024-10-07 11:28:58.823373] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.061 [2024-10-07 11:28:58.823429] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.061 [2024-10-07 11:28:58.823451] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.061 [2024-10-07 11:28:58.823509] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.061 [2024-10-07 11:28:58.823551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.061 [2024-10-07 11:28:58.823570] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.061 [2024-10-07 11:28:58.823585] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.061 [2024-10-07 11:28:58.823616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.061 [2024-10-07 11:28:58.828816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.061 [2024-10-07 11:28:58.828977] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.061 [2024-10-07 11:28:58.829010] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.061 [2024-10-07 11:28:58.829027] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.061 [2024-10-07 11:28:58.829078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.061 [2024-10-07 11:28:58.829113] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.061 [2024-10-07 11:28:58.829130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.061 [2024-10-07 11:28:58.829190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.061 [2024-10-07 11:28:58.830150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.061 [2024-10-07 11:28:58.833237] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.061 [2024-10-07 11:28:58.833377] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.061 [2024-10-07 11:28:58.833424] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.061 [2024-10-07 11:28:58.833444] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.061 [2024-10-07 11:28:58.833479] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.061 [2024-10-07 11:28:58.833510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.061 [2024-10-07 11:28:58.833527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.061 [2024-10-07 11:28:58.833542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.061 [2024-10-07 11:28:58.833573] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.061 [2024-10-07 11:28:58.839719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.061 [2024-10-07 11:28:58.840120] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.061 [2024-10-07 11:28:58.840166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.061 [2024-10-07 11:28:58.840187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.061 [2024-10-07 11:28:58.840259] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.061 [2024-10-07 11:28:58.840316] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.061 [2024-10-07 11:28:58.840339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.061 [2024-10-07 11:28:58.840354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.061 [2024-10-07 11:28:58.840385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.061 [2024-10-07 11:28:58.843337] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.061 [2024-10-07 11:28:58.843472] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.061 [2024-10-07 11:28:58.843504] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.061 [2024-10-07 11:28:58.843521] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.061 [2024-10-07 11:28:58.844461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.061 [2024-10-07 11:28:58.844699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.061 [2024-10-07 11:28:58.844735] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.061 [2024-10-07 11:28:58.844753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.061 [2024-10-07 11:28:58.844844] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.061 [2024-10-07 11:28:58.851930] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.061 [2024-10-07 11:28:58.852131] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.061 [2024-10-07 11:28:58.852204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.061 [2024-10-07 11:28:58.852224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.061 [2024-10-07 11:28:58.852260] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.061 [2024-10-07 11:28:58.852291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.062 [2024-10-07 11:28:58.852308] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.062 [2024-10-07 11:28:58.852322] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.062 [2024-10-07 11:28:58.852353] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.062 [2024-10-07 11:28:58.854120] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.062 [2024-10-07 11:28:58.854473] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.062 [2024-10-07 11:28:58.854515] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.062 [2024-10-07 11:28:58.854534] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.062 [2024-10-07 11:28:58.854602] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.062 [2024-10-07 11:28:58.854638] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.062 [2024-10-07 11:28:58.854655] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.062 [2024-10-07 11:28:58.854669] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.062 [2024-10-07 11:28:58.854698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.062 [2024-10-07 11:28:58.862066] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.062 [2024-10-07 11:28:58.862236] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.062 [2024-10-07 11:28:58.862271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.062 [2024-10-07 11:28:58.862288] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.062 [2024-10-07 11:28:58.862322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.062 [2024-10-07 11:28:58.863344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.062 [2024-10-07 11:28:58.863382] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.062 [2024-10-07 11:28:58.863412] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.062 [2024-10-07 11:28:58.863611] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.062 [2024-10-07 11:28:58.866335] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.062 [2024-10-07 11:28:58.866496] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.062 [2024-10-07 11:28:58.866528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.062 [2024-10-07 11:28:58.866547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.062 [2024-10-07 11:28:58.866579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.062 [2024-10-07 11:28:58.866635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.062 [2024-10-07 11:28:58.866654] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.062 [2024-10-07 11:28:58.866668] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.062 [2024-10-07 11:28:58.866698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.062 [2024-10-07 11:28:58.873317] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.062 [2024-10-07 11:28:58.873508] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.062 [2024-10-07 11:28:58.873543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.062 [2024-10-07 11:28:58.873562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.062 [2024-10-07 11:28:58.874665] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.062 [2024-10-07 11:28:58.874912] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.062 [2024-10-07 11:28:58.874948] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.062 [2024-10-07 11:28:58.874967] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.062 [2024-10-07 11:28:58.875983] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.062 [2024-10-07 11:28:58.876449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.062 [2024-10-07 11:28:58.876557] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.062 [2024-10-07 11:28:58.876588] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.062 [2024-10-07 11:28:58.876605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.062 [2024-10-07 11:28:58.877639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.062 [2024-10-07 11:28:58.877852] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.062 [2024-10-07 11:28:58.877877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.062 [2024-10-07 11:28:58.877893] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.062 [2024-10-07 11:28:58.877975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.062 [2024-10-07 11:28:58.883458] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.062 [2024-10-07 11:28:58.883609] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.062 [2024-10-07 11:28:58.883643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.062 [2024-10-07 11:28:58.883661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.062 [2024-10-07 11:28:58.883694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.062 [2024-10-07 11:28:58.883724] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.062 [2024-10-07 11:28:58.883741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.062 [2024-10-07 11:28:58.883756] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.062 [2024-10-07 11:28:58.883812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.062 [2024-10-07 11:28:58.887613] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.062 [2024-10-07 11:28:58.887734] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.062 [2024-10-07 11:28:58.887766] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.062 [2024-10-07 11:28:58.887783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.062 [2024-10-07 11:28:58.888895] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.062 [2024-10-07 11:28:58.889147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.062 [2024-10-07 11:28:58.889185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.062 [2024-10-07 11:28:58.889200] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.062 [2024-10-07 11:28:58.890217] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.062 [2024-10-07 11:28:58.894841] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.062 [2024-10-07 11:28:58.895011] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.062 [2024-10-07 11:28:58.895045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.062 [2024-10-07 11:28:58.895063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.062 [2024-10-07 11:28:58.895096] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.062 [2024-10-07 11:28:58.895127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.062 [2024-10-07 11:28:58.895144] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.062 [2024-10-07 11:28:58.895159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.062 [2024-10-07 11:28:58.895190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.062 [2024-10-07 11:28:58.897707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.062 [2024-10-07 11:28:58.897817] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.062 [2024-10-07 11:28:58.897847] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.062 [2024-10-07 11:28:58.897864] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.062 [2024-10-07 11:28:58.897894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.062 [2024-10-07 11:28:58.897924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.062 [2024-10-07 11:28:58.897940] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.062 [2024-10-07 11:28:58.897954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.062 [2024-10-07 11:28:58.897982] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.062 [2024-10-07 11:28:58.904954] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.062 [2024-10-07 11:28:58.905129] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.062 [2024-10-07 11:28:58.905163] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.062 [2024-10-07 11:28:58.905212] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.062 [2024-10-07 11:28:58.906243] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.062 [2024-10-07 11:28:58.906473] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.062 [2024-10-07 11:28:58.906516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.062 [2024-10-07 11:28:58.906534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.062 [2024-10-07 11:28:58.906647] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.062 [2024-10-07 11:28:58.909204] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.062 [2024-10-07 11:28:58.909341] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.062 [2024-10-07 11:28:58.909373] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.062 [2024-10-07 11:28:58.909390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.063 [2024-10-07 11:28:58.909438] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.063 [2024-10-07 11:28:58.909471] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.063 [2024-10-07 11:28:58.909488] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.063 [2024-10-07 11:28:58.909502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.063 [2024-10-07 11:28:58.909531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.063 [2024-10-07 11:28:58.916043] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.063 [2024-10-07 11:28:58.916201] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.063 [2024-10-07 11:28:58.916235] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.063 [2024-10-07 11:28:58.916253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.063 [2024-10-07 11:28:58.917372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.063 [2024-10-07 11:28:58.917638] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.063 [2024-10-07 11:28:58.917665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.063 [2024-10-07 11:28:58.917681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.063 [2024-10-07 11:28:58.918693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.063 [2024-10-07 11:28:58.919295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.063 [2024-10-07 11:28:58.920416] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.063 [2024-10-07 11:28:58.920469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.063 [2024-10-07 11:28:58.920489] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.063 [2024-10-07 11:28:58.920685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.063 [2024-10-07 11:28:58.920811] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.063 [2024-10-07 11:28:58.920865] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.063 [2024-10-07 11:28:58.920884] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.063 [2024-10-07 11:28:58.922100] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.063 [2024-10-07 11:28:58.926168] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.063 [2024-10-07 11:28:58.926299] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.063 [2024-10-07 11:28:58.926331] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.063 [2024-10-07 11:28:58.926348] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.063 [2024-10-07 11:28:58.926381] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.063 [2024-10-07 11:28:58.926426] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.063 [2024-10-07 11:28:58.926446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.063 [2024-10-07 11:28:58.926460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.063 [2024-10-07 11:28:58.926491] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.063 [2024-10-07 11:28:58.930257] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.063 [2024-10-07 11:28:58.930371] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.063 [2024-10-07 11:28:58.930414] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.063 [2024-10-07 11:28:58.930434] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.063 [2024-10-07 11:28:58.931531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.063 [2024-10-07 11:28:58.931754] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.063 [2024-10-07 11:28:58.931788] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.063 [2024-10-07 11:28:58.931806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.063 [2024-10-07 11:28:58.932819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.063 [2024-10-07 11:28:58.937465] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.063 [2024-10-07 11:28:58.937623] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.063 [2024-10-07 11:28:58.937664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.063 [2024-10-07 11:28:58.937684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.063 [2024-10-07 11:28:58.937718] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.063 [2024-10-07 11:28:58.937750] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.063 [2024-10-07 11:28:58.937766] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.063 [2024-10-07 11:28:58.937780] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.063 [2024-10-07 11:28:58.937810] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.063 [2024-10-07 11:28:58.940348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.063 [2024-10-07 11:28:58.940471] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.063 [2024-10-07 11:28:58.940506] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.063 [2024-10-07 11:28:58.940525] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.063 [2024-10-07 11:28:58.940557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.063 [2024-10-07 11:28:58.940587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.063 [2024-10-07 11:28:58.940603] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.063 [2024-10-07 11:28:58.940617] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.063 [2024-10-07 11:28:58.940646] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.063 [2024-10-07 11:28:58.947569] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.063 [2024-10-07 11:28:58.947717] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.063 [2024-10-07 11:28:58.947750] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.063 [2024-10-07 11:28:58.947767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.063 [2024-10-07 11:28:58.948791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.063 [2024-10-07 11:28:58.949010] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.063 [2024-10-07 11:28:58.949044] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.063 [2024-10-07 11:28:58.949072] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.063 [2024-10-07 11:28:58.949142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.063 [2024-10-07 11:28:58.951806] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.063 [2024-10-07 11:28:58.951975] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.063 [2024-10-07 11:28:58.952035] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.063 [2024-10-07 11:28:58.952066] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.063 [2024-10-07 11:28:58.952104] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.063 [2024-10-07 11:28:58.952135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.063 [2024-10-07 11:28:58.952152] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.063 [2024-10-07 11:28:58.952166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.063 [2024-10-07 11:28:58.952197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.063 [2024-10-07 11:28:58.958751] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.063 [2024-10-07 11:28:58.958936] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.063 [2024-10-07 11:28:58.958971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.063 [2024-10-07 11:28:58.959014] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.063 [2024-10-07 11:28:58.959051] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.063 [2024-10-07 11:28:58.959082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.063 [2024-10-07 11:28:58.959099] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.063 [2024-10-07 11:28:58.959115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.063 [2024-10-07 11:28:58.959145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.063 [2024-10-07 11:28:58.962895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.063 [2024-10-07 11:28:58.963019] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.063 [2024-10-07 11:28:58.963050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.063 [2024-10-07 11:28:58.963067] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.063 [2024-10-07 11:28:58.963098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.063 [2024-10-07 11:28:58.963128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.063 [2024-10-07 11:28:58.963145] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.063 [2024-10-07 11:28:58.963159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.063 [2024-10-07 11:28:58.963189] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.063 [2024-10-07 11:28:58.969018] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.063 [2024-10-07 11:28:58.969180] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.064 [2024-10-07 11:28:58.969214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.064 [2024-10-07 11:28:58.969232] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.064 [2024-10-07 11:28:58.969282] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.064 [2024-10-07 11:28:58.969316] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.064 [2024-10-07 11:28:58.969333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.064 [2024-10-07 11:28:58.969347] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.064 [2024-10-07 11:28:58.969378] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.064 [2024-10-07 11:28:58.972997] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.064 [2024-10-07 11:28:58.973144] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.064 [2024-10-07 11:28:58.973176] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.064 [2024-10-07 11:28:58.973193] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.064 [2024-10-07 11:28:58.973225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.064 [2024-10-07 11:28:58.973275] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.064 [2024-10-07 11:28:58.973296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.064 [2024-10-07 11:28:58.973340] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.064 [2024-10-07 11:28:58.973373] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.064 [2024-10-07 11:28:58.979715] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.064 [2024-10-07 11:28:58.979889] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.064 [2024-10-07 11:28:58.979924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.064 [2024-10-07 11:28:58.979941] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.064 [2024-10-07 11:28:58.979975] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.064 [2024-10-07 11:28:58.980006] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.064 [2024-10-07 11:28:58.980023] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.064 [2024-10-07 11:28:58.980038] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.064 [2024-10-07 11:28:58.980067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.064 [2024-10-07 11:28:58.984242] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.064 [2024-10-07 11:28:58.984415] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.064 [2024-10-07 11:28:58.984449] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.064 [2024-10-07 11:28:58.984467] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.064 [2024-10-07 11:28:58.984500] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.064 [2024-10-07 11:28:58.984530] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.064 [2024-10-07 11:28:58.984547] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.064 [2024-10-07 11:28:58.984562] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.064 [2024-10-07 11:28:58.984592] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.064 [2024-10-07 11:28:58.989849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.064 [2024-10-07 11:28:58.990012] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.064 [2024-10-07 11:28:58.990045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.064 [2024-10-07 11:28:58.990063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.064 [2024-10-07 11:28:58.990096] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.064 [2024-10-07 11:28:58.990127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.064 [2024-10-07 11:28:58.990144] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.064 [2024-10-07 11:28:58.990159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.064 [2024-10-07 11:28:58.991098] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.064 [2024-10-07 11:28:58.994357] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.064 [2024-10-07 11:28:58.994547] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.064 [2024-10-07 11:28:58.994581] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.064 [2024-10-07 11:28:58.994600] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.064 [2024-10-07 11:28:58.995627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.064 [2024-10-07 11:28:58.995864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.064 [2024-10-07 11:28:58.995900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.064 [2024-10-07 11:28:58.995919] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.064 [2024-10-07 11:28:58.995989] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.064 [2024-10-07 11:28:59.000748] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.064 [2024-10-07 11:28:59.001179] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.064 [2024-10-07 11:28:59.001226] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.064 [2024-10-07 11:28:59.001247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.064 [2024-10-07 11:28:59.001322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.064 [2024-10-07 11:28:59.001360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.064 [2024-10-07 11:28:59.001378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.064 [2024-10-07 11:28:59.001393] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.064 [2024-10-07 11:28:59.001456] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.064 [2024-10-07 11:28:59.005420] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.064 [2024-10-07 11:28:59.005740] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.064 [2024-10-07 11:28:59.005784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.064 [2024-10-07 11:28:59.005805] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.064 [2024-10-07 11:28:59.006954] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.064 [2024-10-07 11:28:59.007180] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.064 [2024-10-07 11:28:59.007214] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.064 [2024-10-07 11:28:59.007233] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.064 [2024-10-07 11:28:59.008258] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.064 [2024-10-07 11:28:59.012911] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.064 [2024-10-07 11:28:59.013099] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.064 [2024-10-07 11:28:59.013136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.064 [2024-10-07 11:28:59.013155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.064 [2024-10-07 11:28:59.013223] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.064 [2024-10-07 11:28:59.013254] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.064 [2024-10-07 11:28:59.013271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.064 [2024-10-07 11:28:59.013286] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.064 [2024-10-07 11:28:59.013316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.064 [2024-10-07 11:28:59.015532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.064 [2024-10-07 11:28:59.015644] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.064 [2024-10-07 11:28:59.015675] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.064 [2024-10-07 11:28:59.015692] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.065 [2024-10-07 11:28:59.015723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.065 [2024-10-07 11:28:59.015753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.065 [2024-10-07 11:28:59.015770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.065 [2024-10-07 11:28:59.015783] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.065 [2024-10-07 11:28:59.015812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.065 [2024-10-07 11:28:59.023029] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.065 [2024-10-07 11:28:59.023199] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.065 [2024-10-07 11:28:59.023232] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.065 [2024-10-07 11:28:59.023250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.065 [2024-10-07 11:28:59.024279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.065 [2024-10-07 11:28:59.024509] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.065 [2024-10-07 11:28:59.024543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.065 [2024-10-07 11:28:59.024562] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.065 [2024-10-07 11:28:59.024675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.065 [2024-10-07 11:28:59.027225] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.065 [2024-10-07 11:28:59.027369] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.065 [2024-10-07 11:28:59.027424] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.065 [2024-10-07 11:28:59.027447] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.065 [2024-10-07 11:28:59.027481] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.065 [2024-10-07 11:28:59.027512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.065 [2024-10-07 11:28:59.027529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.065 [2024-10-07 11:28:59.027567] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.065 [2024-10-07 11:28:59.027599] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.065 [2024-10-07 11:28:59.034158] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.065 [2024-10-07 11:28:59.034326] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.065 [2024-10-07 11:28:59.034361] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.065 [2024-10-07 11:28:59.034378] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.065 [2024-10-07 11:28:59.035493] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.065 [2024-10-07 11:28:59.035721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.065 [2024-10-07 11:28:59.035756] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.065 [2024-10-07 11:28:59.035774] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.065 [2024-10-07 11:28:59.036791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.065 [2024-10-07 11:28:59.037317] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.065 [2024-10-07 11:28:59.037444] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.065 [2024-10-07 11:28:59.037481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.065 [2024-10-07 11:28:59.037499] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.065 [2024-10-07 11:28:59.038519] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.065 [2024-10-07 11:28:59.038755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.065 [2024-10-07 11:28:59.038790] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.065 [2024-10-07 11:28:59.038808] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.065 [2024-10-07 11:28:59.038921] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.065 [2024-10-07 11:28:59.044288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.065 [2024-10-07 11:28:59.044467] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.065 [2024-10-07 11:28:59.044501] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.065 [2024-10-07 11:28:59.044519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.065 [2024-10-07 11:28:59.044554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.065 [2024-10-07 11:28:59.044586] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.065 [2024-10-07 11:28:59.044602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.065 [2024-10-07 11:28:59.044617] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.065 [2024-10-07 11:28:59.044648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.065 [2024-10-07 11:28:59.048382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.065 [2024-10-07 11:28:59.048529] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.065 [2024-10-07 11:28:59.048584] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.065 [2024-10-07 11:28:59.048603] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.065 [2024-10-07 11:28:59.049727] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.065 [2024-10-07 11:28:59.049961] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.065 [2024-10-07 11:28:59.049996] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.065 [2024-10-07 11:28:59.050014] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.065 [2024-10-07 11:28:59.051042] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.065 [2024-10-07 11:28:59.055722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.065 [2024-10-07 11:28:59.055935] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.065 [2024-10-07 11:28:59.055971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.065 [2024-10-07 11:28:59.055990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.065 [2024-10-07 11:28:59.056026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.065 [2024-10-07 11:28:59.056057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.065 [2024-10-07 11:28:59.056073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.065 [2024-10-07 11:28:59.056089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.065 [2024-10-07 11:28:59.056120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.065 [2024-10-07 11:28:59.058504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.065 [2024-10-07 11:28:59.058633] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.065 [2024-10-07 11:28:59.058665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.065 [2024-10-07 11:28:59.058682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.065 [2024-10-07 11:28:59.058714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.065 [2024-10-07 11:28:59.058745] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.065 [2024-10-07 11:28:59.058762] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.065 [2024-10-07 11:28:59.058776] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.065 [2024-10-07 11:28:59.058805] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.065 [2024-10-07 11:28:59.065871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.065 [2024-10-07 11:28:59.066060] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.065 [2024-10-07 11:28:59.066094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.065 [2024-10-07 11:28:59.066112] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.065 [2024-10-07 11:28:59.067144] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.065 [2024-10-07 11:28:59.067395] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.065 [2024-10-07 11:28:59.067442] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.065 [2024-10-07 11:28:59.067462] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.065 [2024-10-07 11:28:59.068700] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.065 [2024-10-07 11:28:59.070148] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.065 [2024-10-07 11:28:59.070298] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.065 [2024-10-07 11:28:59.070340] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.065 [2024-10-07 11:28:59.070361] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.065 [2024-10-07 11:28:59.070394] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.065 [2024-10-07 11:28:59.070444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.065 [2024-10-07 11:28:59.070463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.065 [2024-10-07 11:28:59.070478] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.065 [2024-10-07 11:28:59.070508] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.065 [2024-10-07 11:28:59.076019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.065 [2024-10-07 11:28:59.076206] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.066 [2024-10-07 11:28:59.076240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.066 [2024-10-07 11:28:59.076259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.066 [2024-10-07 11:28:59.076293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.066 [2024-10-07 11:28:59.076324] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.066 [2024-10-07 11:28:59.076341] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.066 [2024-10-07 11:28:59.076356] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.066 [2024-10-07 11:28:59.076386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.066 [2024-10-07 11:28:59.080943] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.066 [2024-10-07 11:28:59.081123] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.066 [2024-10-07 11:28:59.081159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.066 [2024-10-07 11:28:59.081178] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.066 [2024-10-07 11:28:59.081214] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.066 [2024-10-07 11:28:59.081246] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.066 [2024-10-07 11:28:59.081264] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.066 [2024-10-07 11:28:59.081278] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.066 [2024-10-07 11:28:59.081333] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.066 [2024-10-07 11:28:59.086362] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.066 [2024-10-07 11:28:59.086569] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.066 [2024-10-07 11:28:59.086605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.066 [2024-10-07 11:28:59.086624] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.066 [2024-10-07 11:28:59.086659] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.066 [2024-10-07 11:28:59.086690] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.066 [2024-10-07 11:28:59.086707] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.066 [2024-10-07 11:28:59.086722] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.066 [2024-10-07 11:28:59.086753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.066 [2024-10-07 11:28:59.091073] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.066 [2024-10-07 11:28:59.091221] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.066 [2024-10-07 11:28:59.091254] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.066 [2024-10-07 11:28:59.091272] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.066 [2024-10-07 11:28:59.091306] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.066 [2024-10-07 11:28:59.091337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.066 [2024-10-07 11:28:59.091354] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.066 [2024-10-07 11:28:59.091371] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.066 [2024-10-07 11:28:59.091444] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.066 [2024-10-07 11:28:59.098727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.066 8452.57 IOPS, 33.02 MiB/s [2024-10-07T11:29:07.777Z] [2024-10-07 11:28:59.101828] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.066 [2024-10-07 11:28:59.101881] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.066 [2024-10-07 11:28:59.101903] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.066 [2024-10-07 11:28:59.102131] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.066 [2024-10-07 11:28:59.102270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.066 [2024-10-07 11:28:59.102317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.066 [2024-10-07 11:28:59.102336] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.066 [2024-10-07 11:28:59.102351] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.066 [2024-10-07 11:28:59.103582] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.066 [2024-10-07 11:28:59.103674] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.066 [2024-10-07 11:28:59.103704] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.066 [2024-10-07 11:28:59.103752] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.066 [2024-10-07 11:28:59.105023] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.066 [2024-10-07 11:28:59.105295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.066 [2024-10-07 11:28:59.105335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.066 [2024-10-07 11:28:59.105354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.066 [2024-10-07 11:28:59.105430] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.066 [2024-10-07 11:28:59.108874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.066 [2024-10-07 11:28:59.109037] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.066 [2024-10-07 11:28:59.109092] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.066 [2024-10-07 11:28:59.109114] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.066 [2024-10-07 11:28:59.109148] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.066 [2024-10-07 11:28:59.109181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.066 [2024-10-07 11:28:59.109198] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.066 [2024-10-07 11:28:59.109212] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.066 [2024-10-07 11:28:59.109242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.066 [2024-10-07 11:28:59.113251] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.066 [2024-10-07 11:28:59.113395] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.066 [2024-10-07 11:28:59.113446] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.066 [2024-10-07 11:28:59.113466] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.066 [2024-10-07 11:28:59.113501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.066 [2024-10-07 11:28:59.113533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.066 [2024-10-07 11:28:59.113550] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.066 [2024-10-07 11:28:59.113565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.066 [2024-10-07 11:28:59.113595] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.066 [2024-10-07 11:28:59.119017] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.066 [2024-10-07 11:28:59.119208] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.066 [2024-10-07 11:28:59.119244] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.066 [2024-10-07 11:28:59.119263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.066 [2024-10-07 11:28:59.119298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.066 [2024-10-07 11:28:59.119329] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.066 [2024-10-07 11:28:59.119384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.066 [2024-10-07 11:28:59.119428] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.066 [2024-10-07 11:28:59.120658] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.066 [2024-10-07 11:28:59.123367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.066 [2024-10-07 11:28:59.123523] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.066 [2024-10-07 11:28:59.123567] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.066 [2024-10-07 11:28:59.123589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.066 [2024-10-07 11:28:59.124299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.066 [2024-10-07 11:28:59.124976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.066 [2024-10-07 11:28:59.125014] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.066 [2024-10-07 11:28:59.125033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.066 [2024-10-07 11:28:59.125164] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.066 [2024-10-07 11:28:59.129159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.066 [2024-10-07 11:28:59.129311] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.066 [2024-10-07 11:28:59.129345] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.066 [2024-10-07 11:28:59.129363] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.066 [2024-10-07 11:28:59.129419] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.066 [2024-10-07 11:28:59.129454] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.066 [2024-10-07 11:28:59.129472] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.066 [2024-10-07 11:28:59.129488] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.066 [2024-10-07 11:28:59.129517] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.067 [2024-10-07 11:28:59.134608] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.067 [2024-10-07 11:28:59.134762] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.067 [2024-10-07 11:28:59.134795] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.067 [2024-10-07 11:28:59.134813] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.067 [2024-10-07 11:28:59.134846] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.067 [2024-10-07 11:28:59.134876] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.067 [2024-10-07 11:28:59.134893] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.067 [2024-10-07 11:28:59.134908] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.067 [2024-10-07 11:28:59.134938] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.067 [2024-10-07 11:28:59.139566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.067 [2024-10-07 11:28:59.139729] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.067 [2024-10-07 11:28:59.139763] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.067 [2024-10-07 11:28:59.139781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.067 [2024-10-07 11:28:59.139813] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.067 [2024-10-07 11:28:59.139844] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.067 [2024-10-07 11:28:59.139861] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.067 [2024-10-07 11:28:59.139877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.067 [2024-10-07 11:28:59.139907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.067 [2024-10-07 11:28:59.144727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.067 [2024-10-07 11:28:59.144885] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.067 [2024-10-07 11:28:59.144919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.067 [2024-10-07 11:28:59.144937] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.067 [2024-10-07 11:28:59.144970] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.067 [2024-10-07 11:28:59.145001] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.067 [2024-10-07 11:28:59.145018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.067 [2024-10-07 11:28:59.145033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.067 [2024-10-07 11:28:59.145100] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.067 [2024-10-07 11:28:59.149698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.067 [2024-10-07 11:28:59.149875] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.067 [2024-10-07 11:28:59.149910] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.067 [2024-10-07 11:28:59.149930] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.067 [2024-10-07 11:28:59.151183] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.067 [2024-10-07 11:28:59.151457] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.067 [2024-10-07 11:28:59.151513] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.067 [2024-10-07 11:28:59.151545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.067 [2024-10-07 11:28:59.152783] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.067 [2024-10-07 11:28:59.155197] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.067 [2024-10-07 11:28:59.155360] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.067 [2024-10-07 11:28:59.155395] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.067 [2024-10-07 11:28:59.155465] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.067 [2024-10-07 11:28:59.155508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.067 [2024-10-07 11:28:59.155541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.067 [2024-10-07 11:28:59.155558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.067 [2024-10-07 11:28:59.155573] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.067 [2024-10-07 11:28:59.155604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.067 [2024-10-07 11:28:59.159839] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.067 [2024-10-07 11:28:59.160747] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.067 [2024-10-07 11:28:59.160797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.067 [2024-10-07 11:28:59.160819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.067 [2024-10-07 11:28:59.161504] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.067 [2024-10-07 11:28:59.161625] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.067 [2024-10-07 11:28:59.161651] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.067 [2024-10-07 11:28:59.161667] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.067 [2024-10-07 11:28:59.161702] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.067 [2024-10-07 11:28:59.165646] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.067 [2024-10-07 11:28:59.165921] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.067 [2024-10-07 11:28:59.165981] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.067 [2024-10-07 11:28:59.166017] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.067 [2024-10-07 11:28:59.166080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.067 [2024-10-07 11:28:59.166173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.067 [2024-10-07 11:28:59.166213] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.067 [2024-10-07 11:28:59.166245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.067 [2024-10-07 11:28:59.166302] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.067 [2024-10-07 11:28:59.171340] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.067 [2024-10-07 11:28:59.171619] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.067 [2024-10-07 11:28:59.171695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.067 [2024-10-07 11:28:59.171734] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.067 [2024-10-07 11:28:59.171796] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.067 [2024-10-07 11:28:59.171855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.067 [2024-10-07 11:28:59.171940] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.067 [2024-10-07 11:28:59.171971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.067 [2024-10-07 11:28:59.173354] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.067 [2024-10-07 11:28:59.176688] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.067 [2024-10-07 11:28:59.176871] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.067 [2024-10-07 11:28:59.176908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.067 [2024-10-07 11:28:59.176927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.067 [2024-10-07 11:28:59.176963] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.067 [2024-10-07 11:28:59.176995] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.067 [2024-10-07 11:28:59.177013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.067 [2024-10-07 11:28:59.177028] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.067 [2024-10-07 11:28:59.177074] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.067 [2024-10-07 11:28:59.181540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.067 [2024-10-07 11:28:59.181710] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.067 [2024-10-07 11:28:59.181745] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.067 [2024-10-07 11:28:59.181764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.067 [2024-10-07 11:28:59.181799] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.067 [2024-10-07 11:28:59.181831] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.067 [2024-10-07 11:28:59.181848] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.067 [2024-10-07 11:28:59.181863] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.067 [2024-10-07 11:28:59.181893] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.067 [2024-10-07 11:28:59.187387] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.067 [2024-10-07 11:28:59.187599] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.067 [2024-10-07 11:28:59.187634] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.067 [2024-10-07 11:28:59.187653] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.067 [2024-10-07 11:28:59.187688] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.067 [2024-10-07 11:28:59.187720] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.068 [2024-10-07 11:28:59.187738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.068 [2024-10-07 11:28:59.187753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.068 [2024-10-07 11:28:59.188787] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.068 [2024-10-07 11:28:59.192842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.068 [2024-10-07 11:28:59.194127] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.068 [2024-10-07 11:28:59.194177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.068 [2024-10-07 11:28:59.194199] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.068 [2024-10-07 11:28:59.194504] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.068 [2024-10-07 11:28:59.194672] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.068 [2024-10-07 11:28:59.194708] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.068 [2024-10-07 11:28:59.194727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.068 [2024-10-07 11:28:59.194791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.068 [2024-10-07 11:28:59.197545] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.068 [2024-10-07 11:28:59.197909] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.068 [2024-10-07 11:28:59.197953] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.068 [2024-10-07 11:28:59.197975] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.068 [2024-10-07 11:28:59.198046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.068 [2024-10-07 11:28:59.198083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.068 [2024-10-07 11:28:59.198101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.068 [2024-10-07 11:28:59.198116] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.068 [2024-10-07 11:28:59.198147] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.068 [2024-10-07 11:28:59.203587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.068 [2024-10-07 11:28:59.203794] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.068 [2024-10-07 11:28:59.203831] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.068 [2024-10-07 11:28:59.203851] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.068 [2024-10-07 11:28:59.203889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.068 [2024-10-07 11:28:59.203921] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.068 [2024-10-07 11:28:59.203938] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.068 [2024-10-07 11:28:59.203954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.068 [2024-10-07 11:28:59.205169] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.068 [2024-10-07 11:28:59.207652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.068 [2024-10-07 11:28:59.207790] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.068 [2024-10-07 11:28:59.207824] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.068 [2024-10-07 11:28:59.207843] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.068 [2024-10-07 11:28:59.208902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.068 [2024-10-07 11:28:59.209142] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.068 [2024-10-07 11:28:59.209179] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.068 [2024-10-07 11:28:59.209199] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.068 [2024-10-07 11:28:59.209270] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.068 [2024-10-07 11:28:59.213737] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.068 [2024-10-07 11:28:59.214582] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.068 [2024-10-07 11:28:59.214630] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.068 [2024-10-07 11:28:59.214651] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.068 [2024-10-07 11:28:59.215280] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.068 [2024-10-07 11:28:59.215394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.068 [2024-10-07 11:28:59.215434] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.068 [2024-10-07 11:28:59.215451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.068 [2024-10-07 11:28:59.215485] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.068 [2024-10-07 11:28:59.217754] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.068 [2024-10-07 11:28:59.217869] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.068 [2024-10-07 11:28:59.217900] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.068 [2024-10-07 11:28:59.217918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.068 [2024-10-07 11:28:59.217949] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.068 [2024-10-07 11:28:59.217979] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.068 [2024-10-07 11:28:59.217996] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.068 [2024-10-07 11:28:59.218010] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.068 [2024-10-07 11:28:59.218817] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.068 [2024-10-07 11:28:59.224788] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.068 [2024-10-07 11:28:59.224960] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.068 [2024-10-07 11:28:59.224994] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.068 [2024-10-07 11:28:59.225011] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.068 [2024-10-07 11:28:59.225046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.068 [2024-10-07 11:28:59.225095] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.068 [2024-10-07 11:28:59.225112] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.068 [2024-10-07 11:28:59.225170] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.068 [2024-10-07 11:28:59.225221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.068 [2024-10-07 11:28:59.229916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.068 [2024-10-07 11:28:59.230179] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.068 [2024-10-07 11:28:59.230217] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.068 [2024-10-07 11:28:59.230237] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.068 [2024-10-07 11:28:59.230276] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.068 [2024-10-07 11:28:59.230308] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.068 [2024-10-07 11:28:59.230325] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.068 [2024-10-07 11:28:59.230343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.068 [2024-10-07 11:28:59.230375] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.068 [2024-10-07 11:28:59.235209] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.068 [2024-10-07 11:28:59.235447] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.068 [2024-10-07 11:28:59.235486] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.068 [2024-10-07 11:28:59.235505] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.068 [2024-10-07 11:28:59.235541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.068 [2024-10-07 11:28:59.235589] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.068 [2024-10-07 11:28:59.235607] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.068 [2024-10-07 11:28:59.235625] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.069 [2024-10-07 11:28:59.235657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.069 [2024-10-07 11:28:59.240102] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.069 [2024-10-07 11:28:59.240307] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.069 [2024-10-07 11:28:59.240342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.069 [2024-10-07 11:28:59.240361] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.069 [2024-10-07 11:28:59.241439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.069 [2024-10-07 11:28:59.241664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.069 [2024-10-07 11:28:59.241699] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.069 [2024-10-07 11:28:59.241718] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.069 [2024-10-07 11:28:59.241836] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.069 [2024-10-07 11:28:59.246477] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.069 [2024-10-07 11:28:59.246933] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.069 [2024-10-07 11:28:59.247019] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.069 [2024-10-07 11:28:59.247043] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.069 [2024-10-07 11:28:59.247119] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.069 [2024-10-07 11:28:59.247180] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.069 [2024-10-07 11:28:59.247201] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.069 [2024-10-07 11:28:59.247216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.069 [2024-10-07 11:28:59.247247] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.069 [2024-10-07 11:28:59.250257] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.069 [2024-10-07 11:28:59.251392] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.069 [2024-10-07 11:28:59.251462] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.069 [2024-10-07 11:28:59.251485] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.069 [2024-10-07 11:28:59.251719] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.069 [2024-10-07 11:28:59.251848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.069 [2024-10-07 11:28:59.251878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.069 [2024-10-07 11:28:59.251896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.069 [2024-10-07 11:28:59.253006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.069 [2024-10-07 11:28:59.258703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.069 [2024-10-07 11:28:59.258902] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.069 [2024-10-07 11:28:59.258938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.069 [2024-10-07 11:28:59.258956] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.069 [2024-10-07 11:28:59.258992] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.069 [2024-10-07 11:28:59.259023] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.069 [2024-10-07 11:28:59.259039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.069 [2024-10-07 11:28:59.259054] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.069 [2024-10-07 11:28:59.259085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.069 [2024-10-07 11:28:59.260859] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.069 [2024-10-07 11:28:59.261216] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.069 [2024-10-07 11:28:59.261259] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.069 [2024-10-07 11:28:59.261279] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.069 [2024-10-07 11:28:59.261349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.069 [2024-10-07 11:28:59.261424] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.069 [2024-10-07 11:28:59.261445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.069 [2024-10-07 11:28:59.261460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.069 [2024-10-07 11:28:59.261490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.069 [2024-10-07 11:28:59.268842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.069 [2024-10-07 11:28:59.269025] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.069 [2024-10-07 11:28:59.269075] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.069 [2024-10-07 11:28:59.269099] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.069 [2024-10-07 11:28:59.270137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.069 [2024-10-07 11:28:59.270358] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.069 [2024-10-07 11:28:59.270392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.069 [2024-10-07 11:28:59.270425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.069 [2024-10-07 11:28:59.270542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.069 [2024-10-07 11:28:59.273136] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.069 [2024-10-07 11:28:59.273305] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.069 [2024-10-07 11:28:59.273338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.069 [2024-10-07 11:28:59.273356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.069 [2024-10-07 11:28:59.273389] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.069 [2024-10-07 11:28:59.273437] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.069 [2024-10-07 11:28:59.273455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.069 [2024-10-07 11:28:59.273471] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.069 [2024-10-07 11:28:59.273501] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.069 [2024-10-07 11:28:59.279992] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.069 [2024-10-07 11:28:59.280189] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.069 [2024-10-07 11:28:59.280225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.069 [2024-10-07 11:28:59.280243] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.069 [2024-10-07 11:28:59.281390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.069 [2024-10-07 11:28:59.281662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.069 [2024-10-07 11:28:59.281701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.069 [2024-10-07 11:28:59.281720] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.069 [2024-10-07 11:28:59.282795] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.069 [2024-10-07 11:28:59.284246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.069 [2024-10-07 11:28:59.284604] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.069 [2024-10-07 11:28:59.284653] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.069 [2024-10-07 11:28:59.284674] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.069 [2024-10-07 11:28:59.284793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.069 [2024-10-07 11:28:59.286024] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.069 [2024-10-07 11:28:59.286063] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.069 [2024-10-07 11:28:59.286083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.069 [2024-10-07 11:28:59.287261] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.069 [2024-10-07 11:28:59.290146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.069 [2024-10-07 11:28:59.290301] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.069 [2024-10-07 11:28:59.290334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.069 [2024-10-07 11:28:59.290352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.069 [2024-10-07 11:28:59.290386] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.069 [2024-10-07 11:28:59.290436] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.069 [2024-10-07 11:28:59.290455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.069 [2024-10-07 11:28:59.290470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.069 [2024-10-07 11:28:59.290502] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.069 [2024-10-07 11:28:59.294359] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.069 [2024-10-07 11:28:59.295622] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.069 [2024-10-07 11:28:59.295671] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.069 [2024-10-07 11:28:59.295697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.069 [2024-10-07 11:28:59.295914] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.070 [2024-10-07 11:28:59.296962] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.070 [2024-10-07 11:28:59.297001] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.070 [2024-10-07 11:28:59.297021] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.070 [2024-10-07 11:28:59.297298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.070 [2024-10-07 11:28:59.301522] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.070 [2024-10-07 11:28:59.301715] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.070 [2024-10-07 11:28:59.301751] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.070 [2024-10-07 11:28:59.301802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.070 [2024-10-07 11:28:59.301841] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.070 [2024-10-07 11:28:59.301873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.070 [2024-10-07 11:28:59.301890] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.070 [2024-10-07 11:28:59.301906] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.070 [2024-10-07 11:28:59.301938] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.070 [2024-10-07 11:28:59.304496] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.070 [2024-10-07 11:28:59.304626] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.070 [2024-10-07 11:28:59.304659] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.070 [2024-10-07 11:28:59.304676] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.070 [2024-10-07 11:28:59.304708] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.070 [2024-10-07 11:28:59.304739] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.070 [2024-10-07 11:28:59.304756] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.070 [2024-10-07 11:28:59.304770] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.070 [2024-10-07 11:28:59.304800] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.070 [2024-10-07 11:28:59.311660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.070 [2024-10-07 11:28:59.311848] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.070 [2024-10-07 11:28:59.311884] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.070 [2024-10-07 11:28:59.311926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.070 [2024-10-07 11:28:59.311968] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.070 [2024-10-07 11:28:59.312002] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.070 [2024-10-07 11:28:59.312019] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.070 [2024-10-07 11:28:59.312035] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.070 [2024-10-07 11:28:59.312065] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.070 [2024-10-07 11:28:59.316345] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.070 [2024-10-07 11:28:59.316560] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.070 [2024-10-07 11:28:59.316596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.070 [2024-10-07 11:28:59.316616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.070 [2024-10-07 11:28:59.316651] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.070 [2024-10-07 11:28:59.316699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.070 [2024-10-07 11:28:59.316747] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.070 [2024-10-07 11:28:59.316764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.070 [2024-10-07 11:28:59.316797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.070 [2024-10-07 11:28:59.321814] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.070 [2024-10-07 11:28:59.322030] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.070 [2024-10-07 11:28:59.322068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.070 [2024-10-07 11:28:59.322087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.070 [2024-10-07 11:28:59.323037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.070 [2024-10-07 11:28:59.323264] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.070 [2024-10-07 11:28:59.323300] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.070 [2024-10-07 11:28:59.323321] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.070 [2024-10-07 11:28:59.324496] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.070 [2024-10-07 11:28:59.326504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.070 [2024-10-07 11:28:59.327695] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.070 [2024-10-07 11:28:59.327753] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.070 [2024-10-07 11:28:59.327777] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.070 [2024-10-07 11:28:59.328006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.070 [2024-10-07 11:28:59.328129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.070 [2024-10-07 11:28:59.328150] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.070 [2024-10-07 11:28:59.328166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.070 [2024-10-07 11:28:59.329431] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.070 [2024-10-07 11:28:59.332706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.070 [2024-10-07 11:28:59.333156] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.070 [2024-10-07 11:28:59.333206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.070 [2024-10-07 11:28:59.333228] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.070 [2024-10-07 11:28:59.333303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.070 [2024-10-07 11:28:59.333342] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.070 [2024-10-07 11:28:59.333361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.070 [2024-10-07 11:28:59.333376] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.070 [2024-10-07 11:28:59.333422] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.070 [2024-10-07 11:28:59.338155] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.070 [2024-10-07 11:28:59.339734] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.070 [2024-10-07 11:28:59.339792] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.070 [2024-10-07 11:28:59.339816] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.070 [2024-10-07 11:28:59.341086] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.070 [2024-10-07 11:28:59.341340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.070 [2024-10-07 11:28:59.341381] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.070 [2024-10-07 11:28:59.341427] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.070 [2024-10-07 11:28:59.342493] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.070 [2024-10-07 11:28:59.345386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.070 [2024-10-07 11:28:59.345598] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.070 [2024-10-07 11:28:59.345636] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.070 [2024-10-07 11:28:59.345655] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.070 [2024-10-07 11:28:59.345691] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.070 [2024-10-07 11:28:59.346421] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.070 [2024-10-07 11:28:59.346459] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.070 [2024-10-07 11:28:59.346478] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.070 [2024-10-07 11:28:59.347109] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.070 [2024-10-07 11:28:59.348350] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.070 [2024-10-07 11:28:59.348497] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.070 [2024-10-07 11:28:59.348532] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.070 [2024-10-07 11:28:59.348550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.070 [2024-10-07 11:28:59.348582] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.070 [2024-10-07 11:28:59.348613] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.070 [2024-10-07 11:28:59.348630] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.070 [2024-10-07 11:28:59.348645] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.070 [2024-10-07 11:28:59.348674] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.070 [2024-10-07 11:28:59.356574] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.070 [2024-10-07 11:28:59.356765] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.070 [2024-10-07 11:28:59.356800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.070 [2024-10-07 11:28:59.356819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.070 [2024-10-07 11:28:59.358090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.070 [2024-10-07 11:28:59.359305] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.070 [2024-10-07 11:28:59.359345] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.071 [2024-10-07 11:28:59.359365] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.071 [2024-10-07 11:28:59.359617] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.071 [2024-10-07 11:28:59.359684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.071 [2024-10-07 11:28:59.359791] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.071 [2024-10-07 11:28:59.359833] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.071 [2024-10-07 11:28:59.359853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.071 [2024-10-07 11:28:59.359884] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.071 [2024-10-07 11:28:59.359915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.071 [2024-10-07 11:28:59.359932] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.071 [2024-10-07 11:28:59.359946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.071 [2024-10-07 11:28:59.359990] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.071 [2024-10-07 11:28:59.367916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.071 [2024-10-07 11:28:59.369164] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.071 [2024-10-07 11:28:59.369219] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.071 [2024-10-07 11:28:59.369243] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.071 [2024-10-07 11:28:59.369497] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.071 [2024-10-07 11:28:59.369581] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.071 [2024-10-07 11:28:59.369611] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.071 [2024-10-07 11:28:59.369631] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.071 [2024-10-07 11:28:59.369665] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.071 [2024-10-07 11:28:59.370928] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.071 [2024-10-07 11:28:59.371050] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.071 [2024-10-07 11:28:59.371081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.071 [2024-10-07 11:28:59.371099] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.071 [2024-10-07 11:28:59.372314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.071 [2024-10-07 11:28:59.373554] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.071 [2024-10-07 11:28:59.373594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.071 [2024-10-07 11:28:59.373637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.071 [2024-10-07 11:28:59.373883] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.071 [2024-10-07 11:28:59.378927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.071 [2024-10-07 11:28:59.379128] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.071 [2024-10-07 11:28:59.379164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.071 [2024-10-07 11:28:59.379184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.071 [2024-10-07 11:28:59.379219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.071 [2024-10-07 11:28:59.379265] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.071 [2024-10-07 11:28:59.379286] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.071 [2024-10-07 11:28:59.379302] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.071 [2024-10-07 11:28:59.379341] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.071 [2024-10-07 11:28:59.382282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.071 [2024-10-07 11:28:59.383420] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.071 [2024-10-07 11:28:59.383473] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.071 [2024-10-07 11:28:59.383515] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.071 [2024-10-07 11:28:59.383744] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.071 [2024-10-07 11:28:59.383825] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.071 [2024-10-07 11:28:59.383847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.071 [2024-10-07 11:28:59.383874] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.071 [2024-10-07 11:28:59.383907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.071 [2024-10-07 11:28:59.390127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.071 [2024-10-07 11:28:59.390610] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.071 [2024-10-07 11:28:59.390663] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.071 [2024-10-07 11:28:59.390686] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.071 [2024-10-07 11:28:59.390771] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.071 [2024-10-07 11:28:59.390846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.071 [2024-10-07 11:28:59.390868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.071 [2024-10-07 11:28:59.390884] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.071 [2024-10-07 11:28:59.390917] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.071 [2024-10-07 11:28:59.393239] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.071 [2024-10-07 11:28:59.393433] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.071 [2024-10-07 11:28:59.393477] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.071 [2024-10-07 11:28:59.393497] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.071 [2024-10-07 11:28:59.393541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.071 [2024-10-07 11:28:59.393579] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.071 [2024-10-07 11:28:59.393599] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.071 [2024-10-07 11:28:59.393613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.071 [2024-10-07 11:28:59.393645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.071 [2024-10-07 11:28:59.402304] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.071 [2024-10-07 11:28:59.402528] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.071 [2024-10-07 11:28:59.402564] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.071 [2024-10-07 11:28:59.402583] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.071 [2024-10-07 11:28:59.402618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.071 [2024-10-07 11:28:59.402649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.071 [2024-10-07 11:28:59.402666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.071 [2024-10-07 11:28:59.402681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.071 [2024-10-07 11:28:59.402713] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.071 [2024-10-07 11:28:59.404418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.071 [2024-10-07 11:28:59.404759] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.071 [2024-10-07 11:28:59.404802] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.071 [2024-10-07 11:28:59.404822] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.071 [2024-10-07 11:28:59.404892] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.071 [2024-10-07 11:28:59.404950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.071 [2024-10-07 11:28:59.404970] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.071 [2024-10-07 11:28:59.404985] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.071 [2024-10-07 11:28:59.405016] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.071 [2024-10-07 11:28:59.412466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.071 [2024-10-07 11:28:59.413629] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.071 [2024-10-07 11:28:59.413677] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.071 [2024-10-07 11:28:59.413699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.071 [2024-10-07 11:28:59.413933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.071 [2024-10-07 11:28:59.414065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.071 [2024-10-07 11:28:59.414093] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.071 [2024-10-07 11:28:59.414121] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.071 [2024-10-07 11:28:59.415325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.071 [2024-10-07 11:28:59.416721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.071 [2024-10-07 11:28:59.416900] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.071 [2024-10-07 11:28:59.416935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.071 [2024-10-07 11:28:59.416953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.072 [2024-10-07 11:28:59.416994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.072 [2024-10-07 11:28:59.417025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.072 [2024-10-07 11:28:59.417042] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.072 [2024-10-07 11:28:59.417070] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.072 [2024-10-07 11:28:59.417105] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.072 [2024-10-07 11:28:59.422597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.072 [2024-10-07 11:28:59.422780] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.072 [2024-10-07 11:28:59.422816] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.072 [2024-10-07 11:28:59.422834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.072 [2024-10-07 11:28:59.422868] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.072 [2024-10-07 11:28:59.422899] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.072 [2024-10-07 11:28:59.422916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.072 [2024-10-07 11:28:59.422931] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.072 [2024-10-07 11:28:59.422961] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.072 [2024-10-07 11:28:59.427745] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.072 [2024-10-07 11:28:59.428003] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.072 [2024-10-07 11:28:59.428058] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.072 [2024-10-07 11:28:59.428089] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.072 [2024-10-07 11:28:59.429499] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.072 [2024-10-07 11:28:59.429907] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.072 [2024-10-07 11:28:59.429968] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.072 [2024-10-07 11:28:59.430045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.072 [2024-10-07 11:28:59.430241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.072 [2024-10-07 11:28:59.434606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.072 [2024-10-07 11:28:59.435098] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.072 [2024-10-07 11:28:59.435152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.072 [2024-10-07 11:28:59.435174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.072 [2024-10-07 11:28:59.435252] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.072 [2024-10-07 11:28:59.435292] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.072 [2024-10-07 11:28:59.435309] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.072 [2024-10-07 11:28:59.435325] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.072 [2024-10-07 11:28:59.435360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.072 [2024-10-07 11:28:59.438134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.072 [2024-10-07 11:28:59.438301] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.072 [2024-10-07 11:28:59.438338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.072 [2024-10-07 11:28:59.438357] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.072 [2024-10-07 11:28:59.438425] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.072 [2024-10-07 11:28:59.438466] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.072 [2024-10-07 11:28:59.438484] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.072 [2024-10-07 11:28:59.438500] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.072 [2024-10-07 11:28:59.438532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.072 [2024-10-07 11:28:59.444746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.072 [2024-10-07 11:28:59.444923] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.072 [2024-10-07 11:28:59.444957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.072 [2024-10-07 11:28:59.444976] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.072 [2024-10-07 11:28:59.445010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.072 [2024-10-07 11:28:59.445041] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.072 [2024-10-07 11:28:59.445072] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.072 [2024-10-07 11:28:59.445090] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.072 [2024-10-07 11:28:59.445121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.072 [2024-10-07 11:28:59.449356] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.072 [2024-10-07 11:28:59.449530] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.072 [2024-10-07 11:28:59.449601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.072 [2024-10-07 11:28:59.449625] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.072 [2024-10-07 11:28:59.449661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.072 [2024-10-07 11:28:59.449694] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.072 [2024-10-07 11:28:59.449710] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.072 [2024-10-07 11:28:59.449727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.072 [2024-10-07 11:28:59.449951] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.072 [2024-10-07 11:28:59.454881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.072 [2024-10-07 11:28:59.455034] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.072 [2024-10-07 11:28:59.455078] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.072 [2024-10-07 11:28:59.455099] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.072 [2024-10-07 11:28:59.455134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.072 [2024-10-07 11:28:59.455165] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.072 [2024-10-07 11:28:59.455181] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.072 [2024-10-07 11:28:59.455197] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.072 [2024-10-07 11:28:59.455227] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.072 [2024-10-07 11:28:59.459480] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.072 [2024-10-07 11:28:59.459622] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.072 [2024-10-07 11:28:59.459665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.072 [2024-10-07 11:28:59.459685] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.072 [2024-10-07 11:28:59.459720] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.072 [2024-10-07 11:28:59.459751] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.072 [2024-10-07 11:28:59.459767] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.072 [2024-10-07 11:28:59.459782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.072 [2024-10-07 11:28:59.459812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.072 [2024-10-07 11:28:59.465593] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.072 [2024-10-07 11:28:59.465875] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.072 [2024-10-07 11:28:59.465955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.072 [2024-10-07 11:28:59.465996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.072 [2024-10-07 11:28:59.467859] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.072 [2024-10-07 11:28:59.469834] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.072 [2024-10-07 11:28:59.469912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.072 [2024-10-07 11:28:59.469951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.072 [2024-10-07 11:28:59.471233] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.072 [2024-10-07 11:28:59.472097] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.072 [2024-10-07 11:28:59.472736] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.072 [2024-10-07 11:28:59.472806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.072 [2024-10-07 11:28:59.472840] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.072 [2024-10-07 11:28:59.472948] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.072 [2024-10-07 11:28:59.473021] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.072 [2024-10-07 11:28:59.473067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.072 [2024-10-07 11:28:59.473098] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.072 [2024-10-07 11:28:59.473150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.072 [2024-10-07 11:28:59.476110] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.072 [2024-10-07 11:28:59.476346] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.073 [2024-10-07 11:28:59.476419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.073 [2024-10-07 11:28:59.476454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.073 [2024-10-07 11:28:59.476506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.073 [2024-10-07 11:28:59.476556] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.073 [2024-10-07 11:28:59.476583] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.073 [2024-10-07 11:28:59.476606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.073 [2024-10-07 11:28:59.476648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.073 [2024-10-07 11:28:59.482230] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.073 [2024-10-07 11:28:59.482439] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.073 [2024-10-07 11:28:59.482477] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.073 [2024-10-07 11:28:59.482496] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.073 [2024-10-07 11:28:59.482532] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.073 [2024-10-07 11:28:59.482564] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.073 [2024-10-07 11:28:59.482582] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.073 [2024-10-07 11:28:59.482598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.073 [2024-10-07 11:28:59.482655] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.073 [2024-10-07 11:28:59.487148] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.073 [2024-10-07 11:28:59.487293] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.073 [2024-10-07 11:28:59.487333] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.073 [2024-10-07 11:28:59.487353] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.073 [2024-10-07 11:28:59.487395] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.073 [2024-10-07 11:28:59.487450] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.073 [2024-10-07 11:28:59.487467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.073 [2024-10-07 11:28:59.487482] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.073 [2024-10-07 11:28:59.487514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.073 [2024-10-07 11:28:59.492380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.073 [2024-10-07 11:28:59.492541] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.073 [2024-10-07 11:28:59.492576] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.073 [2024-10-07 11:28:59.492594] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.073 [2024-10-07 11:28:59.492627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.073 [2024-10-07 11:28:59.492659] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.073 [2024-10-07 11:28:59.492676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.073 [2024-10-07 11:28:59.492691] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.073 [2024-10-07 11:28:59.492721] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.073 [2024-10-07 11:28:59.497263] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.073 [2024-10-07 11:28:59.497421] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.073 [2024-10-07 11:28:59.497469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.073 [2024-10-07 11:28:59.497497] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.073 [2024-10-07 11:28:59.497536] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.073 [2024-10-07 11:28:59.497568] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.073 [2024-10-07 11:28:59.497586] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.073 [2024-10-07 11:28:59.497601] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.073 [2024-10-07 11:28:59.497632] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.073 [2024-10-07 11:28:59.503203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.073 [2024-10-07 11:28:59.503369] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.073 [2024-10-07 11:28:59.503417] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.073 [2024-10-07 11:28:59.503471] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.073 [2024-10-07 11:28:59.503509] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.073 [2024-10-07 11:28:59.503542] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.073 [2024-10-07 11:28:59.503559] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.073 [2024-10-07 11:28:59.503574] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.073 [2024-10-07 11:28:59.503604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.073 [2024-10-07 11:28:59.507374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.073 [2024-10-07 11:28:59.507533] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.073 [2024-10-07 11:28:59.507576] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.073 [2024-10-07 11:28:59.507596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.073 [2024-10-07 11:28:59.507631] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.073 [2024-10-07 11:28:59.507661] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.073 [2024-10-07 11:28:59.507678] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.073 [2024-10-07 11:28:59.507693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.073 [2024-10-07 11:28:59.507723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.073 [2024-10-07 11:28:59.513977] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.073 [2024-10-07 11:28:59.514149] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.073 [2024-10-07 11:28:59.514194] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.073 [2024-10-07 11:28:59.514215] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.073 [2024-10-07 11:28:59.514251] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.073 [2024-10-07 11:28:59.514282] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.073 [2024-10-07 11:28:59.514299] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.073 [2024-10-07 11:28:59.514314] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.073 [2024-10-07 11:28:59.514345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.073 [2024-10-07 11:28:59.518330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.073 [2024-10-07 11:28:59.518493] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.073 [2024-10-07 11:28:59.518539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.073 [2024-10-07 11:28:59.518560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.074 [2024-10-07 11:28:59.518596] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.074 [2024-10-07 11:28:59.518628] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.074 [2024-10-07 11:28:59.518668] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.074 [2024-10-07 11:28:59.518684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.074 [2024-10-07 11:28:59.518716] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.074 [2024-10-07 11:28:59.525275] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.074 [2024-10-07 11:28:59.525449] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.074 [2024-10-07 11:28:59.525484] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.074 [2024-10-07 11:28:59.525503] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.074 [2024-10-07 11:28:59.525538] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.074 [2024-10-07 11:28:59.525570] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.074 [2024-10-07 11:28:59.525587] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.074 [2024-10-07 11:28:59.525602] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.074 [2024-10-07 11:28:59.525633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.074 [2024-10-07 11:28:59.528753] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.074 [2024-10-07 11:28:59.528898] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.074 [2024-10-07 11:28:59.528941] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.074 [2024-10-07 11:28:59.528962] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.075 [2024-10-07 11:28:59.528996] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.075 [2024-10-07 11:28:59.529027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.075 [2024-10-07 11:28:59.529044] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.075 [2024-10-07 11:28:59.529078] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.075 [2024-10-07 11:28:59.529113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.075 [2024-10-07 11:28:59.535909] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.075 [2024-10-07 11:28:59.536137] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.075 [2024-10-07 11:28:59.536189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.075 [2024-10-07 11:28:59.536212] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.075 [2024-10-07 11:28:59.536260] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.075 [2024-10-07 11:28:59.537444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.075 [2024-10-07 11:28:59.537490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.075 [2024-10-07 11:28:59.537511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.075 [2024-10-07 11:28:59.537732] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.075 [2024-10-07 11:28:59.539169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.075 [2024-10-07 11:28:59.539306] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.075 [2024-10-07 11:28:59.539348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.075 [2024-10-07 11:28:59.539369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.075 [2024-10-07 11:28:59.539426] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.075 [2024-10-07 11:28:59.539475] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.075 [2024-10-07 11:28:59.539495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.075 [2024-10-07 11:28:59.539510] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.075 [2024-10-07 11:28:59.539541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.075 [2024-10-07 11:28:59.546066] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.075 [2024-10-07 11:28:59.546223] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.075 [2024-10-07 11:28:59.546258] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.075 [2024-10-07 11:28:59.546276] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.075 [2024-10-07 11:28:59.547010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.075 [2024-10-07 11:28:59.547684] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.075 [2024-10-07 11:28:59.547722] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.075 [2024-10-07 11:28:59.547741] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.075 [2024-10-07 11:28:59.547861] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.075 [2024-10-07 11:28:59.549265] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.075 [2024-10-07 11:28:59.549386] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.075 [2024-10-07 11:28:59.549439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.075 [2024-10-07 11:28:59.549460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.075 [2024-10-07 11:28:59.549493] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.075 [2024-10-07 11:28:59.549524] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.075 [2024-10-07 11:28:59.549541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.075 [2024-10-07 11:28:59.549555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.075 [2024-10-07 11:28:59.549584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.075 [2024-10-07 11:28:59.556189] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.075 [2024-10-07 11:28:59.556375] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.075 [2024-10-07 11:28:59.556425] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.075 [2024-10-07 11:28:59.556447] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.075 [2024-10-07 11:28:59.556517] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.075 [2024-10-07 11:28:59.556549] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.075 [2024-10-07 11:28:59.556566] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.075 [2024-10-07 11:28:59.556583] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.075 [2024-10-07 11:28:59.556614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.075 [2024-10-07 11:28:59.560562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.075 [2024-10-07 11:28:59.560703] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.075 [2024-10-07 11:28:59.560747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.075 [2024-10-07 11:28:59.560767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.075 [2024-10-07 11:28:59.560800] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.075 [2024-10-07 11:28:59.560832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.075 [2024-10-07 11:28:59.560848] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.075 [2024-10-07 11:28:59.560863] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.075 [2024-10-07 11:28:59.560892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.075 [2024-10-07 11:28:59.566327] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.075 [2024-10-07 11:28:59.566499] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.075 [2024-10-07 11:28:59.566546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.075 [2024-10-07 11:28:59.566567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.075 [2024-10-07 11:28:59.566602] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.075 [2024-10-07 11:28:59.566634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.075 [2024-10-07 11:28:59.566651] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.075 [2024-10-07 11:28:59.566665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.076 [2024-10-07 11:28:59.566696] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.076 [2024-10-07 11:28:59.570671] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.076 [2024-10-07 11:28:59.570809] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.076 [2024-10-07 11:28:59.570851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.076 [2024-10-07 11:28:59.570873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.076 [2024-10-07 11:28:59.570906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.076 [2024-10-07 11:28:59.570937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.076 [2024-10-07 11:28:59.570954] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.076 [2024-10-07 11:28:59.570997] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.076 [2024-10-07 11:28:59.571030] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.076 [2024-10-07 11:28:59.577179] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.076 [2024-10-07 11:28:59.577350] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.076 [2024-10-07 11:28:59.577385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.076 [2024-10-07 11:28:59.577418] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.076 [2024-10-07 11:28:59.577456] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.076 [2024-10-07 11:28:59.577488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.076 [2024-10-07 11:28:59.577505] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.076 [2024-10-07 11:28:59.577520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.076 [2024-10-07 11:28:59.577551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.076 [2024-10-07 11:28:59.581692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.076 [2024-10-07 11:28:59.581880] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.076 [2024-10-07 11:28:59.581925] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.076 [2024-10-07 11:28:59.581946] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.076 [2024-10-07 11:28:59.581982] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.076 [2024-10-07 11:28:59.582014] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.076 [2024-10-07 11:28:59.582038] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.076 [2024-10-07 11:28:59.582063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.076 [2024-10-07 11:28:59.582110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.076 [2024-10-07 11:28:59.587316] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.076 [2024-10-07 11:28:59.587518] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.076 [2024-10-07 11:28:59.587555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.076 [2024-10-07 11:28:59.587574] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.076 [2024-10-07 11:28:59.587609] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.076 [2024-10-07 11:28:59.588553] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.076 [2024-10-07 11:28:59.588593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.076 [2024-10-07 11:28:59.588613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.076 [2024-10-07 11:28:59.588818] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.076 [2024-10-07 11:28:59.591823] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.076 [2024-10-07 11:28:59.592008] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.076 [2024-10-07 11:28:59.592053] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.076 [2024-10-07 11:28:59.592074] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.076 [2024-10-07 11:28:59.592110] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.076 [2024-10-07 11:28:59.593157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.076 [2024-10-07 11:28:59.593197] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.076 [2024-10-07 11:28:59.593217] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.076 [2024-10-07 11:28:59.593443] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.076 [2024-10-07 11:28:59.598389] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.076 [2024-10-07 11:28:59.598844] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.076 [2024-10-07 11:28:59.598893] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.076 [2024-10-07 11:28:59.598915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.076 [2024-10-07 11:28:59.598988] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.076 [2024-10-07 11:28:59.599050] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.076 [2024-10-07 11:28:59.599071] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.076 [2024-10-07 11:28:59.599087] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.076 [2024-10-07 11:28:59.599119] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.076 [2024-10-07 11:28:59.601971] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.076 [2024-10-07 11:28:59.602114] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.076 [2024-10-07 11:28:59.602150] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.076 [2024-10-07 11:28:59.602168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.076 [2024-10-07 11:28:59.602201] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.076 [2024-10-07 11:28:59.602232] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.076 [2024-10-07 11:28:59.602249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.076 [2024-10-07 11:28:59.602264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.076 [2024-10-07 11:28:59.602295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.076 [2024-10-07 11:28:59.609680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.076 [2024-10-07 11:28:59.609841] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.076 [2024-10-07 11:28:59.609878] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.076 [2024-10-07 11:28:59.609896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.076 [2024-10-07 11:28:59.609931] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.076 [2024-10-07 11:28:59.609995] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.076 [2024-10-07 11:28:59.610013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.076 [2024-10-07 11:28:59.610029] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.076 [2024-10-07 11:28:59.610060] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.076 [2024-10-07 11:28:59.612850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.076 [2024-10-07 11:28:59.613002] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.076 [2024-10-07 11:28:59.613046] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.076 [2024-10-07 11:28:59.613086] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.077 [2024-10-07 11:28:59.613123] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.077 [2024-10-07 11:28:59.613155] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.077 [2024-10-07 11:28:59.613171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.077 [2024-10-07 11:28:59.613186] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.077 [2024-10-07 11:28:59.613216] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.077 [2024-10-07 11:28:59.620105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.077 [2024-10-07 11:28:59.620257] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.077 [2024-10-07 11:28:59.620292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.077 [2024-10-07 11:28:59.620311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.077 [2024-10-07 11:28:59.621443] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.077 [2024-10-07 11:28:59.621692] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.077 [2024-10-07 11:28:59.621729] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.077 [2024-10-07 11:28:59.621748] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.077 [2024-10-07 11:28:59.622785] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.077 [2024-10-07 11:28:59.623082] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.077 [2024-10-07 11:28:59.623201] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.077 [2024-10-07 11:28:59.623242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.077 [2024-10-07 11:28:59.623262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.077 [2024-10-07 11:28:59.623294] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.077 [2024-10-07 11:28:59.623324] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.077 [2024-10-07 11:28:59.623340] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.077 [2024-10-07 11:28:59.623355] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.077 [2024-10-07 11:28:59.623426] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.077 [2024-10-07 11:28:59.630243] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.077 [2024-10-07 11:28:59.630414] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.077 [2024-10-07 11:28:59.630462] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.077 [2024-10-07 11:28:59.630484] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.077 [2024-10-07 11:28:59.630522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.077 [2024-10-07 11:28:59.630554] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.077 [2024-10-07 11:28:59.630571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.077 [2024-10-07 11:28:59.630585] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.077 [2024-10-07 11:28:59.630616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.077 [2024-10-07 11:28:59.633172] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.077 [2024-10-07 11:28:59.634071] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.077 [2024-10-07 11:28:59.634117] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.077 [2024-10-07 11:28:59.634138] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.077 [2024-10-07 11:28:59.634327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.077 [2024-10-07 11:28:59.634543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.077 [2024-10-07 11:28:59.634582] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.077 [2024-10-07 11:28:59.634601] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.077 [2024-10-07 11:28:59.634663] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.077 [2024-10-07 11:28:59.640355] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.077 [2024-10-07 11:28:59.640531] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.077 [2024-10-07 11:28:59.640566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.077 [2024-10-07 11:28:59.640584] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.077 [2024-10-07 11:28:59.640618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.077 [2024-10-07 11:28:59.640649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.077 [2024-10-07 11:28:59.640666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.077 [2024-10-07 11:28:59.640680] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.077 [2024-10-07 11:28:59.640711] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.077 [2024-10-07 11:28:59.645344] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.077 [2024-10-07 11:28:59.645488] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.077 [2024-10-07 11:28:59.645550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.077 [2024-10-07 11:28:59.645569] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.077 [2024-10-07 11:28:59.645603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.077 [2024-10-07 11:28:59.645634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.077 [2024-10-07 11:28:59.645650] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.077 [2024-10-07 11:28:59.645664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.077 [2024-10-07 11:28:59.645853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.077 [2024-10-07 11:28:59.650495] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.077 [2024-10-07 11:28:59.650625] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.077 [2024-10-07 11:28:59.650658] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.077 [2024-10-07 11:28:59.650676] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.077 [2024-10-07 11:28:59.650724] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.077 [2024-10-07 11:28:59.650757] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.077 [2024-10-07 11:28:59.650774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.077 [2024-10-07 11:28:59.650789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.077 [2024-10-07 11:28:59.650819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.077 [2024-10-07 11:28:59.655462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.077 [2024-10-07 11:28:59.655587] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.077 [2024-10-07 11:28:59.655618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.077 [2024-10-07 11:28:59.655636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.077 [2024-10-07 11:28:59.655667] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.077 [2024-10-07 11:28:59.655698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.077 [2024-10-07 11:28:59.655714] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.077 [2024-10-07 11:28:59.655729] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.077 [2024-10-07 11:28:59.655758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.077 [2024-10-07 11:28:59.660956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.077 [2024-10-07 11:28:59.661086] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.077 [2024-10-07 11:28:59.661125] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.077 [2024-10-07 11:28:59.661143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.077 [2024-10-07 11:28:59.661176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.077 [2024-10-07 11:28:59.661236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.077 [2024-10-07 11:28:59.661254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.077 [2024-10-07 11:28:59.661268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.077 [2024-10-07 11:28:59.661298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.077 [2024-10-07 11:28:59.665556] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.077 [2024-10-07 11:28:59.665677] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.077 [2024-10-07 11:28:59.665709] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.077 [2024-10-07 11:28:59.665726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.077 [2024-10-07 11:28:59.665757] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.077 [2024-10-07 11:28:59.665788] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.077 [2024-10-07 11:28:59.665804] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.077 [2024-10-07 11:28:59.665819] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.077 [2024-10-07 11:28:59.665848] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.077 [2024-10-07 11:28:59.671449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.077 [2024-10-07 11:28:59.671603] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.078 [2024-10-07 11:28:59.671636] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.078 [2024-10-07 11:28:59.671654] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.078 [2024-10-07 11:28:59.671686] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.078 [2024-10-07 11:28:59.671718] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.078 [2024-10-07 11:28:59.671735] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.078 [2024-10-07 11:28:59.671750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.078 [2024-10-07 11:28:59.671780] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.078 [2024-10-07 11:28:59.675674] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.078 [2024-10-07 11:28:59.675796] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.078 [2024-10-07 11:28:59.675827] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.078 [2024-10-07 11:28:59.675844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.078 [2024-10-07 11:28:59.675876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.078 [2024-10-07 11:28:59.675925] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.078 [2024-10-07 11:28:59.675944] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.078 [2024-10-07 11:28:59.675959] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.078 [2024-10-07 11:28:59.675989] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.078 [2024-10-07 11:28:59.682465] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.078 [2024-10-07 11:28:59.682597] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.078 [2024-10-07 11:28:59.682630] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.078 [2024-10-07 11:28:59.682649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.078 [2024-10-07 11:28:59.682681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.078 [2024-10-07 11:28:59.682711] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.078 [2024-10-07 11:28:59.682727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.078 [2024-10-07 11:28:59.682742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.078 [2024-10-07 11:28:59.682931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.078 [2024-10-07 11:28:59.685982] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.078 [2024-10-07 11:28:59.686108] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.078 [2024-10-07 11:28:59.686140] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.078 [2024-10-07 11:28:59.686157] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.078 [2024-10-07 11:28:59.686189] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.078 [2024-10-07 11:28:59.686220] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.078 [2024-10-07 11:28:59.686236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.078 [2024-10-07 11:28:59.686251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.078 [2024-10-07 11:28:59.686281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.078 [2024-10-07 11:28:59.693601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.078 [2024-10-07 11:28:59.693799] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.078 [2024-10-07 11:28:59.693840] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.078 [2024-10-07 11:28:59.693860] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.078 [2024-10-07 11:28:59.693894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.078 [2024-10-07 11:28:59.693925] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.078 [2024-10-07 11:28:59.693942] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.078 [2024-10-07 11:28:59.693957] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.078 [2024-10-07 11:28:59.693988] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.078 [2024-10-07 11:28:59.696073] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.078 [2024-10-07 11:28:59.696187] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.078 [2024-10-07 11:28:59.696228] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.078 [2024-10-07 11:28:59.696274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.078 [2024-10-07 11:28:59.696310] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.078 [2024-10-07 11:28:59.697289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.078 [2024-10-07 11:28:59.697327] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.078 [2024-10-07 11:28:59.697347] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.078 [2024-10-07 11:28:59.697563] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.078 [2024-10-07 11:28:59.705283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.078 [2024-10-07 11:28:59.705495] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.078 [2024-10-07 11:28:59.705539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.078 [2024-10-07 11:28:59.705561] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.078 [2024-10-07 11:28:59.705596] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.078 [2024-10-07 11:28:59.705628] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.078 [2024-10-07 11:28:59.705645] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.078 [2024-10-07 11:28:59.705660] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.078 [2024-10-07 11:28:59.705691] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.078 [2024-10-07 11:28:59.707421] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.078 [2024-10-07 11:28:59.707774] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.078 [2024-10-07 11:28:59.707816] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.078 [2024-10-07 11:28:59.707836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.078 [2024-10-07 11:28:59.707919] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.078 [2024-10-07 11:28:59.707956] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.078 [2024-10-07 11:28:59.707973] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.078 [2024-10-07 11:28:59.707987] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.078 [2024-10-07 11:28:59.708017] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.078 [2024-10-07 11:28:59.715424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.078 [2024-10-07 11:28:59.715583] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.078 [2024-10-07 11:28:59.715616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.078 [2024-10-07 11:28:59.715634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.078 [2024-10-07 11:28:59.715665] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.078 [2024-10-07 11:28:59.716683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.078 [2024-10-07 11:28:59.716748] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.078 [2024-10-07 11:28:59.716768] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.078 [2024-10-07 11:28:59.716968] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.078 [2024-10-07 11:28:59.719685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.078 [2024-10-07 11:28:59.719834] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.078 [2024-10-07 11:28:59.719876] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.078 [2024-10-07 11:28:59.719897] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.078 [2024-10-07 11:28:59.719930] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.079 [2024-10-07 11:28:59.719961] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.079 [2024-10-07 11:28:59.719977] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.079 [2024-10-07 11:28:59.719991] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.079 [2024-10-07 11:28:59.720021] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.079 [2024-10-07 11:28:59.725548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.079 [2024-10-07 11:28:59.726591] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.079 [2024-10-07 11:28:59.726638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.079 [2024-10-07 11:28:59.726660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.079 [2024-10-07 11:28:59.726873] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.079 [2024-10-07 11:28:59.728030] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.079 [2024-10-07 11:28:59.728067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.079 [2024-10-07 11:28:59.728086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.079 [2024-10-07 11:28:59.728292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.079 [2024-10-07 11:28:59.729781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.079 [2024-10-07 11:28:59.729895] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.079 [2024-10-07 11:28:59.729934] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.079 [2024-10-07 11:28:59.729953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.079 [2024-10-07 11:28:59.729985] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.079 [2024-10-07 11:28:59.730015] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.079 [2024-10-07 11:28:59.730032] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.079 [2024-10-07 11:28:59.730046] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.079 [2024-10-07 11:28:59.731057] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.079 [2024-10-07 11:28:59.736134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.079 [2024-10-07 11:28:59.736565] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.079 [2024-10-07 11:28:59.736613] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.079 [2024-10-07 11:28:59.736635] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.079 [2024-10-07 11:28:59.736709] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.079 [2024-10-07 11:28:59.736747] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.079 [2024-10-07 11:28:59.736764] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.079 [2024-10-07 11:28:59.736779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.079 [2024-10-07 11:28:59.736810] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.079 [2024-10-07 11:28:59.739872] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.079 [2024-10-07 11:28:59.740894] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.079 [2024-10-07 11:28:59.740939] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.079 [2024-10-07 11:28:59.740960] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.079 [2024-10-07 11:28:59.741179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.079 [2024-10-07 11:28:59.741276] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.079 [2024-10-07 11:28:59.741297] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.079 [2024-10-07 11:28:59.741313] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.079 [2024-10-07 11:28:59.742425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.079 [2024-10-07 11:28:59.748293] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.079 [2024-10-07 11:28:59.748468] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.079 [2024-10-07 11:28:59.748514] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.079 [2024-10-07 11:28:59.748534] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.079 [2024-10-07 11:28:59.748570] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.079 [2024-10-07 11:28:59.748601] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.079 [2024-10-07 11:28:59.748618] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.079 [2024-10-07 11:28:59.748633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.079 [2024-10-07 11:28:59.748663] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.079 [2024-10-07 11:28:59.750442] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.079 [2024-10-07 11:28:59.750785] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.079 [2024-10-07 11:28:59.750828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.079 [2024-10-07 11:28:59.750849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.079 [2024-10-07 11:28:59.750954] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.079 [2024-10-07 11:28:59.750991] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.079 [2024-10-07 11:28:59.751009] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.079 [2024-10-07 11:28:59.751023] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.079 [2024-10-07 11:28:59.751054] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.079 [2024-10-07 11:28:59.758431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.079 [2024-10-07 11:28:59.758586] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.079 [2024-10-07 11:28:59.758620] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.079 [2024-10-07 11:28:59.758637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.079 [2024-10-07 11:28:59.759671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.079 [2024-10-07 11:28:59.759889] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.079 [2024-10-07 11:28:59.759924] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.079 [2024-10-07 11:28:59.759942] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.079 [2024-10-07 11:28:59.760027] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.079 [2024-10-07 11:28:59.762629] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.079 [2024-10-07 11:28:59.762771] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.079 [2024-10-07 11:28:59.762813] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.079 [2024-10-07 11:28:59.762834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.079 [2024-10-07 11:28:59.762866] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.079 [2024-10-07 11:28:59.762897] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.079 [2024-10-07 11:28:59.762913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.079 [2024-10-07 11:28:59.762927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.079 [2024-10-07 11:28:59.762956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.079 [2024-10-07 11:28:59.769637] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.079 [2024-10-07 11:28:59.769839] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.079 [2024-10-07 11:28:59.769872] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.079 [2024-10-07 11:28:59.769890] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.079 [2024-10-07 11:28:59.770994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.079 [2024-10-07 11:28:59.771235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.079 [2024-10-07 11:28:59.771271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.079 [2024-10-07 11:28:59.771320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.079 [2024-10-07 11:28:59.772340] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.079 [2024-10-07 11:28:59.772727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.079 [2024-10-07 11:28:59.772841] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.079 [2024-10-07 11:28:59.772872] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.079 [2024-10-07 11:28:59.772890] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.079 [2024-10-07 11:28:59.772921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.079 [2024-10-07 11:28:59.772951] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.079 [2024-10-07 11:28:59.772968] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.079 [2024-10-07 11:28:59.772982] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.079 [2024-10-07 11:28:59.774014] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.080 [2024-10-07 11:28:59.779767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.080 [2024-10-07 11:28:59.779932] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.080 [2024-10-07 11:28:59.779968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.080 [2024-10-07 11:28:59.779986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.080 [2024-10-07 11:28:59.780021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.080 [2024-10-07 11:28:59.780052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.080 [2024-10-07 11:28:59.780070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.080 [2024-10-07 11:28:59.780084] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.080 [2024-10-07 11:28:59.780114] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.080 [2024-10-07 11:28:59.782814] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.080 [2024-10-07 11:28:59.782942] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.080 [2024-10-07 11:28:59.782974] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.080 [2024-10-07 11:28:59.782992] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.080 [2024-10-07 11:28:59.783935] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.080 [2024-10-07 11:28:59.784154] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.080 [2024-10-07 11:28:59.784189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.080 [2024-10-07 11:28:59.784207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.080 [2024-10-07 11:28:59.785363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.080 [2024-10-07 11:28:59.791349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.080 [2024-10-07 11:28:59.791629] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.080 [2024-10-07 11:28:59.791668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.080 [2024-10-07 11:28:59.791687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.080 [2024-10-07 11:28:59.791724] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.080 [2024-10-07 11:28:59.791756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.080 [2024-10-07 11:28:59.791773] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.080 [2024-10-07 11:28:59.791789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.080 [2024-10-07 11:28:59.791821] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.080 [2024-10-07 11:28:59.793505] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.080 [2024-10-07 11:28:59.793857] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.080 [2024-10-07 11:28:59.793901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.080 [2024-10-07 11:28:59.793920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.080 [2024-10-07 11:28:59.793991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.080 [2024-10-07 11:28:59.794028] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.080 [2024-10-07 11:28:59.794044] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.080 [2024-10-07 11:28:59.794058] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.080 [2024-10-07 11:28:59.794088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.080 [2024-10-07 11:28:59.801786] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.080 [2024-10-07 11:28:59.802036] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.080 [2024-10-07 11:28:59.802075] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.080 [2024-10-07 11:28:59.802094] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.080 [2024-10-07 11:28:59.803190] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.080 [2024-10-07 11:28:59.803435] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.080 [2024-10-07 11:28:59.803472] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.080 [2024-10-07 11:28:59.803491] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.080 [2024-10-07 11:28:59.804729] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.080 [2024-10-07 11:28:59.806186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.080 [2024-10-07 11:28:59.806345] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.080 [2024-10-07 11:28:59.806388] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.080 [2024-10-07 11:28:59.806424] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.080 [2024-10-07 11:28:59.806461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.080 [2024-10-07 11:28:59.806518] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.080 [2024-10-07 11:28:59.806536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.080 [2024-10-07 11:28:59.806551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.080 [2024-10-07 11:28:59.806581] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.080 [2024-10-07 11:28:59.811964] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.080 [2024-10-07 11:28:59.813072] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.080 [2024-10-07 11:28:59.813123] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.080 [2024-10-07 11:28:59.813145] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.080 [2024-10-07 11:28:59.813370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.080 [2024-10-07 11:28:59.813536] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.080 [2024-10-07 11:28:59.813570] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.080 [2024-10-07 11:28:59.813589] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.080 [2024-10-07 11:28:59.814696] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.080 [2024-10-07 11:28:59.816308] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.080 [2024-10-07 11:28:59.816509] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.080 [2024-10-07 11:28:59.816569] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.080 [2024-10-07 11:28:59.816594] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.080 [2024-10-07 11:28:59.817830] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.080 [2024-10-07 11:28:59.818193] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.080 [2024-10-07 11:28:59.818250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.080 [2024-10-07 11:28:59.818281] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.080 [2024-10-07 11:28:59.818466] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.080 [2024-10-07 11:28:59.823138] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.080 [2024-10-07 11:28:59.823353] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.080 [2024-10-07 11:28:59.823422] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.080 [2024-10-07 11:28:59.823448] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.080 [2024-10-07 11:28:59.823488] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.080 [2024-10-07 11:28:59.823521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.080 [2024-10-07 11:28:59.823539] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.080 [2024-10-07 11:28:59.823554] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.080 [2024-10-07 11:28:59.823621] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.080 [2024-10-07 11:28:59.826444] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.080 [2024-10-07 11:28:59.826586] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.080 [2024-10-07 11:28:59.826629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.080 [2024-10-07 11:28:59.826649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.080 [2024-10-07 11:28:59.827599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.080 [2024-10-07 11:28:59.827823] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.080 [2024-10-07 11:28:59.827859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.080 [2024-10-07 11:28:59.827878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.080 [2024-10-07 11:28:59.827957] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.080 [2024-10-07 11:28:59.836748] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.080 [2024-10-07 11:28:59.838092] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.080 [2024-10-07 11:28:59.838168] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.080 [2024-10-07 11:28:59.838203] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.080 [2024-10-07 11:28:59.838358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.080 [2024-10-07 11:28:59.838455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.080 [2024-10-07 11:28:59.838583] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.081 [2024-10-07 11:28:59.838638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.081 [2024-10-07 11:28:59.838670] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.081 [2024-10-07 11:28:59.838695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.081 [2024-10-07 11:28:59.838719] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.081 [2024-10-07 11:28:59.838746] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.081 [2024-10-07 11:28:59.838798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.081 [2024-10-07 11:28:59.838832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.081 [2024-10-07 11:28:59.838878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.081 [2024-10-07 11:28:59.838906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.081 [2024-10-07 11:28:59.838930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.081 [2024-10-07 11:28:59.838972] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.081 [2024-10-07 11:28:59.849807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.081 [2024-10-07 11:28:59.851212] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.081 [2024-10-07 11:28:59.851287] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.081 [2024-10-07 11:28:59.851361] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.081 [2024-10-07 11:28:59.852474] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.081 [2024-10-07 11:28:59.852560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.081 [2024-10-07 11:28:59.852779] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.081 [2024-10-07 11:28:59.852837] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.081 [2024-10-07 11:28:59.852870] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.081 [2024-10-07 11:28:59.852897] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.081 [2024-10-07 11:28:59.852921] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.081 [2024-10-07 11:28:59.852947] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.081 [2024-10-07 11:28:59.853001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.081 [2024-10-07 11:28:59.853035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.081 [2024-10-07 11:28:59.853098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.081 [2024-10-07 11:28:59.853129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.081 [2024-10-07 11:28:59.853154] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.081 [2024-10-07 11:28:59.853198] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.081 [2024-10-07 11:28:59.861425] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.081 [2024-10-07 11:28:59.863127] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.081 [2024-10-07 11:28:59.863205] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.081 [2024-10-07 11:28:59.863240] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.081 [2024-10-07 11:28:59.864732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.081 [2024-10-07 11:28:59.865965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.081 [2024-10-07 11:28:59.866052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.081 [2024-10-07 11:28:59.866086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.081 [2024-10-07 11:28:59.866114] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.081 [2024-10-07 11:28:59.867196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.081 [2024-10-07 11:28:59.867349] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.081 [2024-10-07 11:28:59.867424] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.081 [2024-10-07 11:28:59.867460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.081 [2024-10-07 11:28:59.867614] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.081 [2024-10-07 11:28:59.867727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.081 [2024-10-07 11:28:59.867762] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.081 [2024-10-07 11:28:59.867787] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.081 [2024-10-07 11:28:59.867838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.081 [2024-10-07 11:28:59.873930] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.081 [2024-10-07 11:28:59.875655] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.081 [2024-10-07 11:28:59.875736] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.081 [2024-10-07 11:28:59.875771] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.081 [2024-10-07 11:28:59.876067] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.081 [2024-10-07 11:28:59.876271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.081 [2024-10-07 11:28:59.876322] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.081 [2024-10-07 11:28:59.876354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.081 [2024-10-07 11:28:59.877883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.081 [2024-10-07 11:28:59.877953] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.081 [2024-10-07 11:28:59.879512] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.081 [2024-10-07 11:28:59.879580] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.081 [2024-10-07 11:28:59.879614] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.081 [2024-10-07 11:28:59.880751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.081 [2024-10-07 11:28:59.881871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.081 [2024-10-07 11:28:59.881929] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.081 [2024-10-07 11:28:59.881962] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.081 [2024-10-07 11:28:59.882166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.081 [2024-10-07 11:28:59.884118] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.081 [2024-10-07 11:28:59.885460] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.081 [2024-10-07 11:28:59.885525] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.081 [2024-10-07 11:28:59.885560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.081 [2024-10-07 11:28:59.885822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.081 [2024-10-07 11:28:59.886011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.081 [2024-10-07 11:28:59.886056] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.081 [2024-10-07 11:28:59.886086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.081 [2024-10-07 11:28:59.887449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.081 [2024-10-07 11:28:59.890508] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.081 [2024-10-07 11:28:59.892458] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.081 [2024-10-07 11:28:59.892526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.081 [2024-10-07 11:28:59.892560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.081 [2024-10-07 11:28:59.893983] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.081 [2024-10-07 11:28:59.895164] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.081 [2024-10-07 11:28:59.895221] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.081 [2024-10-07 11:28:59.895253] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.081 [2024-10-07 11:28:59.896364] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.081 [2024-10-07 11:28:59.896583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.081 [2024-10-07 11:28:59.896736] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.081 [2024-10-07 11:28:59.896793] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.081 [2024-10-07 11:28:59.896826] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.081 [2024-10-07 11:28:59.897858] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.081 [2024-10-07 11:28:59.898125] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.081 [2024-10-07 11:28:59.898175] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.081 [2024-10-07 11:28:59.898206] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.081 [2024-10-07 11:28:59.898446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.081 [2024-10-07 11:28:59.903013] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.082 [2024-10-07 11:28:59.904446] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.082 [2024-10-07 11:28:59.904512] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.082 [2024-10-07 11:28:59.904549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.082 [2024-10-07 11:28:59.906354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.082 [2024-10-07 11:28:59.907791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.082 [2024-10-07 11:28:59.907848] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.082 [2024-10-07 11:28:59.907880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.082 [2024-10-07 11:28:59.909091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.082 [2024-10-07 11:28:59.910207] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.082 [2024-10-07 11:28:59.910502] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.082 [2024-10-07 11:28:59.910565] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.082 [2024-10-07 11:28:59.910629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.082 [2024-10-07 11:28:59.910685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.082 [2024-10-07 11:28:59.910735] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.082 [2024-10-07 11:28:59.910764] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.082 [2024-10-07 11:28:59.910789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.082 [2024-10-07 11:28:59.910836] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.082 [2024-10-07 11:28:59.914351] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.082 [2024-10-07 11:28:59.915879] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.082 [2024-10-07 11:28:59.915947] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.082 [2024-10-07 11:28:59.915980] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.082 [2024-10-07 11:28:59.917880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.082 [2024-10-07 11:28:59.918506] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.082 [2024-10-07 11:28:59.918583] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.082 [2024-10-07 11:28:59.918621] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.082 [2024-10-07 11:28:59.920770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.082 [2024-10-07 11:28:59.925760] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.082 [2024-10-07 11:28:59.926861] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.082 [2024-10-07 11:28:59.926931] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.082 [2024-10-07 11:28:59.926955] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.082 [2024-10-07 11:28:59.928120] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.082 [2024-10-07 11:28:59.928182] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.082 [2024-10-07 11:28:59.928899] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.082 [2024-10-07 11:28:59.928946] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.082 [2024-10-07 11:28:59.928967] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.082 [2024-10-07 11:28:59.928984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.082 [2024-10-07 11:28:59.928998] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.082 [2024-10-07 11:28:59.929013] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.082 [2024-10-07 11:28:59.929844] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.082 [2024-10-07 11:28:59.929887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.082 [2024-10-07 11:28:59.930357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.082 [2024-10-07 11:28:59.930443] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.082 [2024-10-07 11:28:59.930462] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.082 [2024-10-07 11:28:59.931932] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.082 [2024-10-07 11:28:59.937527] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.082 [2024-10-07 11:28:59.937730] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.082 [2024-10-07 11:28:59.937768] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.082 [2024-10-07 11:28:59.937787] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.082 [2024-10-07 11:28:59.937823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.082 [2024-10-07 11:28:59.938455] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.082 [2024-10-07 11:28:59.938493] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.082 [2024-10-07 11:28:59.938513] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.082 [2024-10-07 11:28:59.939245] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.082 [2024-10-07 11:28:59.939553] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.082 [2024-10-07 11:28:59.939763] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.082 [2024-10-07 11:28:59.939802] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.082 [2024-10-07 11:28:59.939821] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.082 [2024-10-07 11:28:59.939875] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.082 [2024-10-07 11:28:59.939912] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.082 [2024-10-07 11:28:59.939930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.082 [2024-10-07 11:28:59.939944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.082 [2024-10-07 11:28:59.939975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.082 [2024-10-07 11:28:59.949605] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.082 [2024-10-07 11:28:59.950484] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.082 [2024-10-07 11:28:59.950536] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.082 [2024-10-07 11:28:59.950559] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.082 [2024-10-07 11:28:59.950706] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.082 [2024-10-07 11:28:59.950756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.082 [2024-10-07 11:28:59.950789] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.082 [2024-10-07 11:28:59.950806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.082 [2024-10-07 11:28:59.950821] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.082 [2024-10-07 11:28:59.950851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.082 [2024-10-07 11:28:59.950944] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.082 [2024-10-07 11:28:59.950973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.082 [2024-10-07 11:28:59.950989] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.082 [2024-10-07 11:28:59.951022] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.082 [2024-10-07 11:28:59.951053] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.082 [2024-10-07 11:28:59.951070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.082 [2024-10-07 11:28:59.951084] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.082 [2024-10-07 11:28:59.951113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.082 [2024-10-07 11:28:59.961920] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.082 [2024-10-07 11:28:59.962209] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.082 [2024-10-07 11:28:59.962340] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.082 [2024-10-07 11:28:59.962374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.082 [2024-10-07 11:28:59.962394] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.082 [2024-10-07 11:28:59.963384] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.082 [2024-10-07 11:28:59.963442] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.082 [2024-10-07 11:28:59.963462] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.082 [2024-10-07 11:28:59.963485] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.082 [2024-10-07 11:28:59.963704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.082 [2024-10-07 11:28:59.963743] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.082 [2024-10-07 11:28:59.963762] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.082 [2024-10-07 11:28:59.963778] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.082 [2024-10-07 11:28:59.964724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.082 [2024-10-07 11:28:59.964762] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.082 [2024-10-07 11:28:59.964779] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.082 [2024-10-07 11:28:59.964794] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.083 [2024-10-07 11:28:59.965505] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.083 [2024-10-07 11:28:59.972098] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.083 [2024-10-07 11:28:59.972364] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.083 [2024-10-07 11:28:59.972439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.083 [2024-10-07 11:28:59.972480] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.083 [2024-10-07 11:28:59.972604] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.083 [2024-10-07 11:28:59.972699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.083 [2024-10-07 11:28:59.972752] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.083 [2024-10-07 11:28:59.972786] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.083 [2024-10-07 11:28:59.973504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.083 [2024-10-07 11:28:59.973556] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.083 [2024-10-07 11:28:59.973800] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.083 [2024-10-07 11:28:59.973845] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.083 [2024-10-07 11:28:59.973866] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.083 [2024-10-07 11:28:59.974000] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.083 [2024-10-07 11:28:59.974048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.083 [2024-10-07 11:28:59.974067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.083 [2024-10-07 11:28:59.974081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.083 [2024-10-07 11:28:59.975423] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.083 [2024-10-07 11:28:59.982689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.083 [2024-10-07 11:28:59.982942] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.083 [2024-10-07 11:28:59.982981] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.083 [2024-10-07 11:28:59.983000] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.083 [2024-10-07 11:28:59.983037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.083 [2024-10-07 11:28:59.983069] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.083 [2024-10-07 11:28:59.983086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.083 [2024-10-07 11:28:59.983103] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.083 [2024-10-07 11:28:59.983134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.083 [2024-10-07 11:28:59.983619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.083 [2024-10-07 11:28:59.983720] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.083 [2024-10-07 11:28:59.983757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.083 [2024-10-07 11:28:59.983775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.083 [2024-10-07 11:28:59.984537] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.083 [2024-10-07 11:28:59.985193] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.083 [2024-10-07 11:28:59.985232] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.083 [2024-10-07 11:28:59.985280] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.083 [2024-10-07 11:28:59.985645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.083 [2024-10-07 11:28:59.994461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.083 [2024-10-07 11:28:59.994677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.083 [2024-10-07 11:28:59.994799] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.083 [2024-10-07 11:28:59.994842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.083 [2024-10-07 11:28:59.994863] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.083 [2024-10-07 11:28:59.994933] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.083 [2024-10-07 11:28:59.994961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.083 [2024-10-07 11:28:59.994977] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.083 [2024-10-07 11:28:59.994998] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.083 [2024-10-07 11:28:59.995031] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.083 [2024-10-07 11:28:59.995052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.083 [2024-10-07 11:28:59.995066] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.083 [2024-10-07 11:28:59.995081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.083 [2024-10-07 11:28:59.995111] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.083 [2024-10-07 11:28:59.995129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.083 [2024-10-07 11:28:59.995143] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.083 [2024-10-07 11:28:59.995157] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.083 [2024-10-07 11:28:59.995190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.083 [2024-10-07 11:29:00.006083] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.083 [2024-10-07 11:29:00.006185] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.083 [2024-10-07 11:29:00.007392] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.083 [2024-10-07 11:29:00.007468] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.083 [2024-10-07 11:29:00.007490] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.083 [2024-10-07 11:29:00.007549] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.083 [2024-10-07 11:29:00.007575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.083 [2024-10-07 11:29:00.007592] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.083 [2024-10-07 11:29:00.007818] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.083 [2024-10-07 11:29:00.007863] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.083 [2024-10-07 11:29:00.008833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.083 [2024-10-07 11:29:00.008873] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.083 [2024-10-07 11:29:00.008894] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.083 [2024-10-07 11:29:00.008917] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.083 [2024-10-07 11:29:00.008932] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.083 [2024-10-07 11:29:00.008945] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.083 [2024-10-07 11:29:00.009660] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.083 [2024-10-07 11:29:00.009700] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.083 [2024-10-07 11:29:00.016289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.083 [2024-10-07 11:29:00.016433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.083 [2024-10-07 11:29:00.016580] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.083 [2024-10-07 11:29:00.016621] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.084 [2024-10-07 11:29:00.016641] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.084 [2024-10-07 11:29:00.017338] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.084 [2024-10-07 11:29:00.017386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.084 [2024-10-07 11:29:00.017433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.084 [2024-10-07 11:29:00.017458] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.084 [2024-10-07 11:29:00.017639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.084 [2024-10-07 11:29:00.017668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.084 [2024-10-07 11:29:00.017684] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.084 [2024-10-07 11:29:00.017700] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.084 [2024-10-07 11:29:00.017816] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.084 [2024-10-07 11:29:00.017836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.084 [2024-10-07 11:29:00.017851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.084 [2024-10-07 11:29:00.017864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.084 [2024-10-07 11:29:00.017906] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.084 [2024-10-07 11:29:00.026891] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.084 [2024-10-07 11:29:00.026991] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.084 [2024-10-07 11:29:00.027129] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.084 [2024-10-07 11:29:00.027165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.084 [2024-10-07 11:29:00.027184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.084 [2024-10-07 11:29:00.027271] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.084 [2024-10-07 11:29:00.027297] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.084 [2024-10-07 11:29:00.027313] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.084 [2024-10-07 11:29:00.027348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.084 [2024-10-07 11:29:00.027372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.084 [2024-10-07 11:29:00.027414] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.084 [2024-10-07 11:29:00.027436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.084 [2024-10-07 11:29:00.027452] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.084 [2024-10-07 11:29:00.027469] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.084 [2024-10-07 11:29:00.027483] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.084 [2024-10-07 11:29:00.027496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.084 [2024-10-07 11:29:00.027527] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.084 [2024-10-07 11:29:00.027545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.084 [2024-10-07 11:29:00.038700] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.084 [2024-10-07 11:29:00.038797] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.084 [2024-10-07 11:29:00.038931] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.084 [2024-10-07 11:29:00.038967] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.084 [2024-10-07 11:29:00.038986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.084 [2024-10-07 11:29:00.039037] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.084 [2024-10-07 11:29:00.039061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.084 [2024-10-07 11:29:00.039076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.084 [2024-10-07 11:29:00.039112] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.084 [2024-10-07 11:29:00.039135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.084 [2024-10-07 11:29:00.039162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.084 [2024-10-07 11:29:00.039179] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.084 [2024-10-07 11:29:00.039195] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.084 [2024-10-07 11:29:00.039212] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.084 [2024-10-07 11:29:00.039227] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.084 [2024-10-07 11:29:00.039241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.084 [2024-10-07 11:29:00.039270] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.084 [2024-10-07 11:29:00.039310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.084 [2024-10-07 11:29:00.050174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.084 [2024-10-07 11:29:00.050268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.084 [2024-10-07 11:29:00.051520] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.084 [2024-10-07 11:29:00.051572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.084 [2024-10-07 11:29:00.051595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.084 [2024-10-07 11:29:00.051649] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.084 [2024-10-07 11:29:00.051674] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.084 [2024-10-07 11:29:00.051690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.084 [2024-10-07 11:29:00.051889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.084 [2024-10-07 11:29:00.051921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.084 [2024-10-07 11:29:00.053075] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.084 [2024-10-07 11:29:00.053123] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.084 [2024-10-07 11:29:00.053145] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.084 [2024-10-07 11:29:00.053166] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.084 [2024-10-07 11:29:00.053181] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.084 [2024-10-07 11:29:00.053195] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.084 [2024-10-07 11:29:00.053907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.084 [2024-10-07 11:29:00.053946] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.084 [2024-10-07 11:29:00.060368] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.084 [2024-10-07 11:29:00.060454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.084 [2024-10-07 11:29:00.060580] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.084 [2024-10-07 11:29:00.060615] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.084 [2024-10-07 11:29:00.060634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.084 [2024-10-07 11:29:00.060682] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.084 [2024-10-07 11:29:00.060706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.084 [2024-10-07 11:29:00.060721] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.084 [2024-10-07 11:29:00.060756] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.084 [2024-10-07 11:29:00.060780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.084 [2024-10-07 11:29:00.060807] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.084 [2024-10-07 11:29:00.060856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.084 [2024-10-07 11:29:00.060873] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.084 [2024-10-07 11:29:00.060890] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.084 [2024-10-07 11:29:00.060904] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.084 [2024-10-07 11:29:00.060917] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.084 [2024-10-07 11:29:00.061556] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.085 [2024-10-07 11:29:00.061585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.085 [2024-10-07 11:29:00.070544] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.085 [2024-10-07 11:29:00.070650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.085 [2024-10-07 11:29:00.070756] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.085 [2024-10-07 11:29:00.070788] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.085 [2024-10-07 11:29:00.070806] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.085 [2024-10-07 11:29:00.070872] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.085 [2024-10-07 11:29:00.070899] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.085 [2024-10-07 11:29:00.070915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.085 [2024-10-07 11:29:00.070935] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.085 [2024-10-07 11:29:00.070967] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.085 [2024-10-07 11:29:00.070987] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.085 [2024-10-07 11:29:00.071002] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.085 [2024-10-07 11:29:00.071016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.085 [2024-10-07 11:29:00.071046] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.085 [2024-10-07 11:29:00.071064] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.085 [2024-10-07 11:29:00.071077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.085 [2024-10-07 11:29:00.071090] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.085 [2024-10-07 11:29:00.071117] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.085 [2024-10-07 11:29:00.082047] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.085 [2024-10-07 11:29:00.082139] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.085 [2024-10-07 11:29:00.082269] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.085 [2024-10-07 11:29:00.082302] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.085 [2024-10-07 11:29:00.082320] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.085 [2024-10-07 11:29:00.082370] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.085 [2024-10-07 11:29:00.082438] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.085 [2024-10-07 11:29:00.082459] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.085 [2024-10-07 11:29:00.082496] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.085 [2024-10-07 11:29:00.082521] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.085 [2024-10-07 11:29:00.082547] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.085 [2024-10-07 11:29:00.082564] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.085 [2024-10-07 11:29:00.082580] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.085 [2024-10-07 11:29:00.082597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.085 [2024-10-07 11:29:00.082611] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.085 [2024-10-07 11:29:00.082624] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.085 [2024-10-07 11:29:00.082653] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.085 [2024-10-07 11:29:00.082671] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.085 [2024-10-07 11:29:00.093360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.085 [2024-10-07 11:29:00.093463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.085 [2024-10-07 11:29:00.093777] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.085 [2024-10-07 11:29:00.093813] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.085 [2024-10-07 11:29:00.093832] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.085 [2024-10-07 11:29:00.093881] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.085 [2024-10-07 11:29:00.093904] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.085 [2024-10-07 11:29:00.093920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.085 [2024-10-07 11:29:00.094869] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.085 [2024-10-07 11:29:00.094915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.085 [2024-10-07 11:29:00.095131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.085 [2024-10-07 11:29:00.095158] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.085 [2024-10-07 11:29:00.095175] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.085 [2024-10-07 11:29:00.095195] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.085 [2024-10-07 11:29:00.095209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.085 [2024-10-07 11:29:00.095223] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.085 [2024-10-07 11:29:00.096159] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.085 [2024-10-07 11:29:00.096195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.085 8412.12 IOPS, 32.86 MiB/s [2024-10-07T11:29:07.796Z] [2024-10-07 11:29:00.103565] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.085 [2024-10-07 11:29:00.103663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.085 [2024-10-07 11:29:00.103773] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.085 [2024-10-07 11:29:00.103806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.085 [2024-10-07 11:29:00.103824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.085 [2024-10-07 11:29:00.103889] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.085 [2024-10-07 11:29:00.103915] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.085 [2024-10-07 11:29:00.103931] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.085 [2024-10-07 11:29:00.103951] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.085 [2024-10-07 11:29:00.103983] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.085 [2024-10-07 11:29:00.104003] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.085 [2024-10-07 11:29:00.104017] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.085 [2024-10-07 11:29:00.104033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.085 [2024-10-07 11:29:00.104064] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.085 [2024-10-07 11:29:00.104081] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.085 [2024-10-07 11:29:00.104094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.085 [2024-10-07 11:29:00.104107] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.085 [2024-10-07 11:29:00.104722] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.085 [2024-10-07 11:29:00.113735] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.085 [2024-10-07 11:29:00.113853] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.085 [2024-10-07 11:29:00.113966] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.085 [2024-10-07 11:29:00.113998] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.085 [2024-10-07 11:29:00.114017] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.085 [2024-10-07 11:29:00.114082] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.085 [2024-10-07 11:29:00.114109] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.085 [2024-10-07 11:29:00.114125] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.085 [2024-10-07 11:29:00.114145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.085 [2024-10-07 11:29:00.114177] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.085 [2024-10-07 11:29:00.114197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.085 [2024-10-07 11:29:00.114211] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.085 [2024-10-07 11:29:00.114259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.085 [2024-10-07 11:29:00.114293] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.085 [2024-10-07 11:29:00.114311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.085 [2024-10-07 11:29:00.114324] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.085 [2024-10-07 11:29:00.114338] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.085 [2024-10-07 11:29:00.114364] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.085 [2024-10-07 11:29:00.125565] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.085 [2024-10-07 11:29:00.125660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.085 [2024-10-07 11:29:00.125794] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.085 [2024-10-07 11:29:00.125829] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.085 [2024-10-07 11:29:00.125847] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.085 [2024-10-07 11:29:00.125898] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.086 [2024-10-07 11:29:00.125921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.086 [2024-10-07 11:29:00.125936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.086 [2024-10-07 11:29:00.125971] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.086 [2024-10-07 11:29:00.125995] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.086 [2024-10-07 11:29:00.126021] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.086 [2024-10-07 11:29:00.126039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.086 [2024-10-07 11:29:00.126054] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.086 [2024-10-07 11:29:00.126071] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.086 [2024-10-07 11:29:00.126085] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.086 [2024-10-07 11:29:00.126098] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.086 [2024-10-07 11:29:00.126127] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.086 [2024-10-07 11:29:00.126144] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.086 [2024-10-07 11:29:00.137007] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.086 [2024-10-07 11:29:00.137121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.086 [2024-10-07 11:29:00.137250] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.086 [2024-10-07 11:29:00.137285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.086 [2024-10-07 11:29:00.137303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.086 [2024-10-07 11:29:00.137352] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.086 [2024-10-07 11:29:00.137375] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.086 [2024-10-07 11:29:00.137442] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.086 [2024-10-07 11:29:00.138383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.086 [2024-10-07 11:29:00.138442] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.086 [2024-10-07 11:29:00.138633] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.086 [2024-10-07 11:29:00.138668] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.086 [2024-10-07 11:29:00.138694] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.086 [2024-10-07 11:29:00.138712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.086 [2024-10-07 11:29:00.138727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.086 [2024-10-07 11:29:00.138740] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.086 [2024-10-07 11:29:00.139674] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.086 [2024-10-07 11:29:00.139713] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.086 [2024-10-07 11:29:00.147838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.086 [2024-10-07 11:29:00.147931] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.086 [2024-10-07 11:29:00.148060] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.086 [2024-10-07 11:29:00.148094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.086 [2024-10-07 11:29:00.148112] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.086 [2024-10-07 11:29:00.148162] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.086 [2024-10-07 11:29:00.148185] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.086 [2024-10-07 11:29:00.148201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.086 [2024-10-07 11:29:00.148235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.086 [2024-10-07 11:29:00.148258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.086 [2024-10-07 11:29:00.148285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.086 [2024-10-07 11:29:00.148302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.086 [2024-10-07 11:29:00.148317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.086 [2024-10-07 11:29:00.148334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.086 [2024-10-07 11:29:00.148348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.086 [2024-10-07 11:29:00.148372] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.086 [2024-10-07 11:29:00.148416] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.086 [2024-10-07 11:29:00.148437] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.086 [2024-10-07 11:29:00.159454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.086 [2024-10-07 11:29:00.159563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.086 [2024-10-07 11:29:00.159697] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.086 [2024-10-07 11:29:00.159731] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.086 [2024-10-07 11:29:00.159750] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.086 [2024-10-07 11:29:00.159799] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.086 [2024-10-07 11:29:00.159822] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.086 [2024-10-07 11:29:00.159838] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.086 [2024-10-07 11:29:00.160109] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.086 [2024-10-07 11:29:00.160152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.086 [2024-10-07 11:29:00.160225] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.086 [2024-10-07 11:29:00.160251] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.086 [2024-10-07 11:29:00.160267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.086 [2024-10-07 11:29:00.160285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.086 [2024-10-07 11:29:00.160299] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.086 [2024-10-07 11:29:00.160313] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.086 [2024-10-07 11:29:00.160343] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.086 [2024-10-07 11:29:00.160361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.086 [2024-10-07 11:29:00.170258] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.086 [2024-10-07 11:29:00.170337] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.086 [2024-10-07 11:29:00.170479] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.086 [2024-10-07 11:29:00.170514] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.086 [2024-10-07 11:29:00.170532] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.086 [2024-10-07 11:29:00.170582] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.086 [2024-10-07 11:29:00.170605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.086 [2024-10-07 11:29:00.170621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.086 [2024-10-07 11:29:00.171596] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.086 [2024-10-07 11:29:00.171642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.086 [2024-10-07 11:29:00.171837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.086 [2024-10-07 11:29:00.171862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.086 [2024-10-07 11:29:00.171878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.086 [2024-10-07 11:29:00.171919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.086 [2024-10-07 11:29:00.171936] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.087 [2024-10-07 11:29:00.171949] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.087 [2024-10-07 11:29:00.171989] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.087 [2024-10-07 11:29:00.172009] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.087 [2024-10-07 11:29:00.180457] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.087 [2024-10-07 11:29:00.180548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.087 [2024-10-07 11:29:00.180686] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.087 [2024-10-07 11:29:00.180721] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.087 [2024-10-07 11:29:00.180740] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.087 [2024-10-07 11:29:00.180790] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.087 [2024-10-07 11:29:00.180813] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.087 [2024-10-07 11:29:00.180828] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.087 [2024-10-07 11:29:00.181629] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.087 [2024-10-07 11:29:00.181677] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.087 [2024-10-07 11:29:00.182272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.087 [2024-10-07 11:29:00.182313] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.087 [2024-10-07 11:29:00.182333] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.087 [2024-10-07 11:29:00.182353] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.087 [2024-10-07 11:29:00.182367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.087 [2024-10-07 11:29:00.182381] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.087 [2024-10-07 11:29:00.182483] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.087 [2024-10-07 11:29:00.182508] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.087 [2024-10-07 11:29:00.190722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.087 [2024-10-07 11:29:00.190811] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.087 [2024-10-07 11:29:00.190941] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.087 [2024-10-07 11:29:00.190974] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.087 [2024-10-07 11:29:00.190992] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.087 [2024-10-07 11:29:00.191041] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.087 [2024-10-07 11:29:00.191064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.087 [2024-10-07 11:29:00.191123] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.087 [2024-10-07 11:29:00.191179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.087 [2024-10-07 11:29:00.191205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.087 [2024-10-07 11:29:00.191233] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.087 [2024-10-07 11:29:00.191249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.087 [2024-10-07 11:29:00.191264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.087 [2024-10-07 11:29:00.191282] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.087 [2024-10-07 11:29:00.191296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.087 [2024-10-07 11:29:00.191309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.087 [2024-10-07 11:29:00.192272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.087 [2024-10-07 11:29:00.192314] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.087 [2024-10-07 11:29:00.201218] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.087 [2024-10-07 11:29:00.201313] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.087 [2024-10-07 11:29:00.201464] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.087 [2024-10-07 11:29:00.201501] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.087 [2024-10-07 11:29:00.201520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.087 [2024-10-07 11:29:00.201573] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.087 [2024-10-07 11:29:00.201597] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.087 [2024-10-07 11:29:00.201613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.087 [2024-10-07 11:29:00.201934] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.087 [2024-10-07 11:29:00.201974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.087 [2024-10-07 11:29:00.202053] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.087 [2024-10-07 11:29:00.202079] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.087 [2024-10-07 11:29:00.202096] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.087 [2024-10-07 11:29:00.202114] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.087 [2024-10-07 11:29:00.202129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.087 [2024-10-07 11:29:00.202142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.087 [2024-10-07 11:29:00.202174] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.087 [2024-10-07 11:29:00.202192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.087 [2024-10-07 11:29:00.211423] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.087 [2024-10-07 11:29:00.212451] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.087 [2024-10-07 11:29:00.212620] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.087 [2024-10-07 11:29:00.212656] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.087 [2024-10-07 11:29:00.212675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.087 [2024-10-07 11:29:00.213454] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.087 [2024-10-07 11:29:00.213499] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.087 [2024-10-07 11:29:00.213519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.087 [2024-10-07 11:29:00.213541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.087 [2024-10-07 11:29:00.213642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.087 [2024-10-07 11:29:00.213670] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.087 [2024-10-07 11:29:00.213685] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.087 [2024-10-07 11:29:00.213700] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.087 [2024-10-07 11:29:00.213733] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.087 [2024-10-07 11:29:00.213752] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.087 [2024-10-07 11:29:00.213765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.087 [2024-10-07 11:29:00.213779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.087 [2024-10-07 11:29:00.213806] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.087 [2024-10-07 11:29:00.222183] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.087 [2024-10-07 11:29:00.222369] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.087 [2024-10-07 11:29:00.222418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.087 [2024-10-07 11:29:00.222440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.087 [2024-10-07 11:29:00.222475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.087 [2024-10-07 11:29:00.222507] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.087 [2024-10-07 11:29:00.222524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.087 [2024-10-07 11:29:00.222539] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.087 [2024-10-07 11:29:00.222569] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.087 [2024-10-07 11:29:00.222623] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.087 [2024-10-07 11:29:00.222709] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.088 [2024-10-07 11:29:00.222738] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.088 [2024-10-07 11:29:00.222754] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.088 [2024-10-07 11:29:00.222785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.088 [2024-10-07 11:29:00.222856] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.088 [2024-10-07 11:29:00.222875] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.088 [2024-10-07 11:29:00.222889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.088 [2024-10-07 11:29:00.222918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.088 [2024-10-07 11:29:00.232346] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.088 [2024-10-07 11:29:00.232567] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.088 [2024-10-07 11:29:00.232606] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.088 [2024-10-07 11:29:00.232625] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.088 [2024-10-07 11:29:00.232661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.088 [2024-10-07 11:29:00.232732] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.088 [2024-10-07 11:29:00.232756] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.088 [2024-10-07 11:29:00.232772] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.088 [2024-10-07 11:29:00.232804] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.088 [2024-10-07 11:29:00.232826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.088 [2024-10-07 11:29:00.232901] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.088 [2024-10-07 11:29:00.232929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.088 [2024-10-07 11:29:00.232945] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.088 [2024-10-07 11:29:00.232976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.088 [2024-10-07 11:29:00.233005] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.088 [2024-10-07 11:29:00.233022] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.088 [2024-10-07 11:29:00.233036] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.088 [2024-10-07 11:29:00.233080] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.088 [2024-10-07 11:29:00.243470] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.088 [2024-10-07 11:29:00.243571] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.088 [2024-10-07 11:29:00.243720] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.088 [2024-10-07 11:29:00.243756] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.088 [2024-10-07 11:29:00.243774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.088 [2024-10-07 11:29:00.243831] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.088 [2024-10-07 11:29:00.243855] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.088 [2024-10-07 11:29:00.243873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.088 [2024-10-07 11:29:00.243960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.088 [2024-10-07 11:29:00.243986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.088 [2024-10-07 11:29:00.244013] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.088 [2024-10-07 11:29:00.244030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.088 [2024-10-07 11:29:00.244045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.088 [2024-10-07 11:29:00.244063] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.088 [2024-10-07 11:29:00.244077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.088 [2024-10-07 11:29:00.244091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.088 [2024-10-07 11:29:00.245425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.088 [2024-10-07 11:29:00.245474] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.088 [2024-10-07 11:29:00.253937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.088 [2024-10-07 11:29:00.254043] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.088 [2024-10-07 11:29:00.254187] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.088 [2024-10-07 11:29:00.254223] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.088 [2024-10-07 11:29:00.254242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.088 [2024-10-07 11:29:00.254294] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.088 [2024-10-07 11:29:00.254318] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.088 [2024-10-07 11:29:00.254334] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.088 [2024-10-07 11:29:00.254630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.088 [2024-10-07 11:29:00.254664] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.088 [2024-10-07 11:29:00.254734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.088 [2024-10-07 11:29:00.254759] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.088 [2024-10-07 11:29:00.254775] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.088 [2024-10-07 11:29:00.254792] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.088 [2024-10-07 11:29:00.254807] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.088 [2024-10-07 11:29:00.254820] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.088 [2024-10-07 11:29:00.254851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.088 [2024-10-07 11:29:00.254868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.088 [2024-10-07 11:29:00.264250] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.088 [2024-10-07 11:29:00.264344] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.088 [2024-10-07 11:29:00.264493] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.088 [2024-10-07 11:29:00.264562] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.088 [2024-10-07 11:29:00.264583] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.088 [2024-10-07 11:29:00.264636] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.088 [2024-10-07 11:29:00.264661] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.088 [2024-10-07 11:29:00.264676] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.088 [2024-10-07 11:29:00.265645] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.088 [2024-10-07 11:29:00.265692] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.088 [2024-10-07 11:29:00.265887] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.088 [2024-10-07 11:29:00.265914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.088 [2024-10-07 11:29:00.265930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.088 [2024-10-07 11:29:00.265949] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.088 [2024-10-07 11:29:00.265963] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.088 [2024-10-07 11:29:00.265977] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.088 [2024-10-07 11:29:00.266016] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.088 [2024-10-07 11:29:00.266035] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.088 [2024-10-07 11:29:00.274455] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.088 [2024-10-07 11:29:00.275284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.088 [2024-10-07 11:29:00.275433] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.088 [2024-10-07 11:29:00.275467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.088 [2024-10-07 11:29:00.275485] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.088 [2024-10-07 11:29:00.276122] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.088 [2024-10-07 11:29:00.276165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.088 [2024-10-07 11:29:00.276186] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.088 [2024-10-07 11:29:00.276208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.089 [2024-10-07 11:29:00.276296] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.089 [2024-10-07 11:29:00.276323] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.089 [2024-10-07 11:29:00.276338] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.089 [2024-10-07 11:29:00.276353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.089 [2024-10-07 11:29:00.276638] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.089 [2024-10-07 11:29:00.276666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.089 [2024-10-07 11:29:00.276706] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.089 [2024-10-07 11:29:00.276722] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.089 [2024-10-07 11:29:00.276808] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.089 [2024-10-07 11:29:00.284615] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.089 [2024-10-07 11:29:00.284811] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.089 [2024-10-07 11:29:00.284846] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.089 [2024-10-07 11:29:00.284865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.089 [2024-10-07 11:29:00.284901] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.089 [2024-10-07 11:29:00.285870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.089 [2024-10-07 11:29:00.285912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.089 [2024-10-07 11:29:00.285933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.089 [2024-10-07 11:29:00.286143] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.089 [2024-10-07 11:29:00.286203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.089 [2024-10-07 11:29:00.287209] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.089 [2024-10-07 11:29:00.287253] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.089 [2024-10-07 11:29:00.287274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.089 [2024-10-07 11:29:00.287433] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.089 [2024-10-07 11:29:00.288036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.089 [2024-10-07 11:29:00.288073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.089 [2024-10-07 11:29:00.288091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.089 [2024-10-07 11:29:00.288192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.089 [2024-10-07 11:29:00.294772] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.089 [2024-10-07 11:29:00.294970] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.089 [2024-10-07 11:29:00.295007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.089 [2024-10-07 11:29:00.295026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.089 [2024-10-07 11:29:00.295063] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.089 [2024-10-07 11:29:00.295095] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.089 [2024-10-07 11:29:00.295113] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.089 [2024-10-07 11:29:00.295128] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.089 [2024-10-07 11:29:00.295159] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.089 [2024-10-07 11:29:00.296271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.089 [2024-10-07 11:29:00.296377] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.089 [2024-10-07 11:29:00.296423] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.089 [2024-10-07 11:29:00.296443] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.089 [2024-10-07 11:29:00.297227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.089 [2024-10-07 11:29:00.297365] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.089 [2024-10-07 11:29:00.297392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.089 [2024-10-07 11:29:00.297426] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.089 [2024-10-07 11:29:00.297461] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.089 [2024-10-07 11:29:00.306173] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.089 [2024-10-07 11:29:00.307305] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.089 [2024-10-07 11:29:00.307360] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.089 [2024-10-07 11:29:00.307383] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.089 [2024-10-07 11:29:00.307639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.089 [2024-10-07 11:29:00.308608] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.089 [2024-10-07 11:29:00.308662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.089 [2024-10-07 11:29:00.308682] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.089 [2024-10-07 11:29:00.308699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.089 [2024-10-07 11:29:00.309825] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.089 [2024-10-07 11:29:00.309920] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.089 [2024-10-07 11:29:00.309950] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.089 [2024-10-07 11:29:00.309967] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.089 [2024-10-07 11:29:00.310672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.089 [2024-10-07 11:29:00.310794] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.089 [2024-10-07 11:29:00.310821] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.089 [2024-10-07 11:29:00.310837] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.089 [2024-10-07 11:29:00.310870] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.089 [2024-10-07 11:29:00.316968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.089 [2024-10-07 11:29:00.317194] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.089 [2024-10-07 11:29:00.317231] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.089 [2024-10-07 11:29:00.317283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.089 [2024-10-07 11:29:00.317324] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.089 [2024-10-07 11:29:00.317358] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.089 [2024-10-07 11:29:00.317375] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.089 [2024-10-07 11:29:00.317391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.089 [2024-10-07 11:29:00.317440] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.089 [2024-10-07 11:29:00.318887] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.089 [2024-10-07 11:29:00.319008] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.089 [2024-10-07 11:29:00.319041] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.089 [2024-10-07 11:29:00.319059] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.089 [2024-10-07 11:29:00.319090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.089 [2024-10-07 11:29:00.319120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.089 [2024-10-07 11:29:00.319138] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.089 [2024-10-07 11:29:00.319152] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.089 [2024-10-07 11:29:00.319182] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.090 [2024-10-07 11:29:00.327744] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.090 [2024-10-07 11:29:00.327927] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.090 [2024-10-07 11:29:00.327963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.090 [2024-10-07 11:29:00.327982] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.090 [2024-10-07 11:29:00.328018] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.090 [2024-10-07 11:29:00.328050] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.090 [2024-10-07 11:29:00.328067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.090 [2024-10-07 11:29:00.328083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.090 [2024-10-07 11:29:00.328113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.090 [2024-10-07 11:29:00.330176] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.090 [2024-10-07 11:29:00.330577] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.090 [2024-10-07 11:29:00.330629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.090 [2024-10-07 11:29:00.330662] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.090 [2024-10-07 11:29:00.330769] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.090 [2024-10-07 11:29:00.330825] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.090 [2024-10-07 11:29:00.330858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.090 [2024-10-07 11:29:00.330920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.090 [2024-10-07 11:29:00.330973] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.090 [2024-10-07 11:29:00.339651] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.090 [2024-10-07 11:29:00.339986] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.090 [2024-10-07 11:29:00.340044] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.090 [2024-10-07 11:29:00.340080] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.090 [2024-10-07 11:29:00.340139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.090 [2024-10-07 11:29:00.340193] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.090 [2024-10-07 11:29:00.340224] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.090 [2024-10-07 11:29:00.340251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.090 [2024-10-07 11:29:00.340303] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.090 [2024-10-07 11:29:00.340384] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.090 [2024-10-07 11:29:00.340536] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.090 [2024-10-07 11:29:00.340580] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.090 [2024-10-07 11:29:00.340609] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.090 [2024-10-07 11:29:00.341592] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.090 [2024-10-07 11:29:00.342501] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.090 [2024-10-07 11:29:00.342545] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.090 [2024-10-07 11:29:00.342576] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.090 [2024-10-07 11:29:00.342752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.090 [2024-10-07 11:29:00.351568] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.090 [2024-10-07 11:29:00.352770] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.090 [2024-10-07 11:29:00.352907] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.090 [2024-10-07 11:29:00.352951] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.090 [2024-10-07 11:29:00.352973] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.090 [2024-10-07 11:29:00.353227] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.090 [2024-10-07 11:29:00.353276] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.090 [2024-10-07 11:29:00.353297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.090 [2024-10-07 11:29:00.353319] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.090 [2024-10-07 11:29:00.354306] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.090 [2024-10-07 11:29:00.354384] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.090 [2024-10-07 11:29:00.354426] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.090 [2024-10-07 11:29:00.354460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.090 [2024-10-07 11:29:00.355162] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.090 [2024-10-07 11:29:00.355204] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.090 [2024-10-07 11:29:00.355244] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.090 [2024-10-07 11:29:00.355266] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.090 [2024-10-07 11:29:00.356280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.090 [2024-10-07 11:29:00.361727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.090 [2024-10-07 11:29:00.361942] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.090 [2024-10-07 11:29:00.361979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.090 [2024-10-07 11:29:00.361998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.090 [2024-10-07 11:29:00.362036] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.090 [2024-10-07 11:29:00.362679] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.090 [2024-10-07 11:29:00.362720] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.090 [2024-10-07 11:29:00.362740] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.090 [2024-10-07 11:29:00.362922] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.090 [2024-10-07 11:29:00.363088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.090 [2024-10-07 11:29:00.363194] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.090 [2024-10-07 11:29:00.363242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.090 [2024-10-07 11:29:00.363265] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.090 [2024-10-07 11:29:00.363301] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.090 [2024-10-07 11:29:00.363332] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.090 [2024-10-07 11:29:00.363350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.090 [2024-10-07 11:29:00.363364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.090 [2024-10-07 11:29:00.363394] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.090 [2024-10-07 11:29:00.371883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.090 [2024-10-07 11:29:00.372078] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.090 [2024-10-07 11:29:00.372115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.090 [2024-10-07 11:29:00.372135] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.090 [2024-10-07 11:29:00.372202] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.090 [2024-10-07 11:29:00.372236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.090 [2024-10-07 11:29:00.372253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.090 [2024-10-07 11:29:00.372269] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.090 [2024-10-07 11:29:00.372300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.090 [2024-10-07 11:29:00.374223] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.090 [2024-10-07 11:29:00.374615] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.090 [2024-10-07 11:29:00.374661] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.090 [2024-10-07 11:29:00.374682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.090 [2024-10-07 11:29:00.374756] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.090 [2024-10-07 11:29:00.374795] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.090 [2024-10-07 11:29:00.374813] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.090 [2024-10-07 11:29:00.374827] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.090 [2024-10-07 11:29:00.374859] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.090 [2024-10-07 11:29:00.383611] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.090 [2024-10-07 11:29:00.383883] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.090 [2024-10-07 11:29:00.383933] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.090 [2024-10-07 11:29:00.383955] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.090 [2024-10-07 11:29:00.383993] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.090 [2024-10-07 11:29:00.384025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.091 [2024-10-07 11:29:00.384043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.091 [2024-10-07 11:29:00.384059] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.091 [2024-10-07 11:29:00.384091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.091 [2024-10-07 11:29:00.384319] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.091 [2024-10-07 11:29:00.384428] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.091 [2024-10-07 11:29:00.384459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.091 [2024-10-07 11:29:00.384476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.091 [2024-10-07 11:29:00.384508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.091 [2024-10-07 11:29:00.384560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.091 [2024-10-07 11:29:00.384581] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.091 [2024-10-07 11:29:00.384627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.091 [2024-10-07 11:29:00.385572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.091 [2024-10-07 11:29:00.395333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.091 [2024-10-07 11:29:00.395675] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.091 [2024-10-07 11:29:00.395805] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.091 [2024-10-07 11:29:00.395846] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.091 [2024-10-07 11:29:00.395867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.091 [2024-10-07 11:29:00.396907] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.091 [2024-10-07 11:29:00.396953] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.091 [2024-10-07 11:29:00.396973] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.091 [2024-10-07 11:29:00.396996] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.091 [2024-10-07 11:29:00.397226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.091 [2024-10-07 11:29:00.397284] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.091 [2024-10-07 11:29:00.397303] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.091 [2024-10-07 11:29:00.397318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.091 [2024-10-07 11:29:00.398314] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.091 [2024-10-07 11:29:00.398352] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.091 [2024-10-07 11:29:00.398370] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.091 [2024-10-07 11:29:00.398384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.091 [2024-10-07 11:29:00.399120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.091 [2024-10-07 11:29:00.405529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.091 [2024-10-07 11:29:00.405721] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.091 [2024-10-07 11:29:00.405758] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.091 [2024-10-07 11:29:00.405777] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.091 [2024-10-07 11:29:00.405814] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.091 [2024-10-07 11:29:00.405864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.091 [2024-10-07 11:29:00.405885] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.091 [2024-10-07 11:29:00.405902] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.091 [2024-10-07 11:29:00.405934] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.091 [2024-10-07 11:29:00.405956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.091 [2024-10-07 11:29:00.406029] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.091 [2024-10-07 11:29:00.406089] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.091 [2024-10-07 11:29:00.406109] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.091 [2024-10-07 11:29:00.406141] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.091 [2024-10-07 11:29:00.406172] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.091 [2024-10-07 11:29:00.406189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.091 [2024-10-07 11:29:00.406209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.091 [2024-10-07 11:29:00.406254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.091 [2024-10-07 11:29:00.416154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.091 [2024-10-07 11:29:00.416287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.091 [2024-10-07 11:29:00.416417] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.091 [2024-10-07 11:29:00.416451] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.091 [2024-10-07 11:29:00.416470] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.091 [2024-10-07 11:29:00.416545] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.091 [2024-10-07 11:29:00.416572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.091 [2024-10-07 11:29:00.416588] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.091 [2024-10-07 11:29:00.416609] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.091 [2024-10-07 11:29:00.416641] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.091 [2024-10-07 11:29:00.416662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.091 [2024-10-07 11:29:00.416676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.091 [2024-10-07 11:29:00.416692] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.091 [2024-10-07 11:29:00.416723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.091 [2024-10-07 11:29:00.416741] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.091 [2024-10-07 11:29:00.416754] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.091 [2024-10-07 11:29:00.416768] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.091 [2024-10-07 11:29:00.416795] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.091 [2024-10-07 11:29:00.427969] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.091 [2024-10-07 11:29:00.428191] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.091 [2024-10-07 11:29:00.428320] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.091 [2024-10-07 11:29:00.428367] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.091 [2024-10-07 11:29:00.428388] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.091 [2024-10-07 11:29:00.428511] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.091 [2024-10-07 11:29:00.428540] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.091 [2024-10-07 11:29:00.428557] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.091 [2024-10-07 11:29:00.428578] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.091 [2024-10-07 11:29:00.428612] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.091 [2024-10-07 11:29:00.428633] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.091 [2024-10-07 11:29:00.428647] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.091 [2024-10-07 11:29:00.428662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.091 [2024-10-07 11:29:00.428693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.091 [2024-10-07 11:29:00.428712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.091 [2024-10-07 11:29:00.428726] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.091 [2024-10-07 11:29:00.428739] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.091 [2024-10-07 11:29:00.428766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.091 [2024-10-07 11:29:00.439612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.091 [2024-10-07 11:29:00.439705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.091 [2024-10-07 11:29:00.440003] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.092 [2024-10-07 11:29:00.440052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.092 [2024-10-07 11:29:00.440074] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.092 [2024-10-07 11:29:00.440127] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.092 [2024-10-07 11:29:00.440152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.092 [2024-10-07 11:29:00.440168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.092 [2024-10-07 11:29:00.441123] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.092 [2024-10-07 11:29:00.441169] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.092 [2024-10-07 11:29:00.441384] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.092 [2024-10-07 11:29:00.441434] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.092 [2024-10-07 11:29:00.441454] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.092 [2024-10-07 11:29:00.441474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.092 [2024-10-07 11:29:00.441489] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.092 [2024-10-07 11:29:00.441502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.092 [2024-10-07 11:29:00.442458] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.092 [2024-10-07 11:29:00.442520] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.092 [2024-10-07 11:29:00.449802] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.092 [2024-10-07 11:29:00.449908] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.092 [2024-10-07 11:29:00.450018] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.092 [2024-10-07 11:29:00.450049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.092 [2024-10-07 11:29:00.450068] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.092 [2024-10-07 11:29:00.450133] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.092 [2024-10-07 11:29:00.450160] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.092 [2024-10-07 11:29:00.450177] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.092 [2024-10-07 11:29:00.450197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.092 [2024-10-07 11:29:00.450229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.092 [2024-10-07 11:29:00.450249] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.092 [2024-10-07 11:29:00.450263] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.092 [2024-10-07 11:29:00.450279] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.092 [2024-10-07 11:29:00.450309] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.092 [2024-10-07 11:29:00.450326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.092 [2024-10-07 11:29:00.450339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.092 [2024-10-07 11:29:00.450353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.092 [2024-10-07 11:29:00.450379] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.092 [2024-10-07 11:29:00.460227] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.092 [2024-10-07 11:29:00.460323] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.092 [2024-10-07 11:29:00.460467] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.092 [2024-10-07 11:29:00.460502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.092 [2024-10-07 11:29:00.460522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.092 [2024-10-07 11:29:00.460572] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.092 [2024-10-07 11:29:00.460596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.092 [2024-10-07 11:29:00.460612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.092 [2024-10-07 11:29:00.460647] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.092 [2024-10-07 11:29:00.460671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.092 [2024-10-07 11:29:00.460697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.092 [2024-10-07 11:29:00.460743] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.092 [2024-10-07 11:29:00.460760] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.092 [2024-10-07 11:29:00.460778] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.092 [2024-10-07 11:29:00.460792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.092 [2024-10-07 11:29:00.460805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.092 [2024-10-07 11:29:00.460835] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.092 [2024-10-07 11:29:00.460852] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.092 [2024-10-07 11:29:00.471883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.092 [2024-10-07 11:29:00.471970] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.092 [2024-10-07 11:29:00.472757] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.092 [2024-10-07 11:29:00.472805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.092 [2024-10-07 11:29:00.472827] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.092 [2024-10-07 11:29:00.472881] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.092 [2024-10-07 11:29:00.472905] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.092 [2024-10-07 11:29:00.472921] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.092 [2024-10-07 11:29:00.473020] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.092 [2024-10-07 11:29:00.473050] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.092 [2024-10-07 11:29:00.473095] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.092 [2024-10-07 11:29:00.473115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.092 [2024-10-07 11:29:00.473131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.092 [2024-10-07 11:29:00.473149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.092 [2024-10-07 11:29:00.473163] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.092 [2024-10-07 11:29:00.473176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.092 [2024-10-07 11:29:00.473207] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.092 [2024-10-07 11:29:00.473226] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.092 [2024-10-07 11:29:00.484100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.092 [2024-10-07 11:29:00.484186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.092 [2024-10-07 11:29:00.484521] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.093 [2024-10-07 11:29:00.484558] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.093 [2024-10-07 11:29:00.484577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.093 [2024-10-07 11:29:00.484627] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.093 [2024-10-07 11:29:00.484674] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.093 [2024-10-07 11:29:00.484692] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.093 [2024-10-07 11:29:00.485663] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.093 [2024-10-07 11:29:00.485715] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.093 [2024-10-07 11:29:00.485923] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.093 [2024-10-07 11:29:00.485950] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.093 [2024-10-07 11:29:00.485966] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.093 [2024-10-07 11:29:00.485984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.093 [2024-10-07 11:29:00.485999] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.093 [2024-10-07 11:29:00.486012] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.093 [2024-10-07 11:29:00.486952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.093 [2024-10-07 11:29:00.486991] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.093 [2024-10-07 11:29:00.494277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.093 [2024-10-07 11:29:00.494388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.093 [2024-10-07 11:29:00.494520] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.093 [2024-10-07 11:29:00.494553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.093 [2024-10-07 11:29:00.494570] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.093 [2024-10-07 11:29:00.494637] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.093 [2024-10-07 11:29:00.494664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.093 [2024-10-07 11:29:00.494679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.093 [2024-10-07 11:29:00.494700] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.093 [2024-10-07 11:29:00.494732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.093 [2024-10-07 11:29:00.494752] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.093 [2024-10-07 11:29:00.494766] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.093 [2024-10-07 11:29:00.494781] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.093 [2024-10-07 11:29:00.494812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.093 [2024-10-07 11:29:00.494829] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.093 [2024-10-07 11:29:00.494843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.093 [2024-10-07 11:29:00.494856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.093 [2024-10-07 11:29:00.495473] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.093 [2024-10-07 11:29:00.504441] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.093 [2024-10-07 11:29:00.504863] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.093 [2024-10-07 11:29:00.504911] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.093 [2024-10-07 11:29:00.504933] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.093 [2024-10-07 11:29:00.505026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.093 [2024-10-07 11:29:00.505111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.093 [2024-10-07 11:29:00.505155] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.093 [2024-10-07 11:29:00.505174] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.093 [2024-10-07 11:29:00.505189] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.093 [2024-10-07 11:29:00.505227] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.093 [2024-10-07 11:29:00.505302] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.093 [2024-10-07 11:29:00.505329] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.093 [2024-10-07 11:29:00.505346] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.093 [2024-10-07 11:29:00.505379] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.093 [2024-10-07 11:29:00.505427] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.093 [2024-10-07 11:29:00.505448] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.093 [2024-10-07 11:29:00.505462] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.093 [2024-10-07 11:29:00.505491] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.093 [2024-10-07 11:29:00.516665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.093 [2024-10-07 11:29:00.516761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.093 [2024-10-07 11:29:00.517611] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.093 [2024-10-07 11:29:00.517663] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.093 [2024-10-07 11:29:00.517687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.093 [2024-10-07 11:29:00.517742] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.093 [2024-10-07 11:29:00.517767] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.093 [2024-10-07 11:29:00.517783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.093 [2024-10-07 11:29:00.518754] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.093 [2024-10-07 11:29:00.518803] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.093 [2024-10-07 11:29:00.519697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.093 [2024-10-07 11:29:00.519758] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.093 [2024-10-07 11:29:00.519804] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.093 [2024-10-07 11:29:00.519828] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.093 [2024-10-07 11:29:00.519843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.093 [2024-10-07 11:29:00.519856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.093 [2024-10-07 11:29:00.519970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.093 [2024-10-07 11:29:00.519996] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.093 [2024-10-07 11:29:00.528137] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.093 [2024-10-07 11:29:00.528236] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.093 [2024-10-07 11:29:00.528593] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.093 [2024-10-07 11:29:00.528647] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.093 [2024-10-07 11:29:00.528668] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.093 [2024-10-07 11:29:00.528723] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.093 [2024-10-07 11:29:00.528747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.093 [2024-10-07 11:29:00.528763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.093 [2024-10-07 11:29:00.529743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.093 [2024-10-07 11:29:00.529790] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.093 [2024-10-07 11:29:00.529986] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.093 [2024-10-07 11:29:00.530028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.093 [2024-10-07 11:29:00.530048] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.093 [2024-10-07 11:29:00.530068] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.093 [2024-10-07 11:29:00.530083] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.093 [2024-10-07 11:29:00.530096] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.093 [2024-10-07 11:29:00.531037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.093 [2024-10-07 11:29:00.531073] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.093 [2024-10-07 11:29:00.538331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.093 [2024-10-07 11:29:00.538461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.093 [2024-10-07 11:29:00.538574] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.093 [2024-10-07 11:29:00.538607] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.093 [2024-10-07 11:29:00.538625] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.093 [2024-10-07 11:29:00.538691] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.093 [2024-10-07 11:29:00.538718] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.093 [2024-10-07 11:29:00.538768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.093 [2024-10-07 11:29:00.538791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.093 [2024-10-07 11:29:00.538825] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.094 [2024-10-07 11:29:00.538846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.094 [2024-10-07 11:29:00.538860] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.094 [2024-10-07 11:29:00.538875] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.094 [2024-10-07 11:29:00.538905] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.094 [2024-10-07 11:29:00.538923] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.094 [2024-10-07 11:29:00.538937] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.094 [2024-10-07 11:29:00.538950] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.094 [2024-10-07 11:29:00.538977] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.094 [2024-10-07 11:29:00.548694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.094 [2024-10-07 11:29:00.548785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.094 [2024-10-07 11:29:00.548918] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.094 [2024-10-07 11:29:00.548954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.094 [2024-10-07 11:29:00.548972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.094 [2024-10-07 11:29:00.549022] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.094 [2024-10-07 11:29:00.549045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.094 [2024-10-07 11:29:00.549079] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.094 [2024-10-07 11:29:00.549114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.094 [2024-10-07 11:29:00.549138] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.094 [2024-10-07 11:29:00.549164] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.094 [2024-10-07 11:29:00.549181] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.094 [2024-10-07 11:29:00.549196] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.094 [2024-10-07 11:29:00.549214] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.094 [2024-10-07 11:29:00.549228] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.094 [2024-10-07 11:29:00.549241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.094 [2024-10-07 11:29:00.549292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.094 [2024-10-07 11:29:00.549314] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.094 [2024-10-07 11:29:00.559973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.094 [2024-10-07 11:29:00.560101] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.094 [2024-10-07 11:29:00.560910] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.094 [2024-10-07 11:29:00.560961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.094 [2024-10-07 11:29:00.560984] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.094 [2024-10-07 11:29:00.561039] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.094 [2024-10-07 11:29:00.561079] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.094 [2024-10-07 11:29:00.561097] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.094 [2024-10-07 11:29:00.561200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.094 [2024-10-07 11:29:00.561231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.094 [2024-10-07 11:29:00.561260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.094 [2024-10-07 11:29:00.561278] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.094 [2024-10-07 11:29:00.561294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.094 [2024-10-07 11:29:00.561313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.094 [2024-10-07 11:29:00.561328] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.094 [2024-10-07 11:29:00.561341] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.094 [2024-10-07 11:29:00.561371] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.094 [2024-10-07 11:29:00.561389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.094 [2024-10-07 11:29:00.572490] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.094 [2024-10-07 11:29:00.572583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.094 [2024-10-07 11:29:00.572891] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.094 [2024-10-07 11:29:00.572929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.094 [2024-10-07 11:29:00.572949] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.094 [2024-10-07 11:29:00.572999] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.094 [2024-10-07 11:29:00.573022] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.094 [2024-10-07 11:29:00.573038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.094 [2024-10-07 11:29:00.574005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.094 [2024-10-07 11:29:00.574053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.094 [2024-10-07 11:29:00.574276] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.094 [2024-10-07 11:29:00.574312] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.094 [2024-10-07 11:29:00.574330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.094 [2024-10-07 11:29:00.574379] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.094 [2024-10-07 11:29:00.574396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.094 [2024-10-07 11:29:00.574428] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.094 [2024-10-07 11:29:00.575361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.094 [2024-10-07 11:29:00.575416] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.094 [2024-10-07 11:29:00.582681] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.094 [2024-10-07 11:29:00.582797] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.094 [2024-10-07 11:29:00.582910] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.094 [2024-10-07 11:29:00.582943] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.094 [2024-10-07 11:29:00.582961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.094 [2024-10-07 11:29:00.583028] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.094 [2024-10-07 11:29:00.583054] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.094 [2024-10-07 11:29:00.583070] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.094 [2024-10-07 11:29:00.583091] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.094 [2024-10-07 11:29:00.583123] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.094 [2024-10-07 11:29:00.583143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.094 [2024-10-07 11:29:00.583157] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.094 [2024-10-07 11:29:00.583172] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.094 [2024-10-07 11:29:00.583203] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.094 [2024-10-07 11:29:00.583220] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.094 [2024-10-07 11:29:00.583233] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.094 [2024-10-07 11:29:00.583247] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.094 [2024-10-07 11:29:00.583273] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.094 [2024-10-07 11:29:00.592985] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.094 [2024-10-07 11:29:00.593080] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.094 [2024-10-07 11:29:00.593215] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.094 [2024-10-07 11:29:00.593248] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.094 [2024-10-07 11:29:00.593267] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.094 [2024-10-07 11:29:00.593317] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.094 [2024-10-07 11:29:00.593350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.094 [2024-10-07 11:29:00.593366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.094 [2024-10-07 11:29:00.593450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.094 [2024-10-07 11:29:00.593476] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.094 [2024-10-07 11:29:00.593502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.094 [2024-10-07 11:29:00.593519] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.094 [2024-10-07 11:29:00.593535] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.094 [2024-10-07 11:29:00.593551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.095 [2024-10-07 11:29:00.593565] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.095 [2024-10-07 11:29:00.593578] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.095 [2024-10-07 11:29:00.593608] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.095 [2024-10-07 11:29:00.593625] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.095 [2024-10-07 11:29:00.604840] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.095 [2024-10-07 11:29:00.604937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.095 [2024-10-07 11:29:00.605144] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.095 [2024-10-07 11:29:00.605192] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.095 [2024-10-07 11:29:00.605222] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.095 [2024-10-07 11:29:00.605306] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.095 [2024-10-07 11:29:00.605344] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.095 [2024-10-07 11:29:00.605373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.095 [2024-10-07 11:29:00.605445] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.095 [2024-10-07 11:29:00.605489] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.095 [2024-10-07 11:29:00.605535] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.095 [2024-10-07 11:29:00.605565] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.095 [2024-10-07 11:29:00.605594] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.095 [2024-10-07 11:29:00.605623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.095 [2024-10-07 11:29:00.605650] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.095 [2024-10-07 11:29:00.605672] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.095 [2024-10-07 11:29:00.606659] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.095 [2024-10-07 11:29:00.606705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.095 [2024-10-07 11:29:00.616317] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.095 [2024-10-07 11:29:00.616434] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.095 [2024-10-07 11:29:00.617621] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.095 [2024-10-07 11:29:00.617681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.095 [2024-10-07 11:29:00.617716] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.095 [2024-10-07 11:29:00.617809] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.095 [2024-10-07 11:29:00.617848] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.095 [2024-10-07 11:29:00.617876] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.095 [2024-10-07 11:29:00.618135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.095 [2024-10-07 11:29:00.618187] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.095 [2024-10-07 11:29:00.619197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.095 [2024-10-07 11:29:00.619244] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.095 [2024-10-07 11:29:00.619278] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.095 [2024-10-07 11:29:00.619315] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.095 [2024-10-07 11:29:00.619341] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.095 [2024-10-07 11:29:00.619366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.095 [2024-10-07 11:29:00.620164] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.095 [2024-10-07 11:29:00.620213] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.095 [2024-10-07 11:29:00.626594] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.095 [2024-10-07 11:29:00.626719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.095 [2024-10-07 11:29:00.626877] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.095 [2024-10-07 11:29:00.626924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.095 [2024-10-07 11:29:00.626956] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.095 [2024-10-07 11:29:00.627675] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.095 [2024-10-07 11:29:00.627726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.095 [2024-10-07 11:29:00.627761] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.095 [2024-10-07 11:29:00.627797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.095 [2024-10-07 11:29:00.628025] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.095 [2024-10-07 11:29:00.628071] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.095 [2024-10-07 11:29:00.628101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.095 [2024-10-07 11:29:00.628129] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.095 [2024-10-07 11:29:00.628280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.095 [2024-10-07 11:29:00.628354] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.095 [2024-10-07 11:29:00.628385] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.095 [2024-10-07 11:29:00.628429] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.095 [2024-10-07 11:29:00.629809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.095 [2024-10-07 11:29:00.636755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.095 [2024-10-07 11:29:00.636976] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.095 [2024-10-07 11:29:00.637042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.095 [2024-10-07 11:29:00.637096] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.095 [2024-10-07 11:29:00.637178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.095 [2024-10-07 11:29:00.637272] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.095 [2024-10-07 11:29:00.637325] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.095 [2024-10-07 11:29:00.637358] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.095 [2024-10-07 11:29:00.637383] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.095 [2024-10-07 11:29:00.637446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.095 [2024-10-07 11:29:00.637541] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.095 [2024-10-07 11:29:00.637582] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.095 [2024-10-07 11:29:00.637612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.095 [2024-10-07 11:29:00.638455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.095 [2024-10-07 11:29:00.639337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.095 [2024-10-07 11:29:00.639381] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.095 [2024-10-07 11:29:00.639430] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.095 [2024-10-07 11:29:00.639585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.095 [2024-10-07 11:29:00.648284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.095 [2024-10-07 11:29:00.648382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.095 [2024-10-07 11:29:00.648581] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.095 [2024-10-07 11:29:00.648630] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.095 [2024-10-07 11:29:00.648662] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.095 [2024-10-07 11:29:00.648744] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.095 [2024-10-07 11:29:00.648781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.095 [2024-10-07 11:29:00.648810] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.095 [2024-10-07 11:29:00.648883] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.095 [2024-10-07 11:29:00.648972] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.095 [2024-10-07 11:29:00.649022] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.095 [2024-10-07 11:29:00.649069] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.095 [2024-10-07 11:29:00.649101] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.095 [2024-10-07 11:29:00.649130] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.095 [2024-10-07 11:29:00.649157] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.095 [2024-10-07 11:29:00.649178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.095 [2024-10-07 11:29:00.650176] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.095 [2024-10-07 11:29:00.650224] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.095 [2024-10-07 11:29:00.660054] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.095 [2024-10-07 11:29:00.660172] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.095 [2024-10-07 11:29:00.661526] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.095 [2024-10-07 11:29:00.661597] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.096 [2024-10-07 11:29:00.661631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.096 [2024-10-07 11:29:00.661717] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.096 [2024-10-07 11:29:00.661755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.096 [2024-10-07 11:29:00.661785] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.096 [2024-10-07 11:29:00.662048] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.096 [2024-10-07 11:29:00.662101] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.096 [2024-10-07 11:29:00.663101] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.096 [2024-10-07 11:29:00.663148] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.096 [2024-10-07 11:29:00.663181] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.096 [2024-10-07 11:29:00.663221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.096 [2024-10-07 11:29:00.663246] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.096 [2024-10-07 11:29:00.663269] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.096 [2024-10-07 11:29:00.664096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.096 [2024-10-07 11:29:00.664145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.096 [2024-10-07 11:29:00.670291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.096 [2024-10-07 11:29:00.670443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.096 [2024-10-07 11:29:00.670606] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.096 [2024-10-07 11:29:00.670688] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.096 [2024-10-07 11:29:00.670723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.096 [2024-10-07 11:29:00.671446] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.096 [2024-10-07 11:29:00.671498] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.096 [2024-10-07 11:29:00.671530] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.096 [2024-10-07 11:29:00.671566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.096 [2024-10-07 11:29:00.671801] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.096 [2024-10-07 11:29:00.671856] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.096 [2024-10-07 11:29:00.671886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.096 [2024-10-07 11:29:00.671915] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.096 [2024-10-07 11:29:00.672120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.096 [2024-10-07 11:29:00.672164] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.096 [2024-10-07 11:29:00.672193] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.096 [2024-10-07 11:29:00.672219] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.096 [2024-10-07 11:29:00.673579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.096 [2024-10-07 11:29:00.680779] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.096 [2024-10-07 11:29:00.680872] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.096 [2024-10-07 11:29:00.681074] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.096 [2024-10-07 11:29:00.681125] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.096 [2024-10-07 11:29:00.681156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.096 [2024-10-07 11:29:00.681241] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.096 [2024-10-07 11:29:00.681279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.096 [2024-10-07 11:29:00.681308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.096 [2024-10-07 11:29:00.681363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.096 [2024-10-07 11:29:00.681423] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.096 [2024-10-07 11:29:00.682231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.096 [2024-10-07 11:29:00.682277] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.096 [2024-10-07 11:29:00.682310] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.096 [2024-10-07 11:29:00.682341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.096 [2024-10-07 11:29:00.682366] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.096 [2024-10-07 11:29:00.682447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.096 [2024-10-07 11:29:00.683347] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.096 [2024-10-07 11:29:00.683392] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.096 [2024-10-07 11:29:00.693124] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.096 [2024-10-07 11:29:00.693254] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.096 [2024-10-07 11:29:00.694364] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.096 [2024-10-07 11:29:00.694440] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.096 [2024-10-07 11:29:00.694482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.096 [2024-10-07 11:29:00.694590] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.096 [2024-10-07 11:29:00.694629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.096 [2024-10-07 11:29:00.694655] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.096 [2024-10-07 11:29:00.695661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.096 [2024-10-07 11:29:00.695728] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.096 [2024-10-07 11:29:00.696609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.096 [2024-10-07 11:29:00.696653] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.096 [2024-10-07 11:29:00.696675] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.096 [2024-10-07 11:29:00.696699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.096 [2024-10-07 11:29:00.696725] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.096 [2024-10-07 11:29:00.696738] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.096 [2024-10-07 11:29:00.696859] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.096 [2024-10-07 11:29:00.696884] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.096 [2024-10-07 11:29:00.705530] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.096 [2024-10-07 11:29:00.705644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.096 [2024-10-07 11:29:00.707255] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.096 [2024-10-07 11:29:00.707323] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.096 [2024-10-07 11:29:00.707356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.096 [2024-10-07 11:29:00.707670] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.096 [2024-10-07 11:29:00.708826] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.096 [2024-10-07 11:29:00.708887] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.096 [2024-10-07 11:29:00.708920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.096 [2024-10-07 11:29:00.709853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.096 [2024-10-07 11:29:00.715800] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.096 [2024-10-07 11:29:00.716100] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.096 [2024-10-07 11:29:00.716165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.096 [2024-10-07 11:29:00.716200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.096 [2024-10-07 11:29:00.716991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.096 [2024-10-07 11:29:00.717295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.096 [2024-10-07 11:29:00.717353] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.096 [2024-10-07 11:29:00.717384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.096 [2024-10-07 11:29:00.717579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.096 [2024-10-07 11:29:00.727159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.096 [2024-10-07 11:29:00.727498] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.096 [2024-10-07 11:29:00.727592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.096 [2024-10-07 11:29:00.727626] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.096 [2024-10-07 11:29:00.728589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.096 [2024-10-07 11:29:00.729661] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.096 [2024-10-07 11:29:00.729722] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.097 [2024-10-07 11:29:00.729752] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.097 [2024-10-07 11:29:00.729922] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.097 [2024-10-07 11:29:00.739165] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.097 [2024-10-07 11:29:00.739279] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:18:26.097 [2024-10-07 11:29:00.740377] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.097 [2024-10-07 11:29:00.740469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.097 [2024-10-07 11:29:00.740504] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.097 [2024-10-07 11:29:00.741773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.097 [2024-10-07 11:29:00.742908] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.097 [2024-10-07 11:29:00.742964] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.097 [2024-10-07 11:29:00.742994] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.097 [2024-10-07 11:29:00.744044] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.097 [2024-10-07 11:29:00.750846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.097 [2024-10-07 11:29:00.752210] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.097 [2024-10-07 11:29:00.752324] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.097 [2024-10-07 11:29:00.752360] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.097 [2024-10-07 11:29:00.752672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.097 [2024-10-07 11:29:00.752939] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.097 [2024-10-07 11:29:00.752991] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.097 [2024-10-07 11:29:00.753022] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.097 [2024-10-07 11:29:00.753138] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.097 [2024-10-07 11:29:00.762448] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.097 [2024-10-07 11:29:00.762724] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.097 [2024-10-07 11:29:00.762771] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.097 [2024-10-07 11:29:00.762798] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.097 [2024-10-07 11:29:00.763008] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.097 [2024-10-07 11:29:00.763294] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.097 [2024-10-07 11:29:00.763349] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.097 [2024-10-07 11:29:00.763380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.097 [2024-10-07 11:29:00.763491] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.097 [2024-10-07 11:29:00.773756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.097 [2024-10-07 11:29:00.774023] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.097 [2024-10-07 11:29:00.774075] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.097 [2024-10-07 11:29:00.774108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.097 [2024-10-07 11:29:00.774168] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.097 [2024-10-07 11:29:00.774225] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.097 [2024-10-07 11:29:00.774257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.097 [2024-10-07 11:29:00.774284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.097 [2024-10-07 11:29:00.774337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.097 [2024-10-07 11:29:00.785431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.097 [2024-10-07 11:29:00.785786] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.097 [2024-10-07 11:29:00.785851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.097 [2024-10-07 11:29:00.785884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.097 [2024-10-07 11:29:00.785941] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.097 [2024-10-07 11:29:00.786042] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.097 [2024-10-07 11:29:00.786071] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.097 [2024-10-07 11:29:00.786094] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.097 [2024-10-07 11:29:00.786140] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.097 [2024-10-07 11:29:00.797141] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.097 [2024-10-07 11:29:00.797427] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.097 [2024-10-07 11:29:00.797481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.097 [2024-10-07 11:29:00.797522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.097 [2024-10-07 11:29:00.797585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.097 [2024-10-07 11:29:00.797661] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.097 [2024-10-07 11:29:00.797693] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.097 [2024-10-07 11:29:00.797720] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.097 [2024-10-07 11:29:00.797776] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.097 [2024-10-07 11:29:00.807349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.097 [2024-10-07 11:29:00.807840] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.097 [2024-10-07 11:29:00.807908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.097 [2024-10-07 11:29:00.807946] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.097 [2024-10-07 11:29:00.808171] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.097 [2024-10-07 11:29:00.808288] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.097 [2024-10-07 11:29:00.808327] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.097 [2024-10-07 11:29:00.808352] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.097 [2024-10-07 11:29:00.808423] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.097 [2024-10-07 11:29:00.819174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.097 [2024-10-07 11:29:00.820622] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.097 [2024-10-07 11:29:00.820695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.097 [2024-10-07 11:29:00.820733] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.097 [2024-10-07 11:29:00.821041] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.097 [2024-10-07 11:29:00.821246] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.097 [2024-10-07 11:29:00.821299] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.097 [2024-10-07 11:29:00.821340] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.097 [2024-10-07 11:29:00.822856] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.097 [2024-10-07 11:29:00.830003] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.097 [2024-10-07 11:29:00.830297] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.097 [2024-10-07 11:29:00.830363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.097 [2024-10-07 11:29:00.830394] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.097 [2024-10-07 11:29:00.831539] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.097 [2024-10-07 11:29:00.831861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.097 [2024-10-07 11:29:00.831915] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.097 [2024-10-07 11:29:00.831946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.097 [2024-10-07 11:29:00.832091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.097 [2024-10-07 11:29:00.841924] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.097 [2024-10-07 11:29:00.842241] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.097 [2024-10-07 11:29:00.842292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.098 [2024-10-07 11:29:00.842323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.098 [2024-10-07 11:29:00.842380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.098 [2024-10-07 11:29:00.842460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.098 [2024-10-07 11:29:00.842490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.098 [2024-10-07 11:29:00.842515] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.098 [2024-10-07 11:29:00.842566] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.098 [2024-10-07 11:29:00.854242] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.098 [2024-10-07 11:29:00.854587] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.098 [2024-10-07 11:29:00.854660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.098 [2024-10-07 11:29:00.854694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.098 [2024-10-07 11:29:00.855552] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.098 [2024-10-07 11:29:00.856631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.098 [2024-10-07 11:29:00.856690] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.098 [2024-10-07 11:29:00.856722] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.098 [2024-10-07 11:29:00.856883] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.098 [2024-10-07 11:29:00.865750] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.098 [2024-10-07 11:29:00.867439] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.098 [2024-10-07 11:29:00.867515] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.098 [2024-10-07 11:29:00.867592] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.098 [2024-10-07 11:29:00.868973] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.098 [2024-10-07 11:29:00.870113] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.098 [2024-10-07 11:29:00.870172] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.098 [2024-10-07 11:29:00.870202] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.098 [2024-10-07 11:29:00.871297] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.098 [2024-10-07 11:29:00.878197] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.098 [2024-10-07 11:29:00.879926] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.098 [2024-10-07 11:29:00.879995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.098 [2024-10-07 11:29:00.880030] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.098 [2024-10-07 11:29:00.880303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.098 [2024-10-07 11:29:00.880512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.098 [2024-10-07 11:29:00.880561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.098 [2024-10-07 11:29:00.880590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.098 [2024-10-07 11:29:00.882048] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.098 [2024-10-07 11:29:00.888417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.098 [2024-10-07 11:29:00.888662] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.098 [2024-10-07 11:29:00.888711] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.098 [2024-10-07 11:29:00.888739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.098 [2024-10-07 11:29:00.889893] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.098 [2024-10-07 11:29:00.890224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.098 [2024-10-07 11:29:00.890285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.098 [2024-10-07 11:29:00.890321] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.098 [2024-10-07 11:29:00.890502] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.098 [2024-10-07 11:29:00.899864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.098 [2024-10-07 11:29:00.900138] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.098 [2024-10-07 11:29:00.900216] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.098 [2024-10-07 11:29:00.900249] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.098 [2024-10-07 11:29:00.900323] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.098 [2024-10-07 11:29:00.900377] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.098 [2024-10-07 11:29:00.900474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.098 [2024-10-07 11:29:00.900505] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.098 [2024-10-07 11:29:00.900589] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.098 [2024-10-07 11:29:00.912109] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.098 [2024-10-07 11:29:00.913287] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.098 [2024-10-07 11:29:00.913361] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.098 [2024-10-07 11:29:00.913420] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.098 [2024-10-07 11:29:00.914477] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.098 [2024-10-07 11:29:00.914693] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.098 [2024-10-07 11:29:00.914745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.098 [2024-10-07 11:29:00.914779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.098 [2024-10-07 11:29:00.914843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.098 [2024-10-07 11:29:00.923648] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.098 [2024-10-07 11:29:00.925279] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.098 [2024-10-07 11:29:00.925348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.098 [2024-10-07 11:29:00.925381] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.098 [2024-10-07 11:29:00.926742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.098 [2024-10-07 11:29:00.927065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.098 [2024-10-07 11:29:00.927121] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.098 [2024-10-07 11:29:00.927153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.098 [2024-10-07 11:29:00.927251] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.098 [2024-10-07 11:29:00.934058] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.098 [2024-10-07 11:29:00.934321] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.098 [2024-10-07 11:29:00.934390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.098 [2024-10-07 11:29:00.934444] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.098 [2024-10-07 11:29:00.934503] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.098 [2024-10-07 11:29:00.934557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.098 [2024-10-07 11:29:00.934585] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.098 [2024-10-07 11:29:00.934610] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.098 [2024-10-07 11:29:00.935712] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.098 [2024-10-07 11:29:00.945517] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.098 [2024-10-07 11:29:00.945966] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.098 [2024-10-07 11:29:00.946015] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.098 [2024-10-07 11:29:00.946037] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.098 [2024-10-07 11:29:00.946118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.098 [2024-10-07 11:29:00.946162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.098 [2024-10-07 11:29:00.946180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.098 [2024-10-07 11:29:00.946198] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.098 [2024-10-07 11:29:00.946234] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.098 [2024-10-07 11:29:00.958017] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.098 [2024-10-07 11:29:00.958321] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.098 [2024-10-07 11:29:00.958390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.098 [2024-10-07 11:29:00.958450] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.098 [2024-10-07 11:29:00.958520] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.098 [2024-10-07 11:29:00.958582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.098 [2024-10-07 11:29:00.958614] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.098 [2024-10-07 11:29:00.958640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.098 [2024-10-07 11:29:00.959542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.098 [2024-10-07 11:29:00.968211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.099 [2024-10-07 11:29:00.968433] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.099 [2024-10-07 11:29:00.968480] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.099 [2024-10-07 11:29:00.968506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.099 [2024-10-07 11:29:00.969583] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.099 [2024-10-07 11:29:00.969819] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.099 [2024-10-07 11:29:00.969856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.099 [2024-10-07 11:29:00.969875] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.099 [2024-10-07 11:29:00.969952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.099 [2024-10-07 11:29:00.978386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.099 [2024-10-07 11:29:00.979533] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.099 [2024-10-07 11:29:00.979583] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.099 [2024-10-07 11:29:00.979605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.099 [2024-10-07 11:29:00.979871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.099 [2024-10-07 11:29:00.980011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.099 [2024-10-07 11:29:00.980041] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.099 [2024-10-07 11:29:00.980060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.099 [2024-10-07 11:29:00.981196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.099 [2024-10-07 11:29:00.989276] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.099 [2024-10-07 11:29:00.989743] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.099 [2024-10-07 11:29:00.989782] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.099 [2024-10-07 11:29:00.989801] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.099 [2024-10-07 11:29:00.989880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.099 [2024-10-07 11:29:00.989924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.099 [2024-10-07 11:29:00.989941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.099 [2024-10-07 11:29:00.989957] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.099 [2024-10-07 11:29:00.989994] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.099 [2024-10-07 11:29:01.001775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.099 [2024-10-07 11:29:01.002000] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.099 [2024-10-07 11:29:01.002039] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.099 [2024-10-07 11:29:01.002057] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.099 [2024-10-07 11:29:01.002098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.099 [2024-10-07 11:29:01.002134] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.099 [2024-10-07 11:29:01.002152] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.099 [2024-10-07 11:29:01.002167] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.099 [2024-10-07 11:29:01.002203] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.099 [2024-10-07 11:29:01.011936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.099 [2024-10-07 11:29:01.012133] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.099 [2024-10-07 11:29:01.012170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.099 [2024-10-07 11:29:01.012188] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.099 [2024-10-07 11:29:01.013251] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.099 [2024-10-07 11:29:01.013520] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.099 [2024-10-07 11:29:01.013566] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.099 [2024-10-07 11:29:01.013619] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.099 [2024-10-07 11:29:01.013745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.099 [2024-10-07 11:29:01.022086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.099 [2024-10-07 11:29:01.022279] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.099 [2024-10-07 11:29:01.022315] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.099 [2024-10-07 11:29:01.022333] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.099 [2024-10-07 11:29:01.023283] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.099 [2024-10-07 11:29:01.023556] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.099 [2024-10-07 11:29:01.023595] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.099 [2024-10-07 11:29:01.023615] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.099 [2024-10-07 11:29:01.023735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.099 [2024-10-07 11:29:01.032943] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.099 [2024-10-07 11:29:01.033416] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.099 [2024-10-07 11:29:01.033470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.099 [2024-10-07 11:29:01.033505] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.099 [2024-10-07 11:29:01.033603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.099 [2024-10-07 11:29:01.033648] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.099 [2024-10-07 11:29:01.033667] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.099 [2024-10-07 11:29:01.033683] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.099 [2024-10-07 11:29:01.033720] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.099 [2024-10-07 11:29:01.045227] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.099 [2024-10-07 11:29:01.045574] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.099 [2024-10-07 11:29:01.045625] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.099 [2024-10-07 11:29:01.045647] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.099 [2024-10-07 11:29:01.045713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.099 [2024-10-07 11:29:01.045755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.099 [2024-10-07 11:29:01.045774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.099 [2024-10-07 11:29:01.045791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.099 [2024-10-07 11:29:01.045827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.099 [2024-10-07 11:29:01.055675] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.099 [2024-10-07 11:29:01.055988] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.099 [2024-10-07 11:29:01.056028] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.099 [2024-10-07 11:29:01.056048] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.099 [2024-10-07 11:29:01.056090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.099 [2024-10-07 11:29:01.057184] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.099 [2024-10-07 11:29:01.057231] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.099 [2024-10-07 11:29:01.057253] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.099 [2024-10-07 11:29:01.057529] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.099 [2024-10-07 11:29:01.066064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.099 [2024-10-07 11:29:01.066265] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.099 [2024-10-07 11:29:01.066303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.099 [2024-10-07 11:29:01.066322] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.099 [2024-10-07 11:29:01.066376] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.099 [2024-10-07 11:29:01.066430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.099 [2024-10-07 11:29:01.066451] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.099 [2024-10-07 11:29:01.066468] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.099 [2024-10-07 11:29:01.066503] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.099 [2024-10-07 11:29:01.076240] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.099 [2024-10-07 11:29:01.076458] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.099 [2024-10-07 11:29:01.076497] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.099 [2024-10-07 11:29:01.076517] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.099 [2024-10-07 11:29:01.076558] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.099 [2024-10-07 11:29:01.076594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.099 [2024-10-07 11:29:01.076611] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.100 [2024-10-07 11:29:01.076626] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.100 [2024-10-07 11:29:01.076661] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.100 [2024-10-07 11:29:01.087243] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.100 [2024-10-07 11:29:01.087521] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.100 [2024-10-07 11:29:01.087577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.100 [2024-10-07 11:29:01.087602] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.100 [2024-10-07 11:29:01.087692] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.100 [2024-10-07 11:29:01.088828] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.100 [2024-10-07 11:29:01.088873] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.100 [2024-10-07 11:29:01.088894] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.100 [2024-10-07 11:29:01.089124] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.100 [2024-10-07 11:29:01.098014] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.100 [2024-10-07 11:29:01.098237] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.100 [2024-10-07 11:29:01.098276] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.100 [2024-10-07 11:29:01.098296] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.100 [2024-10-07 11:29:01.098337] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.100 [2024-10-07 11:29:01.098374] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.100 [2024-10-07 11:29:01.098391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.100 [2024-10-07 11:29:01.098424] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.100 [2024-10-07 11:29:01.098463] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.100 8377.78 IOPS, 32.73 MiB/s [2024-10-07T11:29:07.811Z] [2024-10-07 11:29:01.109320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.100 [2024-10-07 11:29:01.109763] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.100 [2024-10-07 11:29:01.109813] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.100 [2024-10-07 11:29:01.109835] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.100 [2024-10-07 11:29:01.109915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.100 [2024-10-07 11:29:01.109958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.100 [2024-10-07 11:29:01.109977] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.100 [2024-10-07 11:29:01.109993] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.100 [2024-10-07 11:29:01.110029] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.100 [2024-10-07 11:29:01.120154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.100 [2024-10-07 11:29:01.120355] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.100 [2024-10-07 11:29:01.120393] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.100 [2024-10-07 11:29:01.120433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.100 [2024-10-07 11:29:01.120475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.100 [2024-10-07 11:29:01.120512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.100 [2024-10-07 11:29:01.120529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.100 [2024-10-07 11:29:01.120585] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.100 [2024-10-07 11:29:01.120623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.100 [2024-10-07 11:29:01.130317] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.100 [2024-10-07 11:29:01.130528] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.100 [2024-10-07 11:29:01.130566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.100 [2024-10-07 11:29:01.130585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.100 [2024-10-07 11:29:01.130624] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.100 [2024-10-07 11:29:01.130660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.100 [2024-10-07 11:29:01.130677] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.100 [2024-10-07 11:29:01.130693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.100 [2024-10-07 11:29:01.130728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.100 [2024-10-07 11:29:01.143266] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.100 [2024-10-07 11:29:01.143737] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.100 [2024-10-07 11:29:01.143803] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.100 [2024-10-07 11:29:01.143869] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.100 [2024-10-07 11:29:01.143974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.100 [2024-10-07 11:29:01.144072] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.100 [2024-10-07 11:29:01.144109] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.100 [2024-10-07 11:29:01.144133] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.100 [2024-10-07 11:29:01.144185] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.100 [2024-10-07 11:29:01.153546] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.100 [2024-10-07 11:29:01.153816] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.100 [2024-10-07 11:29:01.153865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.100 [2024-10-07 11:29:01.153896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.100 [2024-10-07 11:29:01.153954] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.100 [2024-10-07 11:29:01.155320] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.100 [2024-10-07 11:29:01.155376] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.100 [2024-10-07 11:29:01.155426] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.100 [2024-10-07 11:29:01.155742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.100 [2024-10-07 11:29:01.164366] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.100 [2024-10-07 11:29:01.164651] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.100 [2024-10-07 11:29:01.164764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.100 [2024-10-07 11:29:01.164811] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.100 [2024-10-07 11:29:01.164871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.100 [2024-10-07 11:29:01.164925] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.100 [2024-10-07 11:29:01.164953] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.100 [2024-10-07 11:29:01.164978] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.100 [2024-10-07 11:29:01.165030] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.100 [2024-10-07 11:29:01.177283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.100 [2024-10-07 11:29:01.177589] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.100 [2024-10-07 11:29:01.177651] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.100 [2024-10-07 11:29:01.177696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.100 [2024-10-07 11:29:01.178608] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.100 [2024-10-07 11:29:01.179756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.100 [2024-10-07 11:29:01.179812] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.100 [2024-10-07 11:29:01.179844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.100 [2024-10-07 11:29:01.180023] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.100 [2024-10-07 11:29:01.187904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.100 [2024-10-07 11:29:01.188147] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.100 [2024-10-07 11:29:01.188194] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.100 [2024-10-07 11:29:01.188225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.100 [2024-10-07 11:29:01.189535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.100 [2024-10-07 11:29:01.189822] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.100 [2024-10-07 11:29:01.189871] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.100 [2024-10-07 11:29:01.189904] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.100 [2024-10-07 11:29:01.190078] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.100 [2024-10-07 11:29:01.198468] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.100 [2024-10-07 11:29:01.198729] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.100 [2024-10-07 11:29:01.198789] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.100 [2024-10-07 11:29:01.198823] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.101 [2024-10-07 11:29:01.199835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.101 [2024-10-07 11:29:01.200128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.101 [2024-10-07 11:29:01.200167] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.101 [2024-10-07 11:29:01.200188] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.101 [2024-10-07 11:29:01.200274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.101 [2024-10-07 11:29:01.208683] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.101 [2024-10-07 11:29:01.208947] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.101 [2024-10-07 11:29:01.208997] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.101 [2024-10-07 11:29:01.209026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.101 [2024-10-07 11:29:01.209952] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.101 [2024-10-07 11:29:01.211076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.101 [2024-10-07 11:29:01.211132] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.101 [2024-10-07 11:29:01.211164] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.101 [2024-10-07 11:29:01.211319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.101 [2024-10-07 11:29:01.218989] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.101 [2024-10-07 11:29:01.220477] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.101 [2024-10-07 11:29:01.220549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.101 [2024-10-07 11:29:01.220582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.101 [2024-10-07 11:29:01.220864] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.101 [2024-10-07 11:29:01.221036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.101 [2024-10-07 11:29:01.221102] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.101 [2024-10-07 11:29:01.221134] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.101 [2024-10-07 11:29:01.222632] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.101 [2024-10-07 11:29:01.229210] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.101 [2024-10-07 11:29:01.229473] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.101 [2024-10-07 11:29:01.229530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.101 [2024-10-07 11:29:01.229561] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.101 [2024-10-07 11:29:01.230734] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.101 [2024-10-07 11:29:01.231082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.101 [2024-10-07 11:29:01.231134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.101 [2024-10-07 11:29:01.231166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.101 [2024-10-07 11:29:01.231363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.101 [2024-10-07 11:29:01.239427] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.101 [2024-10-07 11:29:01.239679] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.101 [2024-10-07 11:29:01.239741] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.101 [2024-10-07 11:29:01.239775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.101 [2024-10-07 11:29:01.239834] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.101 [2024-10-07 11:29:01.239924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.101 [2024-10-07 11:29:01.239968] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.101 [2024-10-07 11:29:01.239999] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.101 [2024-10-07 11:29:01.240911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.101 [2024-10-07 11:29:01.250264] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.101 [2024-10-07 11:29:01.251776] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.101 [2024-10-07 11:29:01.251845] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.101 [2024-10-07 11:29:01.251878] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.101 [2024-10-07 11:29:01.252168] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.101 [2024-10-07 11:29:01.252341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.101 [2024-10-07 11:29:01.252383] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.101 [2024-10-07 11:29:01.252434] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.101 [2024-10-07 11:29:01.253965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.101 [2024-10-07 11:29:01.260470] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.101 [2024-10-07 11:29:01.261623] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.101 [2024-10-07 11:29:01.261676] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.101 [2024-10-07 11:29:01.261699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.101 [2024-10-07 11:29:01.261909] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.101 [2024-10-07 11:29:01.263096] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.101 [2024-10-07 11:29:01.263140] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.101 [2024-10-07 11:29:01.263161] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.101 [2024-10-07 11:29:01.263424] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.101 [2024-10-07 11:29:01.271331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.101 [2024-10-07 11:29:01.271527] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.101 [2024-10-07 11:29:01.271566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.101 [2024-10-07 11:29:01.271618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.101 [2024-10-07 11:29:01.271905] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.101 [2024-10-07 11:29:01.272028] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.101 [2024-10-07 11:29:01.272065] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.101 [2024-10-07 11:29:01.272084] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.101 [2024-10-07 11:29:01.272133] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.101 [2024-10-07 11:29:01.283842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.101 [2024-10-07 11:29:01.284061] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.101 [2024-10-07 11:29:01.284099] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.101 [2024-10-07 11:29:01.284119] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.101 [2024-10-07 11:29:01.284160] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.101 [2024-10-07 11:29:01.284196] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.101 [2024-10-07 11:29:01.284214] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.101 [2024-10-07 11:29:01.284230] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.101 [2024-10-07 11:29:01.284265] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.101 [2024-10-07 11:29:01.294004] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.101 [2024-10-07 11:29:01.294192] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.101 [2024-10-07 11:29:01.294229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.102 [2024-10-07 11:29:01.294247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.102 [2024-10-07 11:29:01.294286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.102 [2024-10-07 11:29:01.294322] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.102 [2024-10-07 11:29:01.294339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.102 [2024-10-07 11:29:01.294354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.102 [2024-10-07 11:29:01.294389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.102 [2024-10-07 11:29:01.304187] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.102 [2024-10-07 11:29:01.304421] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.102 [2024-10-07 11:29:01.304464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.102 [2024-10-07 11:29:01.304484] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.102 [2024-10-07 11:29:01.304529] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.102 [2024-10-07 11:29:01.304566] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.102 [2024-10-07 11:29:01.304615] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.102 [2024-10-07 11:29:01.304632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.102 [2024-10-07 11:29:01.304669] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.102 [2024-10-07 11:29:01.314344] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.102 [2024-10-07 11:29:01.314584] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.102 [2024-10-07 11:29:01.314634] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.102 [2024-10-07 11:29:01.314656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.102 [2024-10-07 11:29:01.314697] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.102 [2024-10-07 11:29:01.314752] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.102 [2024-10-07 11:29:01.314772] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.102 [2024-10-07 11:29:01.314789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.102 [2024-10-07 11:29:01.314824] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.102 [2024-10-07 11:29:01.324627] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.102 [2024-10-07 11:29:01.325992] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.102 [2024-10-07 11:29:01.326065] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.102 [2024-10-07 11:29:01.326103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.102 [2024-10-07 11:29:01.326358] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.102 [2024-10-07 11:29:01.326464] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.102 [2024-10-07 11:29:01.326494] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.102 [2024-10-07 11:29:01.326512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.102 [2024-10-07 11:29:01.326553] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.102 [2024-10-07 11:29:01.334845] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.102 [2024-10-07 11:29:01.335072] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.102 [2024-10-07 11:29:01.335110] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.102 [2024-10-07 11:29:01.335129] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.102 [2024-10-07 11:29:01.335169] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.102 [2024-10-07 11:29:01.335206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.102 [2024-10-07 11:29:01.335223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.102 [2024-10-07 11:29:01.335239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.102 [2024-10-07 11:29:01.335274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.102 [2024-10-07 11:29:01.346777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.102 [2024-10-07 11:29:01.347127] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.102 [2024-10-07 11:29:01.347179] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.102 [2024-10-07 11:29:01.347202] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.102 [2024-10-07 11:29:01.347267] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.102 [2024-10-07 11:29:01.347311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.102 [2024-10-07 11:29:01.347330] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.102 [2024-10-07 11:29:01.347346] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.102 [2024-10-07 11:29:01.347383] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.102 [2024-10-07 11:29:01.356980] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.102 [2024-10-07 11:29:01.358177] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.102 [2024-10-07 11:29:01.358228] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.102 [2024-10-07 11:29:01.358251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.102 [2024-10-07 11:29:01.358495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.102 [2024-10-07 11:29:01.358581] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.102 [2024-10-07 11:29:01.358604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.102 [2024-10-07 11:29:01.358622] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.102 [2024-10-07 11:29:01.358660] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.102 [2024-10-07 11:29:01.367154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.102 [2024-10-07 11:29:01.367355] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.102 [2024-10-07 11:29:01.367416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.102 [2024-10-07 11:29:01.367440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.102 [2024-10-07 11:29:01.367485] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.102 [2024-10-07 11:29:01.367521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.102 [2024-10-07 11:29:01.367540] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.102 [2024-10-07 11:29:01.367566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.102 [2024-10-07 11:29:01.367623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.102 [2024-10-07 11:29:01.378717] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.102 [2024-10-07 11:29:01.378946] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.102 [2024-10-07 11:29:01.378985] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.102 [2024-10-07 11:29:01.379006] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.102 [2024-10-07 11:29:01.379083] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.102 [2024-10-07 11:29:01.379120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.102 [2024-10-07 11:29:01.379137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.102 [2024-10-07 11:29:01.379153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.102 [2024-10-07 11:29:01.379189] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.102 [2024-10-07 11:29:01.388896] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.102 [2024-10-07 11:29:01.389135] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.103 [2024-10-07 11:29:01.389175] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.103 [2024-10-07 11:29:01.389195] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.103 [2024-10-07 11:29:01.389236] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.103 [2024-10-07 11:29:01.389273] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.103 [2024-10-07 11:29:01.389291] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.103 [2024-10-07 11:29:01.389307] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.103 [2024-10-07 11:29:01.389344] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.103 [2024-10-07 11:29:01.399084] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.103 [2024-10-07 11:29:01.399290] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.103 [2024-10-07 11:29:01.399328] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.103 [2024-10-07 11:29:01.399348] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.103 [2024-10-07 11:29:01.399388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.103 [2024-10-07 11:29:01.399444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.103 [2024-10-07 11:29:01.399463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.103 [2024-10-07 11:29:01.399479] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.103 [2024-10-07 11:29:01.399515] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.103 [2024-10-07 11:29:01.410522] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.103 [2024-10-07 11:29:01.410966] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.103 [2024-10-07 11:29:01.411016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.103 [2024-10-07 11:29:01.411038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.103 [2024-10-07 11:29:01.411143] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.103 [2024-10-07 11:29:01.411189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.103 [2024-10-07 11:29:01.411208] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.103 [2024-10-07 11:29:01.411270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.103 [2024-10-07 11:29:01.411348] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.103 [2024-10-07 11:29:01.422984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.103 [2024-10-07 11:29:01.423214] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.103 [2024-10-07 11:29:01.423254] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.103 [2024-10-07 11:29:01.423274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.103 [2024-10-07 11:29:01.423314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.103 [2024-10-07 11:29:01.423351] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.103 [2024-10-07 11:29:01.423369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.103 [2024-10-07 11:29:01.423384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.103 [2024-10-07 11:29:01.423437] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.103 [2024-10-07 11:29:01.433190] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.103 [2024-10-07 11:29:01.433514] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.103 [2024-10-07 11:29:01.433570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.103 [2024-10-07 11:29:01.433604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.103 [2024-10-07 11:29:01.434685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.103 [2024-10-07 11:29:01.434936] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.103 [2024-10-07 11:29:01.434974] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.103 [2024-10-07 11:29:01.434994] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.103 [2024-10-07 11:29:01.436246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.103 [2024-10-07 11:29:01.443423] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.103 [2024-10-07 11:29:01.443627] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.103 [2024-10-07 11:29:01.443665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.103 [2024-10-07 11:29:01.443684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.103 [2024-10-07 11:29:01.443723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.103 [2024-10-07 11:29:01.444698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.103 [2024-10-07 11:29:01.444740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.103 [2024-10-07 11:29:01.444760] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.103 [2024-10-07 11:29:01.444993] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.103 [2024-10-07 11:29:01.454603] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.103 [2024-10-07 11:29:01.455173] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.103 [2024-10-07 11:29:01.455227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.103 [2024-10-07 11:29:01.455251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.103 [2024-10-07 11:29:01.455376] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.103 [2024-10-07 11:29:01.455442] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.103 [2024-10-07 11:29:01.455463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.103 [2024-10-07 11:29:01.455479] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.103 [2024-10-07 11:29:01.455516] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.103 [2024-10-07 11:29:01.465196] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.103 [2024-10-07 11:29:01.465395] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.103 [2024-10-07 11:29:01.465450] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.103 [2024-10-07 11:29:01.465493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.103 [2024-10-07 11:29:01.465563] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.103 [2024-10-07 11:29:01.465602] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.103 [2024-10-07 11:29:01.465620] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.103 [2024-10-07 11:29:01.465635] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.103 [2024-10-07 11:29:01.465689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.103 [2024-10-07 11:29:01.475366] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.103 [2024-10-07 11:29:01.475587] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.103 [2024-10-07 11:29:01.475625] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.103 [2024-10-07 11:29:01.475645] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.103 [2024-10-07 11:29:01.475685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.103 [2024-10-07 11:29:01.475721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.103 [2024-10-07 11:29:01.475740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.103 [2024-10-07 11:29:01.475755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.103 [2024-10-07 11:29:01.475791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.103 [2024-10-07 11:29:01.485563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.103 [2024-10-07 11:29:01.485772] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.103 [2024-10-07 11:29:01.485809] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.103 [2024-10-07 11:29:01.485828] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.103 [2024-10-07 11:29:01.485903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.103 [2024-10-07 11:29:01.485942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.103 [2024-10-07 11:29:01.485960] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.103 [2024-10-07 11:29:01.485975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.103 [2024-10-07 11:29:01.486010] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.103 [2024-10-07 11:29:01.496849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.103 [2024-10-07 11:29:01.497068] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.103 [2024-10-07 11:29:01.497110] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.103 [2024-10-07 11:29:01.497130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.103 [2024-10-07 11:29:01.497171] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.104 [2024-10-07 11:29:01.497208] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.104 [2024-10-07 11:29:01.497226] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.104 [2024-10-07 11:29:01.497241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.104 [2024-10-07 11:29:01.497277] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.104 [2024-10-07 11:29:01.507022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.104 [2024-10-07 11:29:01.507246] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.104 [2024-10-07 11:29:01.507285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.104 [2024-10-07 11:29:01.507304] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.104 [2024-10-07 11:29:01.507344] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.104 [2024-10-07 11:29:01.507381] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.104 [2024-10-07 11:29:01.507413] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.104 [2024-10-07 11:29:01.507434] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.104 [2024-10-07 11:29:01.507470] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.104 [2024-10-07 11:29:01.517204] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.104 [2024-10-07 11:29:01.517459] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.104 [2024-10-07 11:29:01.517514] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.104 [2024-10-07 11:29:01.517546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.104 [2024-10-07 11:29:01.517594] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.104 [2024-10-07 11:29:01.517631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.104 [2024-10-07 11:29:01.517650] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.104 [2024-10-07 11:29:01.517705] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.104 [2024-10-07 11:29:01.517745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.104 [2024-10-07 11:29:01.529502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.104 [2024-10-07 11:29:01.529886] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.104 [2024-10-07 11:29:01.529938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.104 [2024-10-07 11:29:01.529961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.104 [2024-10-07 11:29:01.530035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.104 [2024-10-07 11:29:01.530103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.104 [2024-10-07 11:29:01.530125] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.104 [2024-10-07 11:29:01.530141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.104 [2024-10-07 11:29:01.530177] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.104 [2024-10-07 11:29:01.539681] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.104 [2024-10-07 11:29:01.539931] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.104 [2024-10-07 11:29:01.539970] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.104 [2024-10-07 11:29:01.539990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.104 [2024-10-07 11:29:01.540030] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.104 [2024-10-07 11:29:01.540066] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.104 [2024-10-07 11:29:01.540084] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.104 [2024-10-07 11:29:01.540100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.104 [2024-10-07 11:29:01.540135] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.104 [2024-10-07 11:29:01.550639] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.104 [2024-10-07 11:29:01.550863] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.104 [2024-10-07 11:29:01.550901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.104 [2024-10-07 11:29:01.550920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.104 [2024-10-07 11:29:01.550961] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.104 [2024-10-07 11:29:01.550999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.104 [2024-10-07 11:29:01.551016] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.104 [2024-10-07 11:29:01.551033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.104 [2024-10-07 11:29:01.551069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.104 [2024-10-07 11:29:01.560825] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.104 [2024-10-07 11:29:01.561039] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.104 [2024-10-07 11:29:01.561130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.104 [2024-10-07 11:29:01.561153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.104 [2024-10-07 11:29:01.561194] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.104 [2024-10-07 11:29:01.561231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.104 [2024-10-07 11:29:01.561249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.104 [2024-10-07 11:29:01.561264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.104 [2024-10-07 11:29:01.561299] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.104 [2024-10-07 11:29:01.571004] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.104 [2024-10-07 11:29:01.571228] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.104 [2024-10-07 11:29:01.571265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.104 [2024-10-07 11:29:01.571284] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.104 [2024-10-07 11:29:01.571324] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.104 [2024-10-07 11:29:01.571360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.104 [2024-10-07 11:29:01.571378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.104 [2024-10-07 11:29:01.571394] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.104 [2024-10-07 11:29:01.571447] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.104 [2024-10-07 11:29:01.582199] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.104 [2024-10-07 11:29:01.582429] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.104 [2024-10-07 11:29:01.582469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.104 [2024-10-07 11:29:01.582489] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.104 [2024-10-07 11:29:01.582530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.104 [2024-10-07 11:29:01.582567] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.104 [2024-10-07 11:29:01.582585] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.104 [2024-10-07 11:29:01.582601] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.104 [2024-10-07 11:29:01.582636] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.104 [2024-10-07 11:29:01.592543] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.104 [2024-10-07 11:29:01.592755] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.104 [2024-10-07 11:29:01.592794] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.104 [2024-10-07 11:29:01.592813] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.104 [2024-10-07 11:29:01.592854] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.104 [2024-10-07 11:29:01.592919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.104 [2024-10-07 11:29:01.592938] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.104 [2024-10-07 11:29:01.592954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.105 [2024-10-07 11:29:01.592989] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.105 [2024-10-07 11:29:01.603872] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.105 [2024-10-07 11:29:01.604081] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.105 [2024-10-07 11:29:01.604119] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.105 [2024-10-07 11:29:01.604138] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.105 [2024-10-07 11:29:01.604177] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.105 [2024-10-07 11:29:01.604224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.105 [2024-10-07 11:29:01.604242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.105 [2024-10-07 11:29:01.604258] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.105 [2024-10-07 11:29:01.604293] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.105 [2024-10-07 11:29:01.614378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.105 [2024-10-07 11:29:01.614660] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.105 [2024-10-07 11:29:01.614711] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.105 [2024-10-07 11:29:01.614734] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.105 [2024-10-07 11:29:01.614783] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.105 [2024-10-07 11:29:01.614839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.105 [2024-10-07 11:29:01.614872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.105 [2024-10-07 11:29:01.614891] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.105 [2024-10-07 11:29:01.614930] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.105 [2024-10-07 11:29:01.625773] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.105 [2024-10-07 11:29:01.625975] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.105 [2024-10-07 11:29:01.626012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.105 [2024-10-07 11:29:01.626031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.105 [2024-10-07 11:29:01.626070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.105 [2024-10-07 11:29:01.626106] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.105 [2024-10-07 11:29:01.626124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.105 [2024-10-07 11:29:01.626140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.105 [2024-10-07 11:29:01.626201] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.105 [2024-10-07 11:29:01.635939] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.105 [2024-10-07 11:29:01.636155] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.105 [2024-10-07 11:29:01.636192] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.105 [2024-10-07 11:29:01.636210] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.105 [2024-10-07 11:29:01.636250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.105 [2024-10-07 11:29:01.636287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.105 [2024-10-07 11:29:01.636305] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.105 [2024-10-07 11:29:01.636320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.105 [2024-10-07 11:29:01.636356] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.105 [2024-10-07 11:29:01.646120] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.105 [2024-10-07 11:29:01.646340] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.105 [2024-10-07 11:29:01.646378] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.105 [2024-10-07 11:29:01.646397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.105 [2024-10-07 11:29:01.646460] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.105 [2024-10-07 11:29:01.646498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.105 [2024-10-07 11:29:01.646516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.105 [2024-10-07 11:29:01.646531] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.105 [2024-10-07 11:29:01.646567] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.105 [2024-10-07 11:29:01.657185] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.105 [2024-10-07 11:29:01.658135] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.105 [2024-10-07 11:29:01.658186] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.105 [2024-10-07 11:29:01.658207] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.105 [2024-10-07 11:29:01.658507] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.105 [2024-10-07 11:29:01.658609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.105 [2024-10-07 11:29:01.658639] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.105 [2024-10-07 11:29:01.658658] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.105 [2024-10-07 11:29:01.658696] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.105 [2024-10-07 11:29:01.667378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.105 [2024-10-07 11:29:01.667619] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.105 [2024-10-07 11:29:01.667657] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.105 [2024-10-07 11:29:01.667712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.105 [2024-10-07 11:29:01.667758] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.105 [2024-10-07 11:29:01.667795] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.105 [2024-10-07 11:29:01.667813] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.105 [2024-10-07 11:29:01.667829] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.105 [2024-10-07 11:29:01.667865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.105 [2024-10-07 11:29:01.677572] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.105 [2024-10-07 11:29:01.677802] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.105 [2024-10-07 11:29:01.677844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.105 [2024-10-07 11:29:01.677863] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.105 [2024-10-07 11:29:01.677906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.105 [2024-10-07 11:29:01.677958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.105 [2024-10-07 11:29:01.677981] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.105 [2024-10-07 11:29:01.677997] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.105 [2024-10-07 11:29:01.678032] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.105 [2024-10-07 11:29:01.687746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.105 [2024-10-07 11:29:01.687952] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.105 [2024-10-07 11:29:01.687989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.105 [2024-10-07 11:29:01.688007] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.105 [2024-10-07 11:29:01.688048] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.105 [2024-10-07 11:29:01.688084] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.105 [2024-10-07 11:29:01.688101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.105 [2024-10-07 11:29:01.688118] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.105 [2024-10-07 11:29:01.688167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.105 [2024-10-07 11:29:01.698705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.105 [2024-10-07 11:29:01.699088] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.105 [2024-10-07 11:29:01.699136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.105 [2024-10-07 11:29:01.699158] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.105 [2024-10-07 11:29:01.699312] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.105 [2024-10-07 11:29:01.699395] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.105 [2024-10-07 11:29:01.699474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.105 [2024-10-07 11:29:01.699494] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.105 [2024-10-07 11:29:01.699534] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.106 [2024-10-07 11:29:01.708877] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.106 [2024-10-07 11:29:01.709094] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.106 [2024-10-07 11:29:01.709132] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.106 [2024-10-07 11:29:01.709151] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.106 [2024-10-07 11:29:01.709192] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.106 [2024-10-07 11:29:01.709228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.106 [2024-10-07 11:29:01.709246] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.106 [2024-10-07 11:29:01.709263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.106 [2024-10-07 11:29:01.709299] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.106 [2024-10-07 11:29:01.719037] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.106 [2024-10-07 11:29:01.719252] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.106 [2024-10-07 11:29:01.719288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.106 [2024-10-07 11:29:01.719307] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.106 [2024-10-07 11:29:01.719346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.106 [2024-10-07 11:29:01.719382] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.106 [2024-10-07 11:29:01.719413] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.106 [2024-10-07 11:29:01.719432] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.106 [2024-10-07 11:29:01.719469] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.106 [2024-10-07 11:29:01.729209] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.106 [2024-10-07 11:29:01.729428] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.106 [2024-10-07 11:29:01.729464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.106 [2024-10-07 11:29:01.729483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.106 [2024-10-07 11:29:01.729525] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.106 [2024-10-07 11:29:01.729560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.106 [2024-10-07 11:29:01.729578] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.106 [2024-10-07 11:29:01.729593] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.106 [2024-10-07 11:29:01.729628] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.106 [2024-10-07 11:29:01.739831] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.106 [2024-10-07 11:29:01.740020] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.106 [2024-10-07 11:29:01.740058] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.106 [2024-10-07 11:29:01.740077] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.106 [2024-10-07 11:29:01.740117] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.106 [2024-10-07 11:29:01.740154] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.106 [2024-10-07 11:29:01.740171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.106 [2024-10-07 11:29:01.740188] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.106 [2024-10-07 11:29:01.740231] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.106 [2024-10-07 11:29:01.749987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.106 [2024-10-07 11:29:01.750174] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.106 [2024-10-07 11:29:01.750211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.106 [2024-10-07 11:29:01.750230] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.106 [2024-10-07 11:29:01.750269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.106 [2024-10-07 11:29:01.750316] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.106 [2024-10-07 11:29:01.750334] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.106 [2024-10-07 11:29:01.750349] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.106 [2024-10-07 11:29:01.750385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.106 [2024-10-07 11:29:01.760139] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.106 [2024-10-07 11:29:01.760337] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.106 [2024-10-07 11:29:01.760374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.106 [2024-10-07 11:29:01.760393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.106 [2024-10-07 11:29:01.760450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.106 [2024-10-07 11:29:01.760509] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.106 [2024-10-07 11:29:01.760531] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.106 [2024-10-07 11:29:01.760547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.106 [2024-10-07 11:29:01.760583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.106 [2024-10-07 11:29:01.771720] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.106 [2024-10-07 11:29:01.771988] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.106 [2024-10-07 11:29:01.772037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.106 [2024-10-07 11:29:01.772060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.106 [2024-10-07 11:29:01.772303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.106 [2024-10-07 11:29:01.772380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.106 [2024-10-07 11:29:01.772418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.106 [2024-10-07 11:29:01.772437] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.106 [2024-10-07 11:29:01.772478] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.106 [2024-10-07 11:29:01.781886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.106 [2024-10-07 11:29:01.782097] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.107 [2024-10-07 11:29:01.782135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.107 [2024-10-07 11:29:01.782155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.107 [2024-10-07 11:29:01.782195] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.107 [2024-10-07 11:29:01.782232] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.107 [2024-10-07 11:29:01.782249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.107 [2024-10-07 11:29:01.782265] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.107 [2024-10-07 11:29:01.782300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.107 [2024-10-07 11:29:01.793260] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.107 [2024-10-07 11:29:01.793480] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.107 [2024-10-07 11:29:01.793519] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.107 [2024-10-07 11:29:01.793538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.107 [2024-10-07 11:29:01.793579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.107 [2024-10-07 11:29:01.793615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.107 [2024-10-07 11:29:01.793633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.107 [2024-10-07 11:29:01.793649] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.107 [2024-10-07 11:29:01.793684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.107 [2024-10-07 11:29:01.803449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.107 [2024-10-07 11:29:01.803667] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.107 [2024-10-07 11:29:01.803706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.107 [2024-10-07 11:29:01.803726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.107 [2024-10-07 11:29:01.803766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.107 [2024-10-07 11:29:01.803802] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.107 [2024-10-07 11:29:01.803820] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.107 [2024-10-07 11:29:01.803862] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.107 [2024-10-07 11:29:01.803900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.107 [2024-10-07 11:29:01.814280] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.107 [2024-10-07 11:29:01.814498] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.107 [2024-10-07 11:29:01.814537] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.107 [2024-10-07 11:29:01.814556] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.107 [2024-10-07 11:29:01.814597] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.107 [2024-10-07 11:29:01.814648] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.107 [2024-10-07 11:29:01.814668] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.107 [2024-10-07 11:29:01.814684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.107 [2024-10-07 11:29:01.814720] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.107 [2024-10-07 11:29:01.824472] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.107 [2024-10-07 11:29:01.824699] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.107 [2024-10-07 11:29:01.824738] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.107 [2024-10-07 11:29:01.824757] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.107 [2024-10-07 11:29:01.824811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.107 [2024-10-07 11:29:01.824849] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.107 [2024-10-07 11:29:01.824867] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.107 [2024-10-07 11:29:01.824883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.107 [2024-10-07 11:29:01.824918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.107 [2024-10-07 11:29:01.835882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.107 [2024-10-07 11:29:01.836446] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.107 [2024-10-07 11:29:01.836503] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.107 [2024-10-07 11:29:01.836525] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.107 [2024-10-07 11:29:01.836635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.107 [2024-10-07 11:29:01.836694] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.107 [2024-10-07 11:29:01.836728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.107 [2024-10-07 11:29:01.836756] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.107 [2024-10-07 11:29:01.836800] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.107 [2024-10-07 11:29:01.848297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.107 [2024-10-07 11:29:01.848748] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.107 [2024-10-07 11:29:01.848797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.107 [2024-10-07 11:29:01.848817] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.107 [2024-10-07 11:29:01.848883] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.107 [2024-10-07 11:29:01.848927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.107 [2024-10-07 11:29:01.848945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.107 [2024-10-07 11:29:01.848962] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.107 [2024-10-07 11:29:01.849002] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.107 [2024-10-07 11:29:01.858706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.107 [2024-10-07 11:29:01.858937] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.107 [2024-10-07 11:29:01.858974] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.107 [2024-10-07 11:29:01.858994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.107 [2024-10-07 11:29:01.859035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.107 [2024-10-07 11:29:01.859073] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.107 [2024-10-07 11:29:01.859090] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.107 [2024-10-07 11:29:01.859106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.107 [2024-10-07 11:29:01.859142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.107 [2024-10-07 11:29:01.868898] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.107 [2024-10-07 11:29:01.869119] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.107 [2024-10-07 11:29:01.869156] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.107 [2024-10-07 11:29:01.869175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.107 [2024-10-07 11:29:01.869216] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.107 [2024-10-07 11:29:01.869252] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.107 [2024-10-07 11:29:01.869270] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.107 [2024-10-07 11:29:01.869285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.107 [2024-10-07 11:29:01.869323] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.107 [2024-10-07 11:29:01.880213] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.107 [2024-10-07 11:29:01.880741] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.107 [2024-10-07 11:29:01.880800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.107 [2024-10-07 11:29:01.880825] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.107 [2024-10-07 11:29:01.880970] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.107 [2024-10-07 11:29:01.881089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.107 [2024-10-07 11:29:01.881112] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.107 [2024-10-07 11:29:01.881131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.107 [2024-10-07 11:29:01.881178] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.107 [2024-10-07 11:29:01.890425] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.107 [2024-10-07 11:29:01.891837] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.107 [2024-10-07 11:29:01.891897] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.107 [2024-10-07 11:29:01.891920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.108 [2024-10-07 11:29:01.893132] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.108 [2024-10-07 11:29:01.893387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.108 [2024-10-07 11:29:01.893441] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.108 [2024-10-07 11:29:01.893461] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.108 [2024-10-07 11:29:01.893561] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.108 [2024-10-07 11:29:01.901880] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.108 [2024-10-07 11:29:01.903057] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.108 [2024-10-07 11:29:01.903115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.108 [2024-10-07 11:29:01.903137] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.108 [2024-10-07 11:29:01.903370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.108 [2024-10-07 11:29:01.903465] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.108 [2024-10-07 11:29:01.903489] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.108 [2024-10-07 11:29:01.903505] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.108 [2024-10-07 11:29:01.903555] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.108 [2024-10-07 11:29:01.913066] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.108 [2024-10-07 11:29:01.913265] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.108 [2024-10-07 11:29:01.913301] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.108 [2024-10-07 11:29:01.913320] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.108 [2024-10-07 11:29:01.913359] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.108 [2024-10-07 11:29:01.913396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.108 [2024-10-07 11:29:01.913435] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.108 [2024-10-07 11:29:01.913452] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.108 [2024-10-07 11:29:01.913519] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.108 [2024-10-07 11:29:01.923905] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.108 [2024-10-07 11:29:01.924777] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.108 [2024-10-07 11:29:01.924842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.108 [2024-10-07 11:29:01.924865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.108 [2024-10-07 11:29:01.925223] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.108 [2024-10-07 11:29:01.925346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.108 [2024-10-07 11:29:01.925383] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.108 [2024-10-07 11:29:01.925418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.108 [2024-10-07 11:29:01.925467] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.108 [2024-10-07 11:29:01.934624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.108 [2024-10-07 11:29:01.936028] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.108 [2024-10-07 11:29:01.936081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.108 [2024-10-07 11:29:01.936104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.108 [2024-10-07 11:29:01.937310] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.108 [2024-10-07 11:29:01.937574] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.108 [2024-10-07 11:29:01.937612] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.108 [2024-10-07 11:29:01.937632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.108 [2024-10-07 11:29:01.937699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.108 [2024-10-07 11:29:01.946461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.108 [2024-10-07 11:29:01.948210] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.108 [2024-10-07 11:29:01.948301] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.108 [2024-10-07 11:29:01.948340] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.108 [2024-10-07 11:29:01.948706] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.108 [2024-10-07 11:29:01.949837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.108 [2024-10-07 11:29:01.949884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.108 [2024-10-07 11:29:01.949905] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.108 [2024-10-07 11:29:01.951708] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.108 [2024-10-07 11:29:01.956663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.108 [2024-10-07 11:29:01.956888] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.108 [2024-10-07 11:29:01.956929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.108 [2024-10-07 11:29:01.956976] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.108 [2024-10-07 11:29:01.957020] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.108 [2024-10-07 11:29:01.957078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.108 [2024-10-07 11:29:01.957101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.108 [2024-10-07 11:29:01.957118] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.108 [2024-10-07 11:29:01.957157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.108 [2024-10-07 11:29:01.967851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.108 [2024-10-07 11:29:01.968041] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.108 [2024-10-07 11:29:01.968078] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.108 [2024-10-07 11:29:01.968097] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.108 [2024-10-07 11:29:01.968137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.108 [2024-10-07 11:29:01.968173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.108 [2024-10-07 11:29:01.968190] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.108 [2024-10-07 11:29:01.968207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.108 [2024-10-07 11:29:01.968255] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.108 [2024-10-07 11:29:01.978001] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.108 [2024-10-07 11:29:01.979183] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.108 [2024-10-07 11:29:01.979240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.108 [2024-10-07 11:29:01.979263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.108 [2024-10-07 11:29:01.979521] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.108 [2024-10-07 11:29:01.979661] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.108 [2024-10-07 11:29:01.979691] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.108 [2024-10-07 11:29:01.979710] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.108 [2024-10-07 11:29:01.980930] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.108 [2024-10-07 11:29:01.989453] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.108 [2024-10-07 11:29:01.991033] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.108 [2024-10-07 11:29:01.991095] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.108 [2024-10-07 11:29:01.991119] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.108 [2024-10-07 11:29:01.991344] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.108 [2024-10-07 11:29:01.992447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.109 [2024-10-07 11:29:01.992497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.109 [2024-10-07 11:29:01.992518] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.109 [2024-10-07 11:29:01.993764] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.109 [2024-10-07 11:29:01.999626] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.109 [2024-10-07 11:29:01.999794] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.109 [2024-10-07 11:29:01.999831] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.109 [2024-10-07 11:29:01.999849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.109 [2024-10-07 11:29:01.999887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.109 [2024-10-07 11:29:01.999923] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.109 [2024-10-07 11:29:01.999940] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.109 [2024-10-07 11:29:01.999956] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.109 [2024-10-07 11:29:01.999991] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.109 [2024-10-07 11:29:02.011113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.109 [2024-10-07 11:29:02.011316] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.109 [2024-10-07 11:29:02.011354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.109 [2024-10-07 11:29:02.011373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.109 [2024-10-07 11:29:02.011429] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.109 [2024-10-07 11:29:02.011470] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.109 [2024-10-07 11:29:02.011488] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.109 [2024-10-07 11:29:02.011504] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.109 [2024-10-07 11:29:02.011540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.109 [2024-10-07 11:29:02.021276] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.109 [2024-10-07 11:29:02.021491] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.109 [2024-10-07 11:29:02.021530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.109 [2024-10-07 11:29:02.021550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.109 [2024-10-07 11:29:02.021592] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.109 [2024-10-07 11:29:02.021629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.109 [2024-10-07 11:29:02.021646] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.109 [2024-10-07 11:29:02.021662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.109 [2024-10-07 11:29:02.021698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.109 [2024-10-07 11:29:02.031464] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.109 [2024-10-07 11:29:02.031649] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.109 [2024-10-07 11:29:02.031686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.109 [2024-10-07 11:29:02.031704] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.109 [2024-10-07 11:29:02.032674] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.109 [2024-10-07 11:29:02.032915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.109 [2024-10-07 11:29:02.032954] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.109 [2024-10-07 11:29:02.032973] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.109 [2024-10-07 11:29:02.033074] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.109 [2024-10-07 11:29:02.042739] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.109 [2024-10-07 11:29:02.043143] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.109 [2024-10-07 11:29:02.043192] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.109 [2024-10-07 11:29:02.043221] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.109 [2024-10-07 11:29:02.043318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.109 [2024-10-07 11:29:02.043363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.109 [2024-10-07 11:29:02.043382] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.109 [2024-10-07 11:29:02.043413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.109 [2024-10-07 11:29:02.043481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.109 [2024-10-07 11:29:02.052878] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.109 [2024-10-07 11:29:02.053078] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.109 [2024-10-07 11:29:02.053117] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.109 [2024-10-07 11:29:02.053136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.109 [2024-10-07 11:29:02.054349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.109 [2024-10-07 11:29:02.055587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.109 [2024-10-07 11:29:02.055629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.109 [2024-10-07 11:29:02.055650] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.109 [2024-10-07 11:29:02.055878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.109 [2024-10-07 11:29:02.063177] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.109 [2024-10-07 11:29:02.063355] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.109 [2024-10-07 11:29:02.063392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.109 [2024-10-07 11:29:02.063459] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.109 [2024-10-07 11:29:02.063502] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.109 [2024-10-07 11:29:02.064629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.109 [2024-10-07 11:29:02.064662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.109 [2024-10-07 11:29:02.064679] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.109 [2024-10-07 11:29:02.064900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.109 [2024-10-07 11:29:02.073323] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.109 [2024-10-07 11:29:02.073747] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.109 [2024-10-07 11:29:02.073797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.109 [2024-10-07 11:29:02.073819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.109 [2024-10-07 11:29:02.073897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.109 [2024-10-07 11:29:02.073940] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.109 [2024-10-07 11:29:02.073958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.109 [2024-10-07 11:29:02.073975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.109 [2024-10-07 11:29:02.074011] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.109 [2024-10-07 11:29:02.085638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.109 [2024-10-07 11:29:02.085878] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.109 [2024-10-07 11:29:02.085921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.109 [2024-10-07 11:29:02.085941] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.109 [2024-10-07 11:29:02.085981] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.109 [2024-10-07 11:29:02.086018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.109 [2024-10-07 11:29:02.086036] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.109 [2024-10-07 11:29:02.086052] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.109 [2024-10-07 11:29:02.086090] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.109 [2024-10-07 11:29:02.095812] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.109 [2024-10-07 11:29:02.096005] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.109 [2024-10-07 11:29:02.096042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.109 [2024-10-07 11:29:02.096061] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.109 [2024-10-07 11:29:02.096100] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.110 [2024-10-07 11:29:02.096136] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.110 [2024-10-07 11:29:02.096185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.110 [2024-10-07 11:29:02.096202] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.110 [2024-10-07 11:29:02.097254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.110 8252.80 IOPS, 32.24 MiB/s [2024-10-07T11:29:07.821Z] [2024-10-07 11:29:02.105965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.110 [2024-10-07 11:29:02.106144] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.110 [2024-10-07 11:29:02.106181] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.110 [2024-10-07 11:29:02.106199] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.110 [2024-10-07 11:29:02.107156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.110 [2024-10-07 11:29:02.107388] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.110 [2024-10-07 11:29:02.107450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.110 [2024-10-07 11:29:02.107472] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.110 [2024-10-07 11:29:02.108637] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.110 [2024-10-07 11:29:02.116965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.110 [2024-10-07 11:29:02.117420] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.110 [2024-10-07 11:29:02.117470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.110 [2024-10-07 11:29:02.117493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.110 [2024-10-07 11:29:02.117574] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.110 [2024-10-07 11:29:02.117639] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.110 [2024-10-07 11:29:02.117670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.110 [2024-10-07 11:29:02.117689] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.110 [2024-10-07 11:29:02.117727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.110 [2024-10-07 11:29:02.129602] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.110 [2024-10-07 11:29:02.129856] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.110 [2024-10-07 11:29:02.129907] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.110 [2024-10-07 11:29:02.129929] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.110 [2024-10-07 11:29:02.129971] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.110 [2024-10-07 11:29:02.130009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.110 [2024-10-07 11:29:02.130026] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.110 [2024-10-07 11:29:02.130041] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.110 [2024-10-07 11:29:02.130077] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.110 [2024-10-07 11:29:02.139804] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.110 [2024-10-07 11:29:02.139979] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.110 [2024-10-07 11:29:02.140016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.110 [2024-10-07 11:29:02.140035] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.110 [2024-10-07 11:29:02.140073] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.110 [2024-10-07 11:29:02.140109] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.110 [2024-10-07 11:29:02.140127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.110 [2024-10-07 11:29:02.140143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.110 [2024-10-07 11:29:02.140177] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.110 [2024-10-07 11:29:02.144076] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1471a00 was disconnected and freed. reset controller. 00:18:26.110 [2024-10-07 11:29:02.144466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.110 [2024-10-07 11:29:02.144578] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.110 [2024-10-07 11:29:02.145188] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.110 [2024-10-07 11:29:02.145243] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.110 [2024-10-07 11:29:02.145265] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.110 [2024-10-07 11:29:02.145291] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.110 [2024-10-07 11:29:02.145324] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.110 [2024-10-07 11:29:02.150533] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.110 [2024-10-07 11:29:02.150740] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.110 [2024-10-07 11:29:02.150778] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.110 [2024-10-07 11:29:02.150797] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.110 [2024-10-07 11:29:02.150833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.110 [2024-10-07 11:29:02.150865] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.110 [2024-10-07 11:29:02.150882] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.110 [2024-10-07 11:29:02.150898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.110 [2024-10-07 11:29:02.150931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.110 [2024-10-07 11:29:02.155219] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.110 [2024-10-07 11:29:02.155382] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.110 [2024-10-07 11:29:02.155434] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.110 [2024-10-07 11:29:02.155454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.110 [2024-10-07 11:29:02.155490] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.110 [2024-10-07 11:29:02.155557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.110 [2024-10-07 11:29:02.155576] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.110 [2024-10-07 11:29:02.155592] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.110 [2024-10-07 11:29:02.156616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.110 [2024-10-07 11:29:02.161778] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.110 [2024-10-07 11:29:02.162178] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.110 [2024-10-07 11:29:02.162226] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.110 [2024-10-07 11:29:02.162249] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.110 [2024-10-07 11:29:02.162324] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.110 [2024-10-07 11:29:02.162363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.110 [2024-10-07 11:29:02.162380] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.110 [2024-10-07 11:29:02.162396] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.110 [2024-10-07 11:29:02.162447] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.110 [2024-10-07 11:29:02.165346] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.110 [2024-10-07 11:29:02.165490] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.110 [2024-10-07 11:29:02.165524] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.110 [2024-10-07 11:29:02.165542] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.110 [2024-10-07 11:29:02.165576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.110 [2024-10-07 11:29:02.166517] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.111 [2024-10-07 11:29:02.166555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.111 [2024-10-07 11:29:02.166575] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.111 [2024-10-07 11:29:02.166777] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.111 [2024-10-07 11:29:02.173981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.111 [2024-10-07 11:29:02.174253] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.111 [2024-10-07 11:29:02.174299] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.111 [2024-10-07 11:29:02.174321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.111 [2024-10-07 11:29:02.174380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.111 [2024-10-07 11:29:02.174437] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.111 [2024-10-07 11:29:02.174457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.111 [2024-10-07 11:29:02.174472] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.111 [2024-10-07 11:29:02.174542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.111 [2024-10-07 11:29:02.176220] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.111 [2024-10-07 11:29:02.176587] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.111 [2024-10-07 11:29:02.176630] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.111 [2024-10-07 11:29:02.176651] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.111 [2024-10-07 11:29:02.176724] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.111 [2024-10-07 11:29:02.176762] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.111 [2024-10-07 11:29:02.176781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.111 [2024-10-07 11:29:02.176796] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.111 [2024-10-07 11:29:02.176827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.111 [2024-10-07 11:29:02.184105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.111 [2024-10-07 11:29:02.184252] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.111 [2024-10-07 11:29:02.184285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.111 [2024-10-07 11:29:02.184302] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.111 [2024-10-07 11:29:02.184336] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.111 [2024-10-07 11:29:02.184366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.111 [2024-10-07 11:29:02.184383] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.111 [2024-10-07 11:29:02.184413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.111 [2024-10-07 11:29:02.184449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.111 [2024-10-07 11:29:02.188450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.111 [2024-10-07 11:29:02.188705] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.111 [2024-10-07 11:29:02.188751] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.111 [2024-10-07 11:29:02.188772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.111 [2024-10-07 11:29:02.188831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.111 [2024-10-07 11:29:02.188868] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.111 [2024-10-07 11:29:02.188886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.111 [2024-10-07 11:29:02.188902] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.111 [2024-10-07 11:29:02.188933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.111 [2024-10-07 11:29:02.195092] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.111 [2024-10-07 11:29:02.195286] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.111 [2024-10-07 11:29:02.195363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.111 [2024-10-07 11:29:02.195386] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.111 [2024-10-07 11:29:02.195439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.111 [2024-10-07 11:29:02.195474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.111 [2024-10-07 11:29:02.195491] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.111 [2024-10-07 11:29:02.195507] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.111 [2024-10-07 11:29:02.195538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.111 [2024-10-07 11:29:02.198742] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.111 [2024-10-07 11:29:02.198877] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.111 [2024-10-07 11:29:02.198909] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.111 [2024-10-07 11:29:02.198926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.111 [2024-10-07 11:29:02.199950] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.111 [2024-10-07 11:29:02.200190] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.111 [2024-10-07 11:29:02.200227] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.111 [2024-10-07 11:29:02.200246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.111 [2024-10-07 11:29:02.200308] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.111 [2024-10-07 11:29:02.205209] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.111 [2024-10-07 11:29:02.205371] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.111 [2024-10-07 11:29:02.205421] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.111 [2024-10-07 11:29:02.205450] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.111 [2024-10-07 11:29:02.205495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.111 [2024-10-07 11:29:02.205528] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.111 [2024-10-07 11:29:02.205546] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.111 [2024-10-07 11:29:02.205562] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.111 [2024-10-07 11:29:02.205594] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.111 [2024-10-07 11:29:02.208846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.111 [2024-10-07 11:29:02.208984] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.111 [2024-10-07 11:29:02.209018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.111 [2024-10-07 11:29:02.209036] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.111 [2024-10-07 11:29:02.209087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.111 [2024-10-07 11:29:02.209149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.111 [2024-10-07 11:29:02.209168] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.111 [2024-10-07 11:29:02.209183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.111 [2024-10-07 11:29:02.209215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.111 [2024-10-07 11:29:02.215332] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.111 [2024-10-07 11:29:02.215540] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.111 [2024-10-07 11:29:02.215578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.111 [2024-10-07 11:29:02.215607] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.111 [2024-10-07 11:29:02.215642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.111 [2024-10-07 11:29:02.216684] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.111 [2024-10-07 11:29:02.216724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.111 [2024-10-07 11:29:02.216744] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.111 [2024-10-07 11:29:02.217005] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.111 [2024-10-07 11:29:02.219714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.111 [2024-10-07 11:29:02.219857] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.111 [2024-10-07 11:29:02.219893] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.111 [2024-10-07 11:29:02.219911] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.111 [2024-10-07 11:29:02.219947] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.111 [2024-10-07 11:29:02.219978] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.111 [2024-10-07 11:29:02.219996] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.111 [2024-10-07 11:29:02.220012] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.111 [2024-10-07 11:29:02.220043] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.111 [2024-10-07 11:29:02.225487] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.111 [2024-10-07 11:29:02.225639] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.111 [2024-10-07 11:29:02.225673] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.112 [2024-10-07 11:29:02.225691] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.112 [2024-10-07 11:29:02.225725] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.112 [2024-10-07 11:29:02.226699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.112 [2024-10-07 11:29:02.226743] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.112 [2024-10-07 11:29:02.226764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.112 [2024-10-07 11:29:02.226987] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.112 [2024-10-07 11:29:02.229869] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.112 [2024-10-07 11:29:02.230012] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.112 [2024-10-07 11:29:02.230046] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.112 [2024-10-07 11:29:02.230064] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.112 [2024-10-07 11:29:02.230099] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.112 [2024-10-07 11:29:02.230130] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.112 [2024-10-07 11:29:02.230147] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.112 [2024-10-07 11:29:02.230163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.112 [2024-10-07 11:29:02.230193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.112 [2024-10-07 11:29:02.236777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.112 [2024-10-07 11:29:02.237215] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.112 [2024-10-07 11:29:02.237263] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.112 [2024-10-07 11:29:02.237294] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.112 [2024-10-07 11:29:02.237370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.112 [2024-10-07 11:29:02.237434] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.112 [2024-10-07 11:29:02.237458] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.112 [2024-10-07 11:29:02.237474] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.112 [2024-10-07 11:29:02.237507] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.112 [2024-10-07 11:29:02.240001] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.112 [2024-10-07 11:29:02.240126] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.112 [2024-10-07 11:29:02.240160] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.112 [2024-10-07 11:29:02.240178] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.112 [2024-10-07 11:29:02.240211] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.112 [2024-10-07 11:29:02.240242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.112 [2024-10-07 11:29:02.240259] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.112 [2024-10-07 11:29:02.240274] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.112 [2024-10-07 11:29:02.240304] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.112 [2024-10-07 11:29:02.249194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.112 [2024-10-07 11:29:02.249429] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.112 [2024-10-07 11:29:02.249468] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.112 [2024-10-07 11:29:02.249513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.112 [2024-10-07 11:29:02.249554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.112 [2024-10-07 11:29:02.249587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.112 [2024-10-07 11:29:02.249603] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.112 [2024-10-07 11:29:02.249619] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.112 [2024-10-07 11:29:02.249651] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.112 [2024-10-07 11:29:02.251263] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.112 [2024-10-07 11:29:02.251636] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.112 [2024-10-07 11:29:02.251681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.112 [2024-10-07 11:29:02.251702] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.112 [2024-10-07 11:29:02.251775] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.112 [2024-10-07 11:29:02.251835] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.112 [2024-10-07 11:29:02.251857] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.112 [2024-10-07 11:29:02.251872] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.112 [2024-10-07 11:29:02.251903] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.112 [2024-10-07 11:29:02.259349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.112 [2024-10-07 11:29:02.259519] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.112 [2024-10-07 11:29:02.259555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.112 [2024-10-07 11:29:02.259573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.112 [2024-10-07 11:29:02.260593] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.112 [2024-10-07 11:29:02.260835] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.112 [2024-10-07 11:29:02.260871] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.112 [2024-10-07 11:29:02.260890] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.112 [2024-10-07 11:29:02.262134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.112 [2024-10-07 11:29:02.263541] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.112 [2024-10-07 11:29:02.263689] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.112 [2024-10-07 11:29:02.263728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.112 [2024-10-07 11:29:02.263748] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.112 [2024-10-07 11:29:02.263781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.112 [2024-10-07 11:29:02.263813] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.112 [2024-10-07 11:29:02.263860] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.112 [2024-10-07 11:29:02.263876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.112 [2024-10-07 11:29:02.263909] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.112 [2024-10-07 11:29:02.270569] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.112 [2024-10-07 11:29:02.270720] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.112 [2024-10-07 11:29:02.270754] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.112 [2024-10-07 11:29:02.270773] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.112 [2024-10-07 11:29:02.271896] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.112 [2024-10-07 11:29:02.272136] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.112 [2024-10-07 11:29:02.272174] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.112 [2024-10-07 11:29:02.272193] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.112 [2024-10-07 11:29:02.273298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.112 [2024-10-07 11:29:02.273646] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.112 [2024-10-07 11:29:02.273779] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.112 [2024-10-07 11:29:02.273813] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.112 [2024-10-07 11:29:02.273832] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.112 [2024-10-07 11:29:02.273865] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.112 [2024-10-07 11:29:02.273896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.112 [2024-10-07 11:29:02.273914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.112 [2024-10-07 11:29:02.273929] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.112 [2024-10-07 11:29:02.274957] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.112 [2024-10-07 11:29:02.280697] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.112 [2024-10-07 11:29:02.280913] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.112 [2024-10-07 11:29:02.280951] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.112 [2024-10-07 11:29:02.280970] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.112 [2024-10-07 11:29:02.281007] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.112 [2024-10-07 11:29:02.281039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.112 [2024-10-07 11:29:02.281073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.112 [2024-10-07 11:29:02.281091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.112 [2024-10-07 11:29:02.281124] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.113 [2024-10-07 11:29:02.283748] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.113 [2024-10-07 11:29:02.283931] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.113 [2024-10-07 11:29:02.283966] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.113 [2024-10-07 11:29:02.283985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.113 [2024-10-07 11:29:02.284940] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.113 [2024-10-07 11:29:02.285194] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.113 [2024-10-07 11:29:02.285230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.113 [2024-10-07 11:29:02.285249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.113 [2024-10-07 11:29:02.285332] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.113 [2024-10-07 11:29:02.292562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.113 [2024-10-07 11:29:02.292809] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.113 [2024-10-07 11:29:02.292848] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.113 [2024-10-07 11:29:02.292867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.113 [2024-10-07 11:29:02.292904] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.113 [2024-10-07 11:29:02.292937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.113 [2024-10-07 11:29:02.292955] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.113 [2024-10-07 11:29:02.292971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.113 [2024-10-07 11:29:02.293001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.113 [2024-10-07 11:29:02.294671] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.113 [2024-10-07 11:29:02.295028] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.113 [2024-10-07 11:29:02.295062] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.113 [2024-10-07 11:29:02.295079] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.113 [2024-10-07 11:29:02.295149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.113 [2024-10-07 11:29:02.295208] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.113 [2024-10-07 11:29:02.295230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.113 [2024-10-07 11:29:02.295244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.113 [2024-10-07 11:29:02.295276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.113 [2024-10-07 11:29:02.302735] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.113 [2024-10-07 11:29:02.302927] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.113 [2024-10-07 11:29:02.302963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.113 [2024-10-07 11:29:02.302981] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.113 [2024-10-07 11:29:02.304049] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.113 [2024-10-07 11:29:02.304302] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.113 [2024-10-07 11:29:02.304340] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.113 [2024-10-07 11:29:02.304360] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.113 [2024-10-07 11:29:02.304509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.113 [2024-10-07 11:29:02.307070] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.113 [2024-10-07 11:29:02.307263] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.113 [2024-10-07 11:29:02.307303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.113 [2024-10-07 11:29:02.307322] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.113 [2024-10-07 11:29:02.307358] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.113 [2024-10-07 11:29:02.307390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.113 [2024-10-07 11:29:02.307425] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.113 [2024-10-07 11:29:02.307442] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.113 [2024-10-07 11:29:02.307476] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.113 [2024-10-07 11:29:02.312885] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.113 [2024-10-07 11:29:02.314011] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.113 [2024-10-07 11:29:02.314060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.113 [2024-10-07 11:29:02.314082] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.113 [2024-10-07 11:29:02.314285] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.113 [2024-10-07 11:29:02.315451] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.113 [2024-10-07 11:29:02.315488] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.113 [2024-10-07 11:29:02.315508] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.113 [2024-10-07 11:29:02.315725] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.113 [2024-10-07 11:29:02.317187] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.113 [2024-10-07 11:29:02.317317] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.113 [2024-10-07 11:29:02.317349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.113 [2024-10-07 11:29:02.317367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.113 [2024-10-07 11:29:02.317415] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.113 [2024-10-07 11:29:02.317451] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.113 [2024-10-07 11:29:02.317468] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.113 [2024-10-07 11:29:02.317507] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.113 [2024-10-07 11:29:02.318529] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.113 [2024-10-07 11:29:02.323636] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.113 [2024-10-07 11:29:02.324022] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.113 [2024-10-07 11:29:02.324068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.113 [2024-10-07 11:29:02.324089] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.113 [2024-10-07 11:29:02.324163] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.113 [2024-10-07 11:29:02.324202] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.113 [2024-10-07 11:29:02.324219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.113 [2024-10-07 11:29:02.324235] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.113 [2024-10-07 11:29:02.324266] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.113 [2024-10-07 11:29:02.327280] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.113 [2024-10-07 11:29:02.327415] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.113 [2024-10-07 11:29:02.327449] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.113 [2024-10-07 11:29:02.327466] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.113 [2024-10-07 11:29:02.328391] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.113 [2024-10-07 11:29:02.328627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.113 [2024-10-07 11:29:02.328662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.113 [2024-10-07 11:29:02.328680] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.113 [2024-10-07 11:29:02.328761] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.113 [2024-10-07 11:29:02.335908] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.113 [2024-10-07 11:29:02.336109] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.113 [2024-10-07 11:29:02.336143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.113 [2024-10-07 11:29:02.336162] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.113 [2024-10-07 11:29:02.336198] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.113 [2024-10-07 11:29:02.336230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.113 [2024-10-07 11:29:02.336248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.113 [2024-10-07 11:29:02.336263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.113 [2024-10-07 11:29:02.336293] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.113 [2024-10-07 11:29:02.338018] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.113 [2024-10-07 11:29:02.338390] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.113 [2024-10-07 11:29:02.338448] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.113 [2024-10-07 11:29:02.338469] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.113 [2024-10-07 11:29:02.338543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.113 [2024-10-07 11:29:02.338600] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.113 [2024-10-07 11:29:02.338622] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.114 [2024-10-07 11:29:02.338636] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.114 [2024-10-07 11:29:02.338667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.114 [2024-10-07 11:29:02.346047] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.114 [2024-10-07 11:29:02.346193] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.114 [2024-10-07 11:29:02.346225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.114 [2024-10-07 11:29:02.346243] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.114 [2024-10-07 11:29:02.346277] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.114 [2024-10-07 11:29:02.347297] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.114 [2024-10-07 11:29:02.347336] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.114 [2024-10-07 11:29:02.347355] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.114 [2024-10-07 11:29:02.347603] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.114 [2024-10-07 11:29:02.350256] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.114 [2024-10-07 11:29:02.350423] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.114 [2024-10-07 11:29:02.350457] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.114 [2024-10-07 11:29:02.350476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.114 [2024-10-07 11:29:02.350510] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.114 [2024-10-07 11:29:02.350542] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.114 [2024-10-07 11:29:02.350559] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.114 [2024-10-07 11:29:02.350574] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.114 [2024-10-07 11:29:02.350604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.114 [2024-10-07 11:29:02.356165] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.114 [2024-10-07 11:29:02.357241] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.114 [2024-10-07 11:29:02.357291] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.114 [2024-10-07 11:29:02.357312] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.114 [2024-10-07 11:29:02.357526] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.114 [2024-10-07 11:29:02.357654] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.114 [2024-10-07 11:29:02.357677] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.114 [2024-10-07 11:29:02.357693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.114 [2024-10-07 11:29:02.357726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.114 [2024-10-07 11:29:02.360371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.114 [2024-10-07 11:29:02.360503] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.114 [2024-10-07 11:29:02.360535] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.114 [2024-10-07 11:29:02.360553] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.114 [2024-10-07 11:29:02.360585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.114 [2024-10-07 11:29:02.360616] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.114 [2024-10-07 11:29:02.360634] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.114 [2024-10-07 11:29:02.360648] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.114 [2024-10-07 11:29:02.360678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.114 [2024-10-07 11:29:02.367100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.114 [2024-10-07 11:29:02.367504] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.114 [2024-10-07 11:29:02.367549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.114 [2024-10-07 11:29:02.367571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.114 [2024-10-07 11:29:02.367646] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.114 [2024-10-07 11:29:02.367685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.114 [2024-10-07 11:29:02.367703] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.114 [2024-10-07 11:29:02.367718] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.114 [2024-10-07 11:29:02.367749] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.114 [2024-10-07 11:29:02.370480] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.114 [2024-10-07 11:29:02.370600] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.114 [2024-10-07 11:29:02.370632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.114 [2024-10-07 11:29:02.370650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.114 [2024-10-07 11:29:02.370682] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.114 [2024-10-07 11:29:02.370713] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.114 [2024-10-07 11:29:02.370730] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.114 [2024-10-07 11:29:02.370745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.114 [2024-10-07 11:29:02.370803] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.114 [2024-10-07 11:29:02.379418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.114 [2024-10-07 11:29:02.379669] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.114 [2024-10-07 11:29:02.379708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.114 [2024-10-07 11:29:02.379727] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.114 [2024-10-07 11:29:02.379765] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.114 [2024-10-07 11:29:02.379798] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.114 [2024-10-07 11:29:02.379816] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.114 [2024-10-07 11:29:02.379832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.114 [2024-10-07 11:29:02.379872] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.114 [2024-10-07 11:29:02.381851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.114 [2024-10-07 11:29:02.382225] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.114 [2024-10-07 11:29:02.382272] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.114 [2024-10-07 11:29:02.382295] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.114 [2024-10-07 11:29:02.382388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.114 [2024-10-07 11:29:02.382468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.114 [2024-10-07 11:29:02.382497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.114 [2024-10-07 11:29:02.382513] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.114 [2024-10-07 11:29:02.382546] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.114 [2024-10-07 11:29:02.389733] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.114 [2024-10-07 11:29:02.389893] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.114 [2024-10-07 11:29:02.389928] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.114 [2024-10-07 11:29:02.389947] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.114 [2024-10-07 11:29:02.389982] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.114 [2024-10-07 11:29:02.390013] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.114 [2024-10-07 11:29:02.390030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.114 [2024-10-07 11:29:02.390045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.114 [2024-10-07 11:29:02.390076] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.114 [2024-10-07 11:29:02.394005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.114 [2024-10-07 11:29:02.394243] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.114 [2024-10-07 11:29:02.394287] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.114 [2024-10-07 11:29:02.394332] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.114 [2024-10-07 11:29:02.394393] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.114 [2024-10-07 11:29:02.394450] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.114 [2024-10-07 11:29:02.394470] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.114 [2024-10-07 11:29:02.394484] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.114 [2024-10-07 11:29:02.394515] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.114 [2024-10-07 11:29:02.399860] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.114 [2024-10-07 11:29:02.399991] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.114 [2024-10-07 11:29:02.400023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.114 [2024-10-07 11:29:02.400040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.114 [2024-10-07 11:29:02.400073] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.115 [2024-10-07 11:29:02.400104] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.115 [2024-10-07 11:29:02.400121] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.115 [2024-10-07 11:29:02.400136] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.115 [2024-10-07 11:29:02.400167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.115 [2024-10-07 11:29:02.404177] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.115 [2024-10-07 11:29:02.404301] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.115 [2024-10-07 11:29:02.404334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.115 [2024-10-07 11:29:02.404351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.115 [2024-10-07 11:29:02.404383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.115 [2024-10-07 11:29:02.404431] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.115 [2024-10-07 11:29:02.404452] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.115 [2024-10-07 11:29:02.404467] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.115 [2024-10-07 11:29:02.404497] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.115 [2024-10-07 11:29:02.410832] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.115 [2024-10-07 11:29:02.411213] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.115 [2024-10-07 11:29:02.411258] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.115 [2024-10-07 11:29:02.411279] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.115 [2024-10-07 11:29:02.411352] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.115 [2024-10-07 11:29:02.411422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.115 [2024-10-07 11:29:02.411475] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.115 [2024-10-07 11:29:02.411492] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.115 [2024-10-07 11:29:02.411525] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.115 [2024-10-07 11:29:02.414277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.115 [2024-10-07 11:29:02.414394] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.115 [2024-10-07 11:29:02.414439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.115 [2024-10-07 11:29:02.414458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.115 [2024-10-07 11:29:02.414491] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.115 [2024-10-07 11:29:02.414522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.115 [2024-10-07 11:29:02.414540] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.115 [2024-10-07 11:29:02.414554] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.115 [2024-10-07 11:29:02.414585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.115 [2024-10-07 11:29:02.423179] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.115 [2024-10-07 11:29:02.423564] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.115 [2024-10-07 11:29:02.423622] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.115 [2024-10-07 11:29:02.423650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.115 [2024-10-07 11:29:02.423724] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.115 [2024-10-07 11:29:02.423791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.115 [2024-10-07 11:29:02.423818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.115 [2024-10-07 11:29:02.423841] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.115 [2024-10-07 11:29:02.423881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.115 [2024-10-07 11:29:02.425951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.115 [2024-10-07 11:29:02.426164] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.115 [2024-10-07 11:29:02.426216] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.115 [2024-10-07 11:29:02.426242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.115 [2024-10-07 11:29:02.426285] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.115 [2024-10-07 11:29:02.426324] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.115 [2024-10-07 11:29:02.426348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.115 [2024-10-07 11:29:02.426368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.115 [2024-10-07 11:29:02.426423] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.115 [2024-10-07 11:29:02.433861] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.115 [2024-10-07 11:29:02.434056] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.115 [2024-10-07 11:29:02.434093] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.115 [2024-10-07 11:29:02.434112] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.115 [2024-10-07 11:29:02.434149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.115 [2024-10-07 11:29:02.434181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.115 [2024-10-07 11:29:02.434198] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.115 [2024-10-07 11:29:02.434213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.115 [2024-10-07 11:29:02.434245] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.115 [2024-10-07 11:29:02.438491] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.115 [2024-10-07 11:29:02.438707] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.115 [2024-10-07 11:29:02.438767] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.115 [2024-10-07 11:29:02.438801] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.115 [2024-10-07 11:29:02.438857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.115 [2024-10-07 11:29:02.438909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.115 [2024-10-07 11:29:02.438940] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.115 [2024-10-07 11:29:02.438969] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.115 [2024-10-07 11:29:02.439018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.115 [2024-10-07 11:29:02.444030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.115 [2024-10-07 11:29:02.444177] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.115 [2024-10-07 11:29:02.444212] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.115 [2024-10-07 11:29:02.444231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.115 [2024-10-07 11:29:02.444265] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.115 [2024-10-07 11:29:02.444297] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.115 [2024-10-07 11:29:02.444315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.115 [2024-10-07 11:29:02.444330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.115 [2024-10-07 11:29:02.444361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.115 [2024-10-07 11:29:02.448618] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.115 [2024-10-07 11:29:02.448756] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.115 [2024-10-07 11:29:02.448789] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.115 [2024-10-07 11:29:02.448842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.115 [2024-10-07 11:29:02.448880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.115 [2024-10-07 11:29:02.448913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.115 [2024-10-07 11:29:02.448930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.115 [2024-10-07 11:29:02.448944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.115 [2024-10-07 11:29:02.448975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.116 [2024-10-07 11:29:02.455453] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.116 [2024-10-07 11:29:02.455904] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.116 [2024-10-07 11:29:02.455954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.116 [2024-10-07 11:29:02.455976] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.116 [2024-10-07 11:29:02.456052] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.116 [2024-10-07 11:29:02.456092] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.116 [2024-10-07 11:29:02.456110] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.116 [2024-10-07 11:29:02.456125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.116 [2024-10-07 11:29:02.456156] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.116 [2024-10-07 11:29:02.458775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.116 [2024-10-07 11:29:02.458944] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.116 [2024-10-07 11:29:02.458990] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.116 [2024-10-07 11:29:02.459011] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.116 [2024-10-07 11:29:02.459048] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.116 [2024-10-07 11:29:02.459080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.116 [2024-10-07 11:29:02.459098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.116 [2024-10-07 11:29:02.459113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.116 [2024-10-07 11:29:02.459143] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.116 [2024-10-07 11:29:02.468286] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.116 [2024-10-07 11:29:02.468523] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.116 [2024-10-07 11:29:02.468561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.116 [2024-10-07 11:29:02.468580] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.116 [2024-10-07 11:29:02.468616] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.116 [2024-10-07 11:29:02.468649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.116 [2024-10-07 11:29:02.468701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.116 [2024-10-07 11:29:02.468718] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.116 [2024-10-07 11:29:02.468752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.116 [2024-10-07 11:29:02.470264] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.116 [2024-10-07 11:29:02.470636] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.116 [2024-10-07 11:29:02.470681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.116 [2024-10-07 11:29:02.470701] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.116 [2024-10-07 11:29:02.470773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.116 [2024-10-07 11:29:02.470833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.116 [2024-10-07 11:29:02.470854] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.116 [2024-10-07 11:29:02.470868] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.116 [2024-10-07 11:29:02.470900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.116 [2024-10-07 11:29:02.478551] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.116 [2024-10-07 11:29:02.478744] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.116 [2024-10-07 11:29:02.478780] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.116 [2024-10-07 11:29:02.478799] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.116 [2024-10-07 11:29:02.478834] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.116 [2024-10-07 11:29:02.478867] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.116 [2024-10-07 11:29:02.478884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.116 [2024-10-07 11:29:02.478899] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.116 [2024-10-07 11:29:02.478933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.116 [2024-10-07 11:29:02.480371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.116 [2024-10-07 11:29:02.480519] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.116 [2024-10-07 11:29:02.480577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.116 [2024-10-07 11:29:02.480610] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.116 [2024-10-07 11:29:02.481960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.116 [2024-10-07 11:29:02.483196] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.116 [2024-10-07 11:29:02.483239] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.116 [2024-10-07 11:29:02.483259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.116 [2024-10-07 11:29:02.483500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.116 [2024-10-07 11:29:02.488715] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.116 [2024-10-07 11:29:02.488975] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.116 [2024-10-07 11:29:02.489024] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.116 [2024-10-07 11:29:02.489045] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.116 [2024-10-07 11:29:02.489113] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.116 [2024-10-07 11:29:02.489148] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.116 [2024-10-07 11:29:02.489166] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.116 [2024-10-07 11:29:02.489182] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.116 [2024-10-07 11:29:02.489214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.116 [2024-10-07 11:29:02.490673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.116 [2024-10-07 11:29:02.490816] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.116 [2024-10-07 11:29:02.490850] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.116 [2024-10-07 11:29:02.490868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.116 [2024-10-07 11:29:02.490903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.116 [2024-10-07 11:29:02.490934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.116 [2024-10-07 11:29:02.490951] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.116 [2024-10-07 11:29:02.490966] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.116 [2024-10-07 11:29:02.491001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.116 [2024-10-07 11:29:02.499444] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.116 [2024-10-07 11:29:02.499866] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.116 [2024-10-07 11:29:02.499926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.116 [2024-10-07 11:29:02.499954] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.116 [2024-10-07 11:29:02.500145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.116 [2024-10-07 11:29:02.500229] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.116 [2024-10-07 11:29:02.500259] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.116 [2024-10-07 11:29:02.500281] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.116 [2024-10-07 11:29:02.500322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.116 [2024-10-07 11:29:02.500798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.116 [2024-10-07 11:29:02.500947] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.116 [2024-10-07 11:29:02.501003] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.116 [2024-10-07 11:29:02.501036] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.116 [2024-10-07 11:29:02.501147] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.116 [2024-10-07 11:29:02.501200] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.116 [2024-10-07 11:29:02.501229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.116 [2024-10-07 11:29:02.501256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.116 [2024-10-07 11:29:02.502105] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.116 [2024-10-07 11:29:02.511088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.116 [2024-10-07 11:29:02.511367] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.116 [2024-10-07 11:29:02.511428] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.116 [2024-10-07 11:29:02.511457] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.116 [2024-10-07 11:29:02.512540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.116 [2024-10-07 11:29:02.512608] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.116 [2024-10-07 11:29:02.512868] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.117 [2024-10-07 11:29:02.512912] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.117 [2024-10-07 11:29:02.512932] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.117 [2024-10-07 11:29:02.512948] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.117 [2024-10-07 11:29:02.512962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.117 [2024-10-07 11:29:02.512978] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.117 [2024-10-07 11:29:02.513119] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.117 [2024-10-07 11:29:02.513147] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.117 [2024-10-07 11:29:02.514380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.117 [2024-10-07 11:29:02.514439] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.117 [2024-10-07 11:29:02.514459] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.117 [2024-10-07 11:29:02.515753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.117 [2024-10-07 11:29:02.521300] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.117 [2024-10-07 11:29:02.521519] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.117 [2024-10-07 11:29:02.521558] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.117 [2024-10-07 11:29:02.521579] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.117 [2024-10-07 11:29:02.521615] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.117 [2024-10-07 11:29:02.521648] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.117 [2024-10-07 11:29:02.521665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.117 [2024-10-07 11:29:02.521715] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.117 [2024-10-07 11:29:02.522728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.117 [2024-10-07 11:29:02.523107] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.117 [2024-10-07 11:29:02.524419] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.117 [2024-10-07 11:29:02.524473] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.117 [2024-10-07 11:29:02.524500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.117 [2024-10-07 11:29:02.524769] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.117 [2024-10-07 11:29:02.525953] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.117 [2024-10-07 11:29:02.526008] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.117 [2024-10-07 11:29:02.526036] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.117 [2024-10-07 11:29:02.527510] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.117 [2024-10-07 11:29:02.531500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.117 [2024-10-07 11:29:02.531680] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.117 [2024-10-07 11:29:02.531718] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.117 [2024-10-07 11:29:02.531737] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.117 [2024-10-07 11:29:02.532599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.117 [2024-10-07 11:29:02.533508] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.117 [2024-10-07 11:29:02.533573] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.117 [2024-10-07 11:29:02.533613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.117 [2024-10-07 11:29:02.534079] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.117 [2024-10-07 11:29:02.534224] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.117 [2024-10-07 11:29:02.534417] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.117 [2024-10-07 11:29:02.534491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.117 [2024-10-07 11:29:02.534531] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.117 [2024-10-07 11:29:02.534594] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.117 [2024-10-07 11:29:02.534650] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.117 [2024-10-07 11:29:02.534685] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.117 [2024-10-07 11:29:02.534711] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.117 [2024-10-07 11:29:02.534769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.117 [2024-10-07 11:29:02.542174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.117 [2024-10-07 11:29:02.542463] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.117 [2024-10-07 11:29:02.542556] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.117 [2024-10-07 11:29:02.542596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.117 [2024-10-07 11:29:02.543783] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.117 [2024-10-07 11:29:02.544060] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.117 [2024-10-07 11:29:02.544106] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.117 [2024-10-07 11:29:02.544131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.117 [2024-10-07 11:29:02.544266] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.117 [2024-10-07 11:29:02.547461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.117 [2024-10-07 11:29:02.548428] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.117 [2024-10-07 11:29:02.548478] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.117 [2024-10-07 11:29:02.548501] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.117 [2024-10-07 11:29:02.549443] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.117 [2024-10-07 11:29:02.549587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.117 [2024-10-07 11:29:02.549614] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.117 [2024-10-07 11:29:02.549631] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.117 [2024-10-07 11:29:02.549666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.117 [2024-10-07 11:29:02.552573] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.117 [2024-10-07 11:29:02.552728] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.117 [2024-10-07 11:29:02.552769] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.117 [2024-10-07 11:29:02.552793] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.117 [2024-10-07 11:29:02.552835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.117 [2024-10-07 11:29:02.552874] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.117 [2024-10-07 11:29:02.552898] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.117 [2024-10-07 11:29:02.552919] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.117 [2024-10-07 11:29:02.552959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.117 [2024-10-07 11:29:02.557745] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.117 [2024-10-07 11:29:02.557971] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.117 [2024-10-07 11:29:02.558015] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.117 [2024-10-07 11:29:02.558035] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.117 [2024-10-07 11:29:02.558072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.117 [2024-10-07 11:29:02.558133] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.117 [2024-10-07 11:29:02.558152] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.117 [2024-10-07 11:29:02.558167] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.117 [2024-10-07 11:29:02.559204] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.117 [2024-10-07 11:29:02.562698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.117 [2024-10-07 11:29:02.562927] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.117 [2024-10-07 11:29:02.562977] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.117 [2024-10-07 11:29:02.563008] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.117 [2024-10-07 11:29:02.563064] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.117 [2024-10-07 11:29:02.563106] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.117 [2024-10-07 11:29:02.563134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.117 [2024-10-07 11:29:02.563163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.117 [2024-10-07 11:29:02.563213] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.117 [2024-10-07 11:29:02.568226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.117 [2024-10-07 11:29:02.568476] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.117 [2024-10-07 11:29:02.568537] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.117 [2024-10-07 11:29:02.568561] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.117 [2024-10-07 11:29:02.568601] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.118 [2024-10-07 11:29:02.568635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.118 [2024-10-07 11:29:02.568653] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.118 [2024-10-07 11:29:02.568669] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.118 [2024-10-07 11:29:02.568702] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.118 [2024-10-07 11:29:02.573224] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.118 [2024-10-07 11:29:02.573387] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.118 [2024-10-07 11:29:02.573441] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.118 [2024-10-07 11:29:02.573468] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.118 [2024-10-07 11:29:02.573518] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.118 [2024-10-07 11:29:02.573552] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.118 [2024-10-07 11:29:02.573570] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.118 [2024-10-07 11:29:02.573585] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.118 [2024-10-07 11:29:02.573647] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.118 [2024-10-07 11:29:02.578421] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.118 [2024-10-07 11:29:02.578793] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.118 [2024-10-07 11:29:02.578852] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.118 [2024-10-07 11:29:02.578894] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.118 [2024-10-07 11:29:02.579054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.118 [2024-10-07 11:29:02.579156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.118 [2024-10-07 11:29:02.579192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.118 [2024-10-07 11:29:02.579211] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.118 [2024-10-07 11:29:02.579246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.118 [2024-10-07 11:29:02.583361] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.118 [2024-10-07 11:29:02.583600] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.118 [2024-10-07 11:29:02.583665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.118 [2024-10-07 11:29:02.583699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.118 [2024-10-07 11:29:02.583754] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.118 [2024-10-07 11:29:02.583803] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.118 [2024-10-07 11:29:02.583822] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.118 [2024-10-07 11:29:02.583838] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.118 [2024-10-07 11:29:02.583871] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.118 [2024-10-07 11:29:02.588586] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.118 [2024-10-07 11:29:02.589752] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.118 [2024-10-07 11:29:02.589803] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.118 [2024-10-07 11:29:02.589826] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.118 [2024-10-07 11:29:02.590029] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.118 [2024-10-07 11:29:02.590109] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.118 [2024-10-07 11:29:02.590134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.118 [2024-10-07 11:29:02.590150] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.118 [2024-10-07 11:29:02.590184] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.118 [2024-10-07 11:29:02.594479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.118 [2024-10-07 11:29:02.594645] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.118 [2024-10-07 11:29:02.594681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.118 [2024-10-07 11:29:02.594733] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.118 [2024-10-07 11:29:02.594772] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.118 [2024-10-07 11:29:02.594804] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.118 [2024-10-07 11:29:02.594822] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.118 [2024-10-07 11:29:02.594837] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.118 [2024-10-07 11:29:02.594869] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.118 [2024-10-07 11:29:02.598701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.118 [2024-10-07 11:29:02.599748] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.118 [2024-10-07 11:29:02.599810] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.118 [2024-10-07 11:29:02.599834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.118 [2024-10-07 11:29:02.600039] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.118 [2024-10-07 11:29:02.600223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.118 [2024-10-07 11:29:02.600263] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.118 [2024-10-07 11:29:02.600283] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.118 [2024-10-07 11:29:02.600349] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.119 [2024-10-07 11:29:02.605287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.119 [2024-10-07 11:29:02.605486] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.119 [2024-10-07 11:29:02.605524] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.119 [2024-10-07 11:29:02.605544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.119 [2024-10-07 11:29:02.605582] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.119 [2024-10-07 11:29:02.605615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.119 [2024-10-07 11:29:02.605632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.119 [2024-10-07 11:29:02.605648] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.119 [2024-10-07 11:29:02.605679] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.119 [2024-10-07 11:29:02.609779] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.119 [2024-10-07 11:29:02.609930] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.119 [2024-10-07 11:29:02.609964] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.119 [2024-10-07 11:29:02.609983] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.119 [2024-10-07 11:29:02.610017] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.119 [2024-10-07 11:29:02.610047] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.119 [2024-10-07 11:29:02.610094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.119 [2024-10-07 11:29:02.610110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.119 [2024-10-07 11:29:02.610142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.119 [2024-10-07 11:29:02.615751] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.119 [2024-10-07 11:29:02.615925] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.119 [2024-10-07 11:29:02.615961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.119 [2024-10-07 11:29:02.615979] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.119 [2024-10-07 11:29:02.616015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.119 [2024-10-07 11:29:02.616046] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.119 [2024-10-07 11:29:02.616064] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.119 [2024-10-07 11:29:02.616079] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.119 [2024-10-07 11:29:02.616109] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.119 [2024-10-07 11:29:02.620124] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.119 [2024-10-07 11:29:02.620283] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.119 [2024-10-07 11:29:02.620317] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.119 [2024-10-07 11:29:02.620337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.119 [2024-10-07 11:29:02.620372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.119 [2024-10-07 11:29:02.620421] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.119 [2024-10-07 11:29:02.620443] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.119 [2024-10-07 11:29:02.620460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.119 [2024-10-07 11:29:02.620528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.119 [2024-10-07 11:29:02.628829] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.119 [2024-10-07 11:29:02.630258] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.119 [2024-10-07 11:29:02.630335] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.119 [2024-10-07 11:29:02.630372] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.119 [2024-10-07 11:29:02.630585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.119 [2024-10-07 11:29:02.630676] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.119 [2024-10-07 11:29:02.630710] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.119 [2024-10-07 11:29:02.630736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.119 [2024-10-07 11:29:02.630788] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.119 [2024-10-07 11:29:02.630865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.119 [2024-10-07 11:29:02.630994] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.119 [2024-10-07 11:29:02.631051] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.119 [2024-10-07 11:29:02.631081] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.119 [2024-10-07 11:29:02.631132] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.119 [2024-10-07 11:29:02.631188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.119 [2024-10-07 11:29:02.631222] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.119 [2024-10-07 11:29:02.631250] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.119 [2024-10-07 11:29:02.631302] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.119 [2024-10-07 11:29:02.640095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.119 [2024-10-07 11:29:02.641796] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.119 [2024-10-07 11:29:02.641870] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.119 [2024-10-07 11:29:02.641908] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.119 [2024-10-07 11:29:02.643451] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.119 [2024-10-07 11:29:02.643807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.119 [2024-10-07 11:29:02.643882] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.119 [2024-10-07 11:29:02.643912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.119 [2024-10-07 11:29:02.643938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.119 [2024-10-07 11:29:02.644042] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.119 [2024-10-07 11:29:02.644134] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.119 [2024-10-07 11:29:02.644170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.119 [2024-10-07 11:29:02.644196] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.119 [2024-10-07 11:29:02.644244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.119 [2024-10-07 11:29:02.644289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.119 [2024-10-07 11:29:02.644315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.119 [2024-10-07 11:29:02.644337] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.119 [2024-10-07 11:29:02.644378] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.119 [2024-10-07 11:29:02.652581] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.119 [2024-10-07 11:29:02.653101] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.119 [2024-10-07 11:29:02.653166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.119 [2024-10-07 11:29:02.653199] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.119 [2024-10-07 11:29:02.654513] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.119 [2024-10-07 11:29:02.656096] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.119 [2024-10-07 11:29:02.656161] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.120 [2024-10-07 11:29:02.656192] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.120 [2024-10-07 11:29:02.656500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.120 [2024-10-07 11:29:02.656555] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.120 [2024-10-07 11:29:02.656783] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.120 [2024-10-07 11:29:02.656838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.120 [2024-10-07 11:29:02.656870] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.120 [2024-10-07 11:29:02.658421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.120 [2024-10-07 11:29:02.660048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.120 [2024-10-07 11:29:02.660119] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.120 [2024-10-07 11:29:02.660151] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.120 [2024-10-07 11:29:02.661289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.120 [2024-10-07 11:29:02.663987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.120 [2024-10-07 11:29:02.664194] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.120 [2024-10-07 11:29:02.664262] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.120 [2024-10-07 11:29:02.664298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.120 [2024-10-07 11:29:02.665559] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.120 [2024-10-07 11:29:02.665913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.120 [2024-10-07 11:29:02.665960] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.120 [2024-10-07 11:29:02.665980] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.120 [2024-10-07 11:29:02.666100] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.120 [2024-10-07 11:29:02.668747] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.120 [2024-10-07 11:29:02.670277] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.120 [2024-10-07 11:29:02.670354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.120 [2024-10-07 11:29:02.670395] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.120 [2024-10-07 11:29:02.672340] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.120 [2024-10-07 11:29:02.673945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.120 [2024-10-07 11:29:02.674023] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.120 [2024-10-07 11:29:02.674103] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.120 [2024-10-07 11:29:02.675321] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.120 [2024-10-07 11:29:02.676503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.120 [2024-10-07 11:29:02.676669] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.120 [2024-10-07 11:29:02.676715] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.120 [2024-10-07 11:29:02.676737] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.120 [2024-10-07 11:29:02.676773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.120 [2024-10-07 11:29:02.676806] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.120 [2024-10-07 11:29:02.676822] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.120 [2024-10-07 11:29:02.676837] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.120 [2024-10-07 11:29:02.676868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.120 [2024-10-07 11:29:02.678902] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.120 [2024-10-07 11:29:02.679029] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.120 [2024-10-07 11:29:02.679061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.120 [2024-10-07 11:29:02.679088] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.120 [2024-10-07 11:29:02.679120] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.120 [2024-10-07 11:29:02.679152] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.120 [2024-10-07 11:29:02.679169] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.120 [2024-10-07 11:29:02.679183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.120 [2024-10-07 11:29:02.679214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.120 [2024-10-07 11:29:02.689519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.120 [2024-10-07 11:29:02.690637] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.120 [2024-10-07 11:29:02.690690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.120 [2024-10-07 11:29:02.690713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.120 [2024-10-07 11:29:02.690829] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.120 [2024-10-07 11:29:02.690874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.120 [2024-10-07 11:29:02.690952] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.120 [2024-10-07 11:29:02.690981] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.120 [2024-10-07 11:29:02.690998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.120 [2024-10-07 11:29:02.691013] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.120 [2024-10-07 11:29:02.691060] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.120 [2024-10-07 11:29:02.691076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.120 [2024-10-07 11:29:02.691112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.120 [2024-10-07 11:29:02.691134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.120 [2024-10-07 11:29:02.691162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.120 [2024-10-07 11:29:02.691178] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.120 [2024-10-07 11:29:02.691192] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.120 [2024-10-07 11:29:02.691220] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.120 [2024-10-07 11:29:02.700076] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.120 [2024-10-07 11:29:02.700283] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.120 [2024-10-07 11:29:02.700321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.120 [2024-10-07 11:29:02.700340] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.120 [2024-10-07 11:29:02.701627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.120 [2024-10-07 11:29:02.703126] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.120 [2024-10-07 11:29:02.703205] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.120 [2024-10-07 11:29:02.703240] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.120 [2024-10-07 11:29:02.704481] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.120 [2024-10-07 11:29:02.704552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.120 [2024-10-07 11:29:02.705660] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.120 [2024-10-07 11:29:02.705729] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.120 [2024-10-07 11:29:02.705765] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.120 [2024-10-07 11:29:02.705927] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.120 [2024-10-07 11:29:02.706012] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.120 [2024-10-07 11:29:02.706059] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.120 [2024-10-07 11:29:02.706091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.120 [2024-10-07 11:29:02.706146] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.120 [2024-10-07 11:29:02.713016] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.120 [2024-10-07 11:29:02.713584] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.120 [2024-10-07 11:29:02.713651] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.120 [2024-10-07 11:29:02.713686] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.120 [2024-10-07 11:29:02.714979] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.120 [2024-10-07 11:29:02.716832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.120 [2024-10-07 11:29:02.716897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.120 [2024-10-07 11:29:02.716930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.120 [2024-10-07 11:29:02.718371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.120 [2024-10-07 11:29:02.718458] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.120 [2024-10-07 11:29:02.719725] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.120 [2024-10-07 11:29:02.719791] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.120 [2024-10-07 11:29:02.719826] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.120 [2024-10-07 11:29:02.720916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.120 [2024-10-07 11:29:02.721142] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.120 [2024-10-07 11:29:02.721195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.120 [2024-10-07 11:29:02.721236] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.120 [2024-10-07 11:29:02.721293] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.120 [2024-10-07 11:29:02.723232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.121 [2024-10-07 11:29:02.723428] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.121 [2024-10-07 11:29:02.723477] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.121 [2024-10-07 11:29:02.723506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.121 [2024-10-07 11:29:02.724639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.121 [2024-10-07 11:29:02.724958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.121 [2024-10-07 11:29:02.725010] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.121 [2024-10-07 11:29:02.725040] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.121 [2024-10-07 11:29:02.725215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.121 [2024-10-07 11:29:02.732581] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.121 [2024-10-07 11:29:02.733953] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.121 [2024-10-07 11:29:02.734020] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.121 [2024-10-07 11:29:02.734055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.121 [2024-10-07 11:29:02.735148] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.121 [2024-10-07 11:29:02.735329] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.121 [2024-10-07 11:29:02.735414] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.121 [2024-10-07 11:29:02.735491] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.121 [2024-10-07 11:29:02.735520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.121 [2024-10-07 11:29:02.735571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.121 [2024-10-07 11:29:02.735661] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.121 [2024-10-07 11:29:02.735700] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.121 [2024-10-07 11:29:02.735726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.121 [2024-10-07 11:29:02.735774] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.121 [2024-10-07 11:29:02.735820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.121 [2024-10-07 11:29:02.735847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.121 [2024-10-07 11:29:02.735870] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.121 [2024-10-07 11:29:02.735914] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.121 [2024-10-07 11:29:02.743938] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.121 [2024-10-07 11:29:02.745612] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.121 [2024-10-07 11:29:02.745679] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.121 [2024-10-07 11:29:02.745713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.121 [2024-10-07 11:29:02.747109] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.121 [2024-10-07 11:29:02.748286] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.121 [2024-10-07 11:29:02.748366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.121 [2024-10-07 11:29:02.748419] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.121 [2024-10-07 11:29:02.748451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.121 [2024-10-07 11:29:02.749533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.121 [2024-10-07 11:29:02.749662] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.121 [2024-10-07 11:29:02.749704] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.121 [2024-10-07 11:29:02.749732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.121 [2024-10-07 11:29:02.749888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.121 [2024-10-07 11:29:02.749958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.121 [2024-10-07 11:29:02.749989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.121 [2024-10-07 11:29:02.750015] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.121 [2024-10-07 11:29:02.750061] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.121 [2024-10-07 11:29:02.754357] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.121 [2024-10-07 11:29:02.754575] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.121 [2024-10-07 11:29:02.754658] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.121 [2024-10-07 11:29:02.754689] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.121 [2024-10-07 11:29:02.756029] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.121 [2024-10-07 11:29:02.756358] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.121 [2024-10-07 11:29:02.756430] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.121 [2024-10-07 11:29:02.756464] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.121 [2024-10-07 11:29:02.757709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.121 [2024-10-07 11:29:02.759578] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.121 [2024-10-07 11:29:02.761182] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.121 [2024-10-07 11:29:02.761248] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.121 [2024-10-07 11:29:02.761282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.121 [2024-10-07 11:29:02.762764] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.121 [2024-10-07 11:29:02.763125] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.121 [2024-10-07 11:29:02.763179] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.121 [2024-10-07 11:29:02.763210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.121 [2024-10-07 11:29:02.763295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.121 [2024-10-07 11:29:02.765475] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.121 [2024-10-07 11:29:02.765640] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.121 [2024-10-07 11:29:02.765698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.121 [2024-10-07 11:29:02.765730] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.121 [2024-10-07 11:29:02.765781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.121 [2024-10-07 11:29:02.765827] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.121 [2024-10-07 11:29:02.765855] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.121 [2024-10-07 11:29:02.765879] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.121 [2024-10-07 11:29:02.765923] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.121 [2024-10-07 11:29:02.770710] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.121 [2024-10-07 11:29:02.772198] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.121 [2024-10-07 11:29:02.772263] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.121 [2024-10-07 11:29:02.772295] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.121 [2024-10-07 11:29:02.773777] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.121 [2024-10-07 11:29:02.774140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.121 [2024-10-07 11:29:02.774194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.121 [2024-10-07 11:29:02.774225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.121 [2024-10-07 11:29:02.775472] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.121 [2024-10-07 11:29:02.779951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.121 [2024-10-07 11:29:02.781309] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.121 [2024-10-07 11:29:02.781380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.121 [2024-10-07 11:29:02.781433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.121 [2024-10-07 11:29:02.781611] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.121 [2024-10-07 11:29:02.781692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.121 [2024-10-07 11:29:02.781746] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.121 [2024-10-07 11:29:02.781773] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.121 [2024-10-07 11:29:02.781798] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.121 [2024-10-07 11:29:02.782864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.121 [2024-10-07 11:29:02.783012] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.121 [2024-10-07 11:29:02.783062] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.121 [2024-10-07 11:29:02.783099] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.121 [2024-10-07 11:29:02.783371] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.121 [2024-10-07 11:29:02.784712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.121 [2024-10-07 11:29:02.784770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.121 [2024-10-07 11:29:02.784799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.121 [2024-10-07 11:29:02.785169] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.121 [2024-10-07 11:29:02.794723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.121 [2024-10-07 11:29:02.794857] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.121 [2024-10-07 11:29:02.796357] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.121 [2024-10-07 11:29:02.796466] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.121 [2024-10-07 11:29:02.796509] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.121 [2024-10-07 11:29:02.796614] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.121 [2024-10-07 11:29:02.796660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.122 [2024-10-07 11:29:02.796694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.122 [2024-10-07 11:29:02.798021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.122 [2024-10-07 11:29:02.798107] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.122 [2024-10-07 11:29:02.798432] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.122 [2024-10-07 11:29:02.798495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.122 [2024-10-07 11:29:02.798534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.122 [2024-10-07 11:29:02.798581] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.122 [2024-10-07 11:29:02.798614] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.122 [2024-10-07 11:29:02.798642] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.122 [2024-10-07 11:29:02.800083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.122 [2024-10-07 11:29:02.800156] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.122 [2024-10-07 11:29:02.806112] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.122 [2024-10-07 11:29:02.806219] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.122 [2024-10-07 11:29:02.808219] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.122 [2024-10-07 11:29:02.808291] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.122 [2024-10-07 11:29:02.808326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.122 [2024-10-07 11:29:02.808438] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.122 [2024-10-07 11:29:02.808481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.122 [2024-10-07 11:29:02.808509] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.122 [2024-10-07 11:29:02.810214] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.122 [2024-10-07 11:29:02.810299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.122 [2024-10-07 11:29:02.811623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.122 [2024-10-07 11:29:02.811704] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.122 [2024-10-07 11:29:02.811744] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.122 [2024-10-07 11:29:02.811787] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.122 [2024-10-07 11:29:02.811818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.122 [2024-10-07 11:29:02.811847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.122 [2024-10-07 11:29:02.813112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.122 [2024-10-07 11:29:02.813175] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.122 [2024-10-07 11:29:02.818296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.122 [2024-10-07 11:29:02.818443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.122 [2024-10-07 11:29:02.820332] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.122 [2024-10-07 11:29:02.820500] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.122 [2024-10-07 11:29:02.820547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.122 [2024-10-07 11:29:02.820651] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.122 [2024-10-07 11:29:02.820698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.122 [2024-10-07 11:29:02.820732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.122 [2024-10-07 11:29:02.821120] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.122 [2024-10-07 11:29:02.821196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.122 [2024-10-07 11:29:02.822675] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.122 [2024-10-07 11:29:02.822750] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.122 [2024-10-07 11:29:02.822792] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.122 [2024-10-07 11:29:02.822839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.122 [2024-10-07 11:29:02.822872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.122 [2024-10-07 11:29:02.822899] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.122 [2024-10-07 11:29:02.825123] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.122 [2024-10-07 11:29:02.825197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.122 [2024-10-07 11:29:02.831245] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.122 [2024-10-07 11:29:02.831360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.122 [2024-10-07 11:29:02.832314] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.122 [2024-10-07 11:29:02.832419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.122 [2024-10-07 11:29:02.832462] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.122 [2024-10-07 11:29:02.832558] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.122 [2024-10-07 11:29:02.832608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.122 [2024-10-07 11:29:02.832641] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.122 [2024-10-07 11:29:02.833776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.122 [2024-10-07 11:29:02.833852] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.122 [2024-10-07 11:29:02.834831] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.122 [2024-10-07 11:29:02.834902] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.122 [2024-10-07 11:29:02.834941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.122 [2024-10-07 11:29:02.834981] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.122 [2024-10-07 11:29:02.835013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.122 [2024-10-07 11:29:02.835083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.122 [2024-10-07 11:29:02.835417] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.122 [2024-10-07 11:29:02.835469] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.122 [2024-10-07 11:29:02.843452] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.122 [2024-10-07 11:29:02.843620] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.122 [2024-10-07 11:29:02.845012] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.122 [2024-10-07 11:29:02.845115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.122 [2024-10-07 11:29:02.845160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.122 [2024-10-07 11:29:02.845263] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.122 [2024-10-07 11:29:02.845309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.122 [2024-10-07 11:29:02.845343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.122 [2024-10-07 11:29:02.846694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.122 [2024-10-07 11:29:02.846772] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.122 [2024-10-07 11:29:02.848024] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.122 [2024-10-07 11:29:02.848099] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.122 [2024-10-07 11:29:02.848140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.122 [2024-10-07 11:29:02.848188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.122 [2024-10-07 11:29:02.848219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.122 [2024-10-07 11:29:02.848248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.122 [2024-10-07 11:29:02.849197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.122 [2024-10-07 11:29:02.849257] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.122 [2024-10-07 11:29:02.856510] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.122 [2024-10-07 11:29:02.856660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.122 [2024-10-07 11:29:02.857328] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.122 [2024-10-07 11:29:02.857436] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.122 [2024-10-07 11:29:02.857482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.122 [2024-10-07 11:29:02.857585] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.122 [2024-10-07 11:29:02.857630] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.122 [2024-10-07 11:29:02.857662] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.122 [2024-10-07 11:29:02.858576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.122 [2024-10-07 11:29:02.858688] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.122 [2024-10-07 11:29:02.859840] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.122 [2024-10-07 11:29:02.859911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.122 [2024-10-07 11:29:02.859951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.122 [2024-10-07 11:29:02.859993] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.122 [2024-10-07 11:29:02.860023] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.122 [2024-10-07 11:29:02.860052] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.122 [2024-10-07 11:29:02.860952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.122 [2024-10-07 11:29:02.861012] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.122 [2024-10-07 11:29:02.868722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.122 [2024-10-07 11:29:02.868868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.122 [2024-10-07 11:29:02.869989] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.122 [2024-10-07 11:29:02.870068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.123 [2024-10-07 11:29:02.870123] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.123 [2024-10-07 11:29:02.870221] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.123 [2024-10-07 11:29:02.870266] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.123 [2024-10-07 11:29:02.870298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.123 [2024-10-07 11:29:02.870711] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.123 [2024-10-07 11:29:02.870791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.123 [2024-10-07 11:29:02.872189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.123 [2024-10-07 11:29:02.872257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.123 [2024-10-07 11:29:02.872298] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.123 [2024-10-07 11:29:02.872335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.123 [2024-10-07 11:29:02.872366] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.123 [2024-10-07 11:29:02.872395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.123 [2024-10-07 11:29:02.873368] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.123 [2024-10-07 11:29:02.873460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.123 [2024-10-07 11:29:02.881635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.123 [2024-10-07 11:29:02.881785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.123 [2024-10-07 11:29:02.883359] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.123 [2024-10-07 11:29:02.883449] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.123 [2024-10-07 11:29:02.883535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.123 [2024-10-07 11:29:02.883638] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.123 [2024-10-07 11:29:02.883682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.123 [2024-10-07 11:29:02.883715] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.123 [2024-10-07 11:29:02.884901] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.123 [2024-10-07 11:29:02.884971] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.123 [2024-10-07 11:29:02.885926] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.123 [2024-10-07 11:29:02.886000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.123 [2024-10-07 11:29:02.886040] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.123 [2024-10-07 11:29:02.886082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.123 [2024-10-07 11:29:02.886114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.123 [2024-10-07 11:29:02.886149] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.123 [2024-10-07 11:29:02.887281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.123 [2024-10-07 11:29:02.887346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.123 [2024-10-07 11:29:02.895065] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.123 [2024-10-07 11:29:02.895218] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.123 [2024-10-07 11:29:02.895741] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.123 [2024-10-07 11:29:02.895811] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.123 [2024-10-07 11:29:02.895850] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.123 [2024-10-07 11:29:02.895937] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.123 [2024-10-07 11:29:02.895975] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.123 [2024-10-07 11:29:02.896003] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.123 [2024-10-07 11:29:02.897845] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.123 [2024-10-07 11:29:02.897935] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.123 [2024-10-07 11:29:02.899027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.123 [2024-10-07 11:29:02.899091] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.123 [2024-10-07 11:29:02.899126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.123 [2024-10-07 11:29:02.899171] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.123 [2024-10-07 11:29:02.899200] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.123 [2024-10-07 11:29:02.899270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.123 [2024-10-07 11:29:02.900737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.123 [2024-10-07 11:29:02.900805] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.123 [2024-10-07 11:29:02.907774] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.123 [2024-10-07 11:29:02.907898] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.123 [2024-10-07 11:29:02.910270] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.123 [2024-10-07 11:29:02.910345] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.123 [2024-10-07 11:29:02.910381] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.123 [2024-10-07 11:29:02.910500] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.123 [2024-10-07 11:29:02.910539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.123 [2024-10-07 11:29:02.910568] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.123 [2024-10-07 11:29:02.911886] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.123 [2024-10-07 11:29:02.911973] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.123 [2024-10-07 11:29:02.913048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.123 [2024-10-07 11:29:02.913121] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.123 [2024-10-07 11:29:02.913166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.123 [2024-10-07 11:29:02.913201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.123 [2024-10-07 11:29:02.913228] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.123 [2024-10-07 11:29:02.913248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.123 [2024-10-07 11:29:02.913484] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.123 [2024-10-07 11:29:02.913523] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.123 [2024-10-07 11:29:02.919867] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.123 [2024-10-07 11:29:02.919983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.123 [2024-10-07 11:29:02.921801] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.123 [2024-10-07 11:29:02.921886] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.123 [2024-10-07 11:29:02.921927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.123 [2024-10-07 11:29:02.922025] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.123 [2024-10-07 11:29:02.922071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.123 [2024-10-07 11:29:02.922099] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.123 [2024-10-07 11:29:02.923693] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.123 [2024-10-07 11:29:02.923778] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.123 [2024-10-07 11:29:02.924228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.123 [2024-10-07 11:29:02.924296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.123 [2024-10-07 11:29:02.924335] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.123 [2024-10-07 11:29:02.924376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.123 [2024-10-07 11:29:02.924431] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.123 [2024-10-07 11:29:02.924464] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.123 [2024-10-07 11:29:02.925792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.123 [2024-10-07 11:29:02.925864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.123 [2024-10-07 11:29:02.932217] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.123 [2024-10-07 11:29:02.932338] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.123 [2024-10-07 11:29:02.933746] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.123 [2024-10-07 11:29:02.933819] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.123 [2024-10-07 11:29:02.933862] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.123 [2024-10-07 11:29:02.933969] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.123 [2024-10-07 11:29:02.934015] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.123 [2024-10-07 11:29:02.934047] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.124 [2024-10-07 11:29:02.935330] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.124 [2024-10-07 11:29:02.935460] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.124 [2024-10-07 11:29:02.936635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.124 [2024-10-07 11:29:02.936708] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.124 [2024-10-07 11:29:02.936749] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.124 [2024-10-07 11:29:02.936793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.124 [2024-10-07 11:29:02.936825] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.124 [2024-10-07 11:29:02.936854] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.124 [2024-10-07 11:29:02.937961] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.124 [2024-10-07 11:29:02.938029] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.124 [2024-10-07 11:29:02.944673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.124 [2024-10-07 11:29:02.944780] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.124 [2024-10-07 11:29:02.945221] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.124 [2024-10-07 11:29:02.945300] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.124 [2024-10-07 11:29:02.945342] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.124 [2024-10-07 11:29:02.945520] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.124 [2024-10-07 11:29:02.945582] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.124 [2024-10-07 11:29:02.945619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.124 [2024-10-07 11:29:02.947065] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.124 [2024-10-07 11:29:02.947140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.124 [2024-10-07 11:29:02.948133] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.124 [2024-10-07 11:29:02.948207] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.124 [2024-10-07 11:29:02.948246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.124 [2024-10-07 11:29:02.948287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.124 [2024-10-07 11:29:02.948318] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.124 [2024-10-07 11:29:02.948348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.124 [2024-10-07 11:29:02.948861] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.124 [2024-10-07 11:29:02.948942] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.124 [2024-10-07 11:29:02.957154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.124 [2024-10-07 11:29:02.957298] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.124 [2024-10-07 11:29:02.957770] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.124 [2024-10-07 11:29:02.957841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.124 [2024-10-07 11:29:02.957878] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.124 [2024-10-07 11:29:02.957961] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.124 [2024-10-07 11:29:02.957999] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.124 [2024-10-07 11:29:02.958032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.124 [2024-10-07 11:29:02.959499] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.124 [2024-10-07 11:29:02.959577] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.124 [2024-10-07 11:29:02.959904] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.124 [2024-10-07 11:29:02.959966] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.124 [2024-10-07 11:29:02.960000] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.124 [2024-10-07 11:29:02.960032] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.124 [2024-10-07 11:29:02.960061] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.124 [2024-10-07 11:29:02.960085] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.124 [2024-10-07 11:29:02.961596] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.124 [2024-10-07 11:29:02.961666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.124 [2024-10-07 11:29:02.970272] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.124 [2024-10-07 11:29:02.970428] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.124 [2024-10-07 11:29:02.971785] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.124 [2024-10-07 11:29:02.971871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.124 [2024-10-07 11:29:02.971915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.124 [2024-10-07 11:29:02.972014] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.124 [2024-10-07 11:29:02.972064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.124 [2024-10-07 11:29:02.972097] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.124 [2024-10-07 11:29:02.973138] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.124 [2024-10-07 11:29:02.973226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.124 [2024-10-07 11:29:02.974204] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.124 [2024-10-07 11:29:02.974277] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.124 [2024-10-07 11:29:02.974317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.124 [2024-10-07 11:29:02.974359] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.124 [2024-10-07 11:29:02.974391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.124 [2024-10-07 11:29:02.974448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.124 [2024-10-07 11:29:02.975459] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.124 [2024-10-07 11:29:02.975521] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.124 [2024-10-07 11:29:02.982890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.124 [2024-10-07 11:29:02.983009] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.124 [2024-10-07 11:29:02.983980] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.124 [2024-10-07 11:29:02.984049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.124 [2024-10-07 11:29:02.984084] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.124 [2024-10-07 11:29:02.984164] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.124 [2024-10-07 11:29:02.984201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.124 [2024-10-07 11:29:02.984227] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.124 [2024-10-07 11:29:02.985262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.124 [2024-10-07 11:29:02.985329] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.124 [2024-10-07 11:29:02.986383] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.124 [2024-10-07 11:29:02.986502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.124 [2024-10-07 11:29:02.986535] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.124 [2024-10-07 11:29:02.986567] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.124 [2024-10-07 11:29:02.986592] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.124 [2024-10-07 11:29:02.986615] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.124 [2024-10-07 11:29:02.987649] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.124 [2024-10-07 11:29:02.987703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.124 [2024-10-07 11:29:02.996169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.124 [2024-10-07 11:29:02.996303] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.124 [2024-10-07 11:29:02.996832] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.124 [2024-10-07 11:29:02.996914] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.124 [2024-10-07 11:29:02.996955] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.124 [2024-10-07 11:29:02.997052] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.124 [2024-10-07 11:29:02.997114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.124 [2024-10-07 11:29:02.997150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.124 [2024-10-07 11:29:02.998549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.124 [2024-10-07 11:29:02.998621] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.124 [2024-10-07 11:29:02.999682] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.124 [2024-10-07 11:29:02.999751] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.124 [2024-10-07 11:29:02.999791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.124 [2024-10-07 11:29:02.999833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.124 [2024-10-07 11:29:02.999866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.124 [2024-10-07 11:29:02.999895] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.124 [2024-10-07 11:29:03.001170] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.124 [2024-10-07 11:29:03.001241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.124 [2024-10-07 11:29:03.007997] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.124 [2024-10-07 11:29:03.008117] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.124 [2024-10-07 11:29:03.009752] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.124 [2024-10-07 11:29:03.009826] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.124 [2024-10-07 11:29:03.009867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.125 [2024-10-07 11:29:03.010002] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.125 [2024-10-07 11:29:03.010042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.125 [2024-10-07 11:29:03.010072] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.125 [2024-10-07 11:29:03.011148] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.125 [2024-10-07 11:29:03.011234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.125 [2024-10-07 11:29:03.011564] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.125 [2024-10-07 11:29:03.011628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.125 [2024-10-07 11:29:03.011667] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.125 [2024-10-07 11:29:03.011706] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.125 [2024-10-07 11:29:03.011738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.125 [2024-10-07 11:29:03.011766] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.125 [2024-10-07 11:29:03.013077] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.125 [2024-10-07 11:29:03.013146] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.125 [2024-10-07 11:29:03.020741] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.125 [2024-10-07 11:29:03.020885] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.125 [2024-10-07 11:29:03.022223] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.125 [2024-10-07 11:29:03.022309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.125 [2024-10-07 11:29:03.022350] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.125 [2024-10-07 11:29:03.022473] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.125 [2024-10-07 11:29:03.022530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.125 [2024-10-07 11:29:03.022565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.125 [2024-10-07 11:29:03.023820] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.125 [2024-10-07 11:29:03.023892] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.125 [2024-10-07 11:29:03.024954] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.125 [2024-10-07 11:29:03.025026] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.125 [2024-10-07 11:29:03.025082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.125 [2024-10-07 11:29:03.025127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.125 [2024-10-07 11:29:03.025160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.125 [2024-10-07 11:29:03.025189] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.125 [2024-10-07 11:29:03.026174] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.125 [2024-10-07 11:29:03.026266] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.125 [2024-10-07 11:29:03.032469] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.125 [2024-10-07 11:29:03.032587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.125 [2024-10-07 11:29:03.034086] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.125 [2024-10-07 11:29:03.034171] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.125 [2024-10-07 11:29:03.034214] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.125 [2024-10-07 11:29:03.034313] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.125 [2024-10-07 11:29:03.034357] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.125 [2024-10-07 11:29:03.034390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.125 [2024-10-07 11:29:03.035516] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.125 [2024-10-07 11:29:03.035588] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.125 [2024-10-07 11:29:03.036809] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.125 [2024-10-07 11:29:03.036880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.125 [2024-10-07 11:29:03.036919] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.125 [2024-10-07 11:29:03.036959] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.125 [2024-10-07 11:29:03.036990] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.125 [2024-10-07 11:29:03.037019] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.125 [2024-10-07 11:29:03.038245] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.125 [2024-10-07 11:29:03.038315] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.125 [2024-10-07 11:29:03.044763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.125 [2024-10-07 11:29:03.044881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.125 [2024-10-07 11:29:03.046264] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.125 [2024-10-07 11:29:03.046348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.125 [2024-10-07 11:29:03.046390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.125 [2024-10-07 11:29:03.046525] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.125 [2024-10-07 11:29:03.046572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.125 [2024-10-07 11:29:03.046606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.125 [2024-10-07 11:29:03.047093] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.125 [2024-10-07 11:29:03.047166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.125 [2024-10-07 11:29:03.048430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.125 [2024-10-07 11:29:03.048505] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.125 [2024-10-07 11:29:03.048595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.125 [2024-10-07 11:29:03.048638] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.125 [2024-10-07 11:29:03.048670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.125 [2024-10-07 11:29:03.048699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.125 [2024-10-07 11:29:03.049676] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.125 [2024-10-07 11:29:03.049735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.125 [2024-10-07 11:29:03.057950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.125 [2024-10-07 11:29:03.058083] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.125 [2024-10-07 11:29:03.059458] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.125 [2024-10-07 11:29:03.059543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.125 [2024-10-07 11:29:03.059595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.125 [2024-10-07 11:29:03.059697] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.125 [2024-10-07 11:29:03.059742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.125 [2024-10-07 11:29:03.059775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.125 [2024-10-07 11:29:03.060769] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.125 [2024-10-07 11:29:03.060851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.125 [2024-10-07 11:29:03.061978] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.125 [2024-10-07 11:29:03.062050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.125 [2024-10-07 11:29:03.062089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.125 [2024-10-07 11:29:03.062135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.125 [2024-10-07 11:29:03.062165] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.125 [2024-10-07 11:29:03.062196] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.125 [2024-10-07 11:29:03.062543] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.125 [2024-10-07 11:29:03.062587] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.125 [2024-10-07 11:29:03.072087] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.125 [2024-10-07 11:29:03.072250] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.125 [2024-10-07 11:29:03.073761] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.125 [2024-10-07 11:29:03.073837] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.125 [2024-10-07 11:29:03.073884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.125 [2024-10-07 11:29:03.073970] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.125 [2024-10-07 11:29:03.074058] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.125 [2024-10-07 11:29:03.074092] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.125 [2024-10-07 11:29:03.074421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.125 [2024-10-07 11:29:03.074498] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.125 [2024-10-07 11:29:03.076050] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.125 [2024-10-07 11:29:03.076112] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.125 [2024-10-07 11:29:03.076147] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.125 [2024-10-07 11:29:03.076181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.125 [2024-10-07 11:29:03.076208] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.125 [2024-10-07 11:29:03.076234] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.125 [2024-10-07 11:29:03.077558] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.125 [2024-10-07 11:29:03.077629] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.125 [2024-10-07 11:29:03.084436] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.125 [2024-10-07 11:29:03.084583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.126 [2024-10-07 11:29:03.085685] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.126 [2024-10-07 11:29:03.085762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.126 [2024-10-07 11:29:03.085802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.126 [2024-10-07 11:29:03.085906] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.126 [2024-10-07 11:29:03.085959] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.126 [2024-10-07 11:29:03.085995] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.126 [2024-10-07 11:29:03.087621] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.126 [2024-10-07 11:29:03.087696] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.126 [2024-10-07 11:29:03.088118] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.126 [2024-10-07 11:29:03.088187] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.126 [2024-10-07 11:29:03.088228] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.126 [2024-10-07 11:29:03.088272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.126 [2024-10-07 11:29:03.088304] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.126 [2024-10-07 11:29:03.088331] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.126 [2024-10-07 11:29:03.089808] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.126 [2024-10-07 11:29:03.089873] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.126 [2024-10-07 11:29:03.095935] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.126 [2024-10-07 11:29:03.096076] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.126 [2024-10-07 11:29:03.096484] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.126 [2024-10-07 11:29:03.096555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.126 [2024-10-07 11:29:03.096590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.126 [2024-10-07 11:29:03.096679] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.126 [2024-10-07 11:29:03.096722] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.126 [2024-10-07 11:29:03.096756] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.126 [2024-10-07 11:29:03.097185] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.126 [2024-10-07 11:29:03.097255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.126 [2024-10-07 11:29:03.099089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.126 [2024-10-07 11:29:03.099157] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.126 [2024-10-07 11:29:03.099192] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.126 [2024-10-07 11:29:03.099229] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.126 [2024-10-07 11:29:03.099255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.126 [2024-10-07 11:29:03.099279] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.126 [2024-10-07 11:29:03.100804] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.126 [2024-10-07 11:29:03.100882] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.126 8251.18 IOPS, 32.23 MiB/s [2024-10-07T11:29:07.837Z] [2024-10-07 11:29:03.107089] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.126 [2024-10-07 11:29:03.107218] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.126 [2024-10-07 11:29:03.109080] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.126 [2024-10-07 11:29:03.109177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.126 [2024-10-07 11:29:03.109221] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.126 [2024-10-07 11:29:03.109321] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.126 [2024-10-07 11:29:03.109366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.126 [2024-10-07 11:29:03.109421] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.126 [2024-10-07 11:29:03.110508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.126 [2024-10-07 11:29:03.110590] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.126 [2024-10-07 11:29:03.112046] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.126 [2024-10-07 11:29:03.112107] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.126 [2024-10-07 11:29:03.112181] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.126 [2024-10-07 11:29:03.112224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.126 [2024-10-07 11:29:03.112255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.126 [2024-10-07 11:29:03.112280] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.126 [2024-10-07 11:29:03.113467] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.126 [2024-10-07 11:29:03.113536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.126 [2024-10-07 11:29:03.119494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.126 [2024-10-07 11:29:03.119652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.126 [2024-10-07 11:29:03.121207] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.126 [2024-10-07 11:29:03.121286] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.126 [2024-10-07 11:29:03.121327] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.126 [2024-10-07 11:29:03.121443] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.126 [2024-10-07 11:29:03.121492] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.126 [2024-10-07 11:29:03.121525] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.126 [2024-10-07 11:29:03.122593] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.126 [2024-10-07 11:29:03.122673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.126 [2024-10-07 11:29:03.123012] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.126 [2024-10-07 11:29:03.123073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.126 [2024-10-07 11:29:03.123105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.126 [2024-10-07 11:29:03.123137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.126 [2024-10-07 11:29:03.123164] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.126 [2024-10-07 11:29:03.123190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.126 [2024-10-07 11:29:03.123446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.126 [2024-10-07 11:29:03.123499] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.126 [2024-10-07 11:29:03.133147] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.126 [2024-10-07 11:29:03.133305] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.126 [2024-10-07 11:29:03.133748] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.126 [2024-10-07 11:29:03.133820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.126 [2024-10-07 11:29:03.133856] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.126 [2024-10-07 11:29:03.133940] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.126 [2024-10-07 11:29:03.133990] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.126 [2024-10-07 11:29:03.134057] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.126 [2024-10-07 11:29:03.134224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.126 [2024-10-07 11:29:03.134291] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.126 [2024-10-07 11:29:03.134732] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.126 [2024-10-07 11:29:03.134794] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.126 [2024-10-07 11:29:03.134833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.126 [2024-10-07 11:29:03.134869] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.126 [2024-10-07 11:29:03.134900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.126 [2024-10-07 11:29:03.134926] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.126 [2024-10-07 11:29:03.136789] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.126 [2024-10-07 11:29:03.136863] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.126 [2024-10-07 11:29:03.146424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.126 [2024-10-07 11:29:03.146565] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.126 [2024-10-07 11:29:03.147002] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.126 [2024-10-07 11:29:03.147071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.126 [2024-10-07 11:29:03.147107] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.126 [2024-10-07 11:29:03.147189] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.126 [2024-10-07 11:29:03.147227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.126 [2024-10-07 11:29:03.147258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.126 [2024-10-07 11:29:03.149327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.126 [2024-10-07 11:29:03.149427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.126 [2024-10-07 11:29:03.150328] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.126 [2024-10-07 11:29:03.150395] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.126 [2024-10-07 11:29:03.150465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.126 [2024-10-07 11:29:03.150511] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.126 [2024-10-07 11:29:03.150543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.126 [2024-10-07 11:29:03.150572] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.126 [2024-10-07 11:29:03.151588] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.127 [2024-10-07 11:29:03.151654] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.127 [2024-10-07 11:29:03.157183] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.127 [2024-10-07 11:29:03.157357] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.127 [2024-10-07 11:29:03.157725] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.127 [2024-10-07 11:29:03.157791] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.127 [2024-10-07 11:29:03.157826] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.127 [2024-10-07 11:29:03.157918] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.127 [2024-10-07 11:29:03.157957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.127 [2024-10-07 11:29:03.157985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.127 [2024-10-07 11:29:03.161152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.127 [2024-10-07 11:29:03.161261] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.127 [2024-10-07 11:29:03.163316] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.127 [2024-10-07 11:29:03.163418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.127 [2024-10-07 11:29:03.163462] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.127 [2024-10-07 11:29:03.163510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.127 [2024-10-07 11:29:03.163542] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.127 [2024-10-07 11:29:03.163570] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.127 [2024-10-07 11:29:03.164428] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.127 [2024-10-07 11:29:03.164500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.127 [2024-10-07 11:29:03.169273] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.127 [2024-10-07 11:29:03.169433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.127 [2024-10-07 11:29:03.169793] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.127 [2024-10-07 11:29:03.169871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.127 [2024-10-07 11:29:03.169912] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.127 [2024-10-07 11:29:03.170014] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.127 [2024-10-07 11:29:03.170070] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.127 [2024-10-07 11:29:03.170102] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.127 [2024-10-07 11:29:03.170259] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.127 [2024-10-07 11:29:03.170319] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.127 [2024-10-07 11:29:03.172178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.127 [2024-10-07 11:29:03.172247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.127 [2024-10-07 11:29:03.172282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.127 [2024-10-07 11:29:03.172354] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.127 [2024-10-07 11:29:03.172383] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.127 [2024-10-07 11:29:03.172430] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.127 [2024-10-07 11:29:03.174747] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.127 [2024-10-07 11:29:03.174835] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.127 [2024-10-07 11:29:03.181647] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.127 [2024-10-07 11:29:03.181774] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.127 [2024-10-07 11:29:03.182300] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.127 [2024-10-07 11:29:03.182373] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.127 [2024-10-07 11:29:03.182439] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.127 [2024-10-07 11:29:03.182539] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.127 [2024-10-07 11:29:03.182584] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.127 [2024-10-07 11:29:03.182617] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.127 [2024-10-07 11:29:03.185023] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.127 [2024-10-07 11:29:03.185157] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.127 [2024-10-07 11:29:03.186575] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.127 [2024-10-07 11:29:03.186646] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.127 [2024-10-07 11:29:03.186687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.127 [2024-10-07 11:29:03.186734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.127 [2024-10-07 11:29:03.186765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.127 [2024-10-07 11:29:03.186793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.127 [2024-10-07 11:29:03.187700] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.127 [2024-10-07 11:29:03.187771] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.127 [2024-10-07 11:29:03.194913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.127 [2024-10-07 11:29:03.195064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.127 [2024-10-07 11:29:03.195578] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.127 [2024-10-07 11:29:03.195655] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.127 [2024-10-07 11:29:03.195691] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.127 [2024-10-07 11:29:03.195777] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.127 [2024-10-07 11:29:03.195816] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.127 [2024-10-07 11:29:03.195845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.127 [2024-10-07 11:29:03.197293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.127 [2024-10-07 11:29:03.197378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.127 [2024-10-07 11:29:03.198598] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.127 [2024-10-07 11:29:03.198671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.127 [2024-10-07 11:29:03.198712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.127 [2024-10-07 11:29:03.198756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.127 [2024-10-07 11:29:03.198788] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.127 [2024-10-07 11:29:03.198817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.127 [2024-10-07 11:29:03.200244] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.127 [2024-10-07 11:29:03.200307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.127 [2024-10-07 11:29:03.206925] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.127 [2024-10-07 11:29:03.207062] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.127 [2024-10-07 11:29:03.209044] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.127 [2024-10-07 11:29:03.209143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.127 [2024-10-07 11:29:03.209187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.127 [2024-10-07 11:29:03.209287] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.127 [2024-10-07 11:29:03.209331] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.127 [2024-10-07 11:29:03.209364] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.127 [2024-10-07 11:29:03.210570] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.127 [2024-10-07 11:29:03.210639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.127 [2024-10-07 11:29:03.212178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.127 [2024-10-07 11:29:03.212252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.127 [2024-10-07 11:29:03.212294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.127 [2024-10-07 11:29:03.212340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.127 [2024-10-07 11:29:03.212372] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.127 [2024-10-07 11:29:03.212418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.127 [2024-10-07 11:29:03.212758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.128 [2024-10-07 11:29:03.212821] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.128 [2024-10-07 11:29:03.220659] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.128 [2024-10-07 11:29:03.220796] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.128 [2024-10-07 11:29:03.222043] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.128 [2024-10-07 11:29:03.222117] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.128 [2024-10-07 11:29:03.222154] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.128 [2024-10-07 11:29:03.222248] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.128 [2024-10-07 11:29:03.222286] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.128 [2024-10-07 11:29:03.222314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.128 [2024-10-07 11:29:03.222585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.128 [2024-10-07 11:29:03.222661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.128 [2024-10-07 11:29:03.224099] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.128 [2024-10-07 11:29:03.224159] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.128 [2024-10-07 11:29:03.224190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.128 [2024-10-07 11:29:03.224233] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.128 [2024-10-07 11:29:03.224256] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.128 [2024-10-07 11:29:03.224276] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.128 [2024-10-07 11:29:03.226113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.128 [2024-10-07 11:29:03.226185] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.128 [2024-10-07 11:29:03.234475] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.128 [2024-10-07 11:29:03.234617] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.128 [2024-10-07 11:29:03.236004] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.128 [2024-10-07 11:29:03.236089] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.128 [2024-10-07 11:29:03.236132] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.128 [2024-10-07 11:29:03.236231] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.128 [2024-10-07 11:29:03.236285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.128 [2024-10-07 11:29:03.236333] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.128 [2024-10-07 11:29:03.237636] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.128 [2024-10-07 11:29:03.237712] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.128 [2024-10-07 11:29:03.238719] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.128 [2024-10-07 11:29:03.238789] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.128 [2024-10-07 11:29:03.238828] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.128 [2024-10-07 11:29:03.238873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.128 [2024-10-07 11:29:03.238958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.128 [2024-10-07 11:29:03.238989] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.128 [2024-10-07 11:29:03.239295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.128 [2024-10-07 11:29:03.239354] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.128 [2024-10-07 11:29:03.246801] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.128 [2024-10-07 11:29:03.246955] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.128 [2024-10-07 11:29:03.248417] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.128 [2024-10-07 11:29:03.248495] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.128 [2024-10-07 11:29:03.248532] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.128 [2024-10-07 11:29:03.248621] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.128 [2024-10-07 11:29:03.248660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.128 [2024-10-07 11:29:03.248688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.128 [2024-10-07 11:29:03.249964] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.128 [2024-10-07 11:29:03.250048] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.128 [2024-10-07 11:29:03.251670] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.128 [2024-10-07 11:29:03.251743] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.128 [2024-10-07 11:29:03.251786] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.128 [2024-10-07 11:29:03.251832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.128 [2024-10-07 11:29:03.251864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.128 [2024-10-07 11:29:03.251892] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.128 [2024-10-07 11:29:03.253148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.128 [2024-10-07 11:29:03.253210] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.128 [2024-10-07 11:29:03.259472] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.128 [2024-10-07 11:29:03.259602] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.128 [2024-10-07 11:29:03.260862] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.128 [2024-10-07 11:29:03.260945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.128 [2024-10-07 11:29:03.260986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.128 [2024-10-07 11:29:03.261092] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.128 [2024-10-07 11:29:03.261131] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.128 [2024-10-07 11:29:03.261158] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.128 [2024-10-07 11:29:03.261445] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.128 [2024-10-07 11:29:03.261540] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.128 [2024-10-07 11:29:03.262933] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.128 [2024-10-07 11:29:03.263005] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.128 [2024-10-07 11:29:03.263044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.128 [2024-10-07 11:29:03.263085] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.128 [2024-10-07 11:29:03.263117] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.128 [2024-10-07 11:29:03.263144] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.128 [2024-10-07 11:29:03.263461] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.128 [2024-10-07 11:29:03.263509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.128 [2024-10-07 11:29:03.271895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.128 [2024-10-07 11:29:03.272010] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.128 [2024-10-07 11:29:03.273571] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.128 [2024-10-07 11:29:03.273654] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.128 [2024-10-07 11:29:03.273697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.128 [2024-10-07 11:29:03.273796] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.128 [2024-10-07 11:29:03.273840] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.128 [2024-10-07 11:29:03.273874] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.128 [2024-10-07 11:29:03.274267] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.128 [2024-10-07 11:29:03.274337] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.128 [2024-10-07 11:29:03.274541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.128 [2024-10-07 11:29:03.274594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.128 [2024-10-07 11:29:03.274628] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.128 [2024-10-07 11:29:03.274665] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.128 [2024-10-07 11:29:03.274692] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.128 [2024-10-07 11:29:03.274715] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.128 [2024-10-07 11:29:03.276726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.128 [2024-10-07 11:29:03.276791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.128 [2024-10-07 11:29:03.284458] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.128 [2024-10-07 11:29:03.284593] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.128 [2024-10-07 11:29:03.285193] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.128 [2024-10-07 11:29:03.285302] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.128 [2024-10-07 11:29:03.285341] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.128 [2024-10-07 11:29:03.285454] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.128 [2024-10-07 11:29:03.285497] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.128 [2024-10-07 11:29:03.285530] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.128 [2024-10-07 11:29:03.286977] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.128 [2024-10-07 11:29:03.287051] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.128 [2024-10-07 11:29:03.288314] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.128 [2024-10-07 11:29:03.288384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.128 [2024-10-07 11:29:03.288447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.128 [2024-10-07 11:29:03.288490] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.128 [2024-10-07 11:29:03.288518] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.129 [2024-10-07 11:29:03.288549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.129 [2024-10-07 11:29:03.289730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.129 [2024-10-07 11:29:03.289802] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.129 [2024-10-07 11:29:03.296921] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.129 [2024-10-07 11:29:03.297049] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.129 [2024-10-07 11:29:03.298854] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.129 [2024-10-07 11:29:03.298938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.129 [2024-10-07 11:29:03.298982] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.129 [2024-10-07 11:29:03.299082] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.129 [2024-10-07 11:29:03.299126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.129 [2024-10-07 11:29:03.299160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.129 [2024-10-07 11:29:03.300576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.129 [2024-10-07 11:29:03.300663] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.129 [2024-10-07 11:29:03.302263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.129 [2024-10-07 11:29:03.302338] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.129 [2024-10-07 11:29:03.302379] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.129 [2024-10-07 11:29:03.302449] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.129 [2024-10-07 11:29:03.302485] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.129 [2024-10-07 11:29:03.302553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.129 [2024-10-07 11:29:03.302880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.129 [2024-10-07 11:29:03.302939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.129 [2024-10-07 11:29:03.309069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.129 [2024-10-07 11:29:03.309180] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.129 [2024-10-07 11:29:03.310506] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.129 [2024-10-07 11:29:03.310588] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.129 [2024-10-07 11:29:03.310630] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.129 [2024-10-07 11:29:03.310725] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.129 [2024-10-07 11:29:03.310769] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.129 [2024-10-07 11:29:03.310802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.129 [2024-10-07 11:29:03.312070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.129 [2024-10-07 11:29:03.312145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.129 [2024-10-07 11:29:03.313158] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.129 [2024-10-07 11:29:03.313226] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.129 [2024-10-07 11:29:03.313266] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.129 [2024-10-07 11:29:03.313306] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.129 [2024-10-07 11:29:03.313339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.129 [2024-10-07 11:29:03.313366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.129 [2024-10-07 11:29:03.313682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.129 [2024-10-07 11:29:03.313746] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.129 [2024-10-07 11:29:03.321529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.129 [2024-10-07 11:29:03.321685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.129 [2024-10-07 11:29:03.323136] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.129 [2024-10-07 11:29:03.323214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.129 [2024-10-07 11:29:03.323253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.129 [2024-10-07 11:29:03.323351] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.129 [2024-10-07 11:29:03.323396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.129 [2024-10-07 11:29:03.323454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.129 [2024-10-07 11:29:03.324662] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.129 [2024-10-07 11:29:03.324771] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.129 [2024-10-07 11:29:03.325216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.129 [2024-10-07 11:29:03.325278] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.129 [2024-10-07 11:29:03.325318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.129 [2024-10-07 11:29:03.325363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.129 [2024-10-07 11:29:03.325394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.129 [2024-10-07 11:29:03.325450] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.129 [2024-10-07 11:29:03.325673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.129 [2024-10-07 11:29:03.325732] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.129 [2024-10-07 11:29:03.333501] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.129 [2024-10-07 11:29:03.333651] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.129 [2024-10-07 11:29:03.335159] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.129 [2024-10-07 11:29:03.335235] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.129 [2024-10-07 11:29:03.335273] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.129 [2024-10-07 11:29:03.335367] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.129 [2024-10-07 11:29:03.335433] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.129 [2024-10-07 11:29:03.335471] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.129 [2024-10-07 11:29:03.336564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.129 [2024-10-07 11:29:03.336646] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.129 [2024-10-07 11:29:03.336942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.129 [2024-10-07 11:29:03.337001] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.129 [2024-10-07 11:29:03.337035] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.129 [2024-10-07 11:29:03.337082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.129 [2024-10-07 11:29:03.337112] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.129 [2024-10-07 11:29:03.337135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.129 [2024-10-07 11:29:03.338586] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.129 [2024-10-07 11:29:03.338653] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.129 [2024-10-07 11:29:03.347205] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.129 [2024-10-07 11:29:03.347364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.129 [2024-10-07 11:29:03.348330] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.129 [2024-10-07 11:29:03.348432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.129 [2024-10-07 11:29:03.348529] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.129 [2024-10-07 11:29:03.348640] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.129 [2024-10-07 11:29:03.348697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.129 [2024-10-07 11:29:03.348732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.129 [2024-10-07 11:29:03.349241] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.129 [2024-10-07 11:29:03.349320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.129 [2024-10-07 11:29:03.350527] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.129 [2024-10-07 11:29:03.350605] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.129 [2024-10-07 11:29:03.350646] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.129 [2024-10-07 11:29:03.350689] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.129 [2024-10-07 11:29:03.350721] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.129 [2024-10-07 11:29:03.350749] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.129 [2024-10-07 11:29:03.351807] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.129 [2024-10-07 11:29:03.351868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.129 [2024-10-07 11:29:03.359877] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.129 [2024-10-07 11:29:03.360033] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.129 [2024-10-07 11:29:03.360514] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.129 [2024-10-07 11:29:03.360592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.129 [2024-10-07 11:29:03.360633] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.129 [2024-10-07 11:29:03.360718] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.129 [2024-10-07 11:29:03.360755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.129 [2024-10-07 11:29:03.360786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.129 [2024-10-07 11:29:03.361009] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.129 [2024-10-07 11:29:03.361089] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.129 [2024-10-07 11:29:03.362801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.129 [2024-10-07 11:29:03.362866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.129 [2024-10-07 11:29:03.362901] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.130 [2024-10-07 11:29:03.362934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.130 [2024-10-07 11:29:03.362962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.130 [2024-10-07 11:29:03.362986] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.130 [2024-10-07 11:29:03.364467] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.130 [2024-10-07 11:29:03.364531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.130 [2024-10-07 11:29:03.372235] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.130 [2024-10-07 11:29:03.372382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.130 [2024-10-07 11:29:03.373653] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.130 [2024-10-07 11:29:03.373741] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.130 [2024-10-07 11:29:03.373781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.130 [2024-10-07 11:29:03.373877] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.130 [2024-10-07 11:29:03.373918] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.130 [2024-10-07 11:29:03.373950] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.130 [2024-10-07 11:29:03.375294] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.130 [2024-10-07 11:29:03.375383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.130 [2024-10-07 11:29:03.376360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.130 [2024-10-07 11:29:03.376441] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.130 [2024-10-07 11:29:03.376484] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.130 [2024-10-07 11:29:03.376529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.130 [2024-10-07 11:29:03.376562] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.130 [2024-10-07 11:29:03.376589] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.130 [2024-10-07 11:29:03.376896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.130 [2024-10-07 11:29:03.376955] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.130 [2024-10-07 11:29:03.386675] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.130 [2024-10-07 11:29:03.386826] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.130 [2024-10-07 11:29:03.387433] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.130 [2024-10-07 11:29:03.387509] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.130 [2024-10-07 11:29:03.387549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.130 [2024-10-07 11:29:03.387647] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.130 [2024-10-07 11:29:03.387690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.130 [2024-10-07 11:29:03.387721] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.130 [2024-10-07 11:29:03.387926] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.130 [2024-10-07 11:29:03.387994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.130 [2024-10-07 11:29:03.389814] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.130 [2024-10-07 11:29:03.389888] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.130 [2024-10-07 11:29:03.389929] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.130 [2024-10-07 11:29:03.389977] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.130 [2024-10-07 11:29:03.390007] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.130 [2024-10-07 11:29:03.390035] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.130 [2024-10-07 11:29:03.392101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.130 [2024-10-07 11:29:03.392180] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.130 [2024-10-07 11:29:03.398513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.130 [2024-10-07 11:29:03.398653] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.130 [2024-10-07 11:29:03.400304] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.130 [2024-10-07 11:29:03.400377] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.130 [2024-10-07 11:29:03.400432] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.130 [2024-10-07 11:29:03.400521] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.130 [2024-10-07 11:29:03.400561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.130 [2024-10-07 11:29:03.400589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.130 [2024-10-07 11:29:03.402226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.130 [2024-10-07 11:29:03.402305] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.130 [2024-10-07 11:29:03.403181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.130 [2024-10-07 11:29:03.403242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.130 [2024-10-07 11:29:03.403275] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.130 [2024-10-07 11:29:03.403313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.130 [2024-10-07 11:29:03.403338] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.130 [2024-10-07 11:29:03.403361] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.130 [2024-10-07 11:29:03.403615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.130 [2024-10-07 11:29:03.403653] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.130 [2024-10-07 11:29:03.412625] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.130 [2024-10-07 11:29:03.412763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.130 [2024-10-07 11:29:03.413135] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.130 [2024-10-07 11:29:03.413206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.130 [2024-10-07 11:29:03.413241] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.130 [2024-10-07 11:29:03.413374] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.130 [2024-10-07 11:29:03.413433] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.130 [2024-10-07 11:29:03.413465] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.130 [2024-10-07 11:29:03.415118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.130 [2024-10-07 11:29:03.415197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.130 [2024-10-07 11:29:03.416569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.130 [2024-10-07 11:29:03.416629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.130 [2024-10-07 11:29:03.416657] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.130 [2024-10-07 11:29:03.416696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.130 [2024-10-07 11:29:03.416721] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.130 [2024-10-07 11:29:03.416743] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.130 [2024-10-07 11:29:03.417760] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.130 [2024-10-07 11:29:03.417822] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.130 [2024-10-07 11:29:03.427525] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.130 [2024-10-07 11:29:03.427699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.130 [2024-10-07 11:29:03.428105] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.130 [2024-10-07 11:29:03.428176] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.130 [2024-10-07 11:29:03.428212] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.130 [2024-10-07 11:29:03.428296] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.130 [2024-10-07 11:29:03.428332] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.130 [2024-10-07 11:29:03.428360] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.130 [2024-10-07 11:29:03.430016] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.130 [2024-10-07 11:29:03.430100] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.130 [2024-10-07 11:29:03.431492] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.130 [2024-10-07 11:29:03.431579] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.130 [2024-10-07 11:29:03.431612] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.130 [2024-10-07 11:29:03.431653] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.130 [2024-10-07 11:29:03.431677] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.130 [2024-10-07 11:29:03.431697] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.130 [2024-10-07 11:29:03.432685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.130 [2024-10-07 11:29:03.432779] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.130 [2024-10-07 11:29:03.441577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.130 [2024-10-07 11:29:03.441740] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.130 [2024-10-07 11:29:03.443169] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.130 [2024-10-07 11:29:03.443250] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.130 [2024-10-07 11:29:03.443287] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.130 [2024-10-07 11:29:03.443372] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.130 [2024-10-07 11:29:03.443428] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.130 [2024-10-07 11:29:03.443458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.130 [2024-10-07 11:29:03.443744] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.130 [2024-10-07 11:29:03.443810] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.130 [2024-10-07 11:29:03.444994] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.131 [2024-10-07 11:29:03.445071] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.131 [2024-10-07 11:29:03.445106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.131 [2024-10-07 11:29:03.445146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.131 [2024-10-07 11:29:03.445176] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.131 [2024-10-07 11:29:03.445202] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.131 [2024-10-07 11:29:03.446589] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.131 [2024-10-07 11:29:03.446661] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.131 [2024-10-07 11:29:03.452717] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.131 [2024-10-07 11:29:03.452845] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.131 [2024-10-07 11:29:03.454553] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.131 [2024-10-07 11:29:03.454630] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.131 [2024-10-07 11:29:03.454666] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.131 [2024-10-07 11:29:03.454746] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.131 [2024-10-07 11:29:03.454785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.131 [2024-10-07 11:29:03.454813] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.131 [2024-10-07 11:29:03.456524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.131 [2024-10-07 11:29:03.456601] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.131 [2024-10-07 11:29:03.457913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.131 [2024-10-07 11:29:03.458026] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.131 [2024-10-07 11:29:03.458062] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.131 [2024-10-07 11:29:03.458105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.131 [2024-10-07 11:29:03.458137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.131 [2024-10-07 11:29:03.458163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.131 [2024-10-07 11:29:03.459651] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.131 [2024-10-07 11:29:03.459716] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.131 [2024-10-07 11:29:03.466335] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.131 [2024-10-07 11:29:03.466460] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.131 [2024-10-07 11:29:03.468257] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.131 [2024-10-07 11:29:03.468332] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.131 [2024-10-07 11:29:03.468369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.131 [2024-10-07 11:29:03.468475] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.131 [2024-10-07 11:29:03.468516] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.131 [2024-10-07 11:29:03.468543] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.131 [2024-10-07 11:29:03.468811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.131 [2024-10-07 11:29:03.468874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.131 [2024-10-07 11:29:03.470177] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.131 [2024-10-07 11:29:03.470249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.131 [2024-10-07 11:29:03.470285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.131 [2024-10-07 11:29:03.470331] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.131 [2024-10-07 11:29:03.470361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.131 [2024-10-07 11:29:03.470387] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.131 [2024-10-07 11:29:03.471744] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.131 [2024-10-07 11:29:03.471810] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.131 [2024-10-07 11:29:03.476606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.131 [2024-10-07 11:29:03.477974] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.131 [2024-10-07 11:29:03.478212] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.131 [2024-10-07 11:29:03.478279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.131 [2024-10-07 11:29:03.478313] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.131 [2024-10-07 11:29:03.478682] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.131 [2024-10-07 11:29:03.478785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.131 [2024-10-07 11:29:03.478821] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.131 [2024-10-07 11:29:03.478857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.131 [2024-10-07 11:29:03.479053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.131 [2024-10-07 11:29:03.479110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.131 [2024-10-07 11:29:03.479140] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.131 [2024-10-07 11:29:03.479168] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.131 [2024-10-07 11:29:03.480739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.131 [2024-10-07 11:29:03.480802] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.131 [2024-10-07 11:29:03.480833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.131 [2024-10-07 11:29:03.480861] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.131 [2024-10-07 11:29:03.481993] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.131 [2024-10-07 11:29:03.489608] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.131 [2024-10-07 11:29:03.490692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.131 [2024-10-07 11:29:03.490910] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.131 [2024-10-07 11:29:03.490963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.131 [2024-10-07 11:29:03.490994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.131 [2024-10-07 11:29:03.491296] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.131 [2024-10-07 11:29:03.491358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.131 [2024-10-07 11:29:03.491392] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.131 [2024-10-07 11:29:03.491450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.131 [2024-10-07 11:29:03.492663] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.131 [2024-10-07 11:29:03.492731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.131 [2024-10-07 11:29:03.492762] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.131 [2024-10-07 11:29:03.492790] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.131 [2024-10-07 11:29:03.494730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.131 [2024-10-07 11:29:03.494793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.131 [2024-10-07 11:29:03.494825] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.131 [2024-10-07 11:29:03.494852] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.131 [2024-10-07 11:29:03.495968] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.131 [2024-10-07 11:29:03.502172] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.131 [2024-10-07 11:29:03.503571] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.131 [2024-10-07 11:29:03.503823] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.131 [2024-10-07 11:29:03.503876] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.131 [2024-10-07 11:29:03.503909] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.131 [2024-10-07 11:29:03.504201] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.131 [2024-10-07 11:29:03.504264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.131 [2024-10-07 11:29:03.504297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.131 [2024-10-07 11:29:03.504333] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.131 [2024-10-07 11:29:03.505294] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.131 [2024-10-07 11:29:03.505362] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.131 [2024-10-07 11:29:03.505394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.131 [2024-10-07 11:29:03.505444] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.131 [2024-10-07 11:29:03.505703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.131 [2024-10-07 11:29:03.505744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.131 [2024-10-07 11:29:03.505769] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.132 [2024-10-07 11:29:03.505794] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.132 [2024-10-07 11:29:03.505898] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.132 [2024-10-07 11:29:03.514980] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.132 [2024-10-07 11:29:03.515363] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.132 [2024-10-07 11:29:03.515568] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.132 [2024-10-07 11:29:03.515631] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.132 [2024-10-07 11:29:03.515670] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.132 [2024-10-07 11:29:03.516968] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.132 [2024-10-07 11:29:03.517045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.132 [2024-10-07 11:29:03.517100] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.132 [2024-10-07 11:29:03.517140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.132 [2024-10-07 11:29:03.518396] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.132 [2024-10-07 11:29:03.518479] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.132 [2024-10-07 11:29:03.518508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.132 [2024-10-07 11:29:03.518576] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.132 [2024-10-07 11:29:03.518837] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.132 [2024-10-07 11:29:03.518886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.132 [2024-10-07 11:29:03.518914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.132 [2024-10-07 11:29:03.518940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.132 [2024-10-07 11:29:03.519942] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.132 [2024-10-07 11:29:03.526528] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.132 [2024-10-07 11:29:03.526991] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.132 [2024-10-07 11:29:03.527055] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.132 [2024-10-07 11:29:03.527087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.132 [2024-10-07 11:29:03.528372] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.132 [2024-10-07 11:29:03.528477] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.132 [2024-10-07 11:29:03.529744] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.132 [2024-10-07 11:29:03.529809] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.132 [2024-10-07 11:29:03.529842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.132 [2024-10-07 11:29:03.529868] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.132 [2024-10-07 11:29:03.529891] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.132 [2024-10-07 11:29:03.529914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.132 [2024-10-07 11:29:03.530150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.132 [2024-10-07 11:29:03.530207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.132 [2024-10-07 11:29:03.531355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.132 [2024-10-07 11:29:03.531427] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.132 [2024-10-07 11:29:03.531458] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.132 [2024-10-07 11:29:03.532573] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.132 [2024-10-07 11:29:03.536706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.132 [2024-10-07 11:29:03.538338] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.132 [2024-10-07 11:29:03.538422] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.132 [2024-10-07 11:29:03.538456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.132 [2024-10-07 11:29:03.539495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.132 [2024-10-07 11:29:03.539896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.132 [2024-10-07 11:29:03.539993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.132 [2024-10-07 11:29:03.540027] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.132 [2024-10-07 11:29:03.541424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.132 [2024-10-07 11:29:03.541488] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.132 [2024-10-07 11:29:03.541888] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.132 [2024-10-07 11:29:03.541949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.132 [2024-10-07 11:29:03.541981] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.132 [2024-10-07 11:29:03.543267] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.132 [2024-10-07 11:29:03.544446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.132 [2024-10-07 11:29:03.544502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.132 [2024-10-07 11:29:03.544533] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.132 [2024-10-07 11:29:03.544778] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.132 [2024-10-07 11:29:03.547299] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.132 [2024-10-07 11:29:03.547498] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.132 [2024-10-07 11:29:03.547546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.132 [2024-10-07 11:29:03.547576] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.132 [2024-10-07 11:29:03.547627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.132 [2024-10-07 11:29:03.547674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.132 [2024-10-07 11:29:03.547701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.132 [2024-10-07 11:29:03.547727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.132 [2024-10-07 11:29:03.547772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.132 [2024-10-07 11:29:03.552986] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.132 [2024-10-07 11:29:03.553183] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.132 [2024-10-07 11:29:03.553228] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.132 [2024-10-07 11:29:03.553255] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.132 [2024-10-07 11:29:03.554135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.132 [2024-10-07 11:29:03.554428] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.132 [2024-10-07 11:29:03.554490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.132 [2024-10-07 11:29:03.554520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.132 [2024-10-07 11:29:03.554657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.132 [2024-10-07 11:29:03.558662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.132 [2024-10-07 11:29:03.559029] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.132 [2024-10-07 11:29:03.559090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.132 [2024-10-07 11:29:03.559121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.132 [2024-10-07 11:29:03.559279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.132 [2024-10-07 11:29:03.560372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.132 [2024-10-07 11:29:03.560450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.132 [2024-10-07 11:29:03.560480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.132 [2024-10-07 11:29:03.561363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.132 [2024-10-07 11:29:03.563922] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.132 [2024-10-07 11:29:03.564137] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.132 [2024-10-07 11:29:03.564185] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.132 [2024-10-07 11:29:03.564214] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.132 [2024-10-07 11:29:03.564261] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.132 [2024-10-07 11:29:03.564307] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.132 [2024-10-07 11:29:03.564334] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.132 [2024-10-07 11:29:03.564357] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.132 [2024-10-07 11:29:03.564423] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.132 [2024-10-07 11:29:03.568948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.132 [2024-10-07 11:29:03.569144] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.132 [2024-10-07 11:29:03.569181] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.132 [2024-10-07 11:29:03.569200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.132 [2024-10-07 11:29:03.570411] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.132 [2024-10-07 11:29:03.570644] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.132 [2024-10-07 11:29:03.570680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.132 [2024-10-07 11:29:03.570699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.132 [2024-10-07 11:29:03.571826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.132 [2024-10-07 11:29:03.575635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.132 [2024-10-07 11:29:03.575771] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.132 [2024-10-07 11:29:03.575805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.132 [2024-10-07 11:29:03.575823] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.133 [2024-10-07 11:29:03.576075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.133 [2024-10-07 11:29:03.576223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.133 [2024-10-07 11:29:03.576262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.133 [2024-10-07 11:29:03.576281] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.133 [2024-10-07 11:29:03.576335] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.133 [2024-10-07 11:29:03.579065] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.133 [2024-10-07 11:29:03.579186] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.133 [2024-10-07 11:29:03.579218] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.133 [2024-10-07 11:29:03.579235] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.133 [2024-10-07 11:29:03.580172] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.133 [2024-10-07 11:29:03.580438] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.133 [2024-10-07 11:29:03.580475] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.133 [2024-10-07 11:29:03.580494] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.133 [2024-10-07 11:29:03.580574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.133 [2024-10-07 11:29:03.587176] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.133 [2024-10-07 11:29:03.587349] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.133 [2024-10-07 11:29:03.587384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.133 [2024-10-07 11:29:03.587416] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.133 [2024-10-07 11:29:03.587457] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.133 [2024-10-07 11:29:03.587489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.133 [2024-10-07 11:29:03.587507] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.133 [2024-10-07 11:29:03.587522] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.133 [2024-10-07 11:29:03.587554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.133 [2024-10-07 11:29:03.590307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.133 [2024-10-07 11:29:03.590464] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.133 [2024-10-07 11:29:03.590498] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.133 [2024-10-07 11:29:03.590516] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.133 [2024-10-07 11:29:03.590748] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.133 [2024-10-07 11:29:03.590868] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.133 [2024-10-07 11:29:03.590906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.133 [2024-10-07 11:29:03.590949] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.133 [2024-10-07 11:29:03.591007] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.133 [2024-10-07 11:29:03.598202] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.133 [2024-10-07 11:29:03.598387] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.133 [2024-10-07 11:29:03.598437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.133 [2024-10-07 11:29:03.598458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.133 [2024-10-07 11:29:03.598493] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.133 [2024-10-07 11:29:03.598526] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.133 [2024-10-07 11:29:03.598543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.133 [2024-10-07 11:29:03.598561] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.133 [2024-10-07 11:29:03.598592] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.133 [2024-10-07 11:29:03.602079] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.133 [2024-10-07 11:29:03.602229] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.133 [2024-10-07 11:29:03.602264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.133 [2024-10-07 11:29:03.602282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.133 [2024-10-07 11:29:03.602316] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.133 [2024-10-07 11:29:03.602347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.133 [2024-10-07 11:29:03.602365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.133 [2024-10-07 11:29:03.602380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.133 [2024-10-07 11:29:03.602596] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.133 [2024-10-07 11:29:03.608341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.133 [2024-10-07 11:29:03.608512] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.133 [2024-10-07 11:29:03.608548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.133 [2024-10-07 11:29:03.608567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.133 [2024-10-07 11:29:03.608601] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.133 [2024-10-07 11:29:03.608633] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.133 [2024-10-07 11:29:03.608650] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.133 [2024-10-07 11:29:03.608665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.133 [2024-10-07 11:29:03.609615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.133 [2024-10-07 11:29:03.612791] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.133 [2024-10-07 11:29:03.612918] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.133 [2024-10-07 11:29:03.612976] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.133 [2024-10-07 11:29:03.612996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.133 [2024-10-07 11:29:03.613031] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.133 [2024-10-07 11:29:03.613076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.133 [2024-10-07 11:29:03.613096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.133 [2024-10-07 11:29:03.613111] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.133 [2024-10-07 11:29:03.613142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.133 [2024-10-07 11:29:03.619668] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.133 [2024-10-07 11:29:03.619820] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.133 [2024-10-07 11:29:03.619854] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.133 [2024-10-07 11:29:03.619872] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.133 [2024-10-07 11:29:03.620102] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.133 [2024-10-07 11:29:03.620223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.133 [2024-10-07 11:29:03.620250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.133 [2024-10-07 11:29:03.620267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.133 [2024-10-07 11:29:03.620319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.133 [2024-10-07 11:29:03.622884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.133 [2024-10-07 11:29:03.623018] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.133 [2024-10-07 11:29:03.623051] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.133 [2024-10-07 11:29:03.623068] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.133 [2024-10-07 11:29:03.623102] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.133 [2024-10-07 11:29:03.623133] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.133 [2024-10-07 11:29:03.623150] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.133 [2024-10-07 11:29:03.623165] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.133 [2024-10-07 11:29:03.623195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.133 [2024-10-07 11:29:03.631186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.133 [2024-10-07 11:29:03.631374] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.133 [2024-10-07 11:29:03.631422] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.134 [2024-10-07 11:29:03.631444] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.134 [2024-10-07 11:29:03.631480] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.134 [2024-10-07 11:29:03.631539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.134 [2024-10-07 11:29:03.631558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.134 [2024-10-07 11:29:03.631573] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.134 [2024-10-07 11:29:03.631785] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.134 [2024-10-07 11:29:03.634275] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.134 [2024-10-07 11:29:03.634423] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.134 [2024-10-07 11:29:03.634463] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.134 [2024-10-07 11:29:03.634482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.134 [2024-10-07 11:29:03.634713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.134 [2024-10-07 11:29:03.634833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.134 [2024-10-07 11:29:03.634866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.134 [2024-10-07 11:29:03.634884] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.134 [2024-10-07 11:29:03.634939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.134 [2024-10-07 11:29:03.642039] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.134 [2024-10-07 11:29:03.642221] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.134 [2024-10-07 11:29:03.642256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.134 [2024-10-07 11:29:03.642274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.134 [2024-10-07 11:29:03.642310] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.134 [2024-10-07 11:29:03.642341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.134 [2024-10-07 11:29:03.642359] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.134 [2024-10-07 11:29:03.642374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.134 [2024-10-07 11:29:03.642421] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.134 [2024-10-07 11:29:03.645923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.134 [2024-10-07 11:29:03.646060] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.134 [2024-10-07 11:29:03.646093] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.134 [2024-10-07 11:29:03.646111] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.134 [2024-10-07 11:29:03.646144] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.134 [2024-10-07 11:29:03.646177] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.134 [2024-10-07 11:29:03.646194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.134 [2024-10-07 11:29:03.646209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.134 [2024-10-07 11:29:03.646265] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.134 [2024-10-07 11:29:03.652203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.134 [2024-10-07 11:29:03.652360] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.134 [2024-10-07 11:29:03.652394] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.134 [2024-10-07 11:29:03.652430] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.134 [2024-10-07 11:29:03.652467] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.134 [2024-10-07 11:29:03.652499] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.134 [2024-10-07 11:29:03.652516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.134 [2024-10-07 11:29:03.652531] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.134 [2024-10-07 11:29:03.652562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.134 [2024-10-07 11:29:03.656849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.134 [2024-10-07 11:29:03.656979] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.134 [2024-10-07 11:29:03.657012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.134 [2024-10-07 11:29:03.657031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.134 [2024-10-07 11:29:03.657077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.134 [2024-10-07 11:29:03.657111] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.134 [2024-10-07 11:29:03.657129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.134 [2024-10-07 11:29:03.657144] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.134 [2024-10-07 11:29:03.657175] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.134 [2024-10-07 11:29:03.663670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.134 [2024-10-07 11:29:03.663817] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.134 [2024-10-07 11:29:03.663851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.134 [2024-10-07 11:29:03.663869] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.134 [2024-10-07 11:29:03.663917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.134 [2024-10-07 11:29:03.664149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.134 [2024-10-07 11:29:03.664185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.134 [2024-10-07 11:29:03.664205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.134 [2024-10-07 11:29:03.664319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.134 [2024-10-07 11:29:03.666948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.134 [2024-10-07 11:29:03.667069] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.134 [2024-10-07 11:29:03.667101] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.134 [2024-10-07 11:29:03.667147] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.134 [2024-10-07 11:29:03.667183] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.134 [2024-10-07 11:29:03.667222] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.134 [2024-10-07 11:29:03.667241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.134 [2024-10-07 11:29:03.667256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.134 [2024-10-07 11:29:03.668196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.134 [2024-10-07 11:29:03.675370] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.134 [2024-10-07 11:29:03.675540] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.134 [2024-10-07 11:29:03.675574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.134 [2024-10-07 11:29:03.675591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.134 [2024-10-07 11:29:03.675625] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.134 [2024-10-07 11:29:03.675657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.134 [2024-10-07 11:29:03.675675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.134 [2024-10-07 11:29:03.675690] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.134 [2024-10-07 11:29:03.675721] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.134 [2024-10-07 11:29:03.678447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.134 [2024-10-07 11:29:03.678572] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.134 [2024-10-07 11:29:03.678604] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.134 [2024-10-07 11:29:03.678623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.134 [2024-10-07 11:29:03.678850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.134 [2024-10-07 11:29:03.679003] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.134 [2024-10-07 11:29:03.679042] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.134 [2024-10-07 11:29:03.679083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.134 [2024-10-07 11:29:03.679170] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.134 [2024-10-07 11:29:03.686244] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.134 [2024-10-07 11:29:03.686412] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.134 [2024-10-07 11:29:03.686448] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.134 [2024-10-07 11:29:03.686467] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.134 [2024-10-07 11:29:03.686503] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.134 [2024-10-07 11:29:03.686535] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.134 [2024-10-07 11:29:03.686578] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.134 [2024-10-07 11:29:03.686594] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.134 [2024-10-07 11:29:03.686626] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.134 [2024-10-07 11:29:03.690095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.134 [2024-10-07 11:29:03.690217] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.134 [2024-10-07 11:29:03.690249] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.135 [2024-10-07 11:29:03.690267] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.135 [2024-10-07 11:29:03.690300] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.135 [2024-10-07 11:29:03.690331] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.135 [2024-10-07 11:29:03.690348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.135 [2024-10-07 11:29:03.690362] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.135 [2024-10-07 11:29:03.690392] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.135 [2024-10-07 11:29:03.696364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.135 [2024-10-07 11:29:03.696515] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.135 [2024-10-07 11:29:03.696549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.135 [2024-10-07 11:29:03.696567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.135 [2024-10-07 11:29:03.696601] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.135 [2024-10-07 11:29:03.696632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.135 [2024-10-07 11:29:03.696650] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.135 [2024-10-07 11:29:03.696664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.135 [2024-10-07 11:29:03.697615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.135 [2024-10-07 11:29:03.700781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.135 [2024-10-07 11:29:03.700904] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.135 [2024-10-07 11:29:03.700936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.135 [2024-10-07 11:29:03.700954] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.135 [2024-10-07 11:29:03.700987] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.135 [2024-10-07 11:29:03.701018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.135 [2024-10-07 11:29:03.701035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.135 [2024-10-07 11:29:03.701049] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.135 [2024-10-07 11:29:03.701095] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.135 [2024-10-07 11:29:03.707687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.135 [2024-10-07 11:29:03.707850] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.135 [2024-10-07 11:29:03.707885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.135 [2024-10-07 11:29:03.707903] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.135 [2024-10-07 11:29:03.708137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.135 [2024-10-07 11:29:03.708258] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.135 [2024-10-07 11:29:03.708296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.135 [2024-10-07 11:29:03.708316] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.135 [2024-10-07 11:29:03.708370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.135 [2024-10-07 11:29:03.710894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.135 [2024-10-07 11:29:03.711007] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.135 [2024-10-07 11:29:03.711038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.135 [2024-10-07 11:29:03.711056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.135 [2024-10-07 11:29:03.711090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.135 [2024-10-07 11:29:03.711120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.135 [2024-10-07 11:29:03.711137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.135 [2024-10-07 11:29:03.711151] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.135 [2024-10-07 11:29:03.711180] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.135 [2024-10-07 11:29:03.719180] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.135 [2024-10-07 11:29:03.719380] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.135 [2024-10-07 11:29:03.719431] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.135 [2024-10-07 11:29:03.719451] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.135 [2024-10-07 11:29:03.719489] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.135 [2024-10-07 11:29:03.719521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.135 [2024-10-07 11:29:03.719541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.135 [2024-10-07 11:29:03.719556] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.135 [2024-10-07 11:29:03.719753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.135 [2024-10-07 11:29:03.722226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.135 [2024-10-07 11:29:03.722345] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.135 [2024-10-07 11:29:03.722376] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.135 [2024-10-07 11:29:03.722434] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.135 [2024-10-07 11:29:03.722670] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.135 [2024-10-07 11:29:03.722791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.135 [2024-10-07 11:29:03.722818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.135 [2024-10-07 11:29:03.722834] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.135 [2024-10-07 11:29:03.722885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.135 [2024-10-07 11:29:03.729968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.135 [2024-10-07 11:29:03.730142] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.135 [2024-10-07 11:29:03.730177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.135 [2024-10-07 11:29:03.730195] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.135 [2024-10-07 11:29:03.730229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.135 [2024-10-07 11:29:03.730261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.135 [2024-10-07 11:29:03.730279] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.135 [2024-10-07 11:29:03.730294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.135 [2024-10-07 11:29:03.730324] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.135 [2024-10-07 11:29:03.733798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.135 [2024-10-07 11:29:03.733936] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.135 [2024-10-07 11:29:03.733969] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.135 [2024-10-07 11:29:03.733987] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.135 [2024-10-07 11:29:03.734021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.135 [2024-10-07 11:29:03.734052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.135 [2024-10-07 11:29:03.734068] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.135 [2024-10-07 11:29:03.734083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.135 [2024-10-07 11:29:03.734288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.135 [2024-10-07 11:29:03.740099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.135 [2024-10-07 11:29:03.740257] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.135 [2024-10-07 11:29:03.740291] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.135 [2024-10-07 11:29:03.740309] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.135 [2024-10-07 11:29:03.740343] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.135 [2024-10-07 11:29:03.740375] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.135 [2024-10-07 11:29:03.740418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.135 [2024-10-07 11:29:03.740450] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.135 [2024-10-07 11:29:03.741394] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.135 [2024-10-07 11:29:03.744746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.135 [2024-10-07 11:29:03.744897] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.135 [2024-10-07 11:29:03.744932] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.135 [2024-10-07 11:29:03.744951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.135 [2024-10-07 11:29:03.744986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.135 [2024-10-07 11:29:03.745019] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.135 [2024-10-07 11:29:03.745036] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.135 [2024-10-07 11:29:03.745051] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.135 [2024-10-07 11:29:03.746337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.135 [2024-10-07 11:29:03.751680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.136 [2024-10-07 11:29:03.751851] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.136 [2024-10-07 11:29:03.751885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.136 [2024-10-07 11:29:03.751904] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.136 [2024-10-07 11:29:03.752137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.136 [2024-10-07 11:29:03.752268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.136 [2024-10-07 11:29:03.752305] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.136 [2024-10-07 11:29:03.752325] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.136 [2024-10-07 11:29:03.752380] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.136 [2024-10-07 11:29:03.754849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.136 [2024-10-07 11:29:03.754974] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.136 [2024-10-07 11:29:03.755008] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.136 [2024-10-07 11:29:03.755026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.136 [2024-10-07 11:29:03.755059] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.136 [2024-10-07 11:29:03.755090] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.136 [2024-10-07 11:29:03.755108] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.136 [2024-10-07 11:29:03.755122] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.136 [2024-10-07 11:29:03.755152] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.136 [2024-10-07 11:29:03.763212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.136 [2024-10-07 11:29:03.763422] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.136 [2024-10-07 11:29:03.763457] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.136 [2024-10-07 11:29:03.763476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.136 [2024-10-07 11:29:03.763512] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.136 [2024-10-07 11:29:03.763544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.136 [2024-10-07 11:29:03.763562] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.136 [2024-10-07 11:29:03.763577] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.136 [2024-10-07 11:29:03.763771] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.136 [2024-10-07 11:29:03.766250] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.136 [2024-10-07 11:29:03.766364] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.136 [2024-10-07 11:29:03.766419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.136 [2024-10-07 11:29:03.766440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.136 [2024-10-07 11:29:03.766667] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.136 [2024-10-07 11:29:03.766809] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.136 [2024-10-07 11:29:03.766846] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.136 [2024-10-07 11:29:03.766865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.136 [2024-10-07 11:29:03.766918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.136 [2024-10-07 11:29:03.774068] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.136 [2024-10-07 11:29:03.774236] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.136 [2024-10-07 11:29:03.774271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.136 [2024-10-07 11:29:03.774289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.136 [2024-10-07 11:29:03.774324] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.136 [2024-10-07 11:29:03.774356] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.136 [2024-10-07 11:29:03.774373] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.136 [2024-10-07 11:29:03.774389] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.136 [2024-10-07 11:29:03.775666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.136 [2024-10-07 11:29:03.778046] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.136 [2024-10-07 11:29:03.778164] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.136 [2024-10-07 11:29:03.778206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.136 [2024-10-07 11:29:03.778227] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.136 [2024-10-07 11:29:03.778480] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.136 [2024-10-07 11:29:03.778663] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.136 [2024-10-07 11:29:03.778698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.136 [2024-10-07 11:29:03.778730] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.136 [2024-10-07 11:29:03.778855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.136 [2024-10-07 11:29:03.784197] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.136 [2024-10-07 11:29:03.784342] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.136 [2024-10-07 11:29:03.784376] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.136 [2024-10-07 11:29:03.784393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.136 [2024-10-07 11:29:03.785352] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.136 [2024-10-07 11:29:03.785588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.136 [2024-10-07 11:29:03.785624] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.136 [2024-10-07 11:29:03.785643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.136 [2024-10-07 11:29:03.785723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.136 [2024-10-07 11:29:03.788631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.136 [2024-10-07 11:29:03.788751] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.136 [2024-10-07 11:29:03.788784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.136 [2024-10-07 11:29:03.788801] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.136 [2024-10-07 11:29:03.788834] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.136 [2024-10-07 11:29:03.788864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.136 [2024-10-07 11:29:03.788882] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.136 [2024-10-07 11:29:03.788896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.136 [2024-10-07 11:29:03.788936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.136 [2024-10-07 11:29:03.795556] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.136 [2024-10-07 11:29:03.795703] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.136 [2024-10-07 11:29:03.795737] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.136 [2024-10-07 11:29:03.795755] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.136 [2024-10-07 11:29:03.796009] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.136 [2024-10-07 11:29:03.796141] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.136 [2024-10-07 11:29:03.796178] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.137 [2024-10-07 11:29:03.796223] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.137 [2024-10-07 11:29:03.796287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.137 [2024-10-07 11:29:03.798723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.137 [2024-10-07 11:29:03.798840] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.137 [2024-10-07 11:29:03.798872] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.137 [2024-10-07 11:29:03.798889] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.137 [2024-10-07 11:29:03.798921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.137 [2024-10-07 11:29:03.798952] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.137 [2024-10-07 11:29:03.798969] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.137 [2024-10-07 11:29:03.798983] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.137 [2024-10-07 11:29:03.799014] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.137 [2024-10-07 11:29:03.807276] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.137 [2024-10-07 11:29:03.807481] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.137 [2024-10-07 11:29:03.807518] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.137 [2024-10-07 11:29:03.807536] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.137 [2024-10-07 11:29:03.807572] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.137 [2024-10-07 11:29:03.807605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.137 [2024-10-07 11:29:03.807623] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.137 [2024-10-07 11:29:03.807638] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.137 [2024-10-07 11:29:03.807848] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.137 [2024-10-07 11:29:03.810369] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.137 [2024-10-07 11:29:03.810494] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.137 [2024-10-07 11:29:03.810526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.137 [2024-10-07 11:29:03.810544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.137 [2024-10-07 11:29:03.810773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.137 [2024-10-07 11:29:03.810904] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.137 [2024-10-07 11:29:03.810941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.137 [2024-10-07 11:29:03.810959] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.137 [2024-10-07 11:29:03.811013] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.137 [2024-10-07 11:29:03.818123] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.137 [2024-10-07 11:29:03.818292] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.137 [2024-10-07 11:29:03.818351] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.137 [2024-10-07 11:29:03.818371] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.137 [2024-10-07 11:29:03.818423] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.137 [2024-10-07 11:29:03.818460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.137 [2024-10-07 11:29:03.818478] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.137 [2024-10-07 11:29:03.818493] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.137 [2024-10-07 11:29:03.819678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.137 [2024-10-07 11:29:03.821959] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.137 [2024-10-07 11:29:03.822082] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.137 [2024-10-07 11:29:03.822114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.137 [2024-10-07 11:29:03.822132] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.137 [2024-10-07 11:29:03.822165] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.137 [2024-10-07 11:29:03.822197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.137 [2024-10-07 11:29:03.822214] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.137 [2024-10-07 11:29:03.822228] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.137 [2024-10-07 11:29:03.822436] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.137 [2024-10-07 11:29:03.828262] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.137 [2024-10-07 11:29:03.828439] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.137 [2024-10-07 11:29:03.828475] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.137 [2024-10-07 11:29:03.828493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.137 [2024-10-07 11:29:03.828529] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.137 [2024-10-07 11:29:03.829498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.137 [2024-10-07 11:29:03.829538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.137 [2024-10-07 11:29:03.829557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.137 [2024-10-07 11:29:03.829776] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.137 [2024-10-07 11:29:03.832699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.137 [2024-10-07 11:29:03.832842] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.137 [2024-10-07 11:29:03.832876] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.137 [2024-10-07 11:29:03.832893] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.137 [2024-10-07 11:29:03.832927] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.137 [2024-10-07 11:29:03.832987] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.137 [2024-10-07 11:29:03.833006] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.137 [2024-10-07 11:29:03.833020] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.137 [2024-10-07 11:29:03.833051] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.137 [2024-10-07 11:29:03.840124] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.137 [2024-10-07 11:29:03.840423] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.137 [2024-10-07 11:29:03.840474] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.137 [2024-10-07 11:29:03.840494] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.137 [2024-10-07 11:29:03.840552] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.137 [2024-10-07 11:29:03.840592] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.137 [2024-10-07 11:29:03.840611] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.137 [2024-10-07 11:29:03.840627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.137 [2024-10-07 11:29:03.840659] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.137 [2024-10-07 11:29:03.842813] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.137 [2024-10-07 11:29:03.842953] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.137 [2024-10-07 11:29:03.842988] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.137 [2024-10-07 11:29:03.843007] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.137 [2024-10-07 11:29:03.843041] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.137 [2024-10-07 11:29:03.843094] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.137 [2024-10-07 11:29:03.843114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.137 [2024-10-07 11:29:03.843129] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.137 [2024-10-07 11:29:03.843161] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.137 [2024-10-07 11:29:03.851677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.137 [2024-10-07 11:29:03.851909] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.137 [2024-10-07 11:29:03.851947] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.137 [2024-10-07 11:29:03.851966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.137 [2024-10-07 11:29:03.852167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.137 [2024-10-07 11:29:03.852315] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.137 [2024-10-07 11:29:03.852340] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.137 [2024-10-07 11:29:03.852356] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.137 [2024-10-07 11:29:03.852535] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.137 [2024-10-07 11:29:03.854734] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.137 [2024-10-07 11:29:03.854854] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.137 [2024-10-07 11:29:03.854886] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.137 [2024-10-07 11:29:03.854924] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.137 [2024-10-07 11:29:03.855156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.137 [2024-10-07 11:29:03.855275] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.137 [2024-10-07 11:29:03.855312] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.137 [2024-10-07 11:29:03.855330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.137 [2024-10-07 11:29:03.855384] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.137 [2024-10-07 11:29:03.862387] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.137 [2024-10-07 11:29:03.862576] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.137 [2024-10-07 11:29:03.862612] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.137 [2024-10-07 11:29:03.862630] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.138 [2024-10-07 11:29:03.862665] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.138 [2024-10-07 11:29:03.862697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.138 [2024-10-07 11:29:03.862715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.138 [2024-10-07 11:29:03.862730] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.138 [2024-10-07 11:29:03.862761] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.138 [2024-10-07 11:29:03.866240] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.138 [2024-10-07 11:29:03.866373] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.138 [2024-10-07 11:29:03.866420] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.138 [2024-10-07 11:29:03.866441] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.138 [2024-10-07 11:29:03.866475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.138 [2024-10-07 11:29:03.866506] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.138 [2024-10-07 11:29:03.866523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.138 [2024-10-07 11:29:03.866538] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.138 [2024-10-07 11:29:03.866568] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.138 [2024-10-07 11:29:03.872532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.138 [2024-10-07 11:29:03.872688] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.138 [2024-10-07 11:29:03.872724] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.138 [2024-10-07 11:29:03.872777] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.138 [2024-10-07 11:29:03.872815] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.138 [2024-10-07 11:29:03.872847] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.138 [2024-10-07 11:29:03.872864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.138 [2024-10-07 11:29:03.872880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.138 [2024-10-07 11:29:03.873848] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.138 [2024-10-07 11:29:03.877072] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.138 [2024-10-07 11:29:03.877206] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.138 [2024-10-07 11:29:03.877248] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.138 [2024-10-07 11:29:03.877269] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.138 [2024-10-07 11:29:03.877303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.138 [2024-10-07 11:29:03.877335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.138 [2024-10-07 11:29:03.877352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.138 [2024-10-07 11:29:03.877366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.138 [2024-10-07 11:29:03.877396] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.138 [2024-10-07 11:29:03.883888] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.138 [2024-10-07 11:29:03.884055] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.138 [2024-10-07 11:29:03.884090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.138 [2024-10-07 11:29:03.884108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.138 [2024-10-07 11:29:03.884342] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.138 [2024-10-07 11:29:03.884480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.138 [2024-10-07 11:29:03.884509] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.138 [2024-10-07 11:29:03.884525] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.138 [2024-10-07 11:29:03.884578] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.138 [2024-10-07 11:29:03.887170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.138 [2024-10-07 11:29:03.887293] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.138 [2024-10-07 11:29:03.887325] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.138 [2024-10-07 11:29:03.887342] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.138 [2024-10-07 11:29:03.887374] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.138 [2024-10-07 11:29:03.887421] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.138 [2024-10-07 11:29:03.887468] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.138 [2024-10-07 11:29:03.887484] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.138 [2024-10-07 11:29:03.888433] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.138 [2024-10-07 11:29:03.895607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.138 [2024-10-07 11:29:03.895822] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.138 [2024-10-07 11:29:03.895860] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.138 [2024-10-07 11:29:03.895879] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.138 [2024-10-07 11:29:03.895914] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.138 [2024-10-07 11:29:03.896137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.138 [2024-10-07 11:29:03.896175] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.138 [2024-10-07 11:29:03.896195] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.138 [2024-10-07 11:29:03.896338] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.138 [2024-10-07 11:29:03.898723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.138 [2024-10-07 11:29:03.898868] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.138 [2024-10-07 11:29:03.898901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.138 [2024-10-07 11:29:03.898919] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.138 [2024-10-07 11:29:03.899152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.138 [2024-10-07 11:29:03.899293] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.138 [2024-10-07 11:29:03.899330] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.138 [2024-10-07 11:29:03.899349] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.138 [2024-10-07 11:29:03.899420] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.138 [2024-10-07 11:29:03.906592] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.138 [2024-10-07 11:29:03.906824] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.138 [2024-10-07 11:29:03.906862] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.138 [2024-10-07 11:29:03.906881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.138 [2024-10-07 11:29:03.906917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.138 [2024-10-07 11:29:03.908112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.138 [2024-10-07 11:29:03.908151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.138 [2024-10-07 11:29:03.908172] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.138 [2024-10-07 11:29:03.908433] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.138 [2024-10-07 11:29:03.910587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.138 [2024-10-07 11:29:03.910724] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.138 [2024-10-07 11:29:03.910758] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.138 [2024-10-07 11:29:03.910776] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.138 [2024-10-07 11:29:03.910985] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.138 [2024-10-07 11:29:03.911143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.138 [2024-10-07 11:29:03.911177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.139 [2024-10-07 11:29:03.911196] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.139 [2024-10-07 11:29:03.911317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.139 [2024-10-07 11:29:03.916781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.139 [2024-10-07 11:29:03.916979] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.139 [2024-10-07 11:29:03.917014] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.139 [2024-10-07 11:29:03.917032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.139 [2024-10-07 11:29:03.917100] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.139 [2024-10-07 11:29:03.918056] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.139 [2024-10-07 11:29:03.918096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.139 [2024-10-07 11:29:03.918117] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.139 [2024-10-07 11:29:03.918320] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.139 [2024-10-07 11:29:03.921310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.139 [2024-10-07 11:29:03.921452] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.139 [2024-10-07 11:29:03.921486] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.139 [2024-10-07 11:29:03.921504] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.139 [2024-10-07 11:29:03.921542] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.139 [2024-10-07 11:29:03.921573] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.139 [2024-10-07 11:29:03.921590] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.139 [2024-10-07 11:29:03.921605] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.139 [2024-10-07 11:29:03.921635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.139 [2024-10-07 11:29:03.928232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.139 [2024-10-07 11:29:03.928448] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.139 [2024-10-07 11:29:03.928486] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.139 [2024-10-07 11:29:03.928506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.139 [2024-10-07 11:29:03.928784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.139 [2024-10-07 11:29:03.928919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.139 [2024-10-07 11:29:03.928965] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.139 [2024-10-07 11:29:03.928985] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.139 [2024-10-07 11:29:03.929041] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.139 [2024-10-07 11:29:03.931446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.139 [2024-10-07 11:29:03.931583] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.139 [2024-10-07 11:29:03.931616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.139 [2024-10-07 11:29:03.931634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.139 [2024-10-07 11:29:03.931667] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.139 [2024-10-07 11:29:03.931698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.139 [2024-10-07 11:29:03.931714] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.139 [2024-10-07 11:29:03.931729] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.139 [2024-10-07 11:29:03.931760] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.139 [2024-10-07 11:29:03.939946] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.139 [2024-10-07 11:29:03.940135] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.139 [2024-10-07 11:29:03.940171] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.139 [2024-10-07 11:29:03.940190] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.139 [2024-10-07 11:29:03.940225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.139 [2024-10-07 11:29:03.940257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.139 [2024-10-07 11:29:03.940275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.139 [2024-10-07 11:29:03.940290] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.139 [2024-10-07 11:29:03.940508] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.139 [2024-10-07 11:29:03.942967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.139 [2024-10-07 11:29:03.943092] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.139 [2024-10-07 11:29:03.943124] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.139 [2024-10-07 11:29:03.943141] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.139 [2024-10-07 11:29:03.943371] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.139 [2024-10-07 11:29:03.943509] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.139 [2024-10-07 11:29:03.943547] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.139 [2024-10-07 11:29:03.943597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.139 [2024-10-07 11:29:03.943656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.139 [2024-10-07 11:29:03.950708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.139 [2024-10-07 11:29:03.950909] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.139 [2024-10-07 11:29:03.950946] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.139 [2024-10-07 11:29:03.950965] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.139 [2024-10-07 11:29:03.951000] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.139 [2024-10-07 11:29:03.951032] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.139 [2024-10-07 11:29:03.951050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.139 [2024-10-07 11:29:03.951065] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.139 [2024-10-07 11:29:03.951095] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.139 [2024-10-07 11:29:03.954577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.139 [2024-10-07 11:29:03.954736] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.139 [2024-10-07 11:29:03.954770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.139 [2024-10-07 11:29:03.954789] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.139 [2024-10-07 11:29:03.954823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.139 [2024-10-07 11:29:03.954855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.139 [2024-10-07 11:29:03.954873] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.139 [2024-10-07 11:29:03.954888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.139 [2024-10-07 11:29:03.954919] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.139 [2024-10-07 11:29:03.960855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.139 [2024-10-07 11:29:03.961024] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.139 [2024-10-07 11:29:03.961069] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.139 [2024-10-07 11:29:03.961090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.139 [2024-10-07 11:29:03.961125] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.139 [2024-10-07 11:29:03.961157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.139 [2024-10-07 11:29:03.961175] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.139 [2024-10-07 11:29:03.961190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.139 [2024-10-07 11:29:03.962134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.139 [2024-10-07 11:29:03.965359] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.139 [2024-10-07 11:29:03.965533] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.139 [2024-10-07 11:29:03.965566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.139 [2024-10-07 11:29:03.965584] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.139 [2024-10-07 11:29:03.965618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.139 [2024-10-07 11:29:03.965648] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.139 [2024-10-07 11:29:03.965665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.139 [2024-10-07 11:29:03.965680] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.139 [2024-10-07 11:29:03.965710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.139 [2024-10-07 11:29:03.972169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.139 [2024-10-07 11:29:03.972340] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.139 [2024-10-07 11:29:03.972375] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.139 [2024-10-07 11:29:03.972394] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.139 [2024-10-07 11:29:03.972647] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.139 [2024-10-07 11:29:03.972766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.139 [2024-10-07 11:29:03.972794] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.139 [2024-10-07 11:29:03.972810] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.139 [2024-10-07 11:29:03.972863] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.139 [2024-10-07 11:29:03.975504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.139 [2024-10-07 11:29:03.975625] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.139 [2024-10-07 11:29:03.975657] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.139 [2024-10-07 11:29:03.975675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.140 [2024-10-07 11:29:03.975707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.140 [2024-10-07 11:29:03.975737] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.140 [2024-10-07 11:29:03.975754] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.140 [2024-10-07 11:29:03.975768] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.140 [2024-10-07 11:29:03.976705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.140 [2024-10-07 11:29:03.983714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.140 [2024-10-07 11:29:03.983859] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.140 [2024-10-07 11:29:03.983892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.140 [2024-10-07 11:29:03.983910] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.140 [2024-10-07 11:29:03.983978] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.140 [2024-10-07 11:29:03.984012] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.140 [2024-10-07 11:29:03.984029] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.140 [2024-10-07 11:29:03.984044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.140 [2024-10-07 11:29:03.984075] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.140 [2024-10-07 11:29:03.986770] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.140 [2024-10-07 11:29:03.986887] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.140 [2024-10-07 11:29:03.986918] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.140 [2024-10-07 11:29:03.986936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.140 [2024-10-07 11:29:03.987160] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.140 [2024-10-07 11:29:03.987278] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.140 [2024-10-07 11:29:03.987305] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.140 [2024-10-07 11:29:03.987321] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.140 [2024-10-07 11:29:03.987373] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.140 [2024-10-07 11:29:03.994411] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.140 [2024-10-07 11:29:03.994538] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.140 [2024-10-07 11:29:03.994572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.140 [2024-10-07 11:29:03.994590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.140 [2024-10-07 11:29:03.994623] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.140 [2024-10-07 11:29:03.994653] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.140 [2024-10-07 11:29:03.994671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.140 [2024-10-07 11:29:03.994685] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.140 [2024-10-07 11:29:03.994714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.140 [2024-10-07 11:29:03.998210] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.140 [2024-10-07 11:29:03.998352] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.140 [2024-10-07 11:29:03.998384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.140 [2024-10-07 11:29:03.998415] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.140 [2024-10-07 11:29:03.998451] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.140 [2024-10-07 11:29:03.998482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.140 [2024-10-07 11:29:03.998499] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.140 [2024-10-07 11:29:03.998543] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.140 [2024-10-07 11:29:03.998737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.140 [2024-10-07 11:29:04.004513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.140 [2024-10-07 11:29:04.004636] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.140 [2024-10-07 11:29:04.004668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.140 [2024-10-07 11:29:04.004685] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.140 [2024-10-07 11:29:04.005643] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.140 [2024-10-07 11:29:04.005864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.140 [2024-10-07 11:29:04.005897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.140 [2024-10-07 11:29:04.005914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.140 [2024-10-07 11:29:04.005992] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.140 [2024-10-07 11:29:04.008845] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.140 [2024-10-07 11:29:04.008964] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.140 [2024-10-07 11:29:04.008995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.140 [2024-10-07 11:29:04.009013] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.140 [2024-10-07 11:29:04.009045] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.140 [2024-10-07 11:29:04.009097] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.140 [2024-10-07 11:29:04.009115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.140 [2024-10-07 11:29:04.009130] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.140 [2024-10-07 11:29:04.009160] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.140 [2024-10-07 11:29:04.015659] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.140 [2024-10-07 11:29:04.015802] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.140 [2024-10-07 11:29:04.015835] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.140 [2024-10-07 11:29:04.015853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.140 [2024-10-07 11:29:04.016082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.140 [2024-10-07 11:29:04.016221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.140 [2024-10-07 11:29:04.016260] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.140 [2024-10-07 11:29:04.016280] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.140 [2024-10-07 11:29:04.016334] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.140 [2024-10-07 11:29:04.018937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.140 [2024-10-07 11:29:04.019050] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.140 [2024-10-07 11:29:04.019106] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.141 [2024-10-07 11:29:04.019125] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.141 [2024-10-07 11:29:04.019158] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.141 [2024-10-07 11:29:04.019189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.141 [2024-10-07 11:29:04.019206] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.141 [2024-10-07 11:29:04.019220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.141 [2024-10-07 11:29:04.019249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.141 [2024-10-07 11:29:04.027284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.141 [2024-10-07 11:29:04.027470] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.141 [2024-10-07 11:29:04.027512] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.141 [2024-10-07 11:29:04.027531] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.141 [2024-10-07 11:29:04.027568] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.141 [2024-10-07 11:29:04.027600] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.141 [2024-10-07 11:29:04.027617] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.141 [2024-10-07 11:29:04.027633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.141 [2024-10-07 11:29:04.027663] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.141 [2024-10-07 11:29:04.030373] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.141 [2024-10-07 11:29:04.030510] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.141 [2024-10-07 11:29:04.030542] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.141 [2024-10-07 11:29:04.030560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.141 [2024-10-07 11:29:04.030791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.141 [2024-10-07 11:29:04.030910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.141 [2024-10-07 11:29:04.030937] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.141 [2024-10-07 11:29:04.030952] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.141 [2024-10-07 11:29:04.031003] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.141 [2024-10-07 11:29:04.038161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.141 [2024-10-07 11:29:04.038327] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.141 [2024-10-07 11:29:04.038361] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.141 [2024-10-07 11:29:04.038379] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.141 [2024-10-07 11:29:04.038429] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.141 [2024-10-07 11:29:04.038491] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.141 [2024-10-07 11:29:04.038509] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.141 [2024-10-07 11:29:04.038524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.141 [2024-10-07 11:29:04.038554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.141 [2024-10-07 11:29:04.042011] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.141 [2024-10-07 11:29:04.042153] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.141 [2024-10-07 11:29:04.042185] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.141 [2024-10-07 11:29:04.042203] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.141 [2024-10-07 11:29:04.042237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.141 [2024-10-07 11:29:04.042268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.141 [2024-10-07 11:29:04.042285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.141 [2024-10-07 11:29:04.042299] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.141 [2024-10-07 11:29:04.042505] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.141 [2024-10-07 11:29:04.048292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.141 [2024-10-07 11:29:04.048469] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.141 [2024-10-07 11:29:04.048503] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.141 [2024-10-07 11:29:04.048521] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.141 [2024-10-07 11:29:04.048557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.141 [2024-10-07 11:29:04.049522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.141 [2024-10-07 11:29:04.049562] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.141 [2024-10-07 11:29:04.049581] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.141 [2024-10-07 11:29:04.049782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.141 [2024-10-07 11:29:04.052758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.141 [2024-10-07 11:29:04.052891] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.141 [2024-10-07 11:29:04.052924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.141 [2024-10-07 11:29:04.052942] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.141 [2024-10-07 11:29:04.052977] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.141 [2024-10-07 11:29:04.053008] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.141 [2024-10-07 11:29:04.053025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.141 [2024-10-07 11:29:04.053040] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.141 [2024-10-07 11:29:04.053118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.141 [2024-10-07 11:29:04.059683] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.141 [2024-10-07 11:29:04.059873] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.141 [2024-10-07 11:29:04.059908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.141 [2024-10-07 11:29:04.059926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.141 [2024-10-07 11:29:04.060160] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.141 [2024-10-07 11:29:04.060292] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.141 [2024-10-07 11:29:04.060330] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.141 [2024-10-07 11:29:04.060350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.141 [2024-10-07 11:29:04.060419] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.141 [2024-10-07 11:29:04.062872] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.141 [2024-10-07 11:29:04.062991] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.141 [2024-10-07 11:29:04.063023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.141 [2024-10-07 11:29:04.063040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.141 [2024-10-07 11:29:04.063072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.141 [2024-10-07 11:29:04.063103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.141 [2024-10-07 11:29:04.063120] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.141 [2024-10-07 11:29:04.063135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.141 [2024-10-07 11:29:04.063164] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.141 [2024-10-07 11:29:04.071265] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.141 [2024-10-07 11:29:04.071458] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.141 [2024-10-07 11:29:04.071494] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.141 [2024-10-07 11:29:04.071513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.141 [2024-10-07 11:29:04.071552] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.141 [2024-10-07 11:29:04.071584] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.141 [2024-10-07 11:29:04.071602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.141 [2024-10-07 11:29:04.071617] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.141 [2024-10-07 11:29:04.071815] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.141 [2024-10-07 11:29:04.074310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.141 [2024-10-07 11:29:04.074457] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.141 [2024-10-07 11:29:04.074505] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.141 [2024-10-07 11:29:04.074558] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.141 [2024-10-07 11:29:04.074801] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.141 [2024-10-07 11:29:04.074937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.141 [2024-10-07 11:29:04.074973] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.141 [2024-10-07 11:29:04.074992] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.141 [2024-10-07 11:29:04.075046] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.141 [2024-10-07 11:29:04.082150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.141 [2024-10-07 11:29:04.082527] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.141 [2024-10-07 11:29:04.082578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.141 [2024-10-07 11:29:04.082601] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.141 [2024-10-07 11:29:04.082707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.141 [2024-10-07 11:29:04.082758] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.141 [2024-10-07 11:29:04.082779] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.141 [2024-10-07 11:29:04.082796] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.141 [2024-10-07 11:29:04.082828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.141 [2024-10-07 11:29:04.084426] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.141 [2024-10-07 11:29:04.085659] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.141 [2024-10-07 11:29:04.085705] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.142 [2024-10-07 11:29:04.085727] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.142 [2024-10-07 11:29:04.086580] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.142 [2024-10-07 11:29:04.086716] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.142 [2024-10-07 11:29:04.086751] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.142 [2024-10-07 11:29:04.086769] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.142 [2024-10-07 11:29:04.086805] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.142 [2024-10-07 11:29:04.092532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.142 [2024-10-07 11:29:04.092730] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.142 [2024-10-07 11:29:04.092766] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.142 [2024-10-07 11:29:04.092785] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.142 [2024-10-07 11:29:04.092821] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.142 [2024-10-07 11:29:04.092866] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.142 [2024-10-07 11:29:04.092919] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.142 [2024-10-07 11:29:04.092936] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.142 [2024-10-07 11:29:04.092969] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.142 [2024-10-07 11:29:04.094685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.142 [2024-10-07 11:29:04.094804] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.142 [2024-10-07 11:29:04.094837] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.142 [2024-10-07 11:29:04.094855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.142 [2024-10-07 11:29:04.094888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.142 [2024-10-07 11:29:04.094919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.142 [2024-10-07 11:29:04.094936] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.142 [2024-10-07 11:29:04.094950] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.142 [2024-10-07 11:29:04.096193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.142 8266.83 IOPS, 32.29 MiB/s [2024-10-07T11:29:07.853Z] [2024-10-07 11:29:04.104651] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.142 [2024-10-07 11:29:04.105746] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.142 [2024-10-07 11:29:04.105797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.142 [2024-10-07 11:29:04.105820] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.142 [2024-10-07 11:29:04.106006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.142 [2024-10-07 11:29:04.106089] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.142 [2024-10-07 11:29:04.106129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.142 [2024-10-07 11:29:04.106146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.142 [2024-10-07 11:29:04.106162] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.142 [2024-10-07 11:29:04.106192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.142 [2024-10-07 11:29:04.106254] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.142 [2024-10-07 11:29:04.106281] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.142 [2024-10-07 11:29:04.106298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.142 [2024-10-07 11:29:04.106330] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.142 [2024-10-07 11:29:04.106361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.142 [2024-10-07 11:29:04.106377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.142 [2024-10-07 11:29:04.106391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.142 [2024-10-07 11:29:04.106452] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.142 [2024-10-07 11:29:04.116607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.142 [2024-10-07 11:29:04.116733] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.142 [2024-10-07 11:29:04.116843] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.142 [2024-10-07 11:29:04.116876] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.142 [2024-10-07 11:29:04.116895] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.142 [2024-10-07 11:29:04.116962] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.142 [2024-10-07 11:29:04.116989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.142 [2024-10-07 11:29:04.117006] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.142 [2024-10-07 11:29:04.117027] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.142 [2024-10-07 11:29:04.117251] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.142 [2024-10-07 11:29:04.117282] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.142 [2024-10-07 11:29:04.117298] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.142 [2024-10-07 11:29:04.117314] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.142 [2024-10-07 11:29:04.117471] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.142 [2024-10-07 11:29:04.117497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.142 [2024-10-07 11:29:04.117511] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.142 [2024-10-07 11:29:04.117525] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.142 [2024-10-07 11:29:04.117645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.142 [2024-10-07 11:29:04.127690] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.142 [2024-10-07 11:29:04.127790] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.142 [2024-10-07 11:29:04.127924] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.142 [2024-10-07 11:29:04.127960] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.142 [2024-10-07 11:29:04.127979] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.142 [2024-10-07 11:29:04.128028] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.142 [2024-10-07 11:29:04.128052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.142 [2024-10-07 11:29:04.128068] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.142 [2024-10-07 11:29:04.129291] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.142 [2024-10-07 11:29:04.129340] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.142 [2024-10-07 11:29:04.129588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.142 [2024-10-07 11:29:04.129626] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.142 [2024-10-07 11:29:04.129671] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.142 [2024-10-07 11:29:04.129692] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.142 [2024-10-07 11:29:04.129707] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.142 [2024-10-07 11:29:04.129720] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.142 [2024-10-07 11:29:04.130878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.142 [2024-10-07 11:29:04.130920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.142 [2024-10-07 11:29:04.137890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.142 [2024-10-07 11:29:04.138013] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.142 [2024-10-07 11:29:04.138130] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.142 [2024-10-07 11:29:04.138163] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.142 [2024-10-07 11:29:04.138182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.142 [2024-10-07 11:29:04.138269] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.142 [2024-10-07 11:29:04.138298] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.142 [2024-10-07 11:29:04.138314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.142 [2024-10-07 11:29:04.138335] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.142 [2024-10-07 11:29:04.138368] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.142 [2024-10-07 11:29:04.138388] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.142 [2024-10-07 11:29:04.138425] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.142 [2024-10-07 11:29:04.138455] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.142 [2024-10-07 11:29:04.138503] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.142 [2024-10-07 11:29:04.138523] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.142 [2024-10-07 11:29:04.138538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.142 [2024-10-07 11:29:04.138552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.142 [2024-10-07 11:29:04.138579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.142 [2024-10-07 11:29:04.148053] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.142 [2024-10-07 11:29:04.148264] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.142 [2024-10-07 11:29:04.148301] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.142 [2024-10-07 11:29:04.148320] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.142 [2024-10-07 11:29:04.149298] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.142 [2024-10-07 11:29:04.149358] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.142 [2024-10-07 11:29:04.150175] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.142 [2024-10-07 11:29:04.150245] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.142 [2024-10-07 11:29:04.150268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.142 [2024-10-07 11:29:04.150285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.142 [2024-10-07 11:29:04.150298] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.142 [2024-10-07 11:29:04.150313] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.142 [2024-10-07 11:29:04.150658] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.142 [2024-10-07 11:29:04.150706] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.142 [2024-10-07 11:29:04.150824] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.143 [2024-10-07 11:29:04.150863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.143 [2024-10-07 11:29:04.150881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.143 [2024-10-07 11:29:04.150963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.143 [2024-10-07 11:29:04.158256] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.143 [2024-10-07 11:29:04.158496] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.143 [2024-10-07 11:29:04.158537] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.143 [2024-10-07 11:29:04.158556] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.143 [2024-10-07 11:29:04.158597] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.143 [2024-10-07 11:29:04.158629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.143 [2024-10-07 11:29:04.158647] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.143 [2024-10-07 11:29:04.158663] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.143 [2024-10-07 11:29:04.159882] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.143 [2024-10-07 11:29:04.160232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.143 [2024-10-07 11:29:04.161498] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.143 [2024-10-07 11:29:04.161548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.143 [2024-10-07 11:29:04.161569] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.143 [2024-10-07 11:29:04.162393] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.143 [2024-10-07 11:29:04.162535] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.143 [2024-10-07 11:29:04.162569] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.143 [2024-10-07 11:29:04.162588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.143 [2024-10-07 11:29:04.162626] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.143 [2024-10-07 11:29:04.168448] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.143 [2024-10-07 11:29:04.168681] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.143 [2024-10-07 11:29:04.168720] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.143 [2024-10-07 11:29:04.168739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.143 [2024-10-07 11:29:04.168775] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.143 [2024-10-07 11:29:04.168829] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.143 [2024-10-07 11:29:04.168850] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.143 [2024-10-07 11:29:04.168866] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.143 [2024-10-07 11:29:04.168899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.143 [2024-10-07 11:29:04.170537] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.143 [2024-10-07 11:29:04.170658] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.143 [2024-10-07 11:29:04.170692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.143 [2024-10-07 11:29:04.170709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.143 [2024-10-07 11:29:04.170742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.143 [2024-10-07 11:29:04.170774] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.143 [2024-10-07 11:29:04.170792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.143 [2024-10-07 11:29:04.170806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.143 [2024-10-07 11:29:04.170835] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.143 [2024-10-07 11:29:04.178632] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.143 [2024-10-07 11:29:04.178827] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.143 [2024-10-07 11:29:04.178864] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.143 [2024-10-07 11:29:04.178882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.143 [2024-10-07 11:29:04.179849] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.143 [2024-10-07 11:29:04.180645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.143 [2024-10-07 11:29:04.180685] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.143 [2024-10-07 11:29:04.180705] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.143 [2024-10-07 11:29:04.180829] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.143 [2024-10-07 11:29:04.180870] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.143 [2024-10-07 11:29:04.180964] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.143 [2024-10-07 11:29:04.180995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.143 [2024-10-07 11:29:04.181012] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.143 [2024-10-07 11:29:04.181289] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.143 [2024-10-07 11:29:04.181440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.143 [2024-10-07 11:29:04.181477] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.143 [2024-10-07 11:29:04.181495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.143 [2024-10-07 11:29:04.181550] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.143 [2024-10-07 11:29:04.188931] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.143 [2024-10-07 11:29:04.189157] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.143 [2024-10-07 11:29:04.189196] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.143 [2024-10-07 11:29:04.189216] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.143 [2024-10-07 11:29:04.189254] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.143 [2024-10-07 11:29:04.189288] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.143 [2024-10-07 11:29:04.189305] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.143 [2024-10-07 11:29:04.189320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.143 [2024-10-07 11:29:04.189351] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.143 [2024-10-07 11:29:04.192054] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.143 [2024-10-07 11:29:04.193030] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.143 [2024-10-07 11:29:04.193097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.143 [2024-10-07 11:29:04.193121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.143 [2024-10-07 11:29:04.193232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.143 [2024-10-07 11:29:04.193272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.143 [2024-10-07 11:29:04.193291] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.143 [2024-10-07 11:29:04.193306] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.143 [2024-10-07 11:29:04.193340] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.143 [2024-10-07 11:29:04.199091] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.143 [2024-10-07 11:29:04.199274] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.143 [2024-10-07 11:29:04.199309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.143 [2024-10-07 11:29:04.199328] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.143 [2024-10-07 11:29:04.199364] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.143 [2024-10-07 11:29:04.199441] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.143 [2024-10-07 11:29:04.199476] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.143 [2024-10-07 11:29:04.199524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.143 [2024-10-07 11:29:04.199561] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.143 [2024-10-07 11:29:04.202747] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.143 [2024-10-07 11:29:04.202884] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.143 [2024-10-07 11:29:04.202917] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.143 [2024-10-07 11:29:04.202935] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.143 [2024-10-07 11:29:04.202969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.143 [2024-10-07 11:29:04.203000] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.143 [2024-10-07 11:29:04.203017] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.143 [2024-10-07 11:29:04.203032] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.143 [2024-10-07 11:29:04.203061] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.143 [2024-10-07 11:29:04.209240] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.143 [2024-10-07 11:29:04.210340] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.143 [2024-10-07 11:29:04.210390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.143 [2024-10-07 11:29:04.210426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.143 [2024-10-07 11:29:04.211176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.143 [2024-10-07 11:29:04.211300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.143 [2024-10-07 11:29:04.211331] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.143 [2024-10-07 11:29:04.211348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.143 [2024-10-07 11:29:04.211382] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.143 [2024-10-07 11:29:04.212854] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.143 [2024-10-07 11:29:04.212976] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.143 [2024-10-07 11:29:04.213008] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.143 [2024-10-07 11:29:04.213026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.143 [2024-10-07 11:29:04.213075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.143 [2024-10-07 11:29:04.213112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.143 [2024-10-07 11:29:04.213130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.143 [2024-10-07 11:29:04.213144] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.143 [2024-10-07 11:29:04.213174] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.144 [2024-10-07 11:29:04.219392] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.144 [2024-10-07 11:29:04.219618] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.144 [2024-10-07 11:29:04.219690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.144 [2024-10-07 11:29:04.219711] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.144 [2024-10-07 11:29:04.220916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.144 [2024-10-07 11:29:04.221206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.144 [2024-10-07 11:29:04.221255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.144 [2024-10-07 11:29:04.221274] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.144 [2024-10-07 11:29:04.222412] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.144 [2024-10-07 11:29:04.223363] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.144 [2024-10-07 11:29:04.223516] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.144 [2024-10-07 11:29:04.223562] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.144 [2024-10-07 11:29:04.223583] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.144 [2024-10-07 11:29:04.223618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.144 [2024-10-07 11:29:04.223650] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.144 [2024-10-07 11:29:04.223667] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.144 [2024-10-07 11:29:04.223681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.144 [2024-10-07 11:29:04.223876] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.144 [2024-10-07 11:29:04.229563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.144 [2024-10-07 11:29:04.229698] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.144 [2024-10-07 11:29:04.229732] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.144 [2024-10-07 11:29:04.229751] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.144 [2024-10-07 11:29:04.229815] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.144 [2024-10-07 11:29:04.229851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.144 [2024-10-07 11:29:04.229869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.144 [2024-10-07 11:29:04.229883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.144 [2024-10-07 11:29:04.229914] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.144 [2024-10-07 11:29:04.234356] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.144 [2024-10-07 11:29:04.234496] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.144 [2024-10-07 11:29:04.234530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.144 [2024-10-07 11:29:04.234548] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.144 [2024-10-07 11:29:04.234581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.144 [2024-10-07 11:29:04.234642] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.144 [2024-10-07 11:29:04.234661] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.144 [2024-10-07 11:29:04.234676] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.144 [2024-10-07 11:29:04.234706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.144 [2024-10-07 11:29:04.239677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.144 [2024-10-07 11:29:04.240758] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.144 [2024-10-07 11:29:04.240823] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.144 [2024-10-07 11:29:04.240853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.144 [2024-10-07 11:29:04.241649] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.144 [2024-10-07 11:29:04.241782] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.144 [2024-10-07 11:29:04.241828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.144 [2024-10-07 11:29:04.241858] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.144 [2024-10-07 11:29:04.241918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.144 [2024-10-07 11:29:04.244611] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.144 [2024-10-07 11:29:04.244743] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.144 [2024-10-07 11:29:04.244777] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.144 [2024-10-07 11:29:04.244795] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.144 [2024-10-07 11:29:04.244828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.144 [2024-10-07 11:29:04.244860] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.144 [2024-10-07 11:29:04.244877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.144 [2024-10-07 11:29:04.244892] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.144 [2024-10-07 11:29:04.244922] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.144 [2024-10-07 11:29:04.249794] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.144 [2024-10-07 11:29:04.249939] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.144 [2024-10-07 11:29:04.249974] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.144 [2024-10-07 11:29:04.249992] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.144 [2024-10-07 11:29:04.250027] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.144 [2024-10-07 11:29:04.251232] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.144 [2024-10-07 11:29:04.251274] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.144 [2024-10-07 11:29:04.251293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.144 [2024-10-07 11:29:04.251583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.144 [2024-10-07 11:29:04.254719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.144 [2024-10-07 11:29:04.254865] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.144 [2024-10-07 11:29:04.254916] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.144 [2024-10-07 11:29:04.254938] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.144 [2024-10-07 11:29:04.254973] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.144 [2024-10-07 11:29:04.255006] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.144 [2024-10-07 11:29:04.255023] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.144 [2024-10-07 11:29:04.255037] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.144 [2024-10-07 11:29:04.255986] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.144 [2024-10-07 11:29:04.259907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.144 [2024-10-07 11:29:04.260055] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.144 [2024-10-07 11:29:04.260089] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.144 [2024-10-07 11:29:04.260108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.144 [2024-10-07 11:29:04.260159] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.144 [2024-10-07 11:29:04.260194] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.144 [2024-10-07 11:29:04.260211] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.144 [2024-10-07 11:29:04.260226] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.144 [2024-10-07 11:29:04.260256] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.144 [2024-10-07 11:29:04.264864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.144 [2024-10-07 11:29:04.265008] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.144 [2024-10-07 11:29:04.265042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.144 [2024-10-07 11:29:04.265076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.144 [2024-10-07 11:29:04.265115] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.144 [2024-10-07 11:29:04.265147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.144 [2024-10-07 11:29:04.265164] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.144 [2024-10-07 11:29:04.265179] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.144 [2024-10-07 11:29:04.265209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.144 [2024-10-07 11:29:04.270022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.144 [2024-10-07 11:29:04.271085] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.144 [2024-10-07 11:29:04.271134] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.144 [2024-10-07 11:29:04.271181] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.144 [2024-10-07 11:29:04.271953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.144 [2024-10-07 11:29:04.272081] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.144 [2024-10-07 11:29:04.272115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.144 [2024-10-07 11:29:04.272134] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.144 [2024-10-07 11:29:04.272362] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.144 [2024-10-07 11:29:04.274972] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.144 [2024-10-07 11:29:04.275095] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.144 [2024-10-07 11:29:04.275128] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.144 [2024-10-07 11:29:04.275146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.144 [2024-10-07 11:29:04.275178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.144 [2024-10-07 11:29:04.275210] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.144 [2024-10-07 11:29:04.275227] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.145 [2024-10-07 11:29:04.275242] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.145 [2024-10-07 11:29:04.275271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.145 [2024-10-07 11:29:04.280134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.145 [2024-10-07 11:29:04.280275] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.145 [2024-10-07 11:29:04.280308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.145 [2024-10-07 11:29:04.280326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.145 [2024-10-07 11:29:04.281542] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.145 [2024-10-07 11:29:04.281795] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.145 [2024-10-07 11:29:04.281833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.145 [2024-10-07 11:29:04.281853] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.145 [2024-10-07 11:29:04.282972] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.145 [2024-10-07 11:29:04.285083] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.145 [2024-10-07 11:29:04.285212] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.145 [2024-10-07 11:29:04.285247] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.145 [2024-10-07 11:29:04.285266] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.145 [2024-10-07 11:29:04.285299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.145 [2024-10-07 11:29:04.286242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.145 [2024-10-07 11:29:04.286303] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.145 [2024-10-07 11:29:04.286323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.145 [2024-10-07 11:29:04.287109] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.145 [2024-10-07 11:29:04.290244] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.145 [2024-10-07 11:29:04.290395] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.145 [2024-10-07 11:29:04.290451] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.145 [2024-10-07 11:29:04.290472] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.145 [2024-10-07 11:29:04.290507] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.145 [2024-10-07 11:29:04.290539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.145 [2024-10-07 11:29:04.290556] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.145 [2024-10-07 11:29:04.290571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.145 [2024-10-07 11:29:04.290601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.145 [2024-10-07 11:29:04.295184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.145 [2024-10-07 11:29:04.295320] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.145 [2024-10-07 11:29:04.295353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.145 [2024-10-07 11:29:04.295371] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.145 [2024-10-07 11:29:04.295419] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.145 [2024-10-07 11:29:04.295455] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.145 [2024-10-07 11:29:04.295473] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.145 [2024-10-07 11:29:04.295488] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.145 [2024-10-07 11:29:04.296671] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.145 [2024-10-07 11:29:04.301251] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.145 [2024-10-07 11:29:04.302120] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.145 [2024-10-07 11:29:04.302167] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.145 [2024-10-07 11:29:04.302189] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.145 [2024-10-07 11:29:04.302293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.145 [2024-10-07 11:29:04.302331] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.145 [2024-10-07 11:29:04.302349] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.145 [2024-10-07 11:29:04.302364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.145 [2024-10-07 11:29:04.302397] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.145 [2024-10-07 11:29:04.305291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.145 [2024-10-07 11:29:04.305428] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.145 [2024-10-07 11:29:04.305466] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.145 [2024-10-07 11:29:04.305486] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.145 [2024-10-07 11:29:04.305520] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.145 [2024-10-07 11:29:04.305552] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.145 [2024-10-07 11:29:04.305569] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.145 [2024-10-07 11:29:04.305583] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.145 [2024-10-07 11:29:04.305613] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.145 [2024-10-07 11:29:04.312055] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.145 [2024-10-07 11:29:04.313300] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.145 [2024-10-07 11:29:04.313348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.145 [2024-10-07 11:29:04.313369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.145 [2024-10-07 11:29:04.314205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.145 [2024-10-07 11:29:04.314334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.145 [2024-10-07 11:29:04.314368] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.145 [2024-10-07 11:29:04.314387] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.145 [2024-10-07 11:29:04.314436] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.145 [2024-10-07 11:29:04.315383] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.145 [2024-10-07 11:29:04.315506] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.145 [2024-10-07 11:29:04.315543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.145 [2024-10-07 11:29:04.315562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.145 [2024-10-07 11:29:04.315594] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.145 [2024-10-07 11:29:04.316531] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.145 [2024-10-07 11:29:04.316568] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.145 [2024-10-07 11:29:04.316586] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.145 [2024-10-07 11:29:04.317364] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.145 [2024-10-07 11:29:04.322286] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.145 [2024-10-07 11:29:04.322463] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.145 [2024-10-07 11:29:04.322499] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.145 [2024-10-07 11:29:04.322518] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.145 [2024-10-07 11:29:04.322581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.145 [2024-10-07 11:29:04.323830] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.145 [2024-10-07 11:29:04.323868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.145 [2024-10-07 11:29:04.323888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.145 [2024-10-07 11:29:04.324076] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.145 [2024-10-07 11:29:04.325485] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.145 [2024-10-07 11:29:04.325600] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.145 [2024-10-07 11:29:04.325632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.145 [2024-10-07 11:29:04.325649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.145 [2024-10-07 11:29:04.325681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.145 [2024-10-07 11:29:04.325712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.145 [2024-10-07 11:29:04.325729] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.145 [2024-10-07 11:29:04.325743] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.145 [2024-10-07 11:29:04.325772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.145 [2024-10-07 11:29:04.332488] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.145 [2024-10-07 11:29:04.332665] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.145 [2024-10-07 11:29:04.332699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.145 [2024-10-07 11:29:04.332718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.145 [2024-10-07 11:29:04.332952] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.145 [2024-10-07 11:29:04.333098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.145 [2024-10-07 11:29:04.333135] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.145 [2024-10-07 11:29:04.333155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.145 [2024-10-07 11:29:04.333209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.145 [2024-10-07 11:29:04.335575] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.145 [2024-10-07 11:29:04.335691] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.145 [2024-10-07 11:29:04.335722] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.145 [2024-10-07 11:29:04.335740] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.145 [2024-10-07 11:29:04.335773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.145 [2024-10-07 11:29:04.335804] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.145 [2024-10-07 11:29:04.335821] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.145 [2024-10-07 11:29:04.335860] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.145 [2024-10-07 11:29:04.335892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.145 [2024-10-07 11:29:04.344348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.145 [2024-10-07 11:29:04.344539] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.145 [2024-10-07 11:29:04.344575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.145 [2024-10-07 11:29:04.344594] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.145 [2024-10-07 11:29:04.344630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.145 [2024-10-07 11:29:04.344663] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.145 [2024-10-07 11:29:04.344680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.145 [2024-10-07 11:29:04.344695] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.145 [2024-10-07 11:29:04.344725] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.145 [2024-10-07 11:29:04.345665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.145 [2024-10-07 11:29:04.345772] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.145 [2024-10-07 11:29:04.345803] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.146 [2024-10-07 11:29:04.345820] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.146 [2024-10-07 11:29:04.345852] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.146 [2024-10-07 11:29:04.346789] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.146 [2024-10-07 11:29:04.346828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.146 [2024-10-07 11:29:04.346847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.146 [2024-10-07 11:29:04.347627] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.146 [2024-10-07 11:29:04.355419] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.146 [2024-10-07 11:29:04.355749] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.146 [2024-10-07 11:29:04.355810] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.146 [2024-10-07 11:29:04.355842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.146 [2024-10-07 11:29:04.355893] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.146 [2024-10-07 11:29:04.357249] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.146 [2024-10-07 11:29:04.357296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.146 [2024-10-07 11:29:04.357318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.146 [2024-10-07 11:29:04.357566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.146 [2024-10-07 11:29:04.357610] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.146 [2024-10-07 11:29:04.358831] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.146 [2024-10-07 11:29:04.358879] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.146 [2024-10-07 11:29:04.358901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.146 [2024-10-07 11:29:04.359757] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.146 [2024-10-07 11:29:04.359911] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.146 [2024-10-07 11:29:04.359948] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.146 [2024-10-07 11:29:04.359966] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.146 [2024-10-07 11:29:04.360001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.146 [2024-10-07 11:29:04.365584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.146 [2024-10-07 11:29:04.365736] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.146 [2024-10-07 11:29:04.365770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.146 [2024-10-07 11:29:04.365789] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.146 [2024-10-07 11:29:04.365822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.146 [2024-10-07 11:29:04.365855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.146 [2024-10-07 11:29:04.365872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.146 [2024-10-07 11:29:04.365888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.146 [2024-10-07 11:29:04.365918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.146 [2024-10-07 11:29:04.367701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.146 [2024-10-07 11:29:04.367842] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.146 [2024-10-07 11:29:04.367876] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.146 [2024-10-07 11:29:04.367894] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.146 [2024-10-07 11:29:04.369179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.146 [2024-10-07 11:29:04.369394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.146 [2024-10-07 11:29:04.369457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.146 [2024-10-07 11:29:04.369477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.146 [2024-10-07 11:29:04.369515] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.146 [2024-10-07 11:29:04.375710] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.146 [2024-10-07 11:29:04.375874] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.146 [2024-10-07 11:29:04.375910] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.146 [2024-10-07 11:29:04.375928] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.146 [2024-10-07 11:29:04.376903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.146 [2024-10-07 11:29:04.377727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.146 [2024-10-07 11:29:04.377768] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.146 [2024-10-07 11:29:04.377788] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.146 [2024-10-07 11:29:04.377895] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.146 [2024-10-07 11:29:04.377956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.146 [2024-10-07 11:29:04.378242] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.146 [2024-10-07 11:29:04.378285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.146 [2024-10-07 11:29:04.378306] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.146 [2024-10-07 11:29:04.378439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.146 [2024-10-07 11:29:04.378502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.146 [2024-10-07 11:29:04.378527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.146 [2024-10-07 11:29:04.378541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.146 [2024-10-07 11:29:04.378572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.146 [2024-10-07 11:29:04.385837] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.146 [2024-10-07 11:29:04.386001] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.146 [2024-10-07 11:29:04.386036] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.146 [2024-10-07 11:29:04.386055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.146 [2024-10-07 11:29:04.386090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.146 [2024-10-07 11:29:04.386121] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.146 [2024-10-07 11:29:04.386138] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.146 [2024-10-07 11:29:04.386152] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.146 [2024-10-07 11:29:04.387351] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.146 [2024-10-07 11:29:04.389752] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.146 [2024-10-07 11:29:04.389868] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.146 [2024-10-07 11:29:04.389899] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.146 [2024-10-07 11:29:04.389917] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.146 [2024-10-07 11:29:04.389949] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.146 [2024-10-07 11:29:04.389980] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.146 [2024-10-07 11:29:04.389997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.146 [2024-10-07 11:29:04.390011] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.146 [2024-10-07 11:29:04.390067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.146 [2024-10-07 11:29:04.395965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.146 [2024-10-07 11:29:04.396101] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.146 [2024-10-07 11:29:04.396134] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.146 [2024-10-07 11:29:04.396153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.146 [2024-10-07 11:29:04.396187] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.146 [2024-10-07 11:29:04.396218] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.146 [2024-10-07 11:29:04.396234] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.146 [2024-10-07 11:29:04.396249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.146 [2024-10-07 11:29:04.396279] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.146 [2024-10-07 11:29:04.400722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.146 [2024-10-07 11:29:04.400921] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.146 [2024-10-07 11:29:04.400955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.146 [2024-10-07 11:29:04.400974] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.146 [2024-10-07 11:29:04.401026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.146 [2024-10-07 11:29:04.401072] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.146 [2024-10-07 11:29:04.401093] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.146 [2024-10-07 11:29:04.401108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.146 [2024-10-07 11:29:04.401139] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.146 [2024-10-07 11:29:04.406078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.146 [2024-10-07 11:29:04.407120] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.146 [2024-10-07 11:29:04.407166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.146 [2024-10-07 11:29:04.407188] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.146 [2024-10-07 11:29:04.407960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.146 [2024-10-07 11:29:04.408084] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.146 [2024-10-07 11:29:04.408117] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.146 [2024-10-07 11:29:04.408136] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.146 [2024-10-07 11:29:04.408184] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.146 [2024-10-07 11:29:04.410830] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.146 [2024-10-07 11:29:04.410954] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.146 [2024-10-07 11:29:04.411008] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.146 [2024-10-07 11:29:04.411027] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.146 [2024-10-07 11:29:04.411073] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.146 [2024-10-07 11:29:04.411123] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.146 [2024-10-07 11:29:04.411143] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.146 [2024-10-07 11:29:04.411157] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.146 [2024-10-07 11:29:04.411188] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.146 [2024-10-07 11:29:04.416194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.146 [2024-10-07 11:29:04.416335] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.146 [2024-10-07 11:29:04.416367] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.146 [2024-10-07 11:29:04.416385] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.146 [2024-10-07 11:29:04.417605] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.146 [2024-10-07 11:29:04.417835] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.146 [2024-10-07 11:29:04.417871] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.146 [2024-10-07 11:29:04.417889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.147 [2024-10-07 11:29:04.419007] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.147 [2024-10-07 11:29:04.420942] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.147 [2024-10-07 11:29:04.421079] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.147 [2024-10-07 11:29:04.421112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.147 [2024-10-07 11:29:04.421130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.147 [2024-10-07 11:29:04.421164] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.147 [2024-10-07 11:29:04.421196] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.147 [2024-10-07 11:29:04.421213] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.147 [2024-10-07 11:29:04.421227] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.147 [2024-10-07 11:29:04.421258] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.147 [2024-10-07 11:29:04.426312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.147 [2024-10-07 11:29:04.426486] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.147 [2024-10-07 11:29:04.426522] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.147 [2024-10-07 11:29:04.426541] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.147 [2024-10-07 11:29:04.426575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.147 [2024-10-07 11:29:04.426635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.147 [2024-10-07 11:29:04.426654] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.147 [2024-10-07 11:29:04.426668] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.147 [2024-10-07 11:29:04.426699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.147 [2024-10-07 11:29:04.431058] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.147 [2024-10-07 11:29:04.431192] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.147 [2024-10-07 11:29:04.431225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.147 [2024-10-07 11:29:04.431243] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.147 [2024-10-07 11:29:04.431276] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.147 [2024-10-07 11:29:04.431308] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.147 [2024-10-07 11:29:04.431325] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.147 [2024-10-07 11:29:04.431340] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.147 [2024-10-07 11:29:04.431370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.147 [2024-10-07 11:29:04.438065] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.147 [2024-10-07 11:29:04.438224] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.147 [2024-10-07 11:29:04.438258] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.147 [2024-10-07 11:29:04.438276] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.147 [2024-10-07 11:29:04.438530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.147 [2024-10-07 11:29:04.438664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.147 [2024-10-07 11:29:04.438701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.147 [2024-10-07 11:29:04.438720] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.147 [2024-10-07 11:29:04.438774] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.147 [2024-10-07 11:29:04.441159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.147 [2024-10-07 11:29:04.441271] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.147 [2024-10-07 11:29:04.441303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.147 [2024-10-07 11:29:04.441320] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.147 [2024-10-07 11:29:04.441370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.147 [2024-10-07 11:29:04.441428] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.147 [2024-10-07 11:29:04.441450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.147 [2024-10-07 11:29:04.441465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.147 [2024-10-07 11:29:04.441496] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.147 [2024-10-07 11:29:04.449942] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.147 [2024-10-07 11:29:04.450169] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.147 [2024-10-07 11:29:04.450205] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.147 [2024-10-07 11:29:04.450223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.147 [2024-10-07 11:29:04.450258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.147 [2024-10-07 11:29:04.450290] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.147 [2024-10-07 11:29:04.450308] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.147 [2024-10-07 11:29:04.450323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.147 [2024-10-07 11:29:04.450354] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.147 [2024-10-07 11:29:04.451245] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.147 [2024-10-07 11:29:04.451354] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.147 [2024-10-07 11:29:04.451390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.147 [2024-10-07 11:29:04.451425] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.147 [2024-10-07 11:29:04.452351] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.147 [2024-10-07 11:29:04.453143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.147 [2024-10-07 11:29:04.453182] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.147 [2024-10-07 11:29:04.453201] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.147 [2024-10-07 11:29:04.453303] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.147 [2024-10-07 11:29:04.461042] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.147 [2024-10-07 11:29:04.461253] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.147 [2024-10-07 11:29:04.461289] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.147 [2024-10-07 11:29:04.461308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.147 [2024-10-07 11:29:04.461342] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.147 [2024-10-07 11:29:04.461390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.147 [2024-10-07 11:29:04.461428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.147 [2024-10-07 11:29:04.461445] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.147 [2024-10-07 11:29:04.461480] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.147 [2024-10-07 11:29:04.461504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.147 [2024-10-07 11:29:04.462741] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.147 [2024-10-07 11:29:04.462785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.147 [2024-10-07 11:29:04.462829] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.147 [2024-10-07 11:29:04.463059] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.147 [2024-10-07 11:29:04.464202] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.147 [2024-10-07 11:29:04.464241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.147 [2024-10-07 11:29:04.464259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.147 [2024-10-07 11:29:04.465104] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.147 [2024-10-07 11:29:04.471199] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.147 [2024-10-07 11:29:04.471375] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.147 [2024-10-07 11:29:04.471426] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.147 [2024-10-07 11:29:04.471449] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.147 [2024-10-07 11:29:04.471484] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.147 [2024-10-07 11:29:04.471538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.147 [2024-10-07 11:29:04.471559] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.147 [2024-10-07 11:29:04.471575] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.147 [2024-10-07 11:29:04.471616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.147 [2024-10-07 11:29:04.471650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.147 [2024-10-07 11:29:04.471730] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.147 [2024-10-07 11:29:04.471758] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.147 [2024-10-07 11:29:04.471775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.147 [2024-10-07 11:29:04.471805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.147 [2024-10-07 11:29:04.471836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.147 [2024-10-07 11:29:04.471853] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.147 [2024-10-07 11:29:04.471867] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.147 [2024-10-07 11:29:04.471896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.147 [2024-10-07 11:29:04.481336] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.147 [2024-10-07 11:29:04.482461] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.147 [2024-10-07 11:29:04.482510] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.147 [2024-10-07 11:29:04.482533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.147 [2024-10-07 11:29:04.483302] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.147 [2024-10-07 11:29:04.483445] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.147 [2024-10-07 11:29:04.483522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.147 [2024-10-07 11:29:04.483543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.148 [2024-10-07 11:29:04.483560] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.148 [2024-10-07 11:29:04.483791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.148 [2024-10-07 11:29:04.483873] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.148 [2024-10-07 11:29:04.483901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.148 [2024-10-07 11:29:04.483919] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.148 [2024-10-07 11:29:04.484033] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.148 [2024-10-07 11:29:04.484096] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.148 [2024-10-07 11:29:04.484119] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.148 [2024-10-07 11:29:04.484134] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.148 [2024-10-07 11:29:04.484186] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.148 [2024-10-07 11:29:04.491499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.148 [2024-10-07 11:29:04.491675] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.148 [2024-10-07 11:29:04.491712] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.148 [2024-10-07 11:29:04.491731] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.148 [2024-10-07 11:29:04.492922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.148 [2024-10-07 11:29:04.493192] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.148 [2024-10-07 11:29:04.493229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.148 [2024-10-07 11:29:04.493249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.148 [2024-10-07 11:29:04.494380] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.148 [2024-10-07 11:29:04.495321] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.148 [2024-10-07 11:29:04.495454] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.148 [2024-10-07 11:29:04.495486] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.148 [2024-10-07 11:29:04.495504] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.148 [2024-10-07 11:29:04.495539] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.148 [2024-10-07 11:29:04.495570] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.148 [2024-10-07 11:29:04.495588] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.148 [2024-10-07 11:29:04.495602] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.148 [2024-10-07 11:29:04.495632] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.148 [2024-10-07 11:29:04.501639] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.148 [2024-10-07 11:29:04.501831] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.148 [2024-10-07 11:29:04.501867] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.148 [2024-10-07 11:29:04.501885] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.148 [2024-10-07 11:29:04.501937] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.148 [2024-10-07 11:29:04.501972] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.148 [2024-10-07 11:29:04.501990] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.148 [2024-10-07 11:29:04.502005] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.148 [2024-10-07 11:29:04.502037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.148 [2024-10-07 11:29:04.506390] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.148 [2024-10-07 11:29:04.506558] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.148 [2024-10-07 11:29:04.506593] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.148 [2024-10-07 11:29:04.506611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.148 [2024-10-07 11:29:04.506645] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.148 [2024-10-07 11:29:04.506677] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.148 [2024-10-07 11:29:04.506694] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.148 [2024-10-07 11:29:04.506718] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.148 [2024-10-07 11:29:04.506749] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.148 [2024-10-07 11:29:04.513429] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.148 [2024-10-07 11:29:04.513617] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.148 [2024-10-07 11:29:04.513653] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.148 [2024-10-07 11:29:04.513671] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.148 [2024-10-07 11:29:04.513907] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.148 [2024-10-07 11:29:04.514040] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.148 [2024-10-07 11:29:04.514077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.148 [2024-10-07 11:29:04.514097] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.148 [2024-10-07 11:29:04.514152] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.148 [2024-10-07 11:29:04.516521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.148 [2024-10-07 11:29:04.516638] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.148 [2024-10-07 11:29:04.516676] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.148 [2024-10-07 11:29:04.516694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.148 [2024-10-07 11:29:04.516753] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.148 [2024-10-07 11:29:04.516785] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.148 [2024-10-07 11:29:04.516802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.148 [2024-10-07 11:29:04.516817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.148 [2024-10-07 11:29:04.516846] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.148 [2024-10-07 11:29:04.525392] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.148 [2024-10-07 11:29:04.525596] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.148 [2024-10-07 11:29:04.525632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.148 [2024-10-07 11:29:04.525651] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.148 [2024-10-07 11:29:04.525686] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.148 [2024-10-07 11:29:04.525718] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.148 [2024-10-07 11:29:04.525735] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.148 [2024-10-07 11:29:04.525751] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.148 [2024-10-07 11:29:04.525782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.148 [2024-10-07 11:29:04.526616] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.148 [2024-10-07 11:29:04.526722] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.148 [2024-10-07 11:29:04.526754] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.148 [2024-10-07 11:29:04.526771] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.148 [2024-10-07 11:29:04.526802] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.148 [2024-10-07 11:29:04.526833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.148 [2024-10-07 11:29:04.526851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.148 [2024-10-07 11:29:04.526865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.148 [2024-10-07 11:29:04.527809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.148 [2024-10-07 11:29:04.536515] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.148 [2024-10-07 11:29:04.536713] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.148 [2024-10-07 11:29:04.536749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.148 [2024-10-07 11:29:04.536768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.148 [2024-10-07 11:29:04.536806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.148 [2024-10-07 11:29:04.536855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.148 [2024-10-07 11:29:04.536876] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.148 [2024-10-07 11:29:04.536918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.148 [2024-10-07 11:29:04.538137] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.148 [2024-10-07 11:29:04.538181] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.148 [2024-10-07 11:29:04.538469] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.148 [2024-10-07 11:29:04.538510] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.148 [2024-10-07 11:29:04.538531] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.148 [2024-10-07 11:29:04.539657] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.148 [2024-10-07 11:29:04.540504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.148 [2024-10-07 11:29:04.540543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.148 [2024-10-07 11:29:04.540562] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.148 [2024-10-07 11:29:04.540699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.148 [2024-10-07 11:29:04.546666] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.148 [2024-10-07 11:29:04.546843] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.148 [2024-10-07 11:29:04.546879] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.148 [2024-10-07 11:29:04.546897] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.148 [2024-10-07 11:29:04.546933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.148 [2024-10-07 11:29:04.546969] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.148 [2024-10-07 11:29:04.546987] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.148 [2024-10-07 11:29:04.547003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.148 [2024-10-07 11:29:04.547034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.148 [2024-10-07 11:29:04.548564] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.148 [2024-10-07 11:29:04.548693] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.148 [2024-10-07 11:29:04.548740] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.148 [2024-10-07 11:29:04.548760] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.148 [2024-10-07 11:29:04.548793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.148 [2024-10-07 11:29:04.548824] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.148 [2024-10-07 11:29:04.548841] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.148 [2024-10-07 11:29:04.548855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.148 [2024-10-07 11:29:04.548885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.148 [2024-10-07 11:29:04.556804] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.148 [2024-10-07 11:29:04.557946] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.148 [2024-10-07 11:29:04.557994] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.148 [2024-10-07 11:29:04.558015] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.148 [2024-10-07 11:29:04.558809] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.148 [2024-10-07 11:29:04.559144] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.148 [2024-10-07 11:29:04.559184] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.148 [2024-10-07 11:29:04.559204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.148 [2024-10-07 11:29:04.559323] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.148 [2024-10-07 11:29:04.559354] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.148 [2024-10-07 11:29:04.559471] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.149 [2024-10-07 11:29:04.559508] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.149 [2024-10-07 11:29:04.559526] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.149 [2024-10-07 11:29:04.559559] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.149 [2024-10-07 11:29:04.559590] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.149 [2024-10-07 11:29:04.559608] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.149 [2024-10-07 11:29:04.559622] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.149 [2024-10-07 11:29:04.559652] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.149 [2024-10-07 11:29:04.566972] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.149 [2024-10-07 11:29:04.568310] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.149 [2024-10-07 11:29:04.568359] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.149 [2024-10-07 11:29:04.568381] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.149 [2024-10-07 11:29:04.568606] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.149 [2024-10-07 11:29:04.569767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.149 [2024-10-07 11:29:04.569806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.149 [2024-10-07 11:29:04.569826] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.149 [2024-10-07 11:29:04.570688] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.149 [2024-10-07 11:29:04.570842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.149 [2024-10-07 11:29:04.570952] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.149 [2024-10-07 11:29:04.570995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.149 [2024-10-07 11:29:04.571015] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.149 [2024-10-07 11:29:04.571208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.149 [2024-10-07 11:29:04.571389] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.149 [2024-10-07 11:29:04.571438] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.149 [2024-10-07 11:29:04.571456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.149 [2024-10-07 11:29:04.571577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.149 [2024-10-07 11:29:04.577118] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.149 [2024-10-07 11:29:04.577277] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.149 [2024-10-07 11:29:04.577311] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.149 [2024-10-07 11:29:04.577329] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.149 [2024-10-07 11:29:04.577363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.149 [2024-10-07 11:29:04.577396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.149 [2024-10-07 11:29:04.577433] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.149 [2024-10-07 11:29:04.577450] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.149 [2024-10-07 11:29:04.577482] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.149 [2024-10-07 11:29:04.581811] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.149 [2024-10-07 11:29:04.581966] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.149 [2024-10-07 11:29:04.582002] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.149 [2024-10-07 11:29:04.582020] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.149 [2024-10-07 11:29:04.582056] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.149 [2024-10-07 11:29:04.582088] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.149 [2024-10-07 11:29:04.582106] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.149 [2024-10-07 11:29:04.582121] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.149 [2024-10-07 11:29:04.582151] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.149 [2024-10-07 11:29:04.588877] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.149 [2024-10-07 11:29:04.589052] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.149 [2024-10-07 11:29:04.589118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.149 [2024-10-07 11:29:04.589154] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.149 [2024-10-07 11:29:04.589432] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.149 [2024-10-07 11:29:04.589580] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.149 [2024-10-07 11:29:04.589619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.149 [2024-10-07 11:29:04.589640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.149 [2024-10-07 11:29:04.589721] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.149 [2024-10-07 11:29:04.591985] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.149 [2024-10-07 11:29:04.592103] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.149 [2024-10-07 11:29:04.592134] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.149 [2024-10-07 11:29:04.592152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.149 [2024-10-07 11:29:04.592201] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.149 [2024-10-07 11:29:04.592237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.149 [2024-10-07 11:29:04.592254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.149 [2024-10-07 11:29:04.592268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.149 [2024-10-07 11:29:04.592298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.149 [2024-10-07 11:29:04.600769] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.149 [2024-10-07 11:29:04.600940] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.149 [2024-10-07 11:29:04.600980] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.149 [2024-10-07 11:29:04.601000] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.149 [2024-10-07 11:29:04.601034] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.149 [2024-10-07 11:29:04.601078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.149 [2024-10-07 11:29:04.601098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.149 [2024-10-07 11:29:04.601114] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.149 [2024-10-07 11:29:04.601145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.149 [2024-10-07 11:29:04.602078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.149 [2024-10-07 11:29:04.602186] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.149 [2024-10-07 11:29:04.602217] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.149 [2024-10-07 11:29:04.602234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.149 [2024-10-07 11:29:04.602265] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.149 [2024-10-07 11:29:04.602296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.149 [2024-10-07 11:29:04.602314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.149 [2024-10-07 11:29:04.602328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.149 [2024-10-07 11:29:04.603310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.149 [2024-10-07 11:29:04.611796] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.149 [2024-10-07 11:29:04.612049] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.149 [2024-10-07 11:29:04.612096] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.149 [2024-10-07 11:29:04.612142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.149 [2024-10-07 11:29:04.612181] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.149 [2024-10-07 11:29:04.612241] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.149 [2024-10-07 11:29:04.612270] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.149 [2024-10-07 11:29:04.612287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.149 [2024-10-07 11:29:04.612322] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.149 [2024-10-07 11:29:04.612345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.149 [2024-10-07 11:29:04.612436] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.149 [2024-10-07 11:29:04.612468] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.149 [2024-10-07 11:29:04.612484] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.149 [2024-10-07 11:29:04.613715] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.149 [2024-10-07 11:29:04.613975] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.149 [2024-10-07 11:29:04.614013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.149 [2024-10-07 11:29:04.614032] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.149 [2024-10-07 11:29:04.615167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.149 [2024-10-07 11:29:04.622037] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.149 [2024-10-07 11:29:04.622185] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.149 [2024-10-07 11:29:04.622219] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.149 [2024-10-07 11:29:04.622238] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.149 [2024-10-07 11:29:04.622272] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.149 [2024-10-07 11:29:04.622307] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.149 [2024-10-07 11:29:04.622324] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.149 [2024-10-07 11:29:04.622339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.149 [2024-10-07 11:29:04.622371] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.149 [2024-10-07 11:29:04.622455] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.149 [2024-10-07 11:29:04.622546] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.149 [2024-10-07 11:29:04.622575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.149 [2024-10-07 11:29:04.622591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.149 [2024-10-07 11:29:04.622623] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.149 [2024-10-07 11:29:04.622679] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.149 [2024-10-07 11:29:04.622698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.149 [2024-10-07 11:29:04.622713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.149 [2024-10-07 11:29:04.622742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.149 [2024-10-07 11:29:04.632148] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.149 [2024-10-07 11:29:04.632325] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.149 [2024-10-07 11:29:04.632360] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.149 [2024-10-07 11:29:04.632379] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.149 [2024-10-07 11:29:04.633332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.149 [2024-10-07 11:29:04.634154] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.149 [2024-10-07 11:29:04.634200] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.149 [2024-10-07 11:29:04.634220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.149 [2024-10-07 11:29:04.634329] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.149 [2024-10-07 11:29:04.634359] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.149 [2024-10-07 11:29:04.634460] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.149 [2024-10-07 11:29:04.634492] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.149 [2024-10-07 11:29:04.634510] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.149 [2024-10-07 11:29:04.634543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.150 [2024-10-07 11:29:04.634574] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.150 [2024-10-07 11:29:04.634591] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.150 [2024-10-07 11:29:04.634606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.150 [2024-10-07 11:29:04.634831] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.150 [2024-10-07 11:29:04.642289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.150 [2024-10-07 11:29:04.642493] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.150 [2024-10-07 11:29:04.642529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.150 [2024-10-07 11:29:04.642548] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.150 [2024-10-07 11:29:04.642584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.150 [2024-10-07 11:29:04.643775] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.150 [2024-10-07 11:29:04.643814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.150 [2024-10-07 11:29:04.643834] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.150 [2024-10-07 11:29:04.644068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.150 [2024-10-07 11:29:04.646226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.150 [2024-10-07 11:29:04.646348] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.150 [2024-10-07 11:29:04.646380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.150 [2024-10-07 11:29:04.646414] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.150 [2024-10-07 11:29:04.646453] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.150 [2024-10-07 11:29:04.646484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.150 [2024-10-07 11:29:04.646503] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.150 [2024-10-07 11:29:04.646517] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.150 [2024-10-07 11:29:04.646547] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.150 [2024-10-07 11:29:04.652446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.150 [2024-10-07 11:29:04.652577] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.150 [2024-10-07 11:29:04.652610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.150 [2024-10-07 11:29:04.652628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.150 [2024-10-07 11:29:04.652661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.150 [2024-10-07 11:29:04.652710] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.150 [2024-10-07 11:29:04.652730] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.150 [2024-10-07 11:29:04.652746] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.150 [2024-10-07 11:29:04.652777] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.150 [2024-10-07 11:29:04.657231] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.150 [2024-10-07 11:29:04.657351] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.150 [2024-10-07 11:29:04.657383] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.150 [2024-10-07 11:29:04.657416] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.150 [2024-10-07 11:29:04.657455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.150 [2024-10-07 11:29:04.657507] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.150 [2024-10-07 11:29:04.657532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.150 [2024-10-07 11:29:04.657547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.150 [2024-10-07 11:29:04.657579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.150 [2024-10-07 11:29:04.664180] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.150 [2024-10-07 11:29:04.664343] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.150 [2024-10-07 11:29:04.664377] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.150 [2024-10-07 11:29:04.664436] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.150 [2024-10-07 11:29:04.664674] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.150 [2024-10-07 11:29:04.664808] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.150 [2024-10-07 11:29:04.664845] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.150 [2024-10-07 11:29:04.664865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.150 [2024-10-07 11:29:04.664920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.150 [2024-10-07 11:29:04.667325] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.150 [2024-10-07 11:29:04.667459] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.150 [2024-10-07 11:29:04.667493] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.150 [2024-10-07 11:29:04.667510] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.150 [2024-10-07 11:29:04.667544] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.150 [2024-10-07 11:29:04.667575] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.150 [2024-10-07 11:29:04.667593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.150 [2024-10-07 11:29:04.667607] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.150 [2024-10-07 11:29:04.667637] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.150 [2024-10-07 11:29:04.676054] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.150 [2024-10-07 11:29:04.676226] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.150 [2024-10-07 11:29:04.676260] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.150 [2024-10-07 11:29:04.676280] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.150 [2024-10-07 11:29:04.676314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.150 [2024-10-07 11:29:04.676346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.150 [2024-10-07 11:29:04.676363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.150 [2024-10-07 11:29:04.676379] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.150 [2024-10-07 11:29:04.676427] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.150 [2024-10-07 11:29:04.677433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.150 [2024-10-07 11:29:04.677562] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.150 [2024-10-07 11:29:04.677610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.150 [2024-10-07 11:29:04.677629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.150 [2024-10-07 11:29:04.678573] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.150 [2024-10-07 11:29:04.679357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.150 [2024-10-07 11:29:04.679431] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.150 [2024-10-07 11:29:04.679467] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.150 [2024-10-07 11:29:04.679583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.150 [2024-10-07 11:29:04.686927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.150 [2024-10-07 11:29:04.687258] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.150 [2024-10-07 11:29:04.687304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.150 [2024-10-07 11:29:04.687326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.150 [2024-10-07 11:29:04.687443] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.150 [2024-10-07 11:29:04.687485] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.150 [2024-10-07 11:29:04.687505] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.150 [2024-10-07 11:29:04.687521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.150 [2024-10-07 11:29:04.687554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.150 [2024-10-07 11:29:04.687606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.150 [2024-10-07 11:29:04.687691] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.150 [2024-10-07 11:29:04.687720] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.150 [2024-10-07 11:29:04.687737] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.150 [2024-10-07 11:29:04.688917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.150 [2024-10-07 11:29:04.689161] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.150 [2024-10-07 11:29:04.689199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.150 [2024-10-07 11:29:04.689218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.150 [2024-10-07 11:29:04.690357] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.150 [2024-10-07 11:29:04.697161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.150 [2024-10-07 11:29:04.697321] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.150 [2024-10-07 11:29:04.697356] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.150 [2024-10-07 11:29:04.697375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.150 [2024-10-07 11:29:04.697424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.150 [2024-10-07 11:29:04.697464] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.150 [2024-10-07 11:29:04.697495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.150 [2024-10-07 11:29:04.697521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.150 [2024-10-07 11:29:04.697557] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.150 [2024-10-07 11:29:04.697673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.150 [2024-10-07 11:29:04.697787] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.150 [2024-10-07 11:29:04.697817] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.150 [2024-10-07 11:29:04.697835] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.150 [2024-10-07 11:29:04.697866] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.150 [2024-10-07 11:29:04.697896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.150 [2024-10-07 11:29:04.697913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.150 [2024-10-07 11:29:04.697927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.150 [2024-10-07 11:29:04.697956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.150 [2024-10-07 11:29:04.707282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.150 [2024-10-07 11:29:04.707467] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.150 [2024-10-07 11:29:04.707504] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.150 [2024-10-07 11:29:04.707522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.150 [2024-10-07 11:29:04.708461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.150 [2024-10-07 11:29:04.709280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.150 [2024-10-07 11:29:04.709322] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.150 [2024-10-07 11:29:04.709342] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.150 [2024-10-07 11:29:04.709461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.150 [2024-10-07 11:29:04.709506] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.150 [2024-10-07 11:29:04.709601] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.150 [2024-10-07 11:29:04.709632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.150 [2024-10-07 11:29:04.709649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.151 [2024-10-07 11:29:04.709880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.151 [2024-10-07 11:29:04.710013] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.151 [2024-10-07 11:29:04.710050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.151 [2024-10-07 11:29:04.710069] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.151 [2024-10-07 11:29:04.710121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.151 [2024-10-07 11:29:04.717430] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.151 [2024-10-07 11:29:04.717577] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.151 [2024-10-07 11:29:04.717618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.151 [2024-10-07 11:29:04.717639] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.151 [2024-10-07 11:29:04.718844] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.151 [2024-10-07 11:29:04.719077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.151 [2024-10-07 11:29:04.719114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.151 [2024-10-07 11:29:04.719133] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.151 [2024-10-07 11:29:04.720253] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.151 [2024-10-07 11:29:04.721241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.151 [2024-10-07 11:29:04.721357] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.151 [2024-10-07 11:29:04.721389] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.151 [2024-10-07 11:29:04.721422] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.151 [2024-10-07 11:29:04.721459] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.151 [2024-10-07 11:29:04.721512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.151 [2024-10-07 11:29:04.721534] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.151 [2024-10-07 11:29:04.721549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.151 [2024-10-07 11:29:04.721580] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.151 [2024-10-07 11:29:04.727552] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.151 [2024-10-07 11:29:04.727698] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.151 [2024-10-07 11:29:04.727732] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.151 [2024-10-07 11:29:04.727750] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.151 [2024-10-07 11:29:04.727784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.151 [2024-10-07 11:29:04.727815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.151 [2024-10-07 11:29:04.727832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.151 [2024-10-07 11:29:04.727847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.151 [2024-10-07 11:29:04.727877] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.151 [2024-10-07 11:29:04.732246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.151 [2024-10-07 11:29:04.732378] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.151 [2024-10-07 11:29:04.732425] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.151 [2024-10-07 11:29:04.732456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.151 [2024-10-07 11:29:04.732504] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.151 [2024-10-07 11:29:04.732538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.151 [2024-10-07 11:29:04.732555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.151 [2024-10-07 11:29:04.732594] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.151 [2024-10-07 11:29:04.732627] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.151 [2024-10-07 11:29:04.739282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.151 [2024-10-07 11:29:04.739456] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.151 [2024-10-07 11:29:04.739490] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.151 [2024-10-07 11:29:04.739508] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.151 [2024-10-07 11:29:04.739544] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.151 [2024-10-07 11:29:04.739576] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.151 [2024-10-07 11:29:04.739592] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.151 [2024-10-07 11:29:04.739607] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.151 [2024-10-07 11:29:04.739840] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.151 [2024-10-07 11:29:04.742500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.151 [2024-10-07 11:29:04.742618] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.151 [2024-10-07 11:29:04.742650] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.151 [2024-10-07 11:29:04.742668] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.151 [2024-10-07 11:29:04.742701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.151 [2024-10-07 11:29:04.742732] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.151 [2024-10-07 11:29:04.742750] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.151 [2024-10-07 11:29:04.742764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.151 [2024-10-07 11:29:04.742793] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.151 [2024-10-07 11:29:04.751719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.151 [2024-10-07 11:29:04.751973] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.151 [2024-10-07 11:29:04.752020] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.151 [2024-10-07 11:29:04.752041] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.151 [2024-10-07 11:29:04.752244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.151 [2024-10-07 11:29:04.752421] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.151 [2024-10-07 11:29:04.752454] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.151 [2024-10-07 11:29:04.752472] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.151 [2024-10-07 11:29:04.752614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.151 [2024-10-07 11:29:04.752704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.151 [2024-10-07 11:29:04.752805] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.151 [2024-10-07 11:29:04.752875] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.151 [2024-10-07 11:29:04.752898] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.151 [2024-10-07 11:29:04.752931] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.151 [2024-10-07 11:29:04.752962] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.151 [2024-10-07 11:29:04.752979] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.151 [2024-10-07 11:29:04.752993] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.151 [2024-10-07 11:29:04.753023] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.151 [2024-10-07 11:29:04.762732] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.151 [2024-10-07 11:29:04.762928] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.151 [2024-10-07 11:29:04.762965] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.151 [2024-10-07 11:29:04.762983] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.151 [2024-10-07 11:29:04.763034] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.151 [2024-10-07 11:29:04.763074] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.151 [2024-10-07 11:29:04.763107] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.151 [2024-10-07 11:29:04.763124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.151 [2024-10-07 11:29:04.763139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.151 [2024-10-07 11:29:04.764327] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.151 [2024-10-07 11:29:04.764426] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.151 [2024-10-07 11:29:04.764456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.151 [2024-10-07 11:29:04.764474] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.151 [2024-10-07 11:29:04.764703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.151 [2024-10-07 11:29:04.765856] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.151 [2024-10-07 11:29:04.765896] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.151 [2024-10-07 11:29:04.765914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.151 [2024-10-07 11:29:04.766744] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.151 [2024-10-07 11:29:04.772881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.151 [2024-10-07 11:29:04.773027] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.151 [2024-10-07 11:29:04.773074] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.151 [2024-10-07 11:29:04.773094] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.151 [2024-10-07 11:29:04.773130] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.151 [2024-10-07 11:29:04.773222] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.151 [2024-10-07 11:29:04.773247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.151 [2024-10-07 11:29:04.773263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.151 [2024-10-07 11:29:04.773295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.151 [2024-10-07 11:29:04.773318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.151 [2024-10-07 11:29:04.773393] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.151 [2024-10-07 11:29:04.773437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.151 [2024-10-07 11:29:04.773456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.151 [2024-10-07 11:29:04.773487] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.151 [2024-10-07 11:29:04.773519] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.151 [2024-10-07 11:29:04.773536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.151 [2024-10-07 11:29:04.773550] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.151 [2024-10-07 11:29:04.773579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.151 [2024-10-07 11:29:04.783000] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.151 [2024-10-07 11:29:04.784241] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.151 [2024-10-07 11:29:04.784312] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.151 [2024-10-07 11:29:04.784351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.151 [2024-10-07 11:29:04.785298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.151 [2024-10-07 11:29:04.785653] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.151 [2024-10-07 11:29:04.785711] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.151 [2024-10-07 11:29:04.785734] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.151 [2024-10-07 11:29:04.785751] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.151 [2024-10-07 11:29:04.785867] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.151 [2024-10-07 11:29:04.785944] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.151 [2024-10-07 11:29:04.785973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.151 [2024-10-07 11:29:04.785991] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.151 [2024-10-07 11:29:04.786063] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.152 [2024-10-07 11:29:04.786103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.152 [2024-10-07 11:29:04.786121] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.152 [2024-10-07 11:29:04.786135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.152 [2024-10-07 11:29:04.786192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.152 [2024-10-07 11:29:04.793291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.152 [2024-10-07 11:29:04.794693] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.152 [2024-10-07 11:29:04.794746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.152 [2024-10-07 11:29:04.794769] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.152 [2024-10-07 11:29:04.795006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.152 [2024-10-07 11:29:04.796157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.152 [2024-10-07 11:29:04.796199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.152 [2024-10-07 11:29:04.796230] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.152 [2024-10-07 11:29:04.797114] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.152 [2024-10-07 11:29:04.797253] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.152 [2024-10-07 11:29:04.797368] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.152 [2024-10-07 11:29:04.797420] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.152 [2024-10-07 11:29:04.797443] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.152 [2024-10-07 11:29:04.797477] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.152 [2024-10-07 11:29:04.797671] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.152 [2024-10-07 11:29:04.797706] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.152 [2024-10-07 11:29:04.797725] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.152 [2024-10-07 11:29:04.797864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.152 [2024-10-07 11:29:04.803467] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.152 [2024-10-07 11:29:04.803650] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.152 [2024-10-07 11:29:04.803686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.152 [2024-10-07 11:29:04.803705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.152 [2024-10-07 11:29:04.803741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.152 [2024-10-07 11:29:04.803772] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.152 [2024-10-07 11:29:04.803789] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.152 [2024-10-07 11:29:04.803805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.152 [2024-10-07 11:29:04.803836] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.152 [2024-10-07 11:29:04.808189] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.152 [2024-10-07 11:29:04.808350] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.152 [2024-10-07 11:29:04.808384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.152 [2024-10-07 11:29:04.808446] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.152 [2024-10-07 11:29:04.808486] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.152 [2024-10-07 11:29:04.808518] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.152 [2024-10-07 11:29:04.808536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.152 [2024-10-07 11:29:04.808551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.152 [2024-10-07 11:29:04.808582] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.152 [2024-10-07 11:29:04.815196] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.152 [2024-10-07 11:29:04.815393] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.152 [2024-10-07 11:29:04.815443] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.152 [2024-10-07 11:29:04.815464] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.152 [2024-10-07 11:29:04.815700] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.152 [2024-10-07 11:29:04.815832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.152 [2024-10-07 11:29:04.815869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.152 [2024-10-07 11:29:04.815888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.152 [2024-10-07 11:29:04.815944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.152 [2024-10-07 11:29:04.818311] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.152 [2024-10-07 11:29:04.818452] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.152 [2024-10-07 11:29:04.818485] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.152 [2024-10-07 11:29:04.818504] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.152 [2024-10-07 11:29:04.818538] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.152 [2024-10-07 11:29:04.818569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.152 [2024-10-07 11:29:04.818587] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.152 [2024-10-07 11:29:04.818601] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.152 [2024-10-07 11:29:04.818631] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.152 [2024-10-07 11:29:04.827145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.152 [2024-10-07 11:29:04.827327] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.152 [2024-10-07 11:29:04.827362] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.152 [2024-10-07 11:29:04.827381] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.152 [2024-10-07 11:29:04.827434] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.152 [2024-10-07 11:29:04.827470] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.152 [2024-10-07 11:29:04.827513] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.152 [2024-10-07 11:29:04.827529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.152 [2024-10-07 11:29:04.827727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.152 [2024-10-07 11:29:04.828423] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.152 [2024-10-07 11:29:04.828530] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.152 [2024-10-07 11:29:04.828566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.152 [2024-10-07 11:29:04.828586] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.152 [2024-10-07 11:29:04.829576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.152 [2024-10-07 11:29:04.830367] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.152 [2024-10-07 11:29:04.830419] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.152 [2024-10-07 11:29:04.830440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.152 [2024-10-07 11:29:04.830545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.152 [2024-10-07 11:29:04.838198] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.152 [2024-10-07 11:29:04.838462] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.152 [2024-10-07 11:29:04.838500] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.152 [2024-10-07 11:29:04.838520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.152 [2024-10-07 11:29:04.838558] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.152 [2024-10-07 11:29:04.838607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.152 [2024-10-07 11:29:04.838629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.152 [2024-10-07 11:29:04.838645] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.152 [2024-10-07 11:29:04.838677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.152 [2024-10-07 11:29:04.838699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.152 [2024-10-07 11:29:04.839934] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.152 [2024-10-07 11:29:04.839978] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.152 [2024-10-07 11:29:04.839998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.152 [2024-10-07 11:29:04.840206] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.152 [2024-10-07 11:29:04.840274] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.152 [2024-10-07 11:29:04.840296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.152 [2024-10-07 11:29:04.840310] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.152 [2024-10-07 11:29:04.841448] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.152 [2024-10-07 11:29:04.848339] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.152 [2024-10-07 11:29:04.848516] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.152 [2024-10-07 11:29:04.848552] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.152 [2024-10-07 11:29:04.848571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.152 [2024-10-07 11:29:04.848604] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.152 [2024-10-07 11:29:04.848641] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.152 [2024-10-07 11:29:04.848659] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.152 [2024-10-07 11:29:04.848675] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.152 [2024-10-07 11:29:04.848705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.152 [2024-10-07 11:29:04.848763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.152 [2024-10-07 11:29:04.848843] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.152 [2024-10-07 11:29:04.848871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.152 [2024-10-07 11:29:04.848887] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.152 [2024-10-07 11:29:04.848917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.152 [2024-10-07 11:29:04.848947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.152 [2024-10-07 11:29:04.848964] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.152 [2024-10-07 11:29:04.848978] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.152 [2024-10-07 11:29:04.849007] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.152 [2024-10-07 11:29:04.858480] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.152 [2024-10-07 11:29:04.859562] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.152 [2024-10-07 11:29:04.859610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.152 [2024-10-07 11:29:04.859632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.152 [2024-10-07 11:29:04.860426] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.152 [2024-10-07 11:29:04.860556] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.152 [2024-10-07 11:29:04.860603] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.152 [2024-10-07 11:29:04.860624] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.152 [2024-10-07 11:29:04.860649] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.152 [2024-10-07 11:29:04.860874] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.152 [2024-10-07 11:29:04.860953] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.152 [2024-10-07 11:29:04.860981] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.152 [2024-10-07 11:29:04.861021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.152 [2024-10-07 11:29:04.861154] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.152 [2024-10-07 11:29:04.861219] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.152 [2024-10-07 11:29:04.861242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.152 [2024-10-07 11:29:04.861256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.152 [2024-10-07 11:29:04.861288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.152 [2024-10-07 11:29:04.868620] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.152 [2024-10-07 11:29:04.868786] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.152 [2024-10-07 11:29:04.868820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.152 [2024-10-07 11:29:04.868838] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.152 [2024-10-07 11:29:04.870058] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.152 [2024-10-07 11:29:04.870295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.152 [2024-10-07 11:29:04.870331] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.153 [2024-10-07 11:29:04.870350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.153 [2024-10-07 11:29:04.871481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.153 [2024-10-07 11:29:04.872457] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.153 [2024-10-07 11:29:04.872585] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.153 [2024-10-07 11:29:04.872627] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.153 [2024-10-07 11:29:04.872647] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.153 [2024-10-07 11:29:04.872681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.153 [2024-10-07 11:29:04.872713] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.153 [2024-10-07 11:29:04.872730] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.153 [2024-10-07 11:29:04.872744] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.153 [2024-10-07 11:29:04.872774] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.153 [2024-10-07 11:29:04.878747] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.153 [2024-10-07 11:29:04.878901] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.153 [2024-10-07 11:29:04.878935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.153 [2024-10-07 11:29:04.878953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.153 [2024-10-07 11:29:04.878987] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.153 [2024-10-07 11:29:04.879018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.153 [2024-10-07 11:29:04.879035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.153 [2024-10-07 11:29:04.879077] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.153 [2024-10-07 11:29:04.879110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.153 [2024-10-07 11:29:04.882552] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.153 [2024-10-07 11:29:04.883394] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.153 [2024-10-07 11:29:04.883451] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.153 [2024-10-07 11:29:04.883471] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.153 [2024-10-07 11:29:04.883654] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.153 [2024-10-07 11:29:04.883782] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.153 [2024-10-07 11:29:04.883815] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.153 [2024-10-07 11:29:04.883832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.153 [2024-10-07 11:29:04.883865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.153 [2024-10-07 11:29:04.888875] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.153 [2024-10-07 11:29:04.889962] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.153 [2024-10-07 11:29:04.890010] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.153 [2024-10-07 11:29:04.890031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.153 [2024-10-07 11:29:04.890814] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.153 [2024-10-07 11:29:04.890936] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.153 [2024-10-07 11:29:04.890969] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.153 [2024-10-07 11:29:04.890988] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.153 [2024-10-07 11:29:04.891215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.153 [2024-10-07 11:29:04.892647] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.153 [2024-10-07 11:29:04.892758] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.153 [2024-10-07 11:29:04.892791] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.153 [2024-10-07 11:29:04.892809] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.153 [2024-10-07 11:29:04.893557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.153 [2024-10-07 11:29:04.893764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.153 [2024-10-07 11:29:04.893799] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.153 [2024-10-07 11:29:04.893817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.153 [2024-10-07 11:29:04.893901] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.153 [2024-10-07 11:29:04.899607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.153 [2024-10-07 11:29:04.899778] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.153 [2024-10-07 11:29:04.899814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.153 [2024-10-07 11:29:04.899832] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.153 [2024-10-07 11:29:04.899867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.153 [2024-10-07 11:29:04.899900] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.153 [2024-10-07 11:29:04.899917] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.153 [2024-10-07 11:29:04.899933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.153 [2024-10-07 11:29:04.899981] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.153 [2024-10-07 11:29:04.903785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.153 [2024-10-07 11:29:04.903925] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.153 [2024-10-07 11:29:04.903965] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.153 [2024-10-07 11:29:04.903985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.153 [2024-10-07 11:29:04.904019] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.153 [2024-10-07 11:29:04.904219] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.153 [2024-10-07 11:29:04.904255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.153 [2024-10-07 11:29:04.904274] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.153 [2024-10-07 11:29:04.904429] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.153 [2024-10-07 11:29:04.909748] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.153 [2024-10-07 11:29:04.909895] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.153 [2024-10-07 11:29:04.909928] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.153 [2024-10-07 11:29:04.909947] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.153 [2024-10-07 11:29:04.909981] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.153 [2024-10-07 11:29:04.910012] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.153 [2024-10-07 11:29:04.910028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.153 [2024-10-07 11:29:04.910044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.153 [2024-10-07 11:29:04.910075] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.153 [2024-10-07 11:29:04.915035] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.153 [2024-10-07 11:29:04.915208] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.153 [2024-10-07 11:29:04.915244] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.153 [2024-10-07 11:29:04.915263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.153 [2024-10-07 11:29:04.916521] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.153 [2024-10-07 11:29:04.916788] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.153 [2024-10-07 11:29:04.916827] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.153 [2024-10-07 11:29:04.916847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.153 [2024-10-07 11:29:04.918035] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.153 [2024-10-07 11:29:04.919862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.153 [2024-10-07 11:29:04.920005] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.153 [2024-10-07 11:29:04.920051] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.153 [2024-10-07 11:29:04.920073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.153 [2024-10-07 11:29:04.920108] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.153 [2024-10-07 11:29:04.920139] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.153 [2024-10-07 11:29:04.920156] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.153 [2024-10-07 11:29:04.920171] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.153 [2024-10-07 11:29:04.920202] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.153 [2024-10-07 11:29:04.925166] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.153 [2024-10-07 11:29:04.925315] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.153 [2024-10-07 11:29:04.925349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.153 [2024-10-07 11:29:04.925367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.153 [2024-10-07 11:29:04.925416] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.153 [2024-10-07 11:29:04.925468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.153 [2024-10-07 11:29:04.925490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.153 [2024-10-07 11:29:04.925505] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.153 [2024-10-07 11:29:04.925536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.153 [2024-10-07 11:29:04.930083] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.153 [2024-10-07 11:29:04.930232] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.153 [2024-10-07 11:29:04.930265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.153 [2024-10-07 11:29:04.930283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.153 [2024-10-07 11:29:04.930316] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.153 [2024-10-07 11:29:04.930348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.153 [2024-10-07 11:29:04.930365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.153 [2024-10-07 11:29:04.930422] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.153 [2024-10-07 11:29:04.930459] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.153 [2024-10-07 11:29:04.935284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.153 [2024-10-07 11:29:04.936356] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.153 [2024-10-07 11:29:04.936416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.153 [2024-10-07 11:29:04.936441] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.153 [2024-10-07 11:29:04.937209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.153 [2024-10-07 11:29:04.937334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.153 [2024-10-07 11:29:04.937368] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.153 [2024-10-07 11:29:04.937386] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.153 [2024-10-07 11:29:04.937435] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.153 [2024-10-07 11:29:04.940199] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.153 [2024-10-07 11:29:04.940328] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.153 [2024-10-07 11:29:04.940372] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.153 [2024-10-07 11:29:04.940392] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.153 [2024-10-07 11:29:04.940441] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.153 [2024-10-07 11:29:04.940473] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.153 [2024-10-07 11:29:04.940490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.153 [2024-10-07 11:29:04.940505] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.153 [2024-10-07 11:29:04.940535] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.153 [2024-10-07 11:29:04.945428] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.153 [2024-10-07 11:29:04.945594] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.153 [2024-10-07 11:29:04.945629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.153 [2024-10-07 11:29:04.945648] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.153 [2024-10-07 11:29:04.945684] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.153 [2024-10-07 11:29:04.946879] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.153 [2024-10-07 11:29:04.946918] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.153 [2024-10-07 11:29:04.946939] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.153 [2024-10-07 11:29:04.947172] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.153 [2024-10-07 11:29:04.950305] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.153 [2024-10-07 11:29:04.950485] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.154 [2024-10-07 11:29:04.950549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.154 [2024-10-07 11:29:04.950570] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.154 [2024-10-07 11:29:04.950607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.154 [2024-10-07 11:29:04.950639] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.154 [2024-10-07 11:29:04.950656] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.154 [2024-10-07 11:29:04.950672] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.154 [2024-10-07 11:29:04.950703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.154 [2024-10-07 11:29:04.955562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.154 [2024-10-07 11:29:04.955762] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.154 [2024-10-07 11:29:04.955800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.154 [2024-10-07 11:29:04.955818] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.154 [2024-10-07 11:29:04.955872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.154 [2024-10-07 11:29:04.955908] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.154 [2024-10-07 11:29:04.955926] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.154 [2024-10-07 11:29:04.955941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.154 [2024-10-07 11:29:04.955972] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.154 [2024-10-07 11:29:04.960552] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.154 [2024-10-07 11:29:04.960730] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.154 [2024-10-07 11:29:04.960764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.154 [2024-10-07 11:29:04.960783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.154 [2024-10-07 11:29:04.960817] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.154 [2024-10-07 11:29:04.960849] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.154 [2024-10-07 11:29:04.960866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.154 [2024-10-07 11:29:04.960881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.154 [2024-10-07 11:29:04.960912] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.154 [2024-10-07 11:29:04.965711] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.154 [2024-10-07 11:29:04.965873] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.154 [2024-10-07 11:29:04.965907] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.154 [2024-10-07 11:29:04.965926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.154 [2024-10-07 11:29:04.966871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.154 [2024-10-07 11:29:04.967679] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.154 [2024-10-07 11:29:04.967719] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.154 [2024-10-07 11:29:04.967739] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.154 [2024-10-07 11:29:04.967843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.154 [2024-10-07 11:29:04.970687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.154 [2024-10-07 11:29:04.970834] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.154 [2024-10-07 11:29:04.970869] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.154 [2024-10-07 11:29:04.970887] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.154 [2024-10-07 11:29:04.970921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.154 [2024-10-07 11:29:04.970952] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.154 [2024-10-07 11:29:04.970969] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.154 [2024-10-07 11:29:04.970984] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.154 [2024-10-07 11:29:04.971014] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.154 [2024-10-07 11:29:04.975850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.154 [2024-10-07 11:29:04.976045] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.154 [2024-10-07 11:29:04.976081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.154 [2024-10-07 11:29:04.976100] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.154 [2024-10-07 11:29:04.976135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.154 [2024-10-07 11:29:04.977347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.154 [2024-10-07 11:29:04.977388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.154 [2024-10-07 11:29:04.977425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.154 [2024-10-07 11:29:04.977664] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.154 [2024-10-07 11:29:04.980799] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.154 [2024-10-07 11:29:04.980966] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.154 [2024-10-07 11:29:04.981000] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.154 [2024-10-07 11:29:04.981019] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.154 [2024-10-07 11:29:04.981068] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.154 [2024-10-07 11:29:04.981104] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.154 [2024-10-07 11:29:04.981122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.154 [2024-10-07 11:29:04.981137] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.154 [2024-10-07 11:29:04.982117] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.154 [2024-10-07 11:29:04.986007] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.154 [2024-10-07 11:29:04.986197] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.154 [2024-10-07 11:29:04.986236] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.154 [2024-10-07 11:29:04.986254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.154 [2024-10-07 11:29:04.986290] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.154 [2024-10-07 11:29:04.986343] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.154 [2024-10-07 11:29:04.986364] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.154 [2024-10-07 11:29:04.986379] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.154 [2024-10-07 11:29:04.986428] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.154 [2024-10-07 11:29:04.991028] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.154 [2024-10-07 11:29:04.991220] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.154 [2024-10-07 11:29:04.991255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.154 [2024-10-07 11:29:04.991274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.154 [2024-10-07 11:29:04.991311] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.154 [2024-10-07 11:29:04.991344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.154 [2024-10-07 11:29:04.991361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.154 [2024-10-07 11:29:04.991376] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.154 [2024-10-07 11:29:04.992595] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.154 [2024-10-07 11:29:04.996162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.154 [2024-10-07 11:29:04.996437] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.154 [2024-10-07 11:29:04.996478] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.154 [2024-10-07 11:29:04.996498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.154 [2024-10-07 11:29:04.997490] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.154 [2024-10-07 11:29:04.998271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.154 [2024-10-07 11:29:04.998311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.154 [2024-10-07 11:29:04.998334] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.154 [2024-10-07 11:29:04.998474] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.154 [2024-10-07 11:29:05.001372] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.154 [2024-10-07 11:29:05.001606] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.154 [2024-10-07 11:29:05.001648] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.154 [2024-10-07 11:29:05.001699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.154 [2024-10-07 11:29:05.001740] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.154 [2024-10-07 11:29:05.001773] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.154 [2024-10-07 11:29:05.001791] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.154 [2024-10-07 11:29:05.001807] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.154 [2024-10-07 11:29:05.001840] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.154 [2024-10-07 11:29:05.006599] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.154 [2024-10-07 11:29:05.006848] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.154 [2024-10-07 11:29:05.006885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.154 [2024-10-07 11:29:05.006904] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.154 [2024-10-07 11:29:05.006941] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.154 [2024-10-07 11:29:05.006974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.154 [2024-10-07 11:29:05.006992] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.154 [2024-10-07 11:29:05.007008] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.154 [2024-10-07 11:29:05.008230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.154 [2024-10-07 11:29:05.011548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.154 [2024-10-07 11:29:05.011760] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.154 [2024-10-07 11:29:05.011797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.154 [2024-10-07 11:29:05.011816] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.154 [2024-10-07 11:29:05.011853] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.154 [2024-10-07 11:29:05.011886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.154 [2024-10-07 11:29:05.011903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.154 [2024-10-07 11:29:05.011919] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.154 [2024-10-07 11:29:05.011950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.154 [2024-10-07 11:29:05.016797] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.154 [2024-10-07 11:29:05.017081] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.154 [2024-10-07 11:29:05.017124] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.154 [2024-10-07 11:29:05.017144] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.154 [2024-10-07 11:29:05.017207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.154 [2024-10-07 11:29:05.017244] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.154 [2024-10-07 11:29:05.017295] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.154 [2024-10-07 11:29:05.017313] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.155 [2024-10-07 11:29:05.017346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.155 [2024-10-07 11:29:05.021989] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.155 [2024-10-07 11:29:05.022250] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.155 [2024-10-07 11:29:05.022288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.155 [2024-10-07 11:29:05.022308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.155 [2024-10-07 11:29:05.022348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.155 [2024-10-07 11:29:05.023590] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.155 [2024-10-07 11:29:05.023634] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.155 [2024-10-07 11:29:05.023654] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.155 [2024-10-07 11:29:05.023880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.155 [2024-10-07 11:29:05.027002] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.155 [2024-10-07 11:29:05.027204] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.155 [2024-10-07 11:29:05.027240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.155 [2024-10-07 11:29:05.027259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.155 [2024-10-07 11:29:05.027294] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.155 [2024-10-07 11:29:05.027326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.155 [2024-10-07 11:29:05.027344] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.155 [2024-10-07 11:29:05.027360] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.155 [2024-10-07 11:29:05.027392] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.155 [2024-10-07 11:29:05.032276] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.155 [2024-10-07 11:29:05.032521] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.155 [2024-10-07 11:29:05.032560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.155 [2024-10-07 11:29:05.032580] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.155 [2024-10-07 11:29:05.032617] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.155 [2024-10-07 11:29:05.032649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.155 [2024-10-07 11:29:05.032666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.155 [2024-10-07 11:29:05.032682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.155 [2024-10-07 11:29:05.032714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.155 [2024-10-07 11:29:05.037390] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.155 [2024-10-07 11:29:05.037629] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.155 [2024-10-07 11:29:05.037667] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.155 [2024-10-07 11:29:05.037687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.155 [2024-10-07 11:29:05.037724] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.155 [2024-10-07 11:29:05.037757] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.155 [2024-10-07 11:29:05.037775] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.155 [2024-10-07 11:29:05.037791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.155 [2024-10-07 11:29:05.037823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.155 [2024-10-07 11:29:05.042466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.155 [2024-10-07 11:29:05.042685] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.155 [2024-10-07 11:29:05.042723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.155 [2024-10-07 11:29:05.042742] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.155 [2024-10-07 11:29:05.042779] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.155 [2024-10-07 11:29:05.043753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.155 [2024-10-07 11:29:05.043797] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.155 [2024-10-07 11:29:05.043817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.155 [2024-10-07 11:29:05.044619] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.155 [2024-10-07 11:29:05.047607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.155 [2024-10-07 11:29:05.047799] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.155 [2024-10-07 11:29:05.047841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.155 [2024-10-07 11:29:05.047861] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.155 [2024-10-07 11:29:05.047896] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.155 [2024-10-07 11:29:05.047950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.155 [2024-10-07 11:29:05.047971] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.155 [2024-10-07 11:29:05.047987] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.155 [2024-10-07 11:29:05.048019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.155 [2024-10-07 11:29:05.052794] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.155 [2024-10-07 11:29:05.053005] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.155 [2024-10-07 11:29:05.053042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.155 [2024-10-07 11:29:05.053084] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.155 [2024-10-07 11:29:05.053154] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.155 [2024-10-07 11:29:05.054353] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.155 [2024-10-07 11:29:05.054393] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.155 [2024-10-07 11:29:05.054427] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.155 [2024-10-07 11:29:05.054643] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.155 [2024-10-07 11:29:05.057736] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.155 [2024-10-07 11:29:05.057874] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.155 [2024-10-07 11:29:05.057908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.155 [2024-10-07 11:29:05.057925] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.155 [2024-10-07 11:29:05.057958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.155 [2024-10-07 11:29:05.057990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.155 [2024-10-07 11:29:05.058007] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.155 [2024-10-07 11:29:05.058021] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.155 [2024-10-07 11:29:05.058051] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.155 [2024-10-07 11:29:05.062954] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.155 [2024-10-07 11:29:05.063092] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.155 [2024-10-07 11:29:05.063125] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.155 [2024-10-07 11:29:05.063142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.155 [2024-10-07 11:29:05.063176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.155 [2024-10-07 11:29:05.063208] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.155 [2024-10-07 11:29:05.063224] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.155 [2024-10-07 11:29:05.063239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.155 [2024-10-07 11:29:05.063269] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.155 [2024-10-07 11:29:05.067973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.155 [2024-10-07 11:29:05.068119] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.155 [2024-10-07 11:29:05.068152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.155 [2024-10-07 11:29:05.068170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.155 [2024-10-07 11:29:05.068204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.156 [2024-10-07 11:29:05.068235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.156 [2024-10-07 11:29:05.068252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.156 [2024-10-07 11:29:05.068293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.156 [2024-10-07 11:29:05.068326] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.156 [2024-10-07 11:29:05.073085] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.156 [2024-10-07 11:29:05.073231] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.156 [2024-10-07 11:29:05.073265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.156 [2024-10-07 11:29:05.073283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.156 [2024-10-07 11:29:05.074238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.156 [2024-10-07 11:29:05.075118] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.156 [2024-10-07 11:29:05.075166] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.156 [2024-10-07 11:29:05.075187] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.156 [2024-10-07 11:29:05.075298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.156 [2024-10-07 11:29:05.078091] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.156 [2024-10-07 11:29:05.078250] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.156 [2024-10-07 11:29:05.078292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.156 [2024-10-07 11:29:05.078311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.156 [2024-10-07 11:29:05.078346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.156 [2024-10-07 11:29:05.078416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.156 [2024-10-07 11:29:05.078440] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.156 [2024-10-07 11:29:05.078456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.156 [2024-10-07 11:29:05.078488] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.156 [2024-10-07 11:29:05.083211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.156 [2024-10-07 11:29:05.083435] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.156 [2024-10-07 11:29:05.083484] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.156 [2024-10-07 11:29:05.083507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.156 [2024-10-07 11:29:05.083549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.156 [2024-10-07 11:29:05.084753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.156 [2024-10-07 11:29:05.084794] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.156 [2024-10-07 11:29:05.084814] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.156 [2024-10-07 11:29:05.085031] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.156 [2024-10-07 11:29:05.088209] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.156 [2024-10-07 11:29:05.088396] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.156 [2024-10-07 11:29:05.088455] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.156 [2024-10-07 11:29:05.088477] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.156 [2024-10-07 11:29:05.088514] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.156 [2024-10-07 11:29:05.089534] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.156 [2024-10-07 11:29:05.089584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.156 [2024-10-07 11:29:05.089605] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.156 [2024-10-07 11:29:05.090369] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.156 [2024-10-07 11:29:05.093358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.156 [2024-10-07 11:29:05.093511] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.156 [2024-10-07 11:29:05.093556] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.156 [2024-10-07 11:29:05.093577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.156 [2024-10-07 11:29:05.093613] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.156 [2024-10-07 11:29:05.093645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.156 [2024-10-07 11:29:05.093662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.156 [2024-10-07 11:29:05.093677] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.156 [2024-10-07 11:29:05.093707] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.156 [2024-10-07 11:29:05.098461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.156 [2024-10-07 11:29:05.098601] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.156 [2024-10-07 11:29:05.098635] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.156 [2024-10-07 11:29:05.098653] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.156 [2024-10-07 11:29:05.098688] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.156 [2024-10-07 11:29:05.098720] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.156 [2024-10-07 11:29:05.098738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.156 [2024-10-07 11:29:05.098753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.156 [2024-10-07 11:29:05.098783] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.156 8280.08 IOPS, 32.34 MiB/s [2024-10-07T11:29:07.867Z] [2024-10-07 11:29:05.106307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.156 [2024-10-07 11:29:05.106621] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.156 [2024-10-07 11:29:05.106670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.156 [2024-10-07 11:29:05.106693] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.156 [2024-10-07 11:29:05.106778] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.156 [2024-10-07 11:29:05.106818] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.156 [2024-10-07 11:29:05.106836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.156 [2024-10-07 11:29:05.106852] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.156 [2024-10-07 11:29:05.106884] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.156 [2024-10-07 11:29:05.108570] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.156 [2024-10-07 11:29:05.108686] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.156 [2024-10-07 11:29:05.108723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.156 [2024-10-07 11:29:05.108743] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.156 [2024-10-07 11:29:05.108776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.156 [2024-10-07 11:29:05.108807] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.156 [2024-10-07 11:29:05.108824] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.156 [2024-10-07 11:29:05.108839] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.156 [2024-10-07 11:29:05.108868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.156 [2024-10-07 11:29:05.117588] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.156 [2024-10-07 11:29:05.117805] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.156 [2024-10-07 11:29:05.117842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.156 [2024-10-07 11:29:05.117861] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.156 [2024-10-07 11:29:05.117898] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.156 [2024-10-07 11:29:05.118098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.156 [2024-10-07 11:29:05.118126] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.156 [2024-10-07 11:29:05.118142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.156 [2024-10-07 11:29:05.118283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.156 [2024-10-07 11:29:05.118662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.156 [2024-10-07 11:29:05.118769] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.156 [2024-10-07 11:29:05.118801] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.156 [2024-10-07 11:29:05.118819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.157 [2024-10-07 11:29:05.118850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.157 [2024-10-07 11:29:05.118880] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.157 [2024-10-07 11:29:05.118897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.157 [2024-10-07 11:29:05.118938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.157 [2024-10-07 11:29:05.118970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.157 [2024-10-07 11:29:05.128626] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.157 [2024-10-07 11:29:05.128820] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.157 [2024-10-07 11:29:05.128857] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.157 [2024-10-07 11:29:05.128876] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.157 [2024-10-07 11:29:05.128930] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.157 [2024-10-07 11:29:05.128971] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.157 [2024-10-07 11:29:05.129003] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.157 [2024-10-07 11:29:05.129020] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.157 [2024-10-07 11:29:05.129035] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.157 [2024-10-07 11:29:05.130240] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.157 [2024-10-07 11:29:05.130326] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.157 [2024-10-07 11:29:05.130355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.157 [2024-10-07 11:29:05.130372] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.157 [2024-10-07 11:29:05.130615] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.157 [2024-10-07 11:29:05.131770] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.157 [2024-10-07 11:29:05.131813] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.157 [2024-10-07 11:29:05.131833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.157 [2024-10-07 11:29:05.132678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.157 [2024-10-07 11:29:05.138804] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.157 [2024-10-07 11:29:05.139025] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.157 [2024-10-07 11:29:05.139063] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.157 [2024-10-07 11:29:05.139083] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.157 [2024-10-07 11:29:05.139119] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.157 [2024-10-07 11:29:05.139188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.157 [2024-10-07 11:29:05.139212] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.157 [2024-10-07 11:29:05.139229] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.157 [2024-10-07 11:29:05.139262] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.157 [2024-10-07 11:29:05.139285] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.157 [2024-10-07 11:29:05.139358] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.157 [2024-10-07 11:29:05.139438] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.157 [2024-10-07 11:29:05.139472] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.157 [2024-10-07 11:29:05.139510] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.157 [2024-10-07 11:29:05.139542] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.157 [2024-10-07 11:29:05.139559] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.157 [2024-10-07 11:29:05.139573] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.157 [2024-10-07 11:29:05.139604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.157 [2024-10-07 11:29:05.148980] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.157 [2024-10-07 11:29:05.150119] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.157 [2024-10-07 11:29:05.150172] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.157 [2024-10-07 11:29:05.150196] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.157 [2024-10-07 11:29:05.150990] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.157 [2024-10-07 11:29:05.151122] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.157 [2024-10-07 11:29:05.151173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.157 [2024-10-07 11:29:05.151194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.157 [2024-10-07 11:29:05.151210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.157 [2024-10-07 11:29:05.151481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.157 [2024-10-07 11:29:05.151571] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.157 [2024-10-07 11:29:05.151600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.157 [2024-10-07 11:29:05.151617] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.157 [2024-10-07 11:29:05.151735] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.157 [2024-10-07 11:29:05.151804] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.157 [2024-10-07 11:29:05.151828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.157 [2024-10-07 11:29:05.151843] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.157 [2024-10-07 11:29:05.151898] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.157 [2024-10-07 11:29:05.159154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.157 [2024-10-07 11:29:05.159348] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.157 [2024-10-07 11:29:05.159386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.157 [2024-10-07 11:29:05.159430] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.157 [2024-10-07 11:29:05.160647] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.157 [2024-10-07 11:29:05.160936] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.157 [2024-10-07 11:29:05.160975] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.157 [2024-10-07 11:29:05.160996] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.157 [2024-10-07 11:29:05.162149] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.157 [2024-10-07 11:29:05.163112] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.157 [2024-10-07 11:29:05.163249] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.157 [2024-10-07 11:29:05.163292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.157 [2024-10-07 11:29:05.163313] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.157 [2024-10-07 11:29:05.163348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.157 [2024-10-07 11:29:05.163380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.157 [2024-10-07 11:29:05.163413] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.157 [2024-10-07 11:29:05.163445] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.157 [2024-10-07 11:29:05.163491] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.157 [2024-10-07 11:29:05.169336] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.157 [2024-10-07 11:29:05.169539] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.157 [2024-10-07 11:29:05.169577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.157 [2024-10-07 11:29:05.169595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.157 [2024-10-07 11:29:05.169630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.157 [2024-10-07 11:29:05.169663] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.157 [2024-10-07 11:29:05.169680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.157 [2024-10-07 11:29:05.169695] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.157 [2024-10-07 11:29:05.169726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.157 [2024-10-07 11:29:05.173217] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.157 [2024-10-07 11:29:05.173378] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.157 [2024-10-07 11:29:05.173429] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.157 [2024-10-07 11:29:05.173450] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.157 [2024-10-07 11:29:05.173487] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.157 [2024-10-07 11:29:05.174265] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.157 [2024-10-07 11:29:05.174304] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.158 [2024-10-07 11:29:05.174324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.158 [2024-10-07 11:29:05.174570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.158 [2024-10-07 11:29:05.179525] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.158 [2024-10-07 11:29:05.179720] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.158 [2024-10-07 11:29:05.179757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.158 [2024-10-07 11:29:05.179776] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.158 [2024-10-07 11:29:05.179812] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.158 [2024-10-07 11:29:05.179845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.158 [2024-10-07 11:29:05.179862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.158 [2024-10-07 11:29:05.179878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.158 [2024-10-07 11:29:05.179911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.158 [2024-10-07 11:29:05.183348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.158 [2024-10-07 11:29:05.183570] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.158 [2024-10-07 11:29:05.183608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.158 [2024-10-07 11:29:05.183629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.158 [2024-10-07 11:29:05.183664] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.158 [2024-10-07 11:29:05.183697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.158 [2024-10-07 11:29:05.183714] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.158 [2024-10-07 11:29:05.183730] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.158 [2024-10-07 11:29:05.183761] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.158 [2024-10-07 11:29:05.190132] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.158 [2024-10-07 11:29:05.190328] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.158 [2024-10-07 11:29:05.190364] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.158 [2024-10-07 11:29:05.190383] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.158 [2024-10-07 11:29:05.190434] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.158 [2024-10-07 11:29:05.190469] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.158 [2024-10-07 11:29:05.190487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.158 [2024-10-07 11:29:05.190503] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.158 [2024-10-07 11:29:05.190535] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.158 [2024-10-07 11:29:05.194149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.158 [2024-10-07 11:29:05.194318] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.158 [2024-10-07 11:29:05.194353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.158 [2024-10-07 11:29:05.194413] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.158 [2024-10-07 11:29:05.194455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.158 [2024-10-07 11:29:05.194488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.158 [2024-10-07 11:29:05.194506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.158 [2024-10-07 11:29:05.194521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.158 [2024-10-07 11:29:05.194552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.158 [2024-10-07 11:29:05.200292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.158 [2024-10-07 11:29:05.200518] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.158 [2024-10-07 11:29:05.200558] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.158 [2024-10-07 11:29:05.200578] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.158 [2024-10-07 11:29:05.200616] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.158 [2024-10-07 11:29:05.200649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.158 [2024-10-07 11:29:05.200666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.158 [2024-10-07 11:29:05.200681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.158 [2024-10-07 11:29:05.200714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.158 [2024-10-07 11:29:05.204285] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.158 [2024-10-07 11:29:05.204479] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.158 [2024-10-07 11:29:05.204517] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.158 [2024-10-07 11:29:05.204536] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.158 [2024-10-07 11:29:05.205339] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.158 [2024-10-07 11:29:05.205576] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.158 [2024-10-07 11:29:05.205616] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.158 [2024-10-07 11:29:05.205635] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.158 [2024-10-07 11:29:05.205735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.158 [2024-10-07 11:29:05.210463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.158 [2024-10-07 11:29:05.210647] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.158 [2024-10-07 11:29:05.210684] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.158 [2024-10-07 11:29:05.210703] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.158 [2024-10-07 11:29:05.210739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.158 [2024-10-07 11:29:05.210770] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.158 [2024-10-07 11:29:05.210813] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.158 [2024-10-07 11:29:05.210829] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.158 [2024-10-07 11:29:05.211780] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.158 [2024-10-07 11:29:05.214433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.158 [2024-10-07 11:29:05.214587] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.158 [2024-10-07 11:29:05.214629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.158 [2024-10-07 11:29:05.214650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.158 [2024-10-07 11:29:05.215385] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.158 [2024-10-07 11:29:05.215611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.158 [2024-10-07 11:29:05.215648] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.158 [2024-10-07 11:29:05.215667] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.158 [2024-10-07 11:29:05.215739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.158 [2024-10-07 11:29:05.220729] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.158 [2024-10-07 11:29:05.220909] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.158 [2024-10-07 11:29:05.220945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.158 [2024-10-07 11:29:05.220964] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.159 [2024-10-07 11:29:05.221001] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.159 [2024-10-07 11:29:05.221033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.159 [2024-10-07 11:29:05.221051] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.159 [2024-10-07 11:29:05.221086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.159 [2024-10-07 11:29:05.221121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.159 [2024-10-07 11:29:05.224719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.159 [2024-10-07 11:29:05.224870] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.159 [2024-10-07 11:29:05.224914] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.159 [2024-10-07 11:29:05.224932] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.159 [2024-10-07 11:29:05.224965] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.159 [2024-10-07 11:29:05.224996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.159 [2024-10-07 11:29:05.225014] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.159 [2024-10-07 11:29:05.225029] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.159 [2024-10-07 11:29:05.225076] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.159 [2024-10-07 11:29:05.230926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.159 [2024-10-07 11:29:05.231116] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.159 [2024-10-07 11:29:05.231151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.159 [2024-10-07 11:29:05.231169] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.159 [2024-10-07 11:29:05.231204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.159 [2024-10-07 11:29:05.231236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.159 [2024-10-07 11:29:05.231253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.159 [2024-10-07 11:29:05.231268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.159 [2024-10-07 11:29:05.231299] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.159 [2024-10-07 11:29:05.234838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.159 [2024-10-07 11:29:05.234991] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.159 [2024-10-07 11:29:05.235026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.159 [2024-10-07 11:29:05.235044] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.159 [2024-10-07 11:29:05.235826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.159 [2024-10-07 11:29:05.236031] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.159 [2024-10-07 11:29:05.236067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.159 [2024-10-07 11:29:05.236086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.159 [2024-10-07 11:29:05.236185] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.159 [2024-10-07 11:29:05.241093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.159 [2024-10-07 11:29:05.241267] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.159 [2024-10-07 11:29:05.241304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.159 [2024-10-07 11:29:05.241323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.159 [2024-10-07 11:29:05.241358] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.159 [2024-10-07 11:29:05.241396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.159 [2024-10-07 11:29:05.241448] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.159 [2024-10-07 11:29:05.241472] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.159 [2024-10-07 11:29:05.242425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.159 [2024-10-07 11:29:05.244956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.159 [2024-10-07 11:29:05.245107] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.159 [2024-10-07 11:29:05.245143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.159 [2024-10-07 11:29:05.245168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.159 [2024-10-07 11:29:05.245984] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.159 [2024-10-07 11:29:05.246205] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.159 [2024-10-07 11:29:05.246242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.159 [2024-10-07 11:29:05.246261] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.159 [2024-10-07 11:29:05.246335] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.159 [2024-10-07 11:29:05.251378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.159 [2024-10-07 11:29:05.251571] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.159 [2024-10-07 11:29:05.251608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.159 [2024-10-07 11:29:05.251628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.159 [2024-10-07 11:29:05.251663] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.159 [2024-10-07 11:29:05.251696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.159 [2024-10-07 11:29:05.251713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.159 [2024-10-07 11:29:05.251729] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.159 [2024-10-07 11:29:05.252975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.159 [2024-10-07 11:29:05.255467] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.159 [2024-10-07 11:29:05.255609] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.159 [2024-10-07 11:29:05.255645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.159 [2024-10-07 11:29:05.255664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.159 [2024-10-07 11:29:05.255698] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.159 [2024-10-07 11:29:05.255729] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.159 [2024-10-07 11:29:05.255747] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.159 [2024-10-07 11:29:05.255763] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.159 [2024-10-07 11:29:05.255957] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.159 [2024-10-07 11:29:05.261534] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.159 [2024-10-07 11:29:05.261694] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.159 [2024-10-07 11:29:05.261730] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.159 [2024-10-07 11:29:05.261749] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.159 [2024-10-07 11:29:05.261782] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.159 [2024-10-07 11:29:05.261814] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.159 [2024-10-07 11:29:05.261832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.159 [2024-10-07 11:29:05.261871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.159 [2024-10-07 11:29:05.261904] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.159 [2024-10-07 11:29:05.266513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.159 [2024-10-07 11:29:05.266677] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.159 [2024-10-07 11:29:05.266713] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.159 [2024-10-07 11:29:05.266732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.159 [2024-10-07 11:29:05.266765] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.159 [2024-10-07 11:29:05.266797] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.159 [2024-10-07 11:29:05.266814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.159 [2024-10-07 11:29:05.266829] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.159 [2024-10-07 11:29:05.266859] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.159 [2024-10-07 11:29:05.271656] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.159 [2024-10-07 11:29:05.271805] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.159 [2024-10-07 11:29:05.271839] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.159 [2024-10-07 11:29:05.271858] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.159 [2024-10-07 11:29:05.272810] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.159 [2024-10-07 11:29:05.273622] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.159 [2024-10-07 11:29:05.273661] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.159 [2024-10-07 11:29:05.273681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.159 [2024-10-07 11:29:05.273976] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.159 [2024-10-07 11:29:05.276632] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.160 [2024-10-07 11:29:05.276764] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.160 [2024-10-07 11:29:05.276797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.160 [2024-10-07 11:29:05.276815] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.160 [2024-10-07 11:29:05.276848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.160 [2024-10-07 11:29:05.276901] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.160 [2024-10-07 11:29:05.276922] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.160 [2024-10-07 11:29:05.276937] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.160 [2024-10-07 11:29:05.276967] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.160 [2024-10-07 11:29:05.281773] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.160 [2024-10-07 11:29:05.283103] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.160 [2024-10-07 11:29:05.283151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.160 [2024-10-07 11:29:05.283174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.160 [2024-10-07 11:29:05.283385] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.160 [2024-10-07 11:29:05.284534] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.160 [2024-10-07 11:29:05.284571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.160 [2024-10-07 11:29:05.284591] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.160 [2024-10-07 11:29:05.285449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.160 [2024-10-07 11:29:05.288390] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.160 [2024-10-07 11:29:05.288539] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.160 [2024-10-07 11:29:05.288573] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.160 [2024-10-07 11:29:05.288592] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.160 [2024-10-07 11:29:05.288626] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.160 [2024-10-07 11:29:05.288658] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.160 [2024-10-07 11:29:05.288675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.160 [2024-10-07 11:29:05.288689] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.160 [2024-10-07 11:29:05.288719] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.160 [2024-10-07 11:29:05.292186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.160 [2024-10-07 11:29:05.292393] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.160 [2024-10-07 11:29:05.292483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.160 [2024-10-07 11:29:05.292520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.160 [2024-10-07 11:29:05.292570] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.160 [2024-10-07 11:29:05.292620] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.160 [2024-10-07 11:29:05.292658] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.160 [2024-10-07 11:29:05.292685] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.160 [2024-10-07 11:29:05.292737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.160 [2024-10-07 11:29:05.301052] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.160 [2024-10-07 11:29:05.302536] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.160 [2024-10-07 11:29:05.302603] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.160 [2024-10-07 11:29:05.302629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.160 [2024-10-07 11:29:05.302890] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.160 [2024-10-07 11:29:05.303937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.160 [2024-10-07 11:29:05.303994] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.160 [2024-10-07 11:29:05.304014] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.160 [2024-10-07 11:29:05.304030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.160 [2024-10-07 11:29:05.304825] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.160 [2024-10-07 11:29:05.304914] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.160 [2024-10-07 11:29:05.304944] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.160 [2024-10-07 11:29:05.304962] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.160 [2024-10-07 11:29:05.305284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.160 [2024-10-07 11:29:05.305437] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.160 [2024-10-07 11:29:05.305474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.160 [2024-10-07 11:29:05.305493] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.160 [2024-10-07 11:29:05.305548] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.160 [2024-10-07 11:29:05.311283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.160 [2024-10-07 11:29:05.311476] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.160 [2024-10-07 11:29:05.311513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.160 [2024-10-07 11:29:05.311532] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.160 [2024-10-07 11:29:05.311569] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.160 [2024-10-07 11:29:05.312331] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.160 [2024-10-07 11:29:05.312368] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.160 [2024-10-07 11:29:05.312388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.160 [2024-10-07 11:29:05.312615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.160 [2024-10-07 11:29:05.314367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.160 [2024-10-07 11:29:05.315591] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.160 [2024-10-07 11:29:05.315637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.160 [2024-10-07 11:29:05.315658] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.160 [2024-10-07 11:29:05.316502] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.160 [2024-10-07 11:29:05.316651] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.160 [2024-10-07 11:29:05.316678] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.160 [2024-10-07 11:29:05.316724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.160 [2024-10-07 11:29:05.316762] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.160 [2024-10-07 11:29:05.322246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.160 [2024-10-07 11:29:05.322459] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.160 [2024-10-07 11:29:05.322497] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.160 [2024-10-07 11:29:05.322516] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.160 [2024-10-07 11:29:05.322552] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.160 [2024-10-07 11:29:05.322584] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.160 [2024-10-07 11:29:05.322603] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.160 [2024-10-07 11:29:05.322618] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.160 [2024-10-07 11:29:05.322649] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.160 [2024-10-07 11:29:05.325714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.160 [2024-10-07 11:29:05.326018] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.160 [2024-10-07 11:29:05.326064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.160 [2024-10-07 11:29:05.326085] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.160 [2024-10-07 11:29:05.326120] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.160 [2024-10-07 11:29:05.326153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.160 [2024-10-07 11:29:05.326170] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.160 [2024-10-07 11:29:05.326184] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.160 [2024-10-07 11:29:05.326968] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.160 [2024-10-07 11:29:05.334086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.160 [2024-10-07 11:29:05.334263] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.160 [2024-10-07 11:29:05.334299] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.160 [2024-10-07 11:29:05.334318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.160 [2024-10-07 11:29:05.334587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.160 [2024-10-07 11:29:05.334716] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.160 [2024-10-07 11:29:05.334755] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.161 [2024-10-07 11:29:05.334775] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.161 [2024-10-07 11:29:05.334830] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.161 [2024-10-07 11:29:05.335815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.161 [2024-10-07 11:29:05.336651] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.161 [2024-10-07 11:29:05.336723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.161 [2024-10-07 11:29:05.336745] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.161 [2024-10-07 11:29:05.336933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.161 [2024-10-07 11:29:05.337012] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.161 [2024-10-07 11:29:05.337037] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.161 [2024-10-07 11:29:05.337067] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.161 [2024-10-07 11:29:05.337134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.161 [2024-10-07 11:29:05.345578] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.161 [2024-10-07 11:29:05.345764] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.161 [2024-10-07 11:29:05.345800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.161 [2024-10-07 11:29:05.345818] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.161 [2024-10-07 11:29:05.345854] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.161 [2024-10-07 11:29:05.345891] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.161 [2024-10-07 11:29:05.345909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.161 [2024-10-07 11:29:05.345924] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.161 [2024-10-07 11:29:05.346132] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.161 [2024-10-07 11:29:05.346280] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.161 [2024-10-07 11:29:05.346477] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.161 [2024-10-07 11:29:05.346509] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.161 [2024-10-07 11:29:05.346527] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.161 [2024-10-07 11:29:05.346581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.161 [2024-10-07 11:29:05.346617] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.161 [2024-10-07 11:29:05.346635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.161 [2024-10-07 11:29:05.346649] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.161 [2024-10-07 11:29:05.346679] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.161 [2024-10-07 11:29:05.356312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.161 [2024-10-07 11:29:05.356537] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.161 [2024-10-07 11:29:05.356575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.161 [2024-10-07 11:29:05.356595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.161 [2024-10-07 11:29:05.356648] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.161 [2024-10-07 11:29:05.357946] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.161 [2024-10-07 11:29:05.358011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.161 [2024-10-07 11:29:05.358033] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.161 [2024-10-07 11:29:05.358049] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.161 [2024-10-07 11:29:05.358276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.161 [2024-10-07 11:29:05.358353] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.161 [2024-10-07 11:29:05.358382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.161 [2024-10-07 11:29:05.358414] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.161 [2024-10-07 11:29:05.359547] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.161 [2024-10-07 11:29:05.360411] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.161 [2024-10-07 11:29:05.360450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.161 [2024-10-07 11:29:05.360468] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.161 [2024-10-07 11:29:05.360762] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.161 [2024-10-07 11:29:05.366500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.161 [2024-10-07 11:29:05.366691] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.161 [2024-10-07 11:29:05.366729] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.161 [2024-10-07 11:29:05.366749] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.161 [2024-10-07 11:29:05.367706] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.161 [2024-10-07 11:29:05.367934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.161 [2024-10-07 11:29:05.367965] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.161 [2024-10-07 11:29:05.367982] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.161 [2024-10-07 11:29:05.368063] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.161 [2024-10-07 11:29:05.369358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.161 [2024-10-07 11:29:05.369678] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.161 [2024-10-07 11:29:05.369727] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.161 [2024-10-07 11:29:05.369749] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.161 [2024-10-07 11:29:05.369785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.161 [2024-10-07 11:29:05.369817] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.161 [2024-10-07 11:29:05.369835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.161 [2024-10-07 11:29:05.369849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.161 [2024-10-07 11:29:05.370653] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.161 [2024-10-07 11:29:05.377855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.161 [2024-10-07 11:29:05.378324] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.161 [2024-10-07 11:29:05.378376] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.161 [2024-10-07 11:29:05.378414] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.161 [2024-10-07 11:29:05.378545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.161 [2024-10-07 11:29:05.378611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.161 [2024-10-07 11:29:05.378635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.161 [2024-10-07 11:29:05.378652] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.161 [2024-10-07 11:29:05.378685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.161 [2024-10-07 11:29:05.379462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.161 [2024-10-07 11:29:05.379565] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.161 [2024-10-07 11:29:05.379596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.161 [2024-10-07 11:29:05.379613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.161 [2024-10-07 11:29:05.380382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.161 [2024-10-07 11:29:05.380625] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.161 [2024-10-07 11:29:05.380661] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.161 [2024-10-07 11:29:05.380678] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.161 [2024-10-07 11:29:05.380754] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.161 [2024-10-07 11:29:05.389267] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.161 [2024-10-07 11:29:05.389485] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.161 [2024-10-07 11:29:05.389523] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.161 [2024-10-07 11:29:05.389542] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.161 [2024-10-07 11:29:05.389580] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.161 [2024-10-07 11:29:05.389632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.161 [2024-10-07 11:29:05.389653] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.161 [2024-10-07 11:29:05.389669] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.161 [2024-10-07 11:29:05.389871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.161 [2024-10-07 11:29:05.389902] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.161 [2024-10-07 11:29:05.390089] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.161 [2024-10-07 11:29:05.390121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.162 [2024-10-07 11:29:05.390164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.162 [2024-10-07 11:29:05.390290] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.162 [2024-10-07 11:29:05.390354] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.162 [2024-10-07 11:29:05.390377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.162 [2024-10-07 11:29:05.390392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.162 [2024-10-07 11:29:05.390442] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.162 [2024-10-07 11:29:05.400156] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.162 [2024-10-07 11:29:05.400292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.162 [2024-10-07 11:29:05.400432] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.162 [2024-10-07 11:29:05.400468] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.162 [2024-10-07 11:29:05.400487] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.162 [2024-10-07 11:29:05.401826] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.162 [2024-10-07 11:29:05.401882] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.162 [2024-10-07 11:29:05.401905] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.162 [2024-10-07 11:29:05.401929] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.162 [2024-10-07 11:29:05.402151] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.162 [2024-10-07 11:29:05.402182] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.162 [2024-10-07 11:29:05.402197] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.162 [2024-10-07 11:29:05.402214] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.162 [2024-10-07 11:29:05.403359] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.162 [2024-10-07 11:29:05.403436] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.162 [2024-10-07 11:29:05.403471] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.162 [2024-10-07 11:29:05.403496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.162 [2024-10-07 11:29:05.404578] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.162 [2024-10-07 11:29:05.410330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.162 [2024-10-07 11:29:05.410524] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.162 [2024-10-07 11:29:05.410562] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.162 [2024-10-07 11:29:05.410581] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.162 [2024-10-07 11:29:05.411549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.162 [2024-10-07 11:29:05.411798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.162 [2024-10-07 11:29:05.411874] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.162 [2024-10-07 11:29:05.411895] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.162 [2024-10-07 11:29:05.411912] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.162 [2024-10-07 11:29:05.413219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.162 [2024-10-07 11:29:05.413313] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.162 [2024-10-07 11:29:05.413344] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.162 [2024-10-07 11:29:05.413362] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.162 [2024-10-07 11:29:05.413587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.162 [2024-10-07 11:29:05.413642] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.162 [2024-10-07 11:29:05.413662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.162 [2024-10-07 11:29:05.413678] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.162 [2024-10-07 11:29:05.414460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.162 [2024-10-07 11:29:05.422188] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.162 [2024-10-07 11:29:05.422309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.162 [2024-10-07 11:29:05.422441] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.162 [2024-10-07 11:29:05.422475] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.162 [2024-10-07 11:29:05.422494] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.162 [2024-10-07 11:29:05.422772] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.162 [2024-10-07 11:29:05.422803] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.162 [2024-10-07 11:29:05.422820] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.162 [2024-10-07 11:29:05.422842] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.162 [2024-10-07 11:29:05.422958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.162 [2024-10-07 11:29:05.422988] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.162 [2024-10-07 11:29:05.423003] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.162 [2024-10-07 11:29:05.423019] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.162 [2024-10-07 11:29:05.423072] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.162 [2024-10-07 11:29:05.423096] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.162 [2024-10-07 11:29:05.423109] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.162 [2024-10-07 11:29:05.423124] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.162 [2024-10-07 11:29:05.423154] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.162 [2024-10-07 11:29:05.433862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.162 [2024-10-07 11:29:05.433957] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.162 [2024-10-07 11:29:05.434092] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.162 [2024-10-07 11:29:05.434128] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.162 [2024-10-07 11:29:05.434147] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.162 [2024-10-07 11:29:05.434198] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.162 [2024-10-07 11:29:05.434222] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.162 [2024-10-07 11:29:05.434238] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.162 [2024-10-07 11:29:05.434463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.162 [2024-10-07 11:29:05.434496] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.162 [2024-10-07 11:29:05.434632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.162 [2024-10-07 11:29:05.434659] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.162 [2024-10-07 11:29:05.434675] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.162 [2024-10-07 11:29:05.434692] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.162 [2024-10-07 11:29:05.434707] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.162 [2024-10-07 11:29:05.434720] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.162 [2024-10-07 11:29:05.434840] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.162 [2024-10-07 11:29:05.434864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.162 [2024-10-07 11:29:05.444845] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.162 [2024-10-07 11:29:05.444938] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.162 [2024-10-07 11:29:05.445083] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.162 [2024-10-07 11:29:05.445118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.162 [2024-10-07 11:29:05.445138] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.162 [2024-10-07 11:29:05.445189] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.163 [2024-10-07 11:29:05.445212] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.163 [2024-10-07 11:29:05.445227] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.163 [2024-10-07 11:29:05.446451] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.163 [2024-10-07 11:29:05.446498] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.163 [2024-10-07 11:29:05.446712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.163 [2024-10-07 11:29:05.446740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.163 [2024-10-07 11:29:05.446782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.163 [2024-10-07 11:29:05.446805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.163 [2024-10-07 11:29:05.446820] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.163 [2024-10-07 11:29:05.446833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.163 [2024-10-07 11:29:05.447962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.163 [2024-10-07 11:29:05.448004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.163 [2024-10-07 11:29:05.455030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.163 [2024-10-07 11:29:05.455155] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.163 [2024-10-07 11:29:05.455272] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.163 [2024-10-07 11:29:05.455305] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.163 [2024-10-07 11:29:05.455324] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.163 [2024-10-07 11:29:05.455391] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.163 [2024-10-07 11:29:05.455436] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.163 [2024-10-07 11:29:05.455454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.163 [2024-10-07 11:29:05.455475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.163 [2024-10-07 11:29:05.456427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.163 [2024-10-07 11:29:05.456468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.163 [2024-10-07 11:29:05.456486] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.163 [2024-10-07 11:29:05.456502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.163 [2024-10-07 11:29:05.456708] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.163 [2024-10-07 11:29:05.456734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.163 [2024-10-07 11:29:05.456748] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.163 [2024-10-07 11:29:05.456762] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.163 [2024-10-07 11:29:05.456838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.163 [2024-10-07 11:29:05.466724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.163 [2024-10-07 11:29:05.466824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.163 [2024-10-07 11:29:05.467167] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.163 [2024-10-07 11:29:05.467214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.163 [2024-10-07 11:29:05.467236] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.163 [2024-10-07 11:29:05.467289] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.163 [2024-10-07 11:29:05.467313] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.163 [2024-10-07 11:29:05.467355] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.163 [2024-10-07 11:29:05.467496] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.163 [2024-10-07 11:29:05.467540] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.163 [2024-10-07 11:29:05.467594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.163 [2024-10-07 11:29:05.467618] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.163 [2024-10-07 11:29:05.467634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.163 [2024-10-07 11:29:05.467652] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.163 [2024-10-07 11:29:05.467667] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.163 [2024-10-07 11:29:05.467680] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.163 [2024-10-07 11:29:05.467711] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.163 [2024-10-07 11:29:05.467729] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.163 [2024-10-07 11:29:05.478320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.163 [2024-10-07 11:29:05.478424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.163 [2024-10-07 11:29:05.478557] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.163 [2024-10-07 11:29:05.478592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.163 [2024-10-07 11:29:05.478610] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.163 [2024-10-07 11:29:05.478659] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.163 [2024-10-07 11:29:05.478682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.163 [2024-10-07 11:29:05.478697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.163 [2024-10-07 11:29:05.478900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.163 [2024-10-07 11:29:05.478931] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.163 [2024-10-07 11:29:05.479067] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.163 [2024-10-07 11:29:05.479103] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.163 [2024-10-07 11:29:05.479122] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.163 [2024-10-07 11:29:05.479140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.163 [2024-10-07 11:29:05.479154] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.163 [2024-10-07 11:29:05.479168] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.163 [2024-10-07 11:29:05.479288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.163 [2024-10-07 11:29:05.479312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.163 [2024-10-07 11:29:05.489315] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.163 [2024-10-07 11:29:05.489459] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.163 [2024-10-07 11:29:05.489597] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.163 [2024-10-07 11:29:05.489632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.163 [2024-10-07 11:29:05.489650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.163 [2024-10-07 11:29:05.489700] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.163 [2024-10-07 11:29:05.489724] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.163 [2024-10-07 11:29:05.489739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.163 [2024-10-07 11:29:05.490952] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.163 [2024-10-07 11:29:05.490997] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.163 [2024-10-07 11:29:05.491229] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.163 [2024-10-07 11:29:05.491267] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.163 [2024-10-07 11:29:05.491286] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.163 [2024-10-07 11:29:05.491305] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.163 [2024-10-07 11:29:05.491320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.163 [2024-10-07 11:29:05.491333] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.163 [2024-10-07 11:29:05.492462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.163 [2024-10-07 11:29:05.492498] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.163 [2024-10-07 11:29:05.499551] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.163 [2024-10-07 11:29:05.499656] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.163 [2024-10-07 11:29:05.499763] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.163 [2024-10-07 11:29:05.499794] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.163 [2024-10-07 11:29:05.499813] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.163 [2024-10-07 11:29:05.499878] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.163 [2024-10-07 11:29:05.499904] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.163 [2024-10-07 11:29:05.499921] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.163 [2024-10-07 11:29:05.499941] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.163 [2024-10-07 11:29:05.500894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.163 [2024-10-07 11:29:05.500938] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.164 [2024-10-07 11:29:05.500956] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.164 [2024-10-07 11:29:05.500973] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.164 [2024-10-07 11:29:05.501219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.164 [2024-10-07 11:29:05.501248] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.164 [2024-10-07 11:29:05.501262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.164 [2024-10-07 11:29:05.501276] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.164 [2024-10-07 11:29:05.502572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.164 [2024-10-07 11:29:05.511165] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.164 [2024-10-07 11:29:05.511248] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.164 [2024-10-07 11:29:05.511397] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.164 [2024-10-07 11:29:05.511449] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.164 [2024-10-07 11:29:05.511469] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.164 [2024-10-07 11:29:05.511520] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.164 [2024-10-07 11:29:05.511545] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.164 [2024-10-07 11:29:05.511560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.164 [2024-10-07 11:29:05.511801] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.164 [2024-10-07 11:29:05.511832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.164 [2024-10-07 11:29:05.511952] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.164 [2024-10-07 11:29:05.511980] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.164 [2024-10-07 11:29:05.511997] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.164 [2024-10-07 11:29:05.512015] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.164 [2024-10-07 11:29:05.512030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.164 [2024-10-07 11:29:05.512044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.164 [2024-10-07 11:29:05.512120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.164 [2024-10-07 11:29:05.512145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.164 [2024-10-07 11:29:05.522915] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.164 [2024-10-07 11:29:05.523020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.164 [2024-10-07 11:29:05.523153] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.164 [2024-10-07 11:29:05.523189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.164 [2024-10-07 11:29:05.523206] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.164 [2024-10-07 11:29:05.523256] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.164 [2024-10-07 11:29:05.523280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.164 [2024-10-07 11:29:05.523295] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.164 [2024-10-07 11:29:05.523356] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.164 [2024-10-07 11:29:05.523381] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.164 [2024-10-07 11:29:05.523424] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.164 [2024-10-07 11:29:05.523445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.164 [2024-10-07 11:29:05.523461] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.164 [2024-10-07 11:29:05.523478] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.164 [2024-10-07 11:29:05.523492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.164 [2024-10-07 11:29:05.523506] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.164 [2024-10-07 11:29:05.523703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.164 [2024-10-07 11:29:05.523729] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.164 [2024-10-07 11:29:05.533241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.164 [2024-10-07 11:29:05.533339] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.164 [2024-10-07 11:29:05.533493] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.164 [2024-10-07 11:29:05.533530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.164 [2024-10-07 11:29:05.533549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.164 [2024-10-07 11:29:05.533605] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.164 [2024-10-07 11:29:05.533629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.164 [2024-10-07 11:29:05.533645] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.164 [2024-10-07 11:29:05.534439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.164 [2024-10-07 11:29:05.534488] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.164 [2024-10-07 11:29:05.534701] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.164 [2024-10-07 11:29:05.534739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.164 [2024-10-07 11:29:05.534758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.164 [2024-10-07 11:29:05.534777] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.164 [2024-10-07 11:29:05.534792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.164 [2024-10-07 11:29:05.534806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.164 [2024-10-07 11:29:05.534903] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.164 [2024-10-07 11:29:05.534925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.164 [2024-10-07 11:29:05.543450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.164 [2024-10-07 11:29:05.543569] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.164 [2024-10-07 11:29:05.543702] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.164 [2024-10-07 11:29:05.543735] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.164 [2024-10-07 11:29:05.543753] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.164 [2024-10-07 11:29:05.544548] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.164 [2024-10-07 11:29:05.544592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.164 [2024-10-07 11:29:05.544612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.164 [2024-10-07 11:29:05.544633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.164 [2024-10-07 11:29:05.544833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.164 [2024-10-07 11:29:05.544863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.164 [2024-10-07 11:29:05.544878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.164 [2024-10-07 11:29:05.544893] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.164 [2024-10-07 11:29:05.544964] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.164 [2024-10-07 11:29:05.544990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.164 [2024-10-07 11:29:05.545004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.164 [2024-10-07 11:29:05.545018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.164 [2024-10-07 11:29:05.545082] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.164 [2024-10-07 11:29:05.553609] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.164 [2024-10-07 11:29:05.553812] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.164 [2024-10-07 11:29:05.553850] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.164 [2024-10-07 11:29:05.553869] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.164 [2024-10-07 11:29:05.554087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.164 [2024-10-07 11:29:05.554246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.164 [2024-10-07 11:29:05.554296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.164 [2024-10-07 11:29:05.554316] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.164 [2024-10-07 11:29:05.554332] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.164 [2024-10-07 11:29:05.554473] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.164 [2024-10-07 11:29:05.554545] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.164 [2024-10-07 11:29:05.554582] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.164 [2024-10-07 11:29:05.554599] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.164 [2024-10-07 11:29:05.554654] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.164 [2024-10-07 11:29:05.555651] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.164 [2024-10-07 11:29:05.555691] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.164 [2024-10-07 11:29:05.555710] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.164 [2024-10-07 11:29:05.556536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.165 [2024-10-07 11:29:05.563941] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.165 [2024-10-07 11:29:05.564153] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.165 [2024-10-07 11:29:05.564191] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.165 [2024-10-07 11:29:05.564210] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.165 [2024-10-07 11:29:05.565000] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.165 [2024-10-07 11:29:05.565259] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.165 [2024-10-07 11:29:05.565302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.165 [2024-10-07 11:29:05.565323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.165 [2024-10-07 11:29:05.565441] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.165 [2024-10-07 11:29:05.565469] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.165 [2024-10-07 11:29:05.565556] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.165 [2024-10-07 11:29:05.565587] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.165 [2024-10-07 11:29:05.565604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.165 [2024-10-07 11:29:05.566792] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.165 [2024-10-07 11:29:05.567024] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.165 [2024-10-07 11:29:05.567053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.165 [2024-10-07 11:29:05.567069] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.165 [2024-10-07 11:29:05.568193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.165 [2024-10-07 11:29:05.574860] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.165 [2024-10-07 11:29:05.575045] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.165 [2024-10-07 11:29:05.575080] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.165 [2024-10-07 11:29:05.575102] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.165 [2024-10-07 11:29:05.575138] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.165 [2024-10-07 11:29:05.575185] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.165 [2024-10-07 11:29:05.575205] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.165 [2024-10-07 11:29:05.575220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.165 [2024-10-07 11:29:05.575250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.165 [2024-10-07 11:29:05.575526] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.165 [2024-10-07 11:29:05.575617] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.165 [2024-10-07 11:29:05.575647] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.165 [2024-10-07 11:29:05.575665] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.165 [2024-10-07 11:29:05.576611] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.165 [2024-10-07 11:29:05.576856] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.165 [2024-10-07 11:29:05.576894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.165 [2024-10-07 11:29:05.576913] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.165 [2024-10-07 11:29:05.576997] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.165 [2024-10-07 11:29:05.586680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.165 [2024-10-07 11:29:05.586867] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.165 [2024-10-07 11:29:05.586981] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.165 [2024-10-07 11:29:05.587013] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.165 [2024-10-07 11:29:05.587032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.165 [2024-10-07 11:29:05.587306] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.165 [2024-10-07 11:29:05.587349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.165 [2024-10-07 11:29:05.587369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.165 [2024-10-07 11:29:05.587390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.165 [2024-10-07 11:29:05.587527] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.165 [2024-10-07 11:29:05.587558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.165 [2024-10-07 11:29:05.587573] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.165 [2024-10-07 11:29:05.587588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.165 [2024-10-07 11:29:05.587642] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.165 [2024-10-07 11:29:05.587666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.165 [2024-10-07 11:29:05.587679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.165 [2024-10-07 11:29:05.587694] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.165 [2024-10-07 11:29:05.587723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.165 [2024-10-07 11:29:05.598308] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.165 [2024-10-07 11:29:05.598414] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.165 [2024-10-07 11:29:05.598549] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.165 [2024-10-07 11:29:05.598610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.165 [2024-10-07 11:29:05.598631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.165 [2024-10-07 11:29:05.598683] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.165 [2024-10-07 11:29:05.598707] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.165 [2024-10-07 11:29:05.598722] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.165 [2024-10-07 11:29:05.598757] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.165 [2024-10-07 11:29:05.598780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.165 [2024-10-07 11:29:05.598807] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.165 [2024-10-07 11:29:05.598824] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.165 [2024-10-07 11:29:05.598839] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.165 [2024-10-07 11:29:05.598856] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.165 [2024-10-07 11:29:05.598870] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.165 [2024-10-07 11:29:05.598883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.165 [2024-10-07 11:29:05.598914] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.165 [2024-10-07 11:29:05.598931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.165 [2024-10-07 11:29:05.608801] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.165 [2024-10-07 11:29:05.608902] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.165 [2024-10-07 11:29:05.609107] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.165 [2024-10-07 11:29:05.609160] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.165 [2024-10-07 11:29:05.609191] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.165 [2024-10-07 11:29:05.609278] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.165 [2024-10-07 11:29:05.609309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.165 [2024-10-07 11:29:05.609326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.165 [2024-10-07 11:29:05.610151] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.165 [2024-10-07 11:29:05.610202] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.165 [2024-10-07 11:29:05.610395] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.165 [2024-10-07 11:29:05.610445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.165 [2024-10-07 11:29:05.610466] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.165 [2024-10-07 11:29:05.610489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.165 [2024-10-07 11:29:05.610504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.165 [2024-10-07 11:29:05.610546] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.165 [2024-10-07 11:29:05.610667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.165 [2024-10-07 11:29:05.610689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.165 [2024-10-07 11:29:05.619892] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.165 [2024-10-07 11:29:05.619985] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.165 [2024-10-07 11:29:05.620141] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.165 [2024-10-07 11:29:05.620179] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.165 [2024-10-07 11:29:05.620198] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.165 [2024-10-07 11:29:05.620249] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.166 [2024-10-07 11:29:05.620273] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.166 [2024-10-07 11:29:05.620290] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.166 [2024-10-07 11:29:05.620325] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.166 [2024-10-07 11:29:05.620348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.166 [2024-10-07 11:29:05.620414] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.166 [2024-10-07 11:29:05.620438] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.166 [2024-10-07 11:29:05.620454] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.166 [2024-10-07 11:29:05.620472] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.166 [2024-10-07 11:29:05.620487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.166 [2024-10-07 11:29:05.620500] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.166 [2024-10-07 11:29:05.620532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.166 [2024-10-07 11:29:05.620550] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.166 [2024-10-07 11:29:05.631006] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.166 [2024-10-07 11:29:05.631879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.166 [2024-10-07 11:29:05.632066] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.166 [2024-10-07 11:29:05.632116] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.166 [2024-10-07 11:29:05.632147] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.166 [2024-10-07 11:29:05.632545] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.166 [2024-10-07 11:29:05.632588] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.166 [2024-10-07 11:29:05.632608] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.166 [2024-10-07 11:29:05.632630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.166 [2024-10-07 11:29:05.632778] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.166 [2024-10-07 11:29:05.632810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.166 [2024-10-07 11:29:05.632825] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.166 [2024-10-07 11:29:05.632840] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.166 [2024-10-07 11:29:05.632925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.166 [2024-10-07 11:29:05.632952] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.166 [2024-10-07 11:29:05.632966] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.166 [2024-10-07 11:29:05.632980] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.166 [2024-10-07 11:29:05.633010] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.166 [2024-10-07 11:29:05.642577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.166 [2024-10-07 11:29:05.643617] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.166 [2024-10-07 11:29:05.643668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.166 [2024-10-07 11:29:05.643692] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.166 [2024-10-07 11:29:05.643803] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.166 [2024-10-07 11:29:05.643847] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.166 [2024-10-07 11:29:05.644093] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.166 [2024-10-07 11:29:05.644137] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.166 [2024-10-07 11:29:05.644157] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.166 [2024-10-07 11:29:05.644173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.166 [2024-10-07 11:29:05.644187] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.166 [2024-10-07 11:29:05.644203] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.166 [2024-10-07 11:29:05.644344] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.166 [2024-10-07 11:29:05.644373] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.166 [2024-10-07 11:29:05.644508] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.166 [2024-10-07 11:29:05.644535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.166 [2024-10-07 11:29:05.644550] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.166 [2024-10-07 11:29:05.644604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.166 [2024-10-07 11:29:05.652983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.166 [2024-10-07 11:29:05.653203] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.166 [2024-10-07 11:29:05.653242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.166 [2024-10-07 11:29:05.653261] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.166 [2024-10-07 11:29:05.654087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.166 [2024-10-07 11:29:05.654338] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.166 [2024-10-07 11:29:05.654378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.166 [2024-10-07 11:29:05.654411] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.166 [2024-10-07 11:29:05.654523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.166 [2024-10-07 11:29:05.654549] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.166 [2024-10-07 11:29:05.654630] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.166 [2024-10-07 11:29:05.654660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.166 [2024-10-07 11:29:05.654677] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.166 [2024-10-07 11:29:05.655916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.166 [2024-10-07 11:29:05.656186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.166 [2024-10-07 11:29:05.656216] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.166 [2024-10-07 11:29:05.656233] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.166 [2024-10-07 11:29:05.657388] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.166 [2024-10-07 11:29:05.663986] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.166 [2024-10-07 11:29:05.664199] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.166 [2024-10-07 11:29:05.664239] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.166 [2024-10-07 11:29:05.664259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.166 [2024-10-07 11:29:05.664301] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.166 [2024-10-07 11:29:05.664334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.166 [2024-10-07 11:29:05.664352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.166 [2024-10-07 11:29:05.664368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.166 [2024-10-07 11:29:05.664415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.166 [2024-10-07 11:29:05.664607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.166 [2024-10-07 11:29:05.664692] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.166 [2024-10-07 11:29:05.664722] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.166 [2024-10-07 11:29:05.664739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.166 [2024-10-07 11:29:05.665705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.166 [2024-10-07 11:29:05.665934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.166 [2024-10-07 11:29:05.665962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.166 [2024-10-07 11:29:05.666002] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.166 [2024-10-07 11:29:05.666084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.166 [2024-10-07 11:29:05.675051] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.166 [2024-10-07 11:29:05.675999] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.167 [2024-10-07 11:29:05.676050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.167 [2024-10-07 11:29:05.676072] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.167 [2024-10-07 11:29:05.676395] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.167 [2024-10-07 11:29:05.676474] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.167 [2024-10-07 11:29:05.676637] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.167 [2024-10-07 11:29:05.676671] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.167 [2024-10-07 11:29:05.676688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.167 [2024-10-07 11:29:05.676704] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.167 [2024-10-07 11:29:05.676717] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.167 [2024-10-07 11:29:05.676733] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.167 [2024-10-07 11:29:05.676789] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.167 [2024-10-07 11:29:05.676816] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.167 [2024-10-07 11:29:05.676845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.167 [2024-10-07 11:29:05.676863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.167 [2024-10-07 11:29:05.676877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.167 [2024-10-07 11:29:05.676905] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.167 [2024-10-07 11:29:05.686098] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.167 [2024-10-07 11:29:05.687460] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.167 [2024-10-07 11:29:05.687527] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.167 [2024-10-07 11:29:05.687552] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.167 [2024-10-07 11:29:05.688426] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.167 [2024-10-07 11:29:05.688566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.167 [2024-10-07 11:29:05.688609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.167 [2024-10-07 11:29:05.688627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.167 [2024-10-07 11:29:05.688643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.167 [2024-10-07 11:29:05.688861] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.167 [2024-10-07 11:29:05.688963] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.167 [2024-10-07 11:29:05.688992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.167 [2024-10-07 11:29:05.689010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.167 [2024-10-07 11:29:05.689181] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.167 [2024-10-07 11:29:05.689313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.167 [2024-10-07 11:29:05.689339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.167 [2024-10-07 11:29:05.689354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.167 [2024-10-07 11:29:05.689427] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.167 [2024-10-07 11:29:05.696269] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.167 [2024-10-07 11:29:05.697678] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.167 [2024-10-07 11:29:05.697728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.167 [2024-10-07 11:29:05.697751] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.167 [2024-10-07 11:29:05.697962] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.167 [2024-10-07 11:29:05.698006] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.167 [2024-10-07 11:29:05.698025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.167 [2024-10-07 11:29:05.698040] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.167 [2024-10-07 11:29:05.698817] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.167 [2024-10-07 11:29:05.699123] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.167 [2024-10-07 11:29:05.699232] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.167 [2024-10-07 11:29:05.699264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.167 [2024-10-07 11:29:05.699282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.167 [2024-10-07 11:29:05.699314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.167 [2024-10-07 11:29:05.699345] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.167 [2024-10-07 11:29:05.699362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.167 [2024-10-07 11:29:05.699376] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.167 [2024-10-07 11:29:05.699422] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.167 [2024-10-07 11:29:05.706422] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.167 [2024-10-07 11:29:05.706579] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.167 [2024-10-07 11:29:05.706614] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.167 [2024-10-07 11:29:05.706632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.167 [2024-10-07 11:29:05.706665] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.167 [2024-10-07 11:29:05.706724] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.167 [2024-10-07 11:29:05.706743] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.167 [2024-10-07 11:29:05.706758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.167 [2024-10-07 11:29:05.706788] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.167 [2024-10-07 11:29:05.709207] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.167 [2024-10-07 11:29:05.709319] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.167 [2024-10-07 11:29:05.709351] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.167 [2024-10-07 11:29:05.709368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.167 [2024-10-07 11:29:05.710301] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.167 [2024-10-07 11:29:05.710557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.167 [2024-10-07 11:29:05.710594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.167 [2024-10-07 11:29:05.710612] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.167 [2024-10-07 11:29:05.710691] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.167 [2024-10-07 11:29:05.717447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.167 [2024-10-07 11:29:05.717625] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.167 [2024-10-07 11:29:05.717660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.167 [2024-10-07 11:29:05.717679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.167 [2024-10-07 11:29:05.717714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.167 [2024-10-07 11:29:05.717746] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.167 [2024-10-07 11:29:05.717763] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.167 [2024-10-07 11:29:05.717779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.167 [2024-10-07 11:29:05.717974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.167 [2024-10-07 11:29:05.720504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.167 [2024-10-07 11:29:05.720637] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.167 [2024-10-07 11:29:05.720670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.167 [2024-10-07 11:29:05.720688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.167 [2024-10-07 11:29:05.720918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.167 [2024-10-07 11:29:05.721049] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.167 [2024-10-07 11:29:05.721096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.167 [2024-10-07 11:29:05.721113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.167 [2024-10-07 11:29:05.721192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.167 [2024-10-07 11:29:05.728218] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.167 [2024-10-07 11:29:05.728426] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.167 [2024-10-07 11:29:05.728462] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.167 [2024-10-07 11:29:05.728480] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.167 [2024-10-07 11:29:05.728517] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.167 [2024-10-07 11:29:05.729721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.167 [2024-10-07 11:29:05.729760] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.167 [2024-10-07 11:29:05.729779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.168 [2024-10-07 11:29:05.730008] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.168 [2024-10-07 11:29:05.732090] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.168 [2024-10-07 11:29:05.732214] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.168 [2024-10-07 11:29:05.732247] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.168 [2024-10-07 11:29:05.732265] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.168 [2024-10-07 11:29:05.732298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.168 [2024-10-07 11:29:05.732506] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.168 [2024-10-07 11:29:05.732543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.168 [2024-10-07 11:29:05.732561] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.168 [2024-10-07 11:29:05.732699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.168 [2024-10-07 11:29:05.738365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.168 [2024-10-07 11:29:05.738538] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.168 [2024-10-07 11:29:05.738573] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.168 [2024-10-07 11:29:05.738591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.168 [2024-10-07 11:29:05.739536] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.168 [2024-10-07 11:29:05.739758] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.168 [2024-10-07 11:29:05.739793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.168 [2024-10-07 11:29:05.739812] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.168 [2024-10-07 11:29:05.739938] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.168 [2024-10-07 11:29:05.742774] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.168 [2024-10-07 11:29:05.742915] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.168 [2024-10-07 11:29:05.742949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.168 [2024-10-07 11:29:05.742993] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.168 [2024-10-07 11:29:05.743030] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.168 [2024-10-07 11:29:05.743061] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.168 [2024-10-07 11:29:05.743078] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.168 [2024-10-07 11:29:05.743093] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.168 [2024-10-07 11:29:05.743123] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.168 [2024-10-07 11:29:05.749703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.168 [2024-10-07 11:29:05.749893] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.168 [2024-10-07 11:29:05.749929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.168 [2024-10-07 11:29:05.749947] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.168 [2024-10-07 11:29:05.750206] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.168 [2024-10-07 11:29:05.750340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.168 [2024-10-07 11:29:05.750377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.168 [2024-10-07 11:29:05.750396] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.168 [2024-10-07 11:29:05.750473] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.168 [2024-10-07 11:29:05.752882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.168 [2024-10-07 11:29:05.753004] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.168 [2024-10-07 11:29:05.753035] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.168 [2024-10-07 11:29:05.753052] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.168 [2024-10-07 11:29:05.753102] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.168 [2024-10-07 11:29:05.753134] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.168 [2024-10-07 11:29:05.753151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.168 [2024-10-07 11:29:05.753165] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.168 [2024-10-07 11:29:05.753195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.168 [2024-10-07 11:29:05.761232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.168 [2024-10-07 11:29:05.761445] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.168 [2024-10-07 11:29:05.761481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.168 [2024-10-07 11:29:05.761501] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.168 [2024-10-07 11:29:05.761537] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.168 [2024-10-07 11:29:05.761569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.168 [2024-10-07 11:29:05.761608] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.168 [2024-10-07 11:29:05.761624] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.168 [2024-10-07 11:29:05.761823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.168 [2024-10-07 11:29:05.764234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.168 [2024-10-07 11:29:05.764349] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.168 [2024-10-07 11:29:05.764380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.168 [2024-10-07 11:29:05.764397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.168 [2024-10-07 11:29:05.764648] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.168 [2024-10-07 11:29:05.764778] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.168 [2024-10-07 11:29:05.764814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.168 [2024-10-07 11:29:05.764832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.168 [2024-10-07 11:29:05.764885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.168 [2024-10-07 11:29:05.771939] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.168 [2024-10-07 11:29:05.772109] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.168 [2024-10-07 11:29:05.772144] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.168 [2024-10-07 11:29:05.772163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.168 [2024-10-07 11:29:05.772198] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.168 [2024-10-07 11:29:05.772229] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.168 [2024-10-07 11:29:05.772246] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.168 [2024-10-07 11:29:05.772262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.168 [2024-10-07 11:29:05.772292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.168 [2024-10-07 11:29:05.775752] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.168 [2024-10-07 11:29:05.775885] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.168 [2024-10-07 11:29:05.775918] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.168 [2024-10-07 11:29:05.775936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.168 [2024-10-07 11:29:05.775968] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.168 [2024-10-07 11:29:05.775999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.168 [2024-10-07 11:29:05.776016] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.168 [2024-10-07 11:29:05.776031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.168 [2024-10-07 11:29:05.776061] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.168 [2024-10-07 11:29:05.782073] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.168 [2024-10-07 11:29:05.782267] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.168 [2024-10-07 11:29:05.782302] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.168 [2024-10-07 11:29:05.782321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.168 [2024-10-07 11:29:05.782356] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.168 [2024-10-07 11:29:05.783299] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.168 [2024-10-07 11:29:05.783338] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.168 [2024-10-07 11:29:05.783359] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.168 [2024-10-07 11:29:05.783633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.168 [2024-10-07 11:29:05.786548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.168 [2024-10-07 11:29:05.786684] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.168 [2024-10-07 11:29:05.786718] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.168 [2024-10-07 11:29:05.786736] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.169 [2024-10-07 11:29:05.786770] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.169 [2024-10-07 11:29:05.786801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.169 [2024-10-07 11:29:05.786818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.169 [2024-10-07 11:29:05.786833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.169 [2024-10-07 11:29:05.786863] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.169 [2024-10-07 11:29:05.793438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.169 [2024-10-07 11:29:05.793612] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.169 [2024-10-07 11:29:05.793647] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.169 [2024-10-07 11:29:05.793664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.169 [2024-10-07 11:29:05.793897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.169 [2024-10-07 11:29:05.794029] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.169 [2024-10-07 11:29:05.794065] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.169 [2024-10-07 11:29:05.794085] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.169 [2024-10-07 11:29:05.794140] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.169 [2024-10-07 11:29:05.796648] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.169 [2024-10-07 11:29:05.796761] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.169 [2024-10-07 11:29:05.796792] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.169 [2024-10-07 11:29:05.796833] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.169 [2024-10-07 11:29:05.796870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.169 [2024-10-07 11:29:05.797829] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.169 [2024-10-07 11:29:05.797868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.169 [2024-10-07 11:29:05.797887] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.169 [2024-10-07 11:29:05.798088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.169 [2024-10-07 11:29:05.804896] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.169 [2024-10-07 11:29:05.805114] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.169 [2024-10-07 11:29:05.805151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.169 [2024-10-07 11:29:05.805171] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.169 [2024-10-07 11:29:05.805208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.169 [2024-10-07 11:29:05.805240] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.169 [2024-10-07 11:29:05.805257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.169 [2024-10-07 11:29:05.805273] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.169 [2024-10-07 11:29:05.805490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.169 [2024-10-07 11:29:05.807931] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.169 [2024-10-07 11:29:05.808060] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.169 [2024-10-07 11:29:05.808094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.169 [2024-10-07 11:29:05.808111] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.169 [2024-10-07 11:29:05.808341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.169 [2024-10-07 11:29:05.808485] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.169 [2024-10-07 11:29:05.808523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.169 [2024-10-07 11:29:05.808541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.169 [2024-10-07 11:29:05.808596] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.169 [2024-10-07 11:29:05.815714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.169 [2024-10-07 11:29:05.815917] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.169 [2024-10-07 11:29:05.815953] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.169 [2024-10-07 11:29:05.815972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.169 [2024-10-07 11:29:05.816008] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.169 [2024-10-07 11:29:05.817258] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.169 [2024-10-07 11:29:05.817329] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.169 [2024-10-07 11:29:05.817351] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.169 [2024-10-07 11:29:05.817593] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.169 [2024-10-07 11:29:05.819763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.169 [2024-10-07 11:29:05.819912] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.169 [2024-10-07 11:29:05.819955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.169 [2024-10-07 11:29:05.819975] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.169 [2024-10-07 11:29:05.820183] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.169 [2024-10-07 11:29:05.820390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.169 [2024-10-07 11:29:05.820445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.169 [2024-10-07 11:29:05.820464] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.169 [2024-10-07 11:29:05.820600] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.169 [2024-10-07 11:29:05.825871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.169 [2024-10-07 11:29:05.826060] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.169 [2024-10-07 11:29:05.826097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.169 [2024-10-07 11:29:05.826116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.169 [2024-10-07 11:29:05.826151] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.169 [2024-10-07 11:29:05.827100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.169 [2024-10-07 11:29:05.827138] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.169 [2024-10-07 11:29:05.827158] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.169 [2024-10-07 11:29:05.827387] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.169 [2024-10-07 11:29:05.830337] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.169 [2024-10-07 11:29:05.830521] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.169 [2024-10-07 11:29:05.830558] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.169 [2024-10-07 11:29:05.830577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.169 [2024-10-07 11:29:05.830612] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.169 [2024-10-07 11:29:05.830644] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.169 [2024-10-07 11:29:05.830662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.169 [2024-10-07 11:29:05.830677] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.169 [2024-10-07 11:29:05.830707] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.169 [2024-10-07 11:29:05.837269] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.169 [2024-10-07 11:29:05.837508] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.169 [2024-10-07 11:29:05.837546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.169 [2024-10-07 11:29:05.837565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.169 [2024-10-07 11:29:05.837804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.169 [2024-10-07 11:29:05.837938] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.169 [2024-10-07 11:29:05.837976] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.169 [2024-10-07 11:29:05.837996] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.169 [2024-10-07 11:29:05.838051] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.169 [2024-10-07 11:29:05.840464] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.169 [2024-10-07 11:29:05.840582] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.169 [2024-10-07 11:29:05.840615] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.169 [2024-10-07 11:29:05.840632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.169 [2024-10-07 11:29:05.840664] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.169 [2024-10-07 11:29:05.840695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.169 [2024-10-07 11:29:05.840713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.169 [2024-10-07 11:29:05.840727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.169 [2024-10-07 11:29:05.840757] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.169 [2024-10-07 11:29:05.848875] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.169 [2024-10-07 11:29:05.849090] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.170 [2024-10-07 11:29:05.849126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.170 [2024-10-07 11:29:05.849145] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.170 [2024-10-07 11:29:05.849181] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.170 [2024-10-07 11:29:05.849213] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.170 [2024-10-07 11:29:05.849230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.170 [2024-10-07 11:29:05.849245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.170 [2024-10-07 11:29:05.849276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.170 [2024-10-07 11:29:05.851930] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.170 [2024-10-07 11:29:05.852047] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.170 [2024-10-07 11:29:05.852078] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.170 [2024-10-07 11:29:05.852096] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.170 [2024-10-07 11:29:05.852156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.170 [2024-10-07 11:29:05.852201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.170 [2024-10-07 11:29:05.852221] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.170 [2024-10-07 11:29:05.852235] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.170 [2024-10-07 11:29:05.852479] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.170 [2024-10-07 11:29:05.859883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.170 [2024-10-07 11:29:05.860055] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.170 [2024-10-07 11:29:05.860089] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.170 [2024-10-07 11:29:05.860108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.170 [2024-10-07 11:29:05.860143] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.170 [2024-10-07 11:29:05.860174] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.170 [2024-10-07 11:29:05.860192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.170 [2024-10-07 11:29:05.860206] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.170 [2024-10-07 11:29:05.860237] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.170 [2024-10-07 11:29:05.863747] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.170 [2024-10-07 11:29:05.863882] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.170 [2024-10-07 11:29:05.863915] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.170 [2024-10-07 11:29:05.863933] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.170 [2024-10-07 11:29:05.863967] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.170 [2024-10-07 11:29:05.863999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.170 [2024-10-07 11:29:05.864017] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.170 [2024-10-07 11:29:05.864031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.170 [2024-10-07 11:29:05.864061] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.170 [2024-10-07 11:29:05.870032] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.170 [2024-10-07 11:29:05.870195] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.170 [2024-10-07 11:29:05.870229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.170 [2024-10-07 11:29:05.870248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.170 [2024-10-07 11:29:05.870282] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.170 [2024-10-07 11:29:05.871226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.170 [2024-10-07 11:29:05.871264] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.170 [2024-10-07 11:29:05.871308] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.170 [2024-10-07 11:29:05.871527] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.170 [2024-10-07 11:29:05.874567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.170 [2024-10-07 11:29:05.874687] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.170 [2024-10-07 11:29:05.874720] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.170 [2024-10-07 11:29:05.874737] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.170 [2024-10-07 11:29:05.874769] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.170 [2024-10-07 11:29:05.874800] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.170 [2024-10-07 11:29:05.874818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.170 [2024-10-07 11:29:05.874832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.170 [2024-10-07 11:29:05.874862] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.170 [2024-10-07 11:29:05.881547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.170 [2024-10-07 11:29:05.881710] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.170 [2024-10-07 11:29:05.881745] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.170 [2024-10-07 11:29:05.881763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.170 [2024-10-07 11:29:05.881994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.170 [2024-10-07 11:29:05.882125] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.170 [2024-10-07 11:29:05.882162] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.170 [2024-10-07 11:29:05.882182] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.170 [2024-10-07 11:29:05.882236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.170 [2024-10-07 11:29:05.884663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.170 [2024-10-07 11:29:05.884782] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.170 [2024-10-07 11:29:05.884814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.170 [2024-10-07 11:29:05.884832] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.170 [2024-10-07 11:29:05.884865] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.170 [2024-10-07 11:29:05.884895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.170 [2024-10-07 11:29:05.884913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.170 [2024-10-07 11:29:05.884927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.170 [2024-10-07 11:29:05.884957] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.170 [2024-10-07 11:29:05.893240] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.170 [2024-10-07 11:29:05.893459] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.170 [2024-10-07 11:29:05.893523] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.170 [2024-10-07 11:29:05.893544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.170 [2024-10-07 11:29:05.893768] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.170 [2024-10-07 11:29:05.893974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.170 [2024-10-07 11:29:05.894016] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.170 [2024-10-07 11:29:05.894038] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.170 [2024-10-07 11:29:05.894173] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.170 [2024-10-07 11:29:05.896344] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.170 [2024-10-07 11:29:05.896702] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.170 [2024-10-07 11:29:05.896749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.170 [2024-10-07 11:29:05.896771] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.170 [2024-10-07 11:29:05.896889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.170 [2024-10-07 11:29:05.896952] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.170 [2024-10-07 11:29:05.896975] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.170 [2024-10-07 11:29:05.896990] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.170 [2024-10-07 11:29:05.897024] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.170 [2024-10-07 11:29:05.903987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.170 [2024-10-07 11:29:05.904166] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.170 [2024-10-07 11:29:05.904201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.170 [2024-10-07 11:29:05.904220] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.170 [2024-10-07 11:29:05.904255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.170 [2024-10-07 11:29:05.904287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.170 [2024-10-07 11:29:05.904304] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.170 [2024-10-07 11:29:05.904320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.171 [2024-10-07 11:29:05.905539] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.171 [2024-10-07 11:29:05.907781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.171 [2024-10-07 11:29:05.907922] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.171 [2024-10-07 11:29:05.907955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.171 [2024-10-07 11:29:05.907973] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.171 [2024-10-07 11:29:05.908006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.171 [2024-10-07 11:29:05.908064] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.171 [2024-10-07 11:29:05.908083] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.171 [2024-10-07 11:29:05.908097] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.171 [2024-10-07 11:29:05.908289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.171 [2024-10-07 11:29:05.914140] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.171 [2024-10-07 11:29:05.914348] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.171 [2024-10-07 11:29:05.914387] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.171 [2024-10-07 11:29:05.914423] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.171 [2024-10-07 11:29:05.915368] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.171 [2024-10-07 11:29:05.915608] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.171 [2024-10-07 11:29:05.915645] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.171 [2024-10-07 11:29:05.915665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.171 [2024-10-07 11:29:05.915747] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.171 [2024-10-07 11:29:05.918599] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.171 [2024-10-07 11:29:05.918742] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.171 [2024-10-07 11:29:05.918778] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.171 [2024-10-07 11:29:05.918796] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.171 [2024-10-07 11:29:05.918829] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.171 [2024-10-07 11:29:05.918861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.171 [2024-10-07 11:29:05.918880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.171 [2024-10-07 11:29:05.918894] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.171 [2024-10-07 11:29:05.920141] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.171 [2024-10-07 11:29:05.925364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.171 [2024-10-07 11:29:05.925562] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.171 [2024-10-07 11:29:05.925599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.171 [2024-10-07 11:29:05.925619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.171 [2024-10-07 11:29:05.925855] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.171 [2024-10-07 11:29:05.926009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.171 [2024-10-07 11:29:05.926048] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.171 [2024-10-07 11:29:05.926069] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.171 [2024-10-07 11:29:05.926149] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.171 [2024-10-07 11:29:05.928729] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.171 [2024-10-07 11:29:05.928907] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.171 [2024-10-07 11:29:05.928954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.171 [2024-10-07 11:29:05.928985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.171 [2024-10-07 11:29:05.929998] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.171 [2024-10-07 11:29:05.930253] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.171 [2024-10-07 11:29:05.930291] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.171 [2024-10-07 11:29:05.930311] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.171 [2024-10-07 11:29:05.931613] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.171 [2024-10-07 11:29:05.936965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.171 [2024-10-07 11:29:05.937168] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.171 [2024-10-07 11:29:05.937206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.171 [2024-10-07 11:29:05.937226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.171 [2024-10-07 11:29:05.937262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.171 [2024-10-07 11:29:05.937294] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.171 [2024-10-07 11:29:05.937312] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.171 [2024-10-07 11:29:05.937328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.171 [2024-10-07 11:29:05.937541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.171 [2024-10-07 11:29:05.940051] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.171 [2024-10-07 11:29:05.940170] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.171 [2024-10-07 11:29:05.940202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.171 [2024-10-07 11:29:05.940220] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.171 [2024-10-07 11:29:05.940465] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.171 [2024-10-07 11:29:05.940596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.171 [2024-10-07 11:29:05.940633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.171 [2024-10-07 11:29:05.940652] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.171 [2024-10-07 11:29:05.940706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.171 [2024-10-07 11:29:05.947127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.171 [2024-10-07 11:29:05.948144] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.171 [2024-10-07 11:29:05.948201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.171 [2024-10-07 11:29:05.948250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.171 [2024-10-07 11:29:05.948514] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.171 [2024-10-07 11:29:05.948641] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.171 [2024-10-07 11:29:05.948667] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.171 [2024-10-07 11:29:05.948683] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.171 [2024-10-07 11:29:05.948718] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.171 [2024-10-07 11:29:05.950223] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.171 [2024-10-07 11:29:05.951485] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.171 [2024-10-07 11:29:05.951536] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.171 [2024-10-07 11:29:05.951557] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.171 [2024-10-07 11:29:05.952389] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.171 [2024-10-07 11:29:05.952570] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.171 [2024-10-07 11:29:05.952609] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.171 [2024-10-07 11:29:05.952629] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.171 [2024-10-07 11:29:05.952830] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.171 [2024-10-07 11:29:05.958186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.171 [2024-10-07 11:29:05.958430] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.171 [2024-10-07 11:29:05.958468] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.171 [2024-10-07 11:29:05.958488] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.172 [2024-10-07 11:29:05.958544] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.172 [2024-10-07 11:29:05.958582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.172 [2024-10-07 11:29:05.958600] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.172 [2024-10-07 11:29:05.958615] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.172 [2024-10-07 11:29:05.958648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.172 [2024-10-07 11:29:05.960320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.172 [2024-10-07 11:29:05.960450] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.172 [2024-10-07 11:29:05.960483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.172 [2024-10-07 11:29:05.960500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.172 [2024-10-07 11:29:05.961792] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.172 [2024-10-07 11:29:05.962004] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.172 [2024-10-07 11:29:05.962063] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.172 [2024-10-07 11:29:05.962084] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.172 [2024-10-07 11:29:05.962120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.172 [2024-10-07 11:29:05.968335] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.172 [2024-10-07 11:29:05.969507] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.172 [2024-10-07 11:29:05.969562] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.172 [2024-10-07 11:29:05.969584] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.172 [2024-10-07 11:29:05.970384] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.172 [2024-10-07 11:29:05.970740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.172 [2024-10-07 11:29:05.970780] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.172 [2024-10-07 11:29:05.970801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.172 [2024-10-07 11:29:05.970935] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.172 [2024-10-07 11:29:05.971000] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.172 [2024-10-07 11:29:05.971098] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.172 [2024-10-07 11:29:05.971146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.172 [2024-10-07 11:29:05.971166] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.172 [2024-10-07 11:29:05.971200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.172 [2024-10-07 11:29:05.971231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.172 [2024-10-07 11:29:05.971248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.172 [2024-10-07 11:29:05.971262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.172 [2024-10-07 11:29:05.971292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.172 [2024-10-07 11:29:05.978514] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.172 [2024-10-07 11:29:05.978716] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.172 [2024-10-07 11:29:05.978753] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.172 [2024-10-07 11:29:05.978772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.172 [2024-10-07 11:29:05.980002] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.172 [2024-10-07 11:29:05.980247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.172 [2024-10-07 11:29:05.980284] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.172 [2024-10-07 11:29:05.980304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.172 [2024-10-07 11:29:05.981452] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.172 [2024-10-07 11:29:05.982473] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.172 [2024-10-07 11:29:05.982604] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.172 [2024-10-07 11:29:05.982640] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.172 [2024-10-07 11:29:05.982659] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.172 [2024-10-07 11:29:05.982855] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.172 [2024-10-07 11:29:05.983012] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.172 [2024-10-07 11:29:05.983048] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.172 [2024-10-07 11:29:05.983077] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.172 [2024-10-07 11:29:05.983240] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.172 [2024-10-07 11:29:05.988670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.172 [2024-10-07 11:29:05.988878] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.172 [2024-10-07 11:29:05.988917] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.172 [2024-10-07 11:29:05.988937] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.172 [2024-10-07 11:29:05.989947] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.172 [2024-10-07 11:29:05.990183] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.172 [2024-10-07 11:29:05.990221] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.172 [2024-10-07 11:29:05.990242] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.172 [2024-10-07 11:29:05.990325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.172 [2024-10-07 11:29:05.993322] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.172 [2024-10-07 11:29:05.993492] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.172 [2024-10-07 11:29:05.993529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.172 [2024-10-07 11:29:05.993555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.172 [2024-10-07 11:29:05.993610] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.172 [2024-10-07 11:29:05.993652] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.172 [2024-10-07 11:29:05.993671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.172 [2024-10-07 11:29:05.993686] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.172 [2024-10-07 11:29:05.993718] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.172 [2024-10-07 11:29:06.000397] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.172 [2024-10-07 11:29:06.000610] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.172 [2024-10-07 11:29:06.000647] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.172 [2024-10-07 11:29:06.000667] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.172 [2024-10-07 11:29:06.000934] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.172 [2024-10-07 11:29:06.001084] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.172 [2024-10-07 11:29:06.001122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.172 [2024-10-07 11:29:06.001142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.172 [2024-10-07 11:29:06.001198] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.172 [2024-10-07 11:29:06.003447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.172 [2024-10-07 11:29:06.003569] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.172 [2024-10-07 11:29:06.003602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.172 [2024-10-07 11:29:06.003620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.172 [2024-10-07 11:29:06.003653] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.172 [2024-10-07 11:29:06.003704] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.172 [2024-10-07 11:29:06.003725] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.172 [2024-10-07 11:29:06.003740] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.172 [2024-10-07 11:29:06.003770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.172 [2024-10-07 11:29:06.011956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.172 [2024-10-07 11:29:06.012153] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.172 [2024-10-07 11:29:06.012190] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.172 [2024-10-07 11:29:06.012208] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.172 [2024-10-07 11:29:06.012244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.172 [2024-10-07 11:29:06.012474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.172 [2024-10-07 11:29:06.012504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.172 [2024-10-07 11:29:06.012521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.172 [2024-10-07 11:29:06.012661] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.172 [2024-10-07 11:29:06.014981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.172 [2024-10-07 11:29:06.015112] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.173 [2024-10-07 11:29:06.015146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.173 [2024-10-07 11:29:06.015164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.173 [2024-10-07 11:29:06.015424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.173 [2024-10-07 11:29:06.015556] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.173 [2024-10-07 11:29:06.015591] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.173 [2024-10-07 11:29:06.015633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.173 [2024-10-07 11:29:06.015690] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.173 [2024-10-07 11:29:06.022784] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.173 [2024-10-07 11:29:06.022963] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.173 [2024-10-07 11:29:06.022998] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.173 [2024-10-07 11:29:06.023016] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.173 [2024-10-07 11:29:06.023052] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.173 [2024-10-07 11:29:06.023084] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.173 [2024-10-07 11:29:06.023100] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.173 [2024-10-07 11:29:06.023117] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.173 [2024-10-07 11:29:06.023148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.173 [2024-10-07 11:29:06.026612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.173 [2024-10-07 11:29:06.026739] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.173 [2024-10-07 11:29:06.026773] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.173 [2024-10-07 11:29:06.026790] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.173 [2024-10-07 11:29:06.026823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.173 [2024-10-07 11:29:06.026854] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.173 [2024-10-07 11:29:06.026872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.173 [2024-10-07 11:29:06.026887] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.173 [2024-10-07 11:29:06.026917] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.173 [2024-10-07 11:29:06.032917] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.173 [2024-10-07 11:29:06.033087] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.173 [2024-10-07 11:29:06.033121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.173 [2024-10-07 11:29:06.033140] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.173 [2024-10-07 11:29:06.033175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.173 [2024-10-07 11:29:06.033207] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.173 [2024-10-07 11:29:06.033225] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.173 [2024-10-07 11:29:06.033240] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.173 [2024-10-07 11:29:06.033271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.173 [2024-10-07 11:29:06.037519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.173 [2024-10-07 11:29:06.037675] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.173 [2024-10-07 11:29:06.037709] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.173 [2024-10-07 11:29:06.037727] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.173 [2024-10-07 11:29:06.037761] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.173 [2024-10-07 11:29:06.037792] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.173 [2024-10-07 11:29:06.037809] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.173 [2024-10-07 11:29:06.037823] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.173 [2024-10-07 11:29:06.037854] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.173 [2024-10-07 11:29:06.044355] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.173 [2024-10-07 11:29:06.044549] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.173 [2024-10-07 11:29:06.044585] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.173 [2024-10-07 11:29:06.044604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.173 [2024-10-07 11:29:06.044837] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.173 [2024-10-07 11:29:06.044961] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.173 [2024-10-07 11:29:06.044999] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.173 [2024-10-07 11:29:06.045019] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.173 [2024-10-07 11:29:06.045088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.173 [2024-10-07 11:29:06.047646] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.173 [2024-10-07 11:29:06.047763] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.173 [2024-10-07 11:29:06.047795] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.173 [2024-10-07 11:29:06.047813] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.173 [2024-10-07 11:29:06.047845] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.173 [2024-10-07 11:29:06.047875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.173 [2024-10-07 11:29:06.047893] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.173 [2024-10-07 11:29:06.047907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.173 [2024-10-07 11:29:06.047950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.173 [2024-10-07 11:29:06.056664] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.173 [2024-10-07 11:29:06.056945] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.173 [2024-10-07 11:29:06.056995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.173 [2024-10-07 11:29:06.057017] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.173 [2024-10-07 11:29:06.057263] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.173 [2024-10-07 11:29:06.057445] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.173 [2024-10-07 11:29:06.057492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.173 [2024-10-07 11:29:06.057521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.173 [2024-10-07 11:29:06.057657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.173 [2024-10-07 11:29:06.057765] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.173 [2024-10-07 11:29:06.057870] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.173 [2024-10-07 11:29:06.057907] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.173 [2024-10-07 11:29:06.057926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.173 [2024-10-07 11:29:06.057958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.173 [2024-10-07 11:29:06.058928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.173 [2024-10-07 11:29:06.058970] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.173 [2024-10-07 11:29:06.058989] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.173 [2024-10-07 11:29:06.059797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.173 [2024-10-07 11:29:06.067732] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.173 [2024-10-07 11:29:06.067916] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.173 [2024-10-07 11:29:06.067953] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.173 [2024-10-07 11:29:06.067972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.173 [2024-10-07 11:29:06.068025] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.173 [2024-10-07 11:29:06.068078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.173 [2024-10-07 11:29:06.068111] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.173 [2024-10-07 11:29:06.068129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.173 [2024-10-07 11:29:06.068144] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.173 [2024-10-07 11:29:06.069344] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.173 [2024-10-07 11:29:06.069443] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.173 [2024-10-07 11:29:06.069473] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.173 [2024-10-07 11:29:06.069491] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.173 [2024-10-07 11:29:06.069701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.173 [2024-10-07 11:29:06.070842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.173 [2024-10-07 11:29:06.070880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.173 [2024-10-07 11:29:06.070930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.173 [2024-10-07 11:29:06.071778] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.174 [2024-10-07 11:29:06.077886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.174 [2024-10-07 11:29:06.078084] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.174 [2024-10-07 11:29:06.078136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.174 [2024-10-07 11:29:06.078169] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.174 [2024-10-07 11:29:06.078227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.174 [2024-10-07 11:29:06.079253] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.174 [2024-10-07 11:29:06.079298] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.174 [2024-10-07 11:29:06.079319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.174 [2024-10-07 11:29:06.079546] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.174 [2024-10-07 11:29:06.079596] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.174 [2024-10-07 11:29:06.079734] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.174 [2024-10-07 11:29:06.079776] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.174 [2024-10-07 11:29:06.079796] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.174 [2024-10-07 11:29:06.081045] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.174 [2024-10-07 11:29:06.081298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.174 [2024-10-07 11:29:06.081336] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.174 [2024-10-07 11:29:06.081354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.174 [2024-10-07 11:29:06.081389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.174 [2024-10-07 11:29:06.089574] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.174 [2024-10-07 11:29:06.089802] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.174 [2024-10-07 11:29:06.089839] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.174 [2024-10-07 11:29:06.089858] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.174 [2024-10-07 11:29:06.090114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.174 [2024-10-07 11:29:06.090255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.174 [2024-10-07 11:29:06.090308] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.174 [2024-10-07 11:29:06.090328] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.174 [2024-10-07 11:29:06.090344] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.174 [2024-10-07 11:29:06.090397] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.174 [2024-10-07 11:29:06.090483] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.174 [2024-10-07 11:29:06.090536] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.174 [2024-10-07 11:29:06.090555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.174 [2024-10-07 11:29:06.090589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.174 [2024-10-07 11:29:06.090621] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.174 [2024-10-07 11:29:06.090638] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.174 [2024-10-07 11:29:06.090652] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.174 [2024-10-07 11:29:06.090682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.174 [2024-10-07 11:29:06.101218] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.174 [2024-10-07 11:29:06.101339] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.174 [2024-10-07 11:29:06.101465] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.174 [2024-10-07 11:29:06.101500] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.174 [2024-10-07 11:29:06.101518] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.174 [2024-10-07 11:29:06.101586] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.174 [2024-10-07 11:29:06.101613] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.174 [2024-10-07 11:29:06.101629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.174 [2024-10-07 11:29:06.101650] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.174 8301.86 IOPS, 32.43 MiB/s [2024-10-07T11:29:07.885Z] [2024-10-07 11:29:06.103530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.174 [2024-10-07 11:29:06.103567] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.174 [2024-10-07 11:29:06.103585] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.174 [2024-10-07 11:29:06.103600] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.174 [2024-10-07 11:29:06.103765] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.174 [2024-10-07 11:29:06.103792] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.174 [2024-10-07 11:29:06.103806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.174 [2024-10-07 11:29:06.103821] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.174 [2024-10-07 11:29:06.104831] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.174 [2024-10-07 11:29:06.112206] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.174 [2024-10-07 11:29:06.112295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.174 [2024-10-07 11:29:06.112448] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.174 [2024-10-07 11:29:06.112485] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.174 [2024-10-07 11:29:06.112503] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.174 [2024-10-07 11:29:06.112589] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.174 [2024-10-07 11:29:06.112615] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.174 [2024-10-07 11:29:06.112631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.174 [2024-10-07 11:29:06.113860] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.174 [2024-10-07 11:29:06.113908] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.174 [2024-10-07 11:29:06.114124] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.174 [2024-10-07 11:29:06.114159] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.174 [2024-10-07 11:29:06.114178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.174 [2024-10-07 11:29:06.114197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.174 [2024-10-07 11:29:06.114212] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.174 [2024-10-07 11:29:06.114225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.174 [2024-10-07 11:29:06.115348] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.174 [2024-10-07 11:29:06.115386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.174 [2024-10-07 11:29:06.122386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.174 [2024-10-07 11:29:06.122511] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.174 [2024-10-07 11:29:06.122622] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.174 [2024-10-07 11:29:06.122655] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.174 [2024-10-07 11:29:06.122674] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.174 [2024-10-07 11:29:06.122739] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.174 [2024-10-07 11:29:06.122765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.174 [2024-10-07 11:29:06.122781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.174 [2024-10-07 11:29:06.122801] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.174 [2024-10-07 11:29:06.123748] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.174 [2024-10-07 11:29:06.123791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.174 [2024-10-07 11:29:06.123810] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.174 [2024-10-07 11:29:06.123826] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.174 [2024-10-07 11:29:06.124022] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.174 [2024-10-07 11:29:06.124047] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.174 [2024-10-07 11:29:06.124062] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.174 [2024-10-07 11:29:06.124075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.174 [2024-10-07 11:29:06.124175] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.174 [2024-10-07 11:29:06.133817] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.174 [2024-10-07 11:29:06.133901] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.174 [2024-10-07 11:29:06.134029] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.174 [2024-10-07 11:29:06.134063] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.174 [2024-10-07 11:29:06.134081] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.174 [2024-10-07 11:29:06.134130] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.175 [2024-10-07 11:29:06.134154] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.175 [2024-10-07 11:29:06.134170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.175 [2024-10-07 11:29:06.134438] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.175 [2024-10-07 11:29:06.134472] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.175 [2024-10-07 11:29:06.134582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.175 [2024-10-07 11:29:06.134612] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.175 [2024-10-07 11:29:06.134630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.175 [2024-10-07 11:29:06.134647] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.175 [2024-10-07 11:29:06.134662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.175 [2024-10-07 11:29:06.134675] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.175 [2024-10-07 11:29:06.134726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.175 [2024-10-07 11:29:06.134748] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.175 [2024-10-07 11:29:06.145511] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.175 [2024-10-07 11:29:06.145598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.175 [2024-10-07 11:29:06.145728] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.175 [2024-10-07 11:29:06.145762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.175 [2024-10-07 11:29:06.145781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.175 [2024-10-07 11:29:06.145830] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.175 [2024-10-07 11:29:06.145854] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.175 [2024-10-07 11:29:06.145870] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.175 [2024-10-07 11:29:06.146067] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.175 [2024-10-07 11:29:06.146099] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.175 [2024-10-07 11:29:06.146237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.175 [2024-10-07 11:29:06.146287] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.175 [2024-10-07 11:29:06.146304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.175 [2024-10-07 11:29:06.146322] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.175 [2024-10-07 11:29:06.146337] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.175 [2024-10-07 11:29:06.146351] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.175 [2024-10-07 11:29:06.146491] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.175 [2024-10-07 11:29:06.146518] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.175 [2024-10-07 11:29:06.156504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.175 [2024-10-07 11:29:06.156596] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.175 [2024-10-07 11:29:06.156727] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.175 [2024-10-07 11:29:06.156762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.175 [2024-10-07 11:29:06.156780] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.175 [2024-10-07 11:29:06.156829] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.175 [2024-10-07 11:29:06.156852] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.175 [2024-10-07 11:29:06.156868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.175 [2024-10-07 11:29:06.158075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.175 [2024-10-07 11:29:06.158121] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.175 [2024-10-07 11:29:06.158331] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.175 [2024-10-07 11:29:06.158366] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.175 [2024-10-07 11:29:06.158385] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.175 [2024-10-07 11:29:06.158419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.175 [2024-10-07 11:29:06.158437] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.175 [2024-10-07 11:29:06.158450] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.175 [2024-10-07 11:29:06.159565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.175 [2024-10-07 11:29:06.159602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.175 [2024-10-07 11:29:06.166697] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.175 [2024-10-07 11:29:06.166777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.175 [2024-10-07 11:29:06.166902] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.175 [2024-10-07 11:29:06.166936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.175 [2024-10-07 11:29:06.166955] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.175 [2024-10-07 11:29:06.167003] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.175 [2024-10-07 11:29:06.167051] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.175 [2024-10-07 11:29:06.167069] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.175 [2024-10-07 11:29:06.168022] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.175 [2024-10-07 11:29:06.168068] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.175 [2024-10-07 11:29:06.168272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.175 [2024-10-07 11:29:06.168308] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.175 [2024-10-07 11:29:06.168327] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.175 [2024-10-07 11:29:06.168346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.175 [2024-10-07 11:29:06.168360] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.175 [2024-10-07 11:29:06.168373] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.175 [2024-10-07 11:29:06.168500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.175 [2024-10-07 11:29:06.168523] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.175 [2024-10-07 11:29:06.178300] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.175 [2024-10-07 11:29:06.178421] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.175 [2024-10-07 11:29:06.178654] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.175 [2024-10-07 11:29:06.178693] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.175 [2024-10-07 11:29:06.178713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.175 [2024-10-07 11:29:06.178765] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.175 [2024-10-07 11:29:06.178789] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.175 [2024-10-07 11:29:06.178806] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.175 [2024-10-07 11:29:06.178861] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.175 [2024-10-07 11:29:06.178899] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.175 [2024-10-07 11:29:06.178927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.175 [2024-10-07 11:29:06.178945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.175 [2024-10-07 11:29:06.178962] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.175 [2024-10-07 11:29:06.178980] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.175 [2024-10-07 11:29:06.178994] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.175 [2024-10-07 11:29:06.179007] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.175 [2024-10-07 11:29:06.179039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.175 [2024-10-07 11:29:06.179056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.176 [2024-10-07 11:29:06.189445] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.176 [2024-10-07 11:29:06.189557] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.176 [2024-10-07 11:29:06.189728] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.176 [2024-10-07 11:29:06.189764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.176 [2024-10-07 11:29:06.189784] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.176 [2024-10-07 11:29:06.189834] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.176 [2024-10-07 11:29:06.189857] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.176 [2024-10-07 11:29:06.189873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.176 [2024-10-07 11:29:06.190080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.176 [2024-10-07 11:29:06.190112] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.176 [2024-10-07 11:29:06.190249] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.176 [2024-10-07 11:29:06.190275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.176 [2024-10-07 11:29:06.190293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.176 [2024-10-07 11:29:06.190311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.176 [2024-10-07 11:29:06.190326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.176 [2024-10-07 11:29:06.190339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.176 [2024-10-07 11:29:06.190482] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.176 [2024-10-07 11:29:06.190508] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.176 [2024-10-07 11:29:06.200150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.176 [2024-10-07 11:29:06.200247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.176 [2024-10-07 11:29:06.200379] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.176 [2024-10-07 11:29:06.200430] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.176 [2024-10-07 11:29:06.200451] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.176 [2024-10-07 11:29:06.200504] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.176 [2024-10-07 11:29:06.200528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.176 [2024-10-07 11:29:06.200544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.176 [2024-10-07 11:29:06.201841] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.176 [2024-10-07 11:29:06.201900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.176 [2024-10-07 11:29:06.202138] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.176 [2024-10-07 11:29:06.202177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.176 [2024-10-07 11:29:06.202221] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.176 [2024-10-07 11:29:06.202242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.176 [2024-10-07 11:29:06.202257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.176 [2024-10-07 11:29:06.202271] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.176 [2024-10-07 11:29:06.203466] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.176 [2024-10-07 11:29:06.203519] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.176 [2024-10-07 11:29:06.210343] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.176 [2024-10-07 11:29:06.210466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.176 [2024-10-07 11:29:06.210583] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.176 [2024-10-07 11:29:06.210616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.176 [2024-10-07 11:29:06.210635] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.176 [2024-10-07 11:29:06.211674] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.176 [2024-10-07 11:29:06.211723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.176 [2024-10-07 11:29:06.211744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.176 [2024-10-07 11:29:06.211768] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.176 [2024-10-07 11:29:06.212025] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.176 [2024-10-07 11:29:06.212077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.176 [2024-10-07 11:29:06.212096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.176 [2024-10-07 11:29:06.212113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.176 [2024-10-07 11:29:06.212255] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.176 [2024-10-07 11:29:06.212301] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.176 [2024-10-07 11:29:06.212327] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.176 [2024-10-07 11:29:06.212344] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.176 [2024-10-07 11:29:06.213676] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.176 [2024-10-07 11:29:06.220508] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.176 [2024-10-07 11:29:06.220712] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.176 [2024-10-07 11:29:06.220749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.176 [2024-10-07 11:29:06.220769] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.176 [2024-10-07 11:29:06.220805] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.176 [2024-10-07 11:29:06.220841] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.176 [2024-10-07 11:29:06.220912] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.176 [2024-10-07 11:29:06.220973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.176 [2024-10-07 11:29:06.220992] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.176 [2024-10-07 11:29:06.221008] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.176 [2024-10-07 11:29:06.221022] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.176 [2024-10-07 11:29:06.221037] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.176 [2024-10-07 11:29:06.222006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.176 [2024-10-07 11:29:06.222050] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.176 [2024-10-07 11:29:06.222825] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.176 [2024-10-07 11:29:06.222864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.176 [2024-10-07 11:29:06.222882] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.176 [2024-10-07 11:29:06.223192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.176 [2024-10-07 11:29:06.230657] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.176 [2024-10-07 11:29:06.230839] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.176 [2024-10-07 11:29:06.230876] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.176 [2024-10-07 11:29:06.230894] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.176 [2024-10-07 11:29:06.230930] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.176 [2024-10-07 11:29:06.232139] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.176 [2024-10-07 11:29:06.232178] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.176 [2024-10-07 11:29:06.232198] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.176 [2024-10-07 11:29:06.232447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.176 [2024-10-07 11:29:06.232480] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.176 [2024-10-07 11:29:06.233676] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.176 [2024-10-07 11:29:06.233722] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.176 [2024-10-07 11:29:06.233743] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.176 [2024-10-07 11:29:06.234591] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.176 [2024-10-07 11:29:06.234719] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.176 [2024-10-07 11:29:06.234745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.176 [2024-10-07 11:29:06.234760] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.176 [2024-10-07 11:29:06.234952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.176 [2024-10-07 11:29:06.240799] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.176 [2024-10-07 11:29:06.241016] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.176 [2024-10-07 11:29:06.241067] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.176 [2024-10-07 11:29:06.241091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.176 [2024-10-07 11:29:06.242058] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.176 [2024-10-07 11:29:06.242286] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.177 [2024-10-07 11:29:06.242323] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.177 [2024-10-07 11:29:06.242343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.177 [2024-10-07 11:29:06.243643] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.177 [2024-10-07 11:29:06.243892] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.177 [2024-10-07 11:29:06.246499] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.177 [2024-10-07 11:29:06.246565] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.177 [2024-10-07 11:29:06.246591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.177 [2024-10-07 11:29:06.247434] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.177 [2024-10-07 11:29:06.247695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.177 [2024-10-07 11:29:06.247737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.177 [2024-10-07 11:29:06.247756] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.177 [2024-10-07 11:29:06.247881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.177 [2024-10-07 11:29:06.253533] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.177 [2024-10-07 11:29:06.253868] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.177 [2024-10-07 11:29:06.253925] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.177 [2024-10-07 11:29:06.253949] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.177 [2024-10-07 11:29:06.254736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.177 [2024-10-07 11:29:06.254963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.177 [2024-10-07 11:29:06.255000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.177 [2024-10-07 11:29:06.255020] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.177 [2024-10-07 11:29:06.255097] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.177 [2024-10-07 11:29:06.255128] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.177 [2024-10-07 11:29:06.255234] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.177 [2024-10-07 11:29:06.255266] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.177 [2024-10-07 11:29:06.255283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.177 [2024-10-07 11:29:06.255345] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.177 [2024-10-07 11:29:06.255378] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.177 [2024-10-07 11:29:06.255395] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.177 [2024-10-07 11:29:06.255428] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.177 [2024-10-07 11:29:06.255461] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.177 [2024-10-07 11:29:06.263696] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.177 [2024-10-07 11:29:06.263911] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.177 [2024-10-07 11:29:06.263948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.177 [2024-10-07 11:29:06.263968] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.177 [2024-10-07 11:29:06.264018] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.177 [2024-10-07 11:29:06.264221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.177 [2024-10-07 11:29:06.264248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.177 [2024-10-07 11:29:06.264265] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.177 [2024-10-07 11:29:06.264430] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.177 [2024-10-07 11:29:06.266850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.177 [2024-10-07 11:29:06.266988] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.177 [2024-10-07 11:29:06.267021] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.177 [2024-10-07 11:29:06.267039] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.177 [2024-10-07 11:29:06.267072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.177 [2024-10-07 11:29:06.267301] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.177 [2024-10-07 11:29:06.267327] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.177 [2024-10-07 11:29:06.267343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.177 [2024-10-07 11:29:06.267471] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.177 [2024-10-07 11:29:06.275148] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.177 [2024-10-07 11:29:06.275344] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.177 [2024-10-07 11:29:06.275380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.177 [2024-10-07 11:29:06.275424] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.177 [2024-10-07 11:29:06.276671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.177 [2024-10-07 11:29:06.276938] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.177 [2024-10-07 11:29:06.276979] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.177 [2024-10-07 11:29:06.277031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.177 [2024-10-07 11:29:06.278435] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.177 [2024-10-07 11:29:06.279572] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.177 [2024-10-07 11:29:06.280122] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.177 [2024-10-07 11:29:06.280177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.177 [2024-10-07 11:29:06.280200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.177 [2024-10-07 11:29:06.280349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.177 [2024-10-07 11:29:06.280521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.177 [2024-10-07 11:29:06.280562] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.177 [2024-10-07 11:29:06.280583] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.177 [2024-10-07 11:29:06.281595] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.177 [2024-10-07 11:29:06.285297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.177 [2024-10-07 11:29:06.285497] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.177 [2024-10-07 11:29:06.285538] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.177 [2024-10-07 11:29:06.285558] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.177 [2024-10-07 11:29:06.285597] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.177 [2024-10-07 11:29:06.285630] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.177 [2024-10-07 11:29:06.285648] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.177 [2024-10-07 11:29:06.285663] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.177 [2024-10-07 11:29:06.285694] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.177 [2024-10-07 11:29:06.290340] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.177 [2024-10-07 11:29:06.290540] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.177 [2024-10-07 11:29:06.290576] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.177 [2024-10-07 11:29:06.290595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.177 [2024-10-07 11:29:06.290630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.177 [2024-10-07 11:29:06.290662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.177 [2024-10-07 11:29:06.290680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.177 [2024-10-07 11:29:06.290696] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.177 [2024-10-07 11:29:06.290727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.177 [2024-10-07 11:29:06.295458] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.177 [2024-10-07 11:29:06.296568] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.177 [2024-10-07 11:29:06.296645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.177 [2024-10-07 11:29:06.296669] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.177 [2024-10-07 11:29:06.297464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.177 [2024-10-07 11:29:06.297810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.177 [2024-10-07 11:29:06.297850] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.177 [2024-10-07 11:29:06.297870] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.177 [2024-10-07 11:29:06.297986] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.177 [2024-10-07 11:29:06.300492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.177 [2024-10-07 11:29:06.300643] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.177 [2024-10-07 11:29:06.300679] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.177 [2024-10-07 11:29:06.300697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.178 [2024-10-07 11:29:06.300731] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.178 [2024-10-07 11:29:06.300762] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.178 [2024-10-07 11:29:06.300780] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.178 [2024-10-07 11:29:06.300794] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.178 [2024-10-07 11:29:06.300824] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.178 [2024-10-07 11:29:06.306827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.178 [2024-10-07 11:29:06.308133] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.178 [2024-10-07 11:29:06.308184] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.178 [2024-10-07 11:29:06.308206] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.178 [2024-10-07 11:29:06.309072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.178 [2024-10-07 11:29:06.309378] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.178 [2024-10-07 11:29:06.309432] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.178 [2024-10-07 11:29:06.309451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.178 [2024-10-07 11:29:06.309598] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.178 [2024-10-07 11:29:06.311852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.178 [2024-10-07 11:29:06.311990] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.178 [2024-10-07 11:29:06.312024] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.178 [2024-10-07 11:29:06.312042] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.178 [2024-10-07 11:29:06.312075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.178 [2024-10-07 11:29:06.312335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.178 [2024-10-07 11:29:06.312373] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.178 [2024-10-07 11:29:06.312392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.178 [2024-10-07 11:29:06.312548] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.178 [2024-10-07 11:29:06.318290] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.178 [2024-10-07 11:29:06.318495] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.178 [2024-10-07 11:29:06.318533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.178 [2024-10-07 11:29:06.318558] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.178 [2024-10-07 11:29:06.319339] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.178 [2024-10-07 11:29:06.319583] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.178 [2024-10-07 11:29:06.319620] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.178 [2024-10-07 11:29:06.319639] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.178 [2024-10-07 11:29:06.319739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.178 [2024-10-07 11:29:06.323418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.178 [2024-10-07 11:29:06.323612] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.178 [2024-10-07 11:29:06.323649] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.178 [2024-10-07 11:29:06.323667] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.178 [2024-10-07 11:29:06.323703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.178 [2024-10-07 11:29:06.323736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.178 [2024-10-07 11:29:06.323753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.178 [2024-10-07 11:29:06.323769] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.178 [2024-10-07 11:29:06.323966] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.178 [2024-10-07 11:29:06.329192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.178 [2024-10-07 11:29:06.329447] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.178 [2024-10-07 11:29:06.329485] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.178 [2024-10-07 11:29:06.329505] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.178 [2024-10-07 11:29:06.329543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.178 [2024-10-07 11:29:06.329576] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.178 [2024-10-07 11:29:06.329593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.178 [2024-10-07 11:29:06.329610] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.178 [2024-10-07 11:29:06.329673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.178 [2024-10-07 11:29:06.334145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.178 [2024-10-07 11:29:06.334360] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.178 [2024-10-07 11:29:06.334416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.178 [2024-10-07 11:29:06.334440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.178 [2024-10-07 11:29:06.335645] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.178 [2024-10-07 11:29:06.335900] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.178 [2024-10-07 11:29:06.335938] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.178 [2024-10-07 11:29:06.335958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.178 [2024-10-07 11:29:06.337156] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.178 [2024-10-07 11:29:06.340867] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.178 [2024-10-07 11:29:06.341042] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.178 [2024-10-07 11:29:06.341106] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.178 [2024-10-07 11:29:06.341130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.178 [2024-10-07 11:29:06.341370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.178 [2024-10-07 11:29:06.341541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.178 [2024-10-07 11:29:06.341580] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.178 [2024-10-07 11:29:06.341600] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.178 [2024-10-07 11:29:06.341657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.178 [2024-10-07 11:29:06.344304] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.178 [2024-10-07 11:29:06.345445] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.178 [2024-10-07 11:29:06.345495] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.178 [2024-10-07 11:29:06.345523] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.178 [2024-10-07 11:29:06.345731] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.178 [2024-10-07 11:29:06.347081] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.178 [2024-10-07 11:29:06.347123] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.178 [2024-10-07 11:29:06.347144] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.178 [2024-10-07 11:29:06.347335] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.178 [2024-10-07 11:29:06.352564] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.178 [2024-10-07 11:29:06.352750] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.178 [2024-10-07 11:29:06.352786] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.178 [2024-10-07 11:29:06.352840] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.178 [2024-10-07 11:29:06.353048] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.178 [2024-10-07 11:29:06.353226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.178 [2024-10-07 11:29:06.353262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.178 [2024-10-07 11:29:06.353282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.178 [2024-10-07 11:29:06.353425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.178 [2024-10-07 11:29:06.355423] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.178 [2024-10-07 11:29:06.355554] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.178 [2024-10-07 11:29:06.355598] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.178 [2024-10-07 11:29:06.355619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.178 [2024-10-07 11:29:06.355853] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.178 [2024-10-07 11:29:06.355997] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.178 [2024-10-07 11:29:06.356035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.178 [2024-10-07 11:29:06.356054] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.178 [2024-10-07 11:29:06.356107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.178 [2024-10-07 11:29:06.363097] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.178 [2024-10-07 11:29:06.363287] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.179 [2024-10-07 11:29:06.363324] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.179 [2024-10-07 11:29:06.363343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.179 [2024-10-07 11:29:06.363379] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.179 [2024-10-07 11:29:06.363429] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.179 [2024-10-07 11:29:06.363450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.179 [2024-10-07 11:29:06.363465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.179 [2024-10-07 11:29:06.364675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.179 [2024-10-07 11:29:06.367019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.179 [2024-10-07 11:29:06.367169] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.179 [2024-10-07 11:29:06.367206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.179 [2024-10-07 11:29:06.367225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.179 [2024-10-07 11:29:06.367440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.179 [2024-10-07 11:29:06.367600] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.179 [2024-10-07 11:29:06.367661] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.179 [2024-10-07 11:29:06.367681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.179 [2024-10-07 11:29:06.367806] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.179 [2024-10-07 11:29:06.373246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.179 [2024-10-07 11:29:06.373444] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.179 [2024-10-07 11:29:06.373481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.179 [2024-10-07 11:29:06.373501] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.179 [2024-10-07 11:29:06.374454] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.179 [2024-10-07 11:29:06.374680] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.179 [2024-10-07 11:29:06.374716] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.179 [2024-10-07 11:29:06.374735] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.179 [2024-10-07 11:29:06.374816] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.179 [2024-10-07 11:29:06.377622] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.179 [2024-10-07 11:29:06.377751] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.179 [2024-10-07 11:29:06.377784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.179 [2024-10-07 11:29:06.377802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.179 [2024-10-07 11:29:06.377837] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.179 [2024-10-07 11:29:06.377867] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.179 [2024-10-07 11:29:06.377885] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.179 [2024-10-07 11:29:06.377900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.179 [2024-10-07 11:29:06.377930] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.179 [2024-10-07 11:29:06.384435] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.179 [2024-10-07 11:29:06.384623] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.179 [2024-10-07 11:29:06.384660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.179 [2024-10-07 11:29:06.384679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.179 [2024-10-07 11:29:06.384935] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.179 [2024-10-07 11:29:06.385087] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.179 [2024-10-07 11:29:06.385124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.179 [2024-10-07 11:29:06.385145] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.179 [2024-10-07 11:29:06.385200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.179 [2024-10-07 11:29:06.387722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.179 [2024-10-07 11:29:06.387846] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.179 [2024-10-07 11:29:06.387880] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.179 [2024-10-07 11:29:06.387898] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.179 [2024-10-07 11:29:06.387931] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.179 [2024-10-07 11:29:06.388888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.179 [2024-10-07 11:29:06.388932] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.179 [2024-10-07 11:29:06.388952] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.179 [2024-10-07 11:29:06.389197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.179 [2024-10-07 11:29:06.395942] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.179 [2024-10-07 11:29:06.396133] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.179 [2024-10-07 11:29:06.396170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.179 [2024-10-07 11:29:06.396190] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.179 [2024-10-07 11:29:06.396227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.179 [2024-10-07 11:29:06.396470] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.179 [2024-10-07 11:29:06.396511] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.179 [2024-10-07 11:29:06.396532] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.179 [2024-10-07 11:29:06.396678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.179 [2024-10-07 11:29:06.399002] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.179 [2024-10-07 11:29:06.399143] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.179 [2024-10-07 11:29:06.399176] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.179 [2024-10-07 11:29:06.399194] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.179 [2024-10-07 11:29:06.399228] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.179 [2024-10-07 11:29:06.399486] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.179 [2024-10-07 11:29:06.399526] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.179 [2024-10-07 11:29:06.399546] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.179 [2024-10-07 11:29:06.399665] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.179 [2024-10-07 11:29:06.406833] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.179 [2024-10-07 11:29:06.407022] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.179 [2024-10-07 11:29:06.407060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.179 [2024-10-07 11:29:06.407079] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.179 [2024-10-07 11:29:06.407143] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.179 [2024-10-07 11:29:06.408375] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.179 [2024-10-07 11:29:06.408436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.179 [2024-10-07 11:29:06.408458] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.179 [2024-10-07 11:29:06.408675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.179 [2024-10-07 11:29:06.410782] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.179 [2024-10-07 11:29:06.410914] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.179 [2024-10-07 11:29:06.410957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.179 [2024-10-07 11:29:06.410978] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.179 [2024-10-07 11:29:06.411176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.180 [2024-10-07 11:29:06.411332] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.180 [2024-10-07 11:29:06.411366] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.180 [2024-10-07 11:29:06.411384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.180 [2024-10-07 11:29:06.411539] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.180 [2024-10-07 11:29:06.416979] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.180 [2024-10-07 11:29:06.417142] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.180 [2024-10-07 11:29:06.417177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.180 [2024-10-07 11:29:06.417196] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.180 [2024-10-07 11:29:06.418147] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.180 [2024-10-07 11:29:06.418372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.180 [2024-10-07 11:29:06.418419] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.180 [2024-10-07 11:29:06.418440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.180 [2024-10-07 11:29:06.418522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.180 [2024-10-07 11:29:06.421388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.180 [2024-10-07 11:29:06.421536] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.180 [2024-10-07 11:29:06.421582] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.180 [2024-10-07 11:29:06.421604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.180 [2024-10-07 11:29:06.421638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.180 [2024-10-07 11:29:06.421669] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.180 [2024-10-07 11:29:06.421686] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.180 [2024-10-07 11:29:06.421726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.180 [2024-10-07 11:29:06.421759] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.180 [2024-10-07 11:29:06.428237] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.180 [2024-10-07 11:29:06.428429] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.180 [2024-10-07 11:29:06.428466] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.180 [2024-10-07 11:29:06.428486] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.180 [2024-10-07 11:29:06.428740] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.180 [2024-10-07 11:29:06.428875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.180 [2024-10-07 11:29:06.428912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.180 [2024-10-07 11:29:06.428940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.180 [2024-10-07 11:29:06.429017] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.180 [2024-10-07 11:29:06.431506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.180 [2024-10-07 11:29:06.431635] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.180 [2024-10-07 11:29:06.431679] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.180 [2024-10-07 11:29:06.431700] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.180 [2024-10-07 11:29:06.431733] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.180 [2024-10-07 11:29:06.432697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.180 [2024-10-07 11:29:06.432738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.180 [2024-10-07 11:29:06.432757] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.180 [2024-10-07 11:29:06.432981] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.180 [2024-10-07 11:29:06.439663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.180 [2024-10-07 11:29:06.439815] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.180 [2024-10-07 11:29:06.439851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.180 [2024-10-07 11:29:06.439869] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.180 [2024-10-07 11:29:06.439904] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.180 [2024-10-07 11:29:06.439943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.180 [2024-10-07 11:29:06.439960] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.180 [2024-10-07 11:29:06.439975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.180 [2024-10-07 11:29:06.440006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.180 [2024-10-07 11:29:06.442749] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.180 [2024-10-07 11:29:06.442899] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.180 [2024-10-07 11:29:06.442946] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.180 [2024-10-07 11:29:06.442967] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.180 [2024-10-07 11:29:06.443197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.180 [2024-10-07 11:29:06.443326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.180 [2024-10-07 11:29:06.443367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.180 [2024-10-07 11:29:06.443385] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.180 [2024-10-07 11:29:06.443454] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.180 [2024-10-07 11:29:06.450489] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.180 [2024-10-07 11:29:06.450633] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.180 [2024-10-07 11:29:06.450668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.180 [2024-10-07 11:29:06.450686] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.180 [2024-10-07 11:29:06.450720] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.180 [2024-10-07 11:29:06.450753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.180 [2024-10-07 11:29:06.450770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.180 [2024-10-07 11:29:06.450784] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.180 [2024-10-07 11:29:06.450815] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.180 [2024-10-07 11:29:06.454283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.180 [2024-10-07 11:29:06.454448] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.180 [2024-10-07 11:29:06.454493] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.180 [2024-10-07 11:29:06.454514] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.180 [2024-10-07 11:29:06.454549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.180 [2024-10-07 11:29:06.454582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.180 [2024-10-07 11:29:06.454600] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.180 [2024-10-07 11:29:06.454614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.180 [2024-10-07 11:29:06.454809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.180 [2024-10-07 11:29:06.460598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.180 [2024-10-07 11:29:06.460730] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.180 [2024-10-07 11:29:06.460762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.180 [2024-10-07 11:29:06.460780] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.180 [2024-10-07 11:29:06.460837] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.180 [2024-10-07 11:29:06.461796] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.180 [2024-10-07 11:29:06.461836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.180 [2024-10-07 11:29:06.461855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.180 [2024-10-07 11:29:06.462061] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.180 [2024-10-07 11:29:06.464962] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.180 [2024-10-07 11:29:06.465091] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.180 [2024-10-07 11:29:06.465126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.180 [2024-10-07 11:29:06.465145] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.180 [2024-10-07 11:29:06.465178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.180 [2024-10-07 11:29:06.465210] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.180 [2024-10-07 11:29:06.465228] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.180 [2024-10-07 11:29:06.465242] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.180 [2024-10-07 11:29:06.465272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.180 [2024-10-07 11:29:06.471758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.180 [2024-10-07 11:29:06.471893] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.180 [2024-10-07 11:29:06.471926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.181 [2024-10-07 11:29:06.471945] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.181 [2024-10-07 11:29:06.472173] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.181 [2024-10-07 11:29:06.472325] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.181 [2024-10-07 11:29:06.472362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.181 [2024-10-07 11:29:06.472381] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.181 [2024-10-07 11:29:06.472449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.181 [2024-10-07 11:29:06.475055] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.181 [2024-10-07 11:29:06.475172] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.181 [2024-10-07 11:29:06.475208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.181 [2024-10-07 11:29:06.475225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.181 [2024-10-07 11:29:06.475257] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.181 [2024-10-07 11:29:06.475289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.181 [2024-10-07 11:29:06.475306] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.181 [2024-10-07 11:29:06.475343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.181 [2024-10-07 11:29:06.475376] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.181 [2024-10-07 11:29:06.481889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.181 [2024-10-07 11:29:06.483134] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.181 [2024-10-07 11:29:06.483183] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.181 [2024-10-07 11:29:06.483205] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.181 [2024-10-07 11:29:06.484042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.181 [2024-10-07 11:29:06.484170] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.181 [2024-10-07 11:29:06.484196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.181 [2024-10-07 11:29:06.484212] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.181 [2024-10-07 11:29:06.484246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.181 [2024-10-07 11:29:06.485148] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.181 [2024-10-07 11:29:06.485258] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.181 [2024-10-07 11:29:06.485295] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.181 [2024-10-07 11:29:06.485315] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.181 [2024-10-07 11:29:06.486254] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.181 [2024-10-07 11:29:06.487046] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.181 [2024-10-07 11:29:06.487085] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.181 [2024-10-07 11:29:06.487105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.181 [2024-10-07 11:29:06.487208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.181 [2024-10-07 11:29:06.493230] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.181 [2024-10-07 11:29:06.493562] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.181 [2024-10-07 11:29:06.493610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.181 [2024-10-07 11:29:06.493633] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.181 [2024-10-07 11:29:06.493670] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.181 [2024-10-07 11:29:06.493703] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.181 [2024-10-07 11:29:06.493720] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.181 [2024-10-07 11:29:06.493735] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.181 [2024-10-07 11:29:06.494508] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.181 [2024-10-07 11:29:06.496531] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.181 [2024-10-07 11:29:06.497768] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.181 [2024-10-07 11:29:06.497840] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.181 [2024-10-07 11:29:06.497863] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.181 [2024-10-07 11:29:06.498696] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.181 [2024-10-07 11:29:06.498857] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.181 [2024-10-07 11:29:06.498893] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.181 [2024-10-07 11:29:06.498912] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.181 [2024-10-07 11:29:06.499107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.181 [2024-10-07 11:29:06.503357] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.181 [2024-10-07 11:29:06.504234] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.181 [2024-10-07 11:29:06.504285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.181 [2024-10-07 11:29:06.504308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.181 [2024-10-07 11:29:06.504511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.181 [2024-10-07 11:29:06.504603] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.181 [2024-10-07 11:29:06.504630] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.181 [2024-10-07 11:29:06.504646] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.181 [2024-10-07 11:29:06.504699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.181 [2024-10-07 11:29:06.507829] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.181 [2024-10-07 11:29:06.508145] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.181 [2024-10-07 11:29:06.508190] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.181 [2024-10-07 11:29:06.508212] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.181 [2024-10-07 11:29:06.508248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.181 [2024-10-07 11:29:06.508280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.181 [2024-10-07 11:29:06.508297] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.181 [2024-10-07 11:29:06.508311] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.181 [2024-10-07 11:29:06.509105] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.181 [2024-10-07 11:29:06.513485] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.181 [2024-10-07 11:29:06.513641] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.181 [2024-10-07 11:29:06.513675] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.181 [2024-10-07 11:29:06.513694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.181 [2024-10-07 11:29:06.513893] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.181 [2024-10-07 11:29:06.514076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.181 [2024-10-07 11:29:06.514111] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.181 [2024-10-07 11:29:06.514130] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.181 [2024-10-07 11:29:06.514254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.181 [2024-10-07 11:29:06.517934] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.181 [2024-10-07 11:29:06.518065] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.181 [2024-10-07 11:29:06.518098] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.181 [2024-10-07 11:29:06.518116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.181 [2024-10-07 11:29:06.518149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.181 [2024-10-07 11:29:06.518181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.181 [2024-10-07 11:29:06.518198] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.181 [2024-10-07 11:29:06.518213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.181 [2024-10-07 11:29:06.518243] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.181 [2024-10-07 11:29:06.523607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.181 [2024-10-07 11:29:06.523749] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.181 [2024-10-07 11:29:06.523782] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.181 [2024-10-07 11:29:06.523800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.181 [2024-10-07 11:29:06.523833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.181 [2024-10-07 11:29:06.523864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.181 [2024-10-07 11:29:06.523881] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.181 [2024-10-07 11:29:06.523895] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.181 [2024-10-07 11:29:06.523926] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.181 [2024-10-07 11:29:06.530035] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.182 [2024-10-07 11:29:06.530222] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.182 [2024-10-07 11:29:06.530259] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.182 [2024-10-07 11:29:06.530279] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.182 [2024-10-07 11:29:06.530315] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.182 [2024-10-07 11:29:06.530349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.182 [2024-10-07 11:29:06.530367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.182 [2024-10-07 11:29:06.530384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.182 [2024-10-07 11:29:06.530468] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.182 [2024-10-07 11:29:06.533775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.182 [2024-10-07 11:29:06.533913] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.182 [2024-10-07 11:29:06.533948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.182 [2024-10-07 11:29:06.533966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.182 [2024-10-07 11:29:06.534008] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.182 [2024-10-07 11:29:06.534060] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.182 [2024-10-07 11:29:06.534080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.182 [2024-10-07 11:29:06.534095] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.182 [2024-10-07 11:29:06.534126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.182 [2024-10-07 11:29:06.541089] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.182 [2024-10-07 11:29:06.541291] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.182 [2024-10-07 11:29:06.541343] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.182 [2024-10-07 11:29:06.541367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.182 [2024-10-07 11:29:06.541421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.182 [2024-10-07 11:29:06.541458] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.182 [2024-10-07 11:29:06.541477] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.182 [2024-10-07 11:29:06.541492] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.182 [2024-10-07 11:29:06.542692] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.182 [2024-10-07 11:29:06.545001] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.182 [2024-10-07 11:29:06.545144] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.182 [2024-10-07 11:29:06.545178] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.182 [2024-10-07 11:29:06.545196] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.182 [2024-10-07 11:29:06.545229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.182 [2024-10-07 11:29:06.545260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.182 [2024-10-07 11:29:06.545279] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.182 [2024-10-07 11:29:06.545294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.182 [2024-10-07 11:29:06.545514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.182 [2024-10-07 11:29:06.551237] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.182 [2024-10-07 11:29:06.551377] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.182 [2024-10-07 11:29:06.551427] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.182 [2024-10-07 11:29:06.551476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.182 [2024-10-07 11:29:06.551512] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.182 [2024-10-07 11:29:06.551544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.182 [2024-10-07 11:29:06.551561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.182 [2024-10-07 11:29:06.551576] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.182 [2024-10-07 11:29:06.551607] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.182 [2024-10-07 11:29:06.555850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.182 [2024-10-07 11:29:06.555992] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.182 [2024-10-07 11:29:06.556026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.182 [2024-10-07 11:29:06.556044] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.182 [2024-10-07 11:29:06.556078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.182 [2024-10-07 11:29:06.556111] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.182 [2024-10-07 11:29:06.556128] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.182 [2024-10-07 11:29:06.556142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.182 [2024-10-07 11:29:06.556173] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.182 [2024-10-07 11:29:06.562720] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.182 [2024-10-07 11:29:06.562873] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.182 [2024-10-07 11:29:06.562908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.182 [2024-10-07 11:29:06.562926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.182 [2024-10-07 11:29:06.563165] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.182 [2024-10-07 11:29:06.563286] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.182 [2024-10-07 11:29:06.563313] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.182 [2024-10-07 11:29:06.563329] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.182 [2024-10-07 11:29:06.563381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.182 [2024-10-07 11:29:06.565960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.182 [2024-10-07 11:29:06.566080] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.182 [2024-10-07 11:29:06.566112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.182 [2024-10-07 11:29:06.566130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.182 [2024-10-07 11:29:06.566162] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.182 [2024-10-07 11:29:06.566193] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.182 [2024-10-07 11:29:06.566235] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.182 [2024-10-07 11:29:06.566250] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.182 [2024-10-07 11:29:06.566282] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.182 [2024-10-07 11:29:06.574349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.182 [2024-10-07 11:29:06.574565] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.182 [2024-10-07 11:29:06.574602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.182 [2024-10-07 11:29:06.574621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.182 [2024-10-07 11:29:06.574656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.182 [2024-10-07 11:29:06.574854] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.182 [2024-10-07 11:29:06.574881] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.182 [2024-10-07 11:29:06.574897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.182 [2024-10-07 11:29:06.575036] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.182 [2024-10-07 11:29:06.577395] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.182 [2024-10-07 11:29:06.577536] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.182 [2024-10-07 11:29:06.577570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.182 [2024-10-07 11:29:06.577588] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.182 [2024-10-07 11:29:06.577817] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.182 [2024-10-07 11:29:06.577949] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.182 [2024-10-07 11:29:06.577997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.182 [2024-10-07 11:29:06.578016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.182 [2024-10-07 11:29:06.578069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.182 [2024-10-07 11:29:06.585177] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.182 [2024-10-07 11:29:06.585358] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.182 [2024-10-07 11:29:06.585393] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.182 [2024-10-07 11:29:06.585434] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.182 [2024-10-07 11:29:06.585471] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.182 [2024-10-07 11:29:06.585504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.182 [2024-10-07 11:29:06.585522] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.183 [2024-10-07 11:29:06.585538] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.183 [2024-10-07 11:29:06.586723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.183 [2024-10-07 11:29:06.589090] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.183 [2024-10-07 11:29:06.589229] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.183 [2024-10-07 11:29:06.589264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.183 [2024-10-07 11:29:06.589282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.183 [2024-10-07 11:29:06.589316] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.183 [2024-10-07 11:29:06.589532] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.183 [2024-10-07 11:29:06.589570] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.183 [2024-10-07 11:29:06.589590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.183 [2024-10-07 11:29:06.589733] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.183 [2024-10-07 11:29:06.595310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.183 [2024-10-07 11:29:06.595472] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.183 [2024-10-07 11:29:06.595508] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.183 [2024-10-07 11:29:06.595526] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.183 [2024-10-07 11:29:06.595560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.183 [2024-10-07 11:29:06.595593] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.183 [2024-10-07 11:29:06.595611] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.183 [2024-10-07 11:29:06.595626] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.183 [2024-10-07 11:29:06.595656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.183 [2024-10-07 11:29:06.599899] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.183 [2024-10-07 11:29:06.600050] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.183 [2024-10-07 11:29:06.600084] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.183 [2024-10-07 11:29:06.600107] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.183 [2024-10-07 11:29:06.600140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.183 [2024-10-07 11:29:06.600171] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.183 [2024-10-07 11:29:06.600188] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.183 [2024-10-07 11:29:06.600202] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.183 [2024-10-07 11:29:06.600233] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.183 [2024-10-07 11:29:06.606792] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.183 [2024-10-07 11:29:06.606934] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.183 [2024-10-07 11:29:06.606968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.183 [2024-10-07 11:29:06.606986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.183 [2024-10-07 11:29:06.607258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.183 [2024-10-07 11:29:06.607392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.183 [2024-10-07 11:29:06.607439] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.183 [2024-10-07 11:29:06.607456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.183 [2024-10-07 11:29:06.607511] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.183 [2024-10-07 11:29:06.610011] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.183 [2024-10-07 11:29:06.610127] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.183 [2024-10-07 11:29:06.610159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.183 [2024-10-07 11:29:06.610177] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.183 [2024-10-07 11:29:06.610209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.183 [2024-10-07 11:29:06.610240] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.183 [2024-10-07 11:29:06.610257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.183 [2024-10-07 11:29:06.610271] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.183 [2024-10-07 11:29:06.611212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.183 [2024-10-07 11:29:06.618277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.183 [2024-10-07 11:29:06.618455] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.183 [2024-10-07 11:29:06.618490] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.183 [2024-10-07 11:29:06.618509] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.183 [2024-10-07 11:29:06.618543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.183 [2024-10-07 11:29:06.618575] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.183 [2024-10-07 11:29:06.618593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.183 [2024-10-07 11:29:06.618608] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.183 [2024-10-07 11:29:06.618799] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.183 [2024-10-07 11:29:06.621292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.183 [2024-10-07 11:29:06.621425] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.183 [2024-10-07 11:29:06.621464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.183 [2024-10-07 11:29:06.621484] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.183 [2024-10-07 11:29:06.621710] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.183 [2024-10-07 11:29:06.621855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.183 [2024-10-07 11:29:06.621892] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.183 [2024-10-07 11:29:06.621946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.183 [2024-10-07 11:29:06.622003] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.183 [2024-10-07 11:29:06.629006] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.183 [2024-10-07 11:29:06.629232] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.183 [2024-10-07 11:29:06.629268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.183 [2024-10-07 11:29:06.629287] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.183 [2024-10-07 11:29:06.629323] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.183 [2024-10-07 11:29:06.629355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.183 [2024-10-07 11:29:06.629373] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.183 [2024-10-07 11:29:06.629388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.183 [2024-10-07 11:29:06.630600] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.183 [2024-10-07 11:29:06.632926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.183 [2024-10-07 11:29:06.633098] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.183 [2024-10-07 11:29:06.633142] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.183 [2024-10-07 11:29:06.633161] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.183 [2024-10-07 11:29:06.633363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.183 [2024-10-07 11:29:06.633531] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.183 [2024-10-07 11:29:06.633577] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.183 [2024-10-07 11:29:06.633597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.183 [2024-10-07 11:29:06.633722] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.183 [2024-10-07 11:29:06.639185] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.183 [2024-10-07 11:29:06.639382] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.183 [2024-10-07 11:29:06.639435] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.183 [2024-10-07 11:29:06.639456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.183 [2024-10-07 11:29:06.639492] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.183 [2024-10-07 11:29:06.640451] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.183 [2024-10-07 11:29:06.640499] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.183 [2024-10-07 11:29:06.640521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.183 [2024-10-07 11:29:06.640757] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.183 [2024-10-07 11:29:06.643726] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.183 [2024-10-07 11:29:06.643915] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.183 [2024-10-07 11:29:06.643952] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.183 [2024-10-07 11:29:06.643970] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.183 [2024-10-07 11:29:06.644005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.184 [2024-10-07 11:29:06.644037] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.184 [2024-10-07 11:29:06.644054] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.184 [2024-10-07 11:29:06.644069] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.184 [2024-10-07 11:29:06.644099] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.184 [2024-10-07 11:29:06.650760] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.184 [2024-10-07 11:29:06.650963] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.184 [2024-10-07 11:29:06.651001] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.184 [2024-10-07 11:29:06.651019] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.184 [2024-10-07 11:29:06.651255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.184 [2024-10-07 11:29:06.651375] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.184 [2024-10-07 11:29:06.651426] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.184 [2024-10-07 11:29:06.651447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.184 [2024-10-07 11:29:06.651503] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.184 [2024-10-07 11:29:06.653869] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.184 [2024-10-07 11:29:06.654007] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.184 [2024-10-07 11:29:06.654041] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.184 [2024-10-07 11:29:06.654059] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.184 [2024-10-07 11:29:06.654112] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.184 [2024-10-07 11:29:06.654147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.184 [2024-10-07 11:29:06.654165] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.184 [2024-10-07 11:29:06.654179] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.184 [2024-10-07 11:29:06.654210] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.184 [2024-10-07 11:29:06.662626] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.184 [2024-10-07 11:29:06.662868] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.184 [2024-10-07 11:29:06.662908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.184 [2024-10-07 11:29:06.662927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.184 [2024-10-07 11:29:06.663141] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.184 [2024-10-07 11:29:06.663346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.184 [2024-10-07 11:29:06.663384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.184 [2024-10-07 11:29:06.663420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.184 [2024-10-07 11:29:06.663552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.184 [2024-10-07 11:29:06.665645] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.184 [2024-10-07 11:29:06.665807] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.184 [2024-10-07 11:29:06.665842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.184 [2024-10-07 11:29:06.665860] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.184 [2024-10-07 11:29:06.666098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.184 [2024-10-07 11:29:06.666218] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.184 [2024-10-07 11:29:06.666263] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.184 [2024-10-07 11:29:06.666282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.184 [2024-10-07 11:29:06.666338] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.184 [2024-10-07 11:29:06.673713] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.184 [2024-10-07 11:29:06.673925] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.184 [2024-10-07 11:29:06.673965] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.184 [2024-10-07 11:29:06.673984] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.184 [2024-10-07 11:29:06.674021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.184 [2024-10-07 11:29:06.674053] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.184 [2024-10-07 11:29:06.674072] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.184 [2024-10-07 11:29:06.674087] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.184 [2024-10-07 11:29:06.674118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.184 [2024-10-07 11:29:06.677658] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.184 [2024-10-07 11:29:06.677846] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.184 [2024-10-07 11:29:06.677883] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.184 [2024-10-07 11:29:06.677901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.184 [2024-10-07 11:29:06.677938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.184 [2024-10-07 11:29:06.677972] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.184 [2024-10-07 11:29:06.677989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.184 [2024-10-07 11:29:06.678005] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.184 [2024-10-07 11:29:06.678238] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.184 [2024-10-07 11:29:06.683884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.184 [2024-10-07 11:29:06.684089] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.184 [2024-10-07 11:29:06.684127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.184 [2024-10-07 11:29:06.684146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.184 [2024-10-07 11:29:06.684204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.184 [2024-10-07 11:29:06.684239] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.184 [2024-10-07 11:29:06.684258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.184 [2024-10-07 11:29:06.684274] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.184 [2024-10-07 11:29:06.684306] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.184 [2024-10-07 11:29:06.687807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.184 [2024-10-07 11:29:06.688773] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.184 [2024-10-07 11:29:06.688826] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.184 [2024-10-07 11:29:06.688849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.184 [2024-10-07 11:29:06.689081] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.184 [2024-10-07 11:29:06.689198] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.184 [2024-10-07 11:29:06.689229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.184 [2024-10-07 11:29:06.689248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.184 [2024-10-07 11:29:06.689284] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.184 [2024-10-07 11:29:06.694116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.184 [2024-10-07 11:29:06.694297] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.184 [2024-10-07 11:29:06.694333] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.184 [2024-10-07 11:29:06.694351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.184 [2024-10-07 11:29:06.694387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.184 [2024-10-07 11:29:06.694468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.184 [2024-10-07 11:29:06.694492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.184 [2024-10-07 11:29:06.694508] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.184 [2024-10-07 11:29:06.694541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.184 [2024-10-07 11:29:06.697948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.185 [2024-10-07 11:29:06.698095] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.185 [2024-10-07 11:29:06.698128] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.185 [2024-10-07 11:29:06.698178] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.185 [2024-10-07 11:29:06.698215] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.185 [2024-10-07 11:29:06.698247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.185 [2024-10-07 11:29:06.698264] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.185 [2024-10-07 11:29:06.698279] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.185 [2024-10-07 11:29:06.698310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.185 [2024-10-07 11:29:06.704737] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.185 [2024-10-07 11:29:06.704920] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.185 [2024-10-07 11:29:06.704958] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.185 [2024-10-07 11:29:06.704977] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.185 [2024-10-07 11:29:06.705015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.185 [2024-10-07 11:29:06.705047] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.185 [2024-10-07 11:29:06.705085] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.185 [2024-10-07 11:29:06.705102] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.185 [2024-10-07 11:29:06.705136] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.185 [2024-10-07 11:29:06.709687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.185 [2024-10-07 11:29:06.709952] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.185 [2024-10-07 11:29:06.710001] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.185 [2024-10-07 11:29:06.710023] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.185 [2024-10-07 11:29:06.710084] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.185 [2024-10-07 11:29:06.710123] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.185 [2024-10-07 11:29:06.710140] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.185 [2024-10-07 11:29:06.710156] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.185 [2024-10-07 11:29:06.711116] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.185 [2024-10-07 11:29:06.714951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.185 [2024-10-07 11:29:06.715129] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.185 [2024-10-07 11:29:06.715169] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.185 [2024-10-07 11:29:06.715188] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.185 [2024-10-07 11:29:06.715223] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.185 [2024-10-07 11:29:06.715313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.185 [2024-10-07 11:29:06.715337] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.185 [2024-10-07 11:29:06.715353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.185 [2024-10-07 11:29:06.715385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.185 [2024-10-07 11:29:06.720282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.185 [2024-10-07 11:29:06.720543] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.185 [2024-10-07 11:29:06.720595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.185 [2024-10-07 11:29:06.720625] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.185 [2024-10-07 11:29:06.720677] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.185 [2024-10-07 11:29:06.721976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.185 [2024-10-07 11:29:06.722025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.185 [2024-10-07 11:29:06.722047] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.185 [2024-10-07 11:29:06.722276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.185 [2024-10-07 11:29:06.725439] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.185 [2024-10-07 11:29:06.725757] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.185 [2024-10-07 11:29:06.725832] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.185 [2024-10-07 11:29:06.725873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.185 [2024-10-07 11:29:06.727142] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.185 [2024-10-07 11:29:06.728272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.185 [2024-10-07 11:29:06.728323] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.185 [2024-10-07 11:29:06.728345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.185 [2024-10-07 11:29:06.728552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.185 [2024-10-07 11:29:06.730711] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.185 [2024-10-07 11:29:06.730889] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.185 [2024-10-07 11:29:06.730937] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.185 [2024-10-07 11:29:06.730959] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.185 [2024-10-07 11:29:06.730995] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.185 [2024-10-07 11:29:06.731027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.185 [2024-10-07 11:29:06.731044] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.185 [2024-10-07 11:29:06.731058] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.185 [2024-10-07 11:29:06.731090] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.185 [2024-10-07 11:29:06.735917] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.185 [2024-10-07 11:29:06.736114] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.185 [2024-10-07 11:29:06.736151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.185 [2024-10-07 11:29:06.736182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.185 [2024-10-07 11:29:06.736236] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.185 [2024-10-07 11:29:06.736289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.185 [2024-10-07 11:29:06.736320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.185 [2024-10-07 11:29:06.736346] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.185 [2024-10-07 11:29:06.737710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.185 [2024-10-07 11:29:06.740827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.185 [2024-10-07 11:29:06.741005] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.185 [2024-10-07 11:29:06.741042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.185 [2024-10-07 11:29:06.741082] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.185 [2024-10-07 11:29:06.741122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.185 [2024-10-07 11:29:06.742076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.185 [2024-10-07 11:29:06.742135] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.185 [2024-10-07 11:29:06.742172] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.185 [2024-10-07 11:29:06.743250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.185 [2024-10-07 11:29:06.746077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.185 [2024-10-07 11:29:06.746284] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.185 [2024-10-07 11:29:06.746332] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.185 [2024-10-07 11:29:06.746354] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.185 [2024-10-07 11:29:06.746391] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.185 [2024-10-07 11:29:06.746446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.185 [2024-10-07 11:29:06.746466] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.185 [2024-10-07 11:29:06.746482] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.185 [2024-10-07 11:29:06.746513] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.185 [2024-10-07 11:29:06.750973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.185 [2024-10-07 11:29:06.751192] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.185 [2024-10-07 11:29:06.751229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.185 [2024-10-07 11:29:06.751280] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.185 [2024-10-07 11:29:06.752525] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.185 [2024-10-07 11:29:06.752790] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.185 [2024-10-07 11:29:06.752826] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.185 [2024-10-07 11:29:06.752847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.186 [2024-10-07 11:29:06.754143] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.186 [2024-10-07 11:29:06.758020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.186 [2024-10-07 11:29:06.758247] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.186 [2024-10-07 11:29:06.758286] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.186 [2024-10-07 11:29:06.758307] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.186 [2024-10-07 11:29:06.758344] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.186 [2024-10-07 11:29:06.758387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.186 [2024-10-07 11:29:06.758424] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.186 [2024-10-07 11:29:06.758442] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.186 [2024-10-07 11:29:06.758680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.186 [2024-10-07 11:29:06.761472] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.186 [2024-10-07 11:29:06.761659] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.186 [2024-10-07 11:29:06.761726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.186 [2024-10-07 11:29:06.761765] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.186 [2024-10-07 11:29:06.761823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.186 [2024-10-07 11:29:06.762976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.186 [2024-10-07 11:29:06.763039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.186 [2024-10-07 11:29:06.763074] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.186 [2024-10-07 11:29:06.763315] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.186 [2024-10-07 11:29:06.770763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.186 [2024-10-07 11:29:06.771225] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.186 [2024-10-07 11:29:06.771294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.186 [2024-10-07 11:29:06.771329] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.186 [2024-10-07 11:29:06.772590] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.186 [2024-10-07 11:29:06.773895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.186 [2024-10-07 11:29:06.773992] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.186 [2024-10-07 11:29:06.774026] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.186 [2024-10-07 11:29:06.774259] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.186 [2024-10-07 11:29:06.774321] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.186 [2024-10-07 11:29:06.774513] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.186 [2024-10-07 11:29:06.774572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.186 [2024-10-07 11:29:06.774606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.186 [2024-10-07 11:29:06.774656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.186 [2024-10-07 11:29:06.774703] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.186 [2024-10-07 11:29:06.774731] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.186 [2024-10-07 11:29:06.774754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.186 [2024-10-07 11:29:06.774800] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.186 [2024-10-07 11:29:06.781257] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.186 [2024-10-07 11:29:06.782791] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.186 [2024-10-07 11:29:06.782850] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.186 [2024-10-07 11:29:06.782874] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.186 [2024-10-07 11:29:06.783100] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.186 [2024-10-07 11:29:06.784254] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.186 [2024-10-07 11:29:06.784294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.186 [2024-10-07 11:29:06.784315] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.186 [2024-10-07 11:29:06.785195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.186 [2024-10-07 11:29:06.785677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.186 [2024-10-07 11:29:06.785891] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.186 [2024-10-07 11:29:06.785935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.186 [2024-10-07 11:29:06.785956] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.186 [2024-10-07 11:29:06.786013] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.186 [2024-10-07 11:29:06.786051] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.186 [2024-10-07 11:29:06.786069] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.186 [2024-10-07 11:29:06.786083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.186 [2024-10-07 11:29:06.787038] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.186 [2024-10-07 11:29:06.792597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.186 [2024-10-07 11:29:06.792831] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.186 [2024-10-07 11:29:06.792868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.186 [2024-10-07 11:29:06.792887] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.186 [2024-10-07 11:29:06.794166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.186 [2024-10-07 11:29:06.794421] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.186 [2024-10-07 11:29:06.794460] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.186 [2024-10-07 11:29:06.794480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.186 [2024-10-07 11:29:06.794517] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.186 [2024-10-07 11:29:06.795775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.186 [2024-10-07 11:29:06.795900] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.186 [2024-10-07 11:29:06.795942] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.186 [2024-10-07 11:29:06.795964] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.186 [2024-10-07 11:29:06.795997] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.186 [2024-10-07 11:29:06.796028] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.186 [2024-10-07 11:29:06.796045] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.186 [2024-10-07 11:29:06.796060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.186 [2024-10-07 11:29:06.797275] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.186 [2024-10-07 11:29:06.803062] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.186 [2024-10-07 11:29:06.803266] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.186 [2024-10-07 11:29:06.803304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.186 [2024-10-07 11:29:06.803323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.186 [2024-10-07 11:29:06.803360] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.186 [2024-10-07 11:29:06.803392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.186 [2024-10-07 11:29:06.803429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.186 [2024-10-07 11:29:06.803447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.186 [2024-10-07 11:29:06.803479] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.186 [2024-10-07 11:29:06.805874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.186 [2024-10-07 11:29:06.805999] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.186 [2024-10-07 11:29:06.806032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.186 [2024-10-07 11:29:06.806050] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.186 [2024-10-07 11:29:06.806110] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.186 [2024-10-07 11:29:06.806143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.186 [2024-10-07 11:29:06.806160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.186 [2024-10-07 11:29:06.806174] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.186 [2024-10-07 11:29:06.807120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.186 [2024-10-07 11:29:06.815320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.186 [2024-10-07 11:29:06.815729] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.186 [2024-10-07 11:29:06.815799] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.186 [2024-10-07 11:29:06.815836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.186 [2024-10-07 11:29:06.817014] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.186 [2024-10-07 11:29:06.818304] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.187 [2024-10-07 11:29:06.818367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.187 [2024-10-07 11:29:06.818417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.187 [2024-10-07 11:29:06.818669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.187 [2024-10-07 11:29:06.818736] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.187 [2024-10-07 11:29:06.818903] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.187 [2024-10-07 11:29:06.818963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.187 [2024-10-07 11:29:06.818999] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.187 [2024-10-07 11:29:06.819054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.187 [2024-10-07 11:29:06.819106] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.187 [2024-10-07 11:29:06.819137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.187 [2024-10-07 11:29:06.819164] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.187 [2024-10-07 11:29:06.819214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.187 [2024-10-07 11:29:06.826433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.187 [2024-10-07 11:29:06.826695] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.187 [2024-10-07 11:29:06.826747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.187 [2024-10-07 11:29:06.826778] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.187 [2024-10-07 11:29:06.826831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.187 [2024-10-07 11:29:06.826881] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.187 [2024-10-07 11:29:06.826910] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.187 [2024-10-07 11:29:06.826974] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.187 [2024-10-07 11:29:06.828449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.187 [2024-10-07 11:29:06.831467] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.187 [2024-10-07 11:29:06.831892] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.187 [2024-10-07 11:29:06.831967] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.187 [2024-10-07 11:29:06.832005] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.187 [2024-10-07 11:29:06.832190] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.187 [2024-10-07 11:29:06.833433] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.187 [2024-10-07 11:29:06.833494] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.187 [2024-10-07 11:29:06.833529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.187 [2024-10-07 11:29:06.834714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.187 [2024-10-07 11:29:06.837009] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.187 [2024-10-07 11:29:06.837254] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.187 [2024-10-07 11:29:06.837318] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.187 [2024-10-07 11:29:06.837352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.187 [2024-10-07 11:29:06.837423] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.187 [2024-10-07 11:29:06.837476] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.187 [2024-10-07 11:29:06.837506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.187 [2024-10-07 11:29:06.837531] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.187 [2024-10-07 11:29:06.837583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.187 [2024-10-07 11:29:06.842090] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.187 [2024-10-07 11:29:06.842296] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.187 [2024-10-07 11:29:06.842344] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.187 [2024-10-07 11:29:06.842373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.187 [2024-10-07 11:29:06.843785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.187 [2024-10-07 11:29:06.844108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.187 [2024-10-07 11:29:06.844168] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.187 [2024-10-07 11:29:06.844200] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.187 [2024-10-07 11:29:06.845645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.187 [2024-10-07 11:29:06.849704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.187 [2024-10-07 11:29:06.850113] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.187 [2024-10-07 11:29:06.850220] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.187 [2024-10-07 11:29:06.850259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.187 [2024-10-07 11:29:06.850347] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.187 [2024-10-07 11:29:06.850430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.187 [2024-10-07 11:29:06.850464] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.187 [2024-10-07 11:29:06.850497] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.187 [2024-10-07 11:29:06.850555] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.187 [2024-10-07 11:29:06.852247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.187 [2024-10-07 11:29:06.852446] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.187 [2024-10-07 11:29:06.852504] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.187 [2024-10-07 11:29:06.852539] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.187 [2024-10-07 11:29:06.853701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.187 [2024-10-07 11:29:06.853992] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.187 [2024-10-07 11:29:06.854032] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.187 [2024-10-07 11:29:06.854052] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.187 [2024-10-07 11:29:06.854175] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.187 [2024-10-07 11:29:06.860676] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.187 [2024-10-07 11:29:06.860926] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.187 [2024-10-07 11:29:06.860968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.187 [2024-10-07 11:29:06.860988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.187 [2024-10-07 11:29:06.861226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.187 [2024-10-07 11:29:06.861385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.187 [2024-10-07 11:29:06.861441] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.187 [2024-10-07 11:29:06.861462] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.187 [2024-10-07 11:29:06.861591] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.187 [2024-10-07 11:29:06.863800] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.187 [2024-10-07 11:29:06.863964] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.187 [2024-10-07 11:29:06.863999] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.187 [2024-10-07 11:29:06.864018] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.187 [2024-10-07 11:29:06.864259] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.187 [2024-10-07 11:29:06.864447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.187 [2024-10-07 11:29:06.864485] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.187 [2024-10-07 11:29:06.864512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.187 [2024-10-07 11:29:06.864585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.187 [2024-10-07 11:29:06.871656] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.187 [2024-10-07 11:29:06.871896] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.187 [2024-10-07 11:29:06.871935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.187 [2024-10-07 11:29:06.871956] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.187 [2024-10-07 11:29:06.873229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.187 [2024-10-07 11:29:06.873511] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.187 [2024-10-07 11:29:06.873550] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.187 [2024-10-07 11:29:06.873570] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.187 [2024-10-07 11:29:06.874754] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.187 [2024-10-07 11:29:06.876365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.188 [2024-10-07 11:29:06.876745] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.188 [2024-10-07 11:29:06.876799] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.188 [2024-10-07 11:29:06.876825] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.188 [2024-10-07 11:29:06.877902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.188 [2024-10-07 11:29:06.878975] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.188 [2024-10-07 11:29:06.879045] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.188 [2024-10-07 11:29:06.879081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.188 [2024-10-07 11:29:06.879548] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.188 [2024-10-07 11:29:06.881964] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.188 [2024-10-07 11:29:06.882263] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.188 [2024-10-07 11:29:06.882338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.188 [2024-10-07 11:29:06.882376] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.188 [2024-10-07 11:29:06.883575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.188 [2024-10-07 11:29:06.883891] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.188 [2024-10-07 11:29:06.883952] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.188 [2024-10-07 11:29:06.883990] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.188 [2024-10-07 11:29:06.884218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.188 [2024-10-07 11:29:06.887600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.188 [2024-10-07 11:29:06.889560] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.188 [2024-10-07 11:29:06.889648] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.188 [2024-10-07 11:29:06.889685] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.188 [2024-10-07 11:29:06.891557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.188 [2024-10-07 11:29:06.893073] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.188 [2024-10-07 11:29:06.893144] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.188 [2024-10-07 11:29:06.893181] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.188 [2024-10-07 11:29:06.894933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.188 [2024-10-07 11:29:06.896357] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.188 [2024-10-07 11:29:06.897941] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.188 [2024-10-07 11:29:06.898024] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.188 [2024-10-07 11:29:06.898065] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.188 [2024-10-07 11:29:06.898367] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.188 [2024-10-07 11:29:06.899689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.188 [2024-10-07 11:29:06.899798] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.188 [2024-10-07 11:29:06.899840] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.188 [2024-10-07 11:29:06.899874] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.188 [2024-10-07 11:29:06.901942] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.188 [2024-10-07 11:29:06.902141] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.188 [2024-10-07 11:29:06.902205] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.188 [2024-10-07 11:29:06.902239] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.188 [2024-10-07 11:29:06.903437] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.188 [2024-10-07 11:29:06.905291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.188 [2024-10-07 11:29:06.905360] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.188 [2024-10-07 11:29:06.905392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.188 [2024-10-07 11:29:06.905784] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.188 [2024-10-07 11:29:06.908718] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.188 [2024-10-07 11:29:06.910199] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.188 [2024-10-07 11:29:06.910270] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.188 [2024-10-07 11:29:06.910349] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.188 [2024-10-07 11:29:06.911573] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.188 [2024-10-07 11:29:06.912694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.188 [2024-10-07 11:29:06.912787] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.188 [2024-10-07 11:29:06.912823] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.188 [2024-10-07 11:29:06.912852] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.188 [2024-10-07 11:29:06.914275] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.188 [2024-10-07 11:29:06.914488] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.188 [2024-10-07 11:29:06.914553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.188 [2024-10-07 11:29:06.914588] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.188 [2024-10-07 11:29:06.914885] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.188 [2024-10-07 11:29:06.915067] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.188 [2024-10-07 11:29:06.915114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.188 [2024-10-07 11:29:06.915142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.188 [2024-10-07 11:29:06.916701] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.188 [2024-10-07 11:29:06.922673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.188 [2024-10-07 11:29:06.923219] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.188 [2024-10-07 11:29:06.923292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.188 [2024-10-07 11:29:06.923328] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.188 [2024-10-07 11:29:06.924583] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.188 [2024-10-07 11:29:06.925970] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.188 [2024-10-07 11:29:06.926081] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.188 [2024-10-07 11:29:06.926118] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.188 [2024-10-07 11:29:06.926147] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.188 [2024-10-07 11:29:06.926397] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.188 [2024-10-07 11:29:06.926601] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.188 [2024-10-07 11:29:06.926665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.188 [2024-10-07 11:29:06.926701] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.188 [2024-10-07 11:29:06.927694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.188 [2024-10-07 11:29:06.927991] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.188 [2024-10-07 11:29:06.928098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.188 [2024-10-07 11:29:06.928130] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.188 [2024-10-07 11:29:06.928248] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.188 [2024-10-07 11:29:06.933016] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.188 [2024-10-07 11:29:06.934725] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.188 [2024-10-07 11:29:06.934818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.188 [2024-10-07 11:29:06.934854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.189 [2024-10-07 11:29:06.935231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.189 [2024-10-07 11:29:06.936705] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.189 [2024-10-07 11:29:06.936784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.189 [2024-10-07 11:29:06.936820] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.189 [2024-10-07 11:29:06.938163] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.189 [2024-10-07 11:29:06.938483] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.189 [2024-10-07 11:29:06.939820] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.189 [2024-10-07 11:29:06.939901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.189 [2024-10-07 11:29:06.939940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.189 [2024-10-07 11:29:06.941298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.189 [2024-10-07 11:29:06.941640] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.189 [2024-10-07 11:29:06.941701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.189 [2024-10-07 11:29:06.941735] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.189 [2024-10-07 11:29:06.941838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.189 [2024-10-07 11:29:06.943705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.189 [2024-10-07 11:29:06.943998] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.189 [2024-10-07 11:29:06.944067] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.189 [2024-10-07 11:29:06.944104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.189 [2024-10-07 11:29:06.944161] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.189 [2024-10-07 11:29:06.945360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.189 [2024-10-07 11:29:06.945449] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.189 [2024-10-07 11:29:06.945495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.189 [2024-10-07 11:29:06.945809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.189 [2024-10-07 11:29:06.948844] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.189 [2024-10-07 11:29:06.950594] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.189 [2024-10-07 11:29:06.950681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.189 [2024-10-07 11:29:06.950720] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.189 [2024-10-07 11:29:06.951029] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.189 [2024-10-07 11:29:06.952461] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.189 [2024-10-07 11:29:06.952523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.189 [2024-10-07 11:29:06.952556] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.189 [2024-10-07 11:29:06.953782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.189 [2024-10-07 11:29:06.956461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.189 [2024-10-07 11:29:06.956943] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.189 [2024-10-07 11:29:06.957017] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.189 [2024-10-07 11:29:06.957075] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.189 [2024-10-07 11:29:06.957197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.189 [2024-10-07 11:29:06.957275] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.189 [2024-10-07 11:29:06.957309] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.189 [2024-10-07 11:29:06.957336] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.189 [2024-10-07 11:29:06.957389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.189 [2024-10-07 11:29:06.959048] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.189 [2024-10-07 11:29:06.959220] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.189 [2024-10-07 11:29:06.959268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.189 [2024-10-07 11:29:06.959300] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.189 [2024-10-07 11:29:06.960508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.189 [2024-10-07 11:29:06.960814] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.189 [2024-10-07 11:29:06.960871] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.189 [2024-10-07 11:29:06.960903] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.189 [2024-10-07 11:29:06.961076] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.189 [2024-10-07 11:29:06.968655] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.189 [2024-10-07 11:29:06.970096] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.189 [2024-10-07 11:29:06.970165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.189 [2024-10-07 11:29:06.970242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.189 [2024-10-07 11:29:06.971489] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.189 [2024-10-07 11:29:06.971757] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.189 [2024-10-07 11:29:06.971835] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.189 [2024-10-07 11:29:06.971869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.189 [2024-10-07 11:29:06.971895] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.189 [2024-10-07 11:29:06.971975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.189 [2024-10-07 11:29:06.972070] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.189 [2024-10-07 11:29:06.972110] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.189 [2024-10-07 11:29:06.972137] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.189 [2024-10-07 11:29:06.973022] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.189 [2024-10-07 11:29:06.973338] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.189 [2024-10-07 11:29:06.973396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.189 [2024-10-07 11:29:06.973451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.189 [2024-10-07 11:29:06.973572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.189 [2024-10-07 11:29:06.981791] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.189 [2024-10-07 11:29:06.983310] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.189 [2024-10-07 11:29:06.983388] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.189 [2024-10-07 11:29:06.983451] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.189 [2024-10-07 11:29:06.983742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.189 [2024-10-07 11:29:06.985023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.189 [2024-10-07 11:29:06.985126] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.189 [2024-10-07 11:29:06.985161] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.189 [2024-10-07 11:29:06.985186] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.189 [2024-10-07 11:29:06.986363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.189 [2024-10-07 11:29:06.986546] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.189 [2024-10-07 11:29:06.986608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.189 [2024-10-07 11:29:06.986642] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.189 [2024-10-07 11:29:06.986879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.189 [2024-10-07 11:29:06.987924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.189 [2024-10-07 11:29:06.988025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.189 [2024-10-07 11:29:06.988060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.189 [2024-10-07 11:29:06.988321] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.189 [2024-10-07 11:29:06.993270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.189 [2024-10-07 11:29:06.994953] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.189 [2024-10-07 11:29:06.995030] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.189 [2024-10-07 11:29:06.995065] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.189 [2024-10-07 11:29:06.995440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.189 [2024-10-07 11:29:06.996792] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.189 [2024-10-07 11:29:06.996858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.189 [2024-10-07 11:29:06.996897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.189 [2024-10-07 11:29:06.998154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.189 [2024-10-07 11:29:06.998225] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.189 [2024-10-07 11:29:06.998586] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.190 [2024-10-07 11:29:06.998649] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.190 [2024-10-07 11:29:06.998683] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.190 [2024-10-07 11:29:06.999946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.190 [2024-10-07 11:29:07.001237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.190 [2024-10-07 11:29:07.001304] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.190 [2024-10-07 11:29:07.001339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.190 [2024-10-07 11:29:07.002500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.190 [2024-10-07 11:29:07.004925] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.190 [2024-10-07 11:29:07.006753] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.190 [2024-10-07 11:29:07.006838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.190 [2024-10-07 11:29:07.006871] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.190 [2024-10-07 11:29:07.007956] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.190 [2024-10-07 11:29:07.008219] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.190 [2024-10-07 11:29:07.008270] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.190 [2024-10-07 11:29:07.008300] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.190 [2024-10-07 11:29:07.008481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.190 [2024-10-07 11:29:07.011539] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.190 [2024-10-07 11:29:07.012904] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.190 [2024-10-07 11:29:07.012971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.190 [2024-10-07 11:29:07.013003] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.190 [2024-10-07 11:29:07.014395] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.190 [2024-10-07 11:29:07.015616] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.190 [2024-10-07 11:29:07.015672] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.190 [2024-10-07 11:29:07.015703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.190 [2024-10-07 11:29:07.015970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.190 [2024-10-07 11:29:07.016074] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.190 [2024-10-07 11:29:07.016211] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.190 [2024-10-07 11:29:07.016265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.190 [2024-10-07 11:29:07.016295] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.190 [2024-10-07 11:29:07.017188] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.190 [2024-10-07 11:29:07.017474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.190 [2024-10-07 11:29:07.017524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.190 [2024-10-07 11:29:07.017553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.190 [2024-10-07 11:29:07.017651] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.190 [2024-10-07 11:29:07.022325] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.190 [2024-10-07 11:29:07.022612] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.190 [2024-10-07 11:29:07.022664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.190 [2024-10-07 11:29:07.022693] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.190 [2024-10-07 11:29:07.024026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.190 [2024-10-07 11:29:07.024367] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.190 [2024-10-07 11:29:07.024436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.190 [2024-10-07 11:29:07.024469] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.190 [2024-10-07 11:29:07.025773] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.190 [2024-10-07 11:29:07.027320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.190 [2024-10-07 11:29:07.028735] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.190 [2024-10-07 11:29:07.028821] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.190 [2024-10-07 11:29:07.028859] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.190 [2024-10-07 11:29:07.030171] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.190 [2024-10-07 11:29:07.030479] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.190 [2024-10-07 11:29:07.030535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.190 [2024-10-07 11:29:07.030566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.190 [2024-10-07 11:29:07.030661] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.190 [2024-10-07 11:29:07.032545] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.190 [2024-10-07 11:29:07.032756] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.190 [2024-10-07 11:29:07.032810] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.190 [2024-10-07 11:29:07.032839] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.190 [2024-10-07 11:29:07.033946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.190 [2024-10-07 11:29:07.034232] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.190 [2024-10-07 11:29:07.034286] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.190 [2024-10-07 11:29:07.034317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.190 [2024-10-07 11:29:07.034480] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.190 [2024-10-07 11:29:07.040425] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.190 [2024-10-07 11:29:07.041916] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.190 [2024-10-07 11:29:07.041992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.190 [2024-10-07 11:29:07.042033] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.190 [2024-10-07 11:29:07.042329] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.190 [2024-10-07 11:29:07.043525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.190 [2024-10-07 11:29:07.043583] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.190 [2024-10-07 11:29:07.043616] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.190 [2024-10-07 11:29:07.044766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.190 [2024-10-07 11:29:07.045034] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.190 [2024-10-07 11:29:07.045290] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.190 [2024-10-07 11:29:07.045357] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.190 [2024-10-07 11:29:07.045390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.190 [2024-10-07 11:29:07.045475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.190 [2024-10-07 11:29:07.045524] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.190 [2024-10-07 11:29:07.045552] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.190 [2024-10-07 11:29:07.045622] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.190 [2024-10-07 11:29:07.045673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.190 [2024-10-07 11:29:07.050739] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.190 [2024-10-07 11:29:07.051863] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.190 [2024-10-07 11:29:07.051930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.190 [2024-10-07 11:29:07.051964] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.190 [2024-10-07 11:29:07.052191] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.190 [2024-10-07 11:29:07.052372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.190 [2024-10-07 11:29:07.052435] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.190 [2024-10-07 11:29:07.052467] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.190 [2024-10-07 11:29:07.053824] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.190 [2024-10-07 11:29:07.056745] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.190 [2024-10-07 11:29:07.058270] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.190 [2024-10-07 11:29:07.058358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.190 [2024-10-07 11:29:07.058396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.190 [2024-10-07 11:29:07.059705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.190 [2024-10-07 11:29:07.060029] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.190 [2024-10-07 11:29:07.060085] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.190 [2024-10-07 11:29:07.060118] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.190 [2024-10-07 11:29:07.060212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.191 [2024-10-07 11:29:07.061792] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.191 [2024-10-07 11:29:07.062028] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.191 [2024-10-07 11:29:07.062090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.191 [2024-10-07 11:29:07.062124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.191 [2024-10-07 11:29:07.062178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.191 [2024-10-07 11:29:07.062226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.191 [2024-10-07 11:29:07.062256] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.191 [2024-10-07 11:29:07.062284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.191 [2024-10-07 11:29:07.063455] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.191 [2024-10-07 11:29:07.066948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.191 [2024-10-07 11:29:07.068739] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.191 [2024-10-07 11:29:07.068869] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.191 [2024-10-07 11:29:07.068907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.191 [2024-10-07 11:29:07.069274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.191 [2024-10-07 11:29:07.070681] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.191 [2024-10-07 11:29:07.070739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.191 [2024-10-07 11:29:07.070772] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.191 [2024-10-07 11:29:07.071962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.191 [2024-10-07 11:29:07.073450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.191 [2024-10-07 11:29:07.074901] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.191 [2024-10-07 11:29:07.074986] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.191 [2024-10-07 11:29:07.075019] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.191 [2024-10-07 11:29:07.075257] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.191 [2024-10-07 11:29:07.075363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.191 [2024-10-07 11:29:07.075427] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.191 [2024-10-07 11:29:07.075458] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.191 [2024-10-07 11:29:07.076276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.191 [2024-10-07 11:29:07.077132] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.191 [2024-10-07 11:29:07.078305] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.191 [2024-10-07 11:29:07.078368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.191 [2024-10-07 11:29:07.078419] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.191 [2024-10-07 11:29:07.078695] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.191 [2024-10-07 11:29:07.078858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.191 [2024-10-07 11:29:07.078901] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.191 [2024-10-07 11:29:07.078927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.191 [2024-10-07 11:29:07.080318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.191 [2024-10-07 11:29:07.085826] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.191 [2024-10-07 11:29:07.086188] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.191 [2024-10-07 11:29:07.086255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.191 [2024-10-07 11:29:07.086288] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.191 [2024-10-07 11:29:07.086484] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.191 [2024-10-07 11:29:07.087642] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.191 [2024-10-07 11:29:07.087701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.191 [2024-10-07 11:29:07.087734] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.191 [2024-10-07 11:29:07.088878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.191 [2024-10-07 11:29:07.089170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.191 [2024-10-07 11:29:07.089365] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.191 [2024-10-07 11:29:07.089439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.191 [2024-10-07 11:29:07.089473] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.191 [2024-10-07 11:29:07.089525] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.191 [2024-10-07 11:29:07.089576] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.191 [2024-10-07 11:29:07.089604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.191 [2024-10-07 11:29:07.089628] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.191 [2024-10-07 11:29:07.089674] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.191 [2024-10-07 11:29:07.096799] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.191 [2024-10-07 11:29:07.097045] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.191 [2024-10-07 11:29:07.097112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.191 [2024-10-07 11:29:07.097143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.191 [2024-10-07 11:29:07.097759] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.191 [2024-10-07 11:29:07.097981] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.191 [2024-10-07 11:29:07.098034] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.191 [2024-10-07 11:29:07.098064] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.191 [2024-10-07 11:29:07.098135] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.191 [2024-10-07 11:29:07.099971] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.191 [2024-10-07 11:29:07.100176] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.191 [2024-10-07 11:29:07.100237] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.191 [2024-10-07 11:29:07.100270] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.191 [2024-10-07 11:29:07.100321] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.191 [2024-10-07 11:29:07.100368] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.191 [2024-10-07 11:29:07.100396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.191 [2024-10-07 11:29:07.100440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.191 [2024-10-07 11:29:07.100533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.191 8320.13 IOPS, 32.50 MiB/s 00:18:26.191 Latency(us) 00:18:26.191 [2024-10-07T11:29:07.902Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:26.191 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:18:26.191 Verification LBA range: start 0x0 length 0x4000 00:18:26.191 NVMe0n1 : 15.01 8319.67 32.50 0.00 0.00 15349.00 1683.08 18588.39 00:18:26.191 [2024-10-07T11:29:07.902Z] =================================================================================================================== 00:18:26.191 [2024-10-07T11:29:07.902Z] Total : 8319.67 32.50 0.00 0.00 15349.00 1683.08 18588.39 00:18:26.191 [2024-10-07 11:29:07.109835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.191 [2024-10-07 11:29:07.110194] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.191 [2024-10-07 11:29:07.110258] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.191 [2024-10-07 11:29:07.110292] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.191 [2024-10-07 11:29:07.111137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.191 [2024-10-07 11:29:07.111205] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.191 [2024-10-07 11:29:07.111257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.191 [2024-10-07 11:29:07.111286] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.191 [2024-10-07 11:29:07.111311] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.191 [2024-10-07 11:29:07.111340] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.191 [2024-10-07 11:29:07.111446] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.191 [2024-10-07 11:29:07.111488] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.191 [2024-10-07 11:29:07.111517] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.191 [2024-10-07 11:29:07.111551] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.191 [2024-10-07 11:29:07.111582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.191 [2024-10-07 11:29:07.111606] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.191 [2024-10-07 11:29:07.111628] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.191 [2024-10-07 11:29:07.111656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.192 [2024-10-07 11:29:07.119987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.192 [2024-10-07 11:29:07.120262] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.192 [2024-10-07 11:29:07.120311] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.192 [2024-10-07 11:29:07.120349] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.192 [2024-10-07 11:29:07.120390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.192 [2024-10-07 11:29:07.120460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.192 [2024-10-07 11:29:07.120547] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.192 [2024-10-07 11:29:07.120574] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.192 [2024-10-07 11:29:07.120605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.192 [2024-10-07 11:29:07.121278] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.192 [2024-10-07 11:29:07.121429] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.192 [2024-10-07 11:29:07.121474] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.192 [2024-10-07 11:29:07.121515] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.192 [2024-10-07 11:29:07.121550] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.192 [2024-10-07 11:29:07.121616] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.192 [2024-10-07 11:29:07.121646] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.192 [2024-10-07 11:29:07.121671] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.192 [2024-10-07 11:29:07.121699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.192 [2024-10-07 11:29:07.130159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.192 [2024-10-07 11:29:07.130380] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.192 [2024-10-07 11:29:07.130449] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.192 [2024-10-07 11:29:07.130483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.192 [2024-10-07 11:29:07.130522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.192 [2024-10-07 11:29:07.130557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.192 [2024-10-07 11:29:07.130583] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.192 [2024-10-07 11:29:07.130606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.192 [2024-10-07 11:29:07.130644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.192 [2024-10-07 11:29:07.131368] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.192 [2024-10-07 11:29:07.131543] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.192 [2024-10-07 11:29:07.131599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.192 [2024-10-07 11:29:07.131633] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.192 [2024-10-07 11:29:07.131669] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.192 [2024-10-07 11:29:07.131703] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.192 [2024-10-07 11:29:07.131728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.192 [2024-10-07 11:29:07.131761] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.192 [2024-10-07 11:29:07.131790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.192 [2024-10-07 11:29:07.140309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.192 [2024-10-07 11:29:07.140574] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.192 [2024-10-07 11:29:07.140627] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.192 [2024-10-07 11:29:07.140658] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.192 [2024-10-07 11:29:07.140713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.192 [2024-10-07 11:29:07.140749] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.192 [2024-10-07 11:29:07.140772] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.192 [2024-10-07 11:29:07.140796] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.192 [2024-10-07 11:29:07.140823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.192 [2024-10-07 11:29:07.141488] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.192 [2024-10-07 11:29:07.141610] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.192 [2024-10-07 11:29:07.141666] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.192 [2024-10-07 11:29:07.141697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.192 [2024-10-07 11:29:07.141748] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.192 [2024-10-07 11:29:07.141782] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.192 [2024-10-07 11:29:07.141808] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.192 [2024-10-07 11:29:07.141829] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.192 [2024-10-07 11:29:07.141855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.192 [2024-10-07 11:29:07.150482] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.192 [2024-10-07 11:29:07.150737] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.192 [2024-10-07 11:29:07.150784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.192 [2024-10-07 11:29:07.150813] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.192 [2024-10-07 11:29:07.150848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.192 [2024-10-07 11:29:07.150880] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.192 [2024-10-07 11:29:07.150904] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.192 [2024-10-07 11:29:07.150927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.192 [2024-10-07 11:29:07.150955] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.192 [2024-10-07 11:29:07.151570] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.192 [2024-10-07 11:29:07.151699] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.192 [2024-10-07 11:29:07.151741] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.192 [2024-10-07 11:29:07.151767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.192 [2024-10-07 11:29:07.151831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.192 [2024-10-07 11:29:07.151862] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.192 [2024-10-07 11:29:07.151885] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.192 [2024-10-07 11:29:07.151907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.192 [2024-10-07 11:29:07.151932] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.192 Received shutdown signal, test time was about 15.000000 seconds 00:18:26.192 00:18:26.192 Latency(us) 00:18:26.192 [2024-10-07T11:29:07.903Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:26.192 [2024-10-07T11:29:07.903Z] =================================================================================================================== 00:18:26.192 [2024-10-07T11:29:07.903Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:26.192 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:18:26.192 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@65 -- # count=1 00:18:26.192 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@67 -- # (( count != 3 )) 00:18:26.192 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@68 -- # false 00:18:26.192 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@68 -- # trap - ERR 00:18:26.192 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@68 -- # print_backtrace 00:18:26.192 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1153 -- # [[ ehxBET =~ e ]] 00:18:26.192 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1155 -- # args=('--transport=tcp') 00:18:26.192 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1155 -- # local args 00:18:26.192 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1157 -- # xtrace_disable 00:18:26.192 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:18:26.192 ========== Backtrace start: ========== 00:18:26.192 00:18:26.193 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/failover.sh:68 -> main(["--transport=tcp"]) 00:18:26.193 ... 00:18:26.193 63 cat $testdir/try.txt 00:18:26.193 64 # if this test fails it means we didn't fail over to the second 00:18:26.193 65 count="$(grep -c "Resetting controller successful" < $testdir/try.txt)" 00:18:26.193 66 00:18:26.193 67 if ((count != 3)); then 00:18:26.193 => 68 false 00:18:26.193 69 fi 00:18:26.193 70 00:18:26.193 71 # Part 2 of the test. Start removing ports, starting with the one we are connected to, confirm that the ctrlr remains active until the final trid is removed. 00:18:26.193 72 $rootdir/build/examples/bdevperf -z -r $bdevperf_rpc_sock -q 128 -o 4096 -w verify -t 1 -f &> $testdir/try.txt & 00:18:26.193 73 bdevperf_pid=$! 00:18:26.193 ... 00:18:26.193 00:18:26.193 ========== Backtrace end ========== 00:18:26.193 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1194 -- # return 0 00:18:26.193 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # process_shm --id 0 00:18:26.193 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@808 -- # type=--id 00:18:26.193 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@809 -- # id=0 00:18:26.193 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@810 -- # '[' --id = --pid ']' 00:18:26.193 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@814 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:26.193 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@814 -- # shm_files=nvmf_trace.0 00:18:26.193 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@816 -- # [[ -z nvmf_trace.0 ]] 00:18:26.193 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@820 -- # for n in $shm_files 00:18:26.193 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@821 -- # tar -C /dev/shm/ -cvzf /home/vagrant/spdk_repo/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:26.193 nvmf_trace.0 00:18:26.193 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@823 -- # return 0 00:18:26.193 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # cat /home/vagrant/spdk_repo/spdk/test/nvmf/host/try.txt 00:18:26.193 [2024-10-07 11:28:51.030974] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:18:26.193 [2024-10-07 11:28:51.031080] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid75360 ] 00:18:26.193 [2024-10-07 11:28:51.165165] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:26.193 [2024-10-07 11:28:51.224317] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:18:26.193 [2024-10-07 11:28:51.253318] sock.c: 25:sock_subsystem_init: *NOTICE*: Default socket implementation override: uring 00:18:26.193 Running I/O for 15 seconds... 00:18:26.193 7964.00 IOPS, 31.11 MiB/s [2024-10-07T11:29:07.904Z] [2024-10-07 11:28:53.269475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:75856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.269544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.269575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:75864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.269592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.269608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:75872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.269623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.269639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:75880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.269653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.269669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:76400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.193 [2024-10-07 11:28:53.269683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.269699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:76408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.193 [2024-10-07 11:28:53.269713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.269729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:76416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.193 [2024-10-07 11:28:53.269743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.269759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:76424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.193 [2024-10-07 11:28:53.269773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.269788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:76432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.193 [2024-10-07 11:28:53.269802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.269819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:76440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.193 [2024-10-07 11:28:53.269832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.269848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:76448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.193 [2024-10-07 11:28:53.269893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.269911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:76456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.193 [2024-10-07 11:28:53.269925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.269941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:75888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.269955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.269971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:75896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.269984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.270000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:75904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.270014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.270030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:75912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.270044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.270060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:75920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.270084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.270104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:75928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.270119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.270134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:75936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.270148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.270164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:75944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.270178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.270194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:75952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.270207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.270223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:75960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.270237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.270253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:75968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.270267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.270291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:75976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.270306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.270321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:75984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.270335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.270350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:75992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.270364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.270380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:76000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.270394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.270425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:76008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.193 [2024-10-07 11:28:53.270441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.270456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:76464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.193 [2024-10-07 11:28:53.270471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.270486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:76472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.193 [2024-10-07 11:28:53.270500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.193 [2024-10-07 11:28:53.270516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:76480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.193 [2024-10-07 11:28:53.270530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.270545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:76488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.194 [2024-10-07 11:28:53.270560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.270576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:76496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.194 [2024-10-07 11:28:53.270590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.270628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:76504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.194 [2024-10-07 11:28:53.270647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.270665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:76512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.194 [2024-10-07 11:28:53.270682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.270699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:76520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.194 [2024-10-07 11:28:53.270721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.270738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:76016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.270752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.270768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:76024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.270782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.270797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:76032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.270811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.270826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:76040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.270840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.270856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:76048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.270870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.270885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:76056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.270899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.270915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:76064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.270928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.270944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:76072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.270957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.270973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:76080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.270987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:76088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:76096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:76104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:76112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:76120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:76128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:76136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:76528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.194 [2024-10-07 11:28:53.271230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:76536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.194 [2024-10-07 11:28:53.271259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:76544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.194 [2024-10-07 11:28:53.271289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:76552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.194 [2024-10-07 11:28:53.271318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:76560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.194 [2024-10-07 11:28:53.271347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:76568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.194 [2024-10-07 11:28:53.271376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:76576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.194 [2024-10-07 11:28:53.271418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:76584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.194 [2024-10-07 11:28:53.271449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:76144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:76152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:76160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:76168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:76176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:76184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:76192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:76200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:76208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:76216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:76224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:76232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.194 [2024-10-07 11:28:53.271831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:76240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.194 [2024-10-07 11:28:53.271845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.271860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:76248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.195 [2024-10-07 11:28:53.271880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.271896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:76256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.195 [2024-10-07 11:28:53.271910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.271926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:76264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.195 [2024-10-07 11:28:53.271940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.271956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:76272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.195 [2024-10-07 11:28:53.271970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.271986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:76280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.195 [2024-10-07 11:28:53.272000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:76288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.195 [2024-10-07 11:28:53.272030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:76296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.195 [2024-10-07 11:28:53.272059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:76304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.195 [2024-10-07 11:28:53.272088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:76312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.195 [2024-10-07 11:28:53.272119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:76320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.195 [2024-10-07 11:28:53.272148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:76328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.195 [2024-10-07 11:28:53.272178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:76592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.195 [2024-10-07 11:28:53.272207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:76600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.195 [2024-10-07 11:28:53.272236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:76608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.195 [2024-10-07 11:28:53.272273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:76616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.195 [2024-10-07 11:28:53.272303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:76624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.195 [2024-10-07 11:28:53.272332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:76632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.195 [2024-10-07 11:28:53.272369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:76640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.195 [2024-10-07 11:28:53.272397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:76648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.195 [2024-10-07 11:28:53.272444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:76656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.195 [2024-10-07 11:28:53.272473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:76664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.195 [2024-10-07 11:28:53.272503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:76672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.195 [2024-10-07 11:28:53.272535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:76680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.195 [2024-10-07 11:28:53.272564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:76688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.195 [2024-10-07 11:28:53.272593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:76696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.195 [2024-10-07 11:28:53.272622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:76704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.195 [2024-10-07 11:28:53.272651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:76712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.195 [2024-10-07 11:28:53.272689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:76336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.195 [2024-10-07 11:28:53.272718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:76344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.195 [2024-10-07 11:28:53.272747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:76352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.195 [2024-10-07 11:28:53.272776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:76360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.195 [2024-10-07 11:28:53.272805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:76368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.195 [2024-10-07 11:28:53.272836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:76376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.195 [2024-10-07 11:28:53.272866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:76384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.195 [2024-10-07 11:28:53.272895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272909] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x148c6e0 is same with the state(6) to be set 00:18:26.195 [2024-10-07 11:28:53.272927] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.195 [2024-10-07 11:28:53.272938] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.195 [2024-10-07 11:28:53.272949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:76392 len:8 PRP1 0x0 PRP2 0x0 00:18:26.195 [2024-10-07 11:28:53.272962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.272977] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.195 [2024-10-07 11:28:53.272989] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.195 [2024-10-07 11:28:53.273000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76720 len:8 PRP1 0x0 PRP2 0x0 00:18:26.195 [2024-10-07 11:28:53.273013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.273027] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.195 [2024-10-07 11:28:53.273036] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.195 [2024-10-07 11:28:53.273063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76728 len:8 PRP1 0x0 PRP2 0x0 00:18:26.195 [2024-10-07 11:28:53.273080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.273095] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.195 [2024-10-07 11:28:53.273105] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.195 [2024-10-07 11:28:53.273115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76736 len:8 PRP1 0x0 PRP2 0x0 00:18:26.195 [2024-10-07 11:28:53.273128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.195 [2024-10-07 11:28:53.273142] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.196 [2024-10-07 11:28:53.273152] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.196 [2024-10-07 11:28:53.273163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76744 len:8 PRP1 0x0 PRP2 0x0 00:18:26.196 [2024-10-07 11:28:53.273176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.196 [2024-10-07 11:28:53.273189] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.196 [2024-10-07 11:28:53.273199] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.196 [2024-10-07 11:28:53.273210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76752 len:8 PRP1 0x0 PRP2 0x0 00:18:26.196 [2024-10-07 11:28:53.273223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.196 [2024-10-07 11:28:53.273236] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.196 [2024-10-07 11:28:53.273246] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.196 [2024-10-07 11:28:53.273257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76760 len:8 PRP1 0x0 PRP2 0x0 00:18:26.196 [2024-10-07 11:28:53.273270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.196 [2024-10-07 11:28:53.273284] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.196 [2024-10-07 11:28:53.273294] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.196 [2024-10-07 11:28:53.273304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76768 len:8 PRP1 0x0 PRP2 0x0 00:18:26.196 [2024-10-07 11:28:53.273318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.196 [2024-10-07 11:28:53.273331] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.196 [2024-10-07 11:28:53.273341] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.196 [2024-10-07 11:28:53.273351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76776 len:8 PRP1 0x0 PRP2 0x0 00:18:26.196 [2024-10-07 11:28:53.273364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.196 [2024-10-07 11:28:53.273378] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.196 [2024-10-07 11:28:53.273389] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.196 [2024-10-07 11:28:53.273411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76784 len:8 PRP1 0x0 PRP2 0x0 00:18:26.196 [2024-10-07 11:28:53.273427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.196 [2024-10-07 11:28:53.273449] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.196 [2024-10-07 11:28:53.273459] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.196 [2024-10-07 11:28:53.273470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76792 len:8 PRP1 0x0 PRP2 0x0 00:18:26.196 [2024-10-07 11:28:53.273483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.196 [2024-10-07 11:28:53.273497] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.196 [2024-10-07 11:28:53.273506] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.196 [2024-10-07 11:28:53.273517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76800 len:8 PRP1 0x0 PRP2 0x0 00:18:26.196 [2024-10-07 11:28:53.273530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.196 [2024-10-07 11:28:53.273543] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.196 [2024-10-07 11:28:53.273553] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.196 [2024-10-07 11:28:53.273563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76808 len:8 PRP1 0x0 PRP2 0x0 00:18:26.196 [2024-10-07 11:28:53.273576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.196 [2024-10-07 11:28:53.273590] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.196 [2024-10-07 11:28:53.273599] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.196 [2024-10-07 11:28:53.273609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76816 len:8 PRP1 0x0 PRP2 0x0 00:18:26.196 [2024-10-07 11:28:53.273622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.196 [2024-10-07 11:28:53.273636] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.196 [2024-10-07 11:28:53.273646] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.196 [2024-10-07 11:28:53.273656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76824 len:8 PRP1 0x0 PRP2 0x0 00:18:26.196 [2024-10-07 11:28:53.273674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.196 [2024-10-07 11:28:53.273689] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.196 [2024-10-07 11:28:53.273699] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.196 [2024-10-07 11:28:53.273709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76832 len:8 PRP1 0x0 PRP2 0x0 00:18:26.196 [2024-10-07 11:28:53.273722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.196 [2024-10-07 11:28:53.273736] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.196 [2024-10-07 11:28:53.273746] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.196 [2024-10-07 11:28:53.273756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76840 len:8 PRP1 0x0 PRP2 0x0 00:18:26.196 [2024-10-07 11:28:53.273769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.196 [2024-10-07 11:28:53.273782] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.196 [2024-10-07 11:28:53.273794] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.196 [2024-10-07 11:28:53.273804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76848 len:8 PRP1 0x0 PRP2 0x0 00:18:26.196 [2024-10-07 11:28:53.273823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.196 [2024-10-07 11:28:53.273838] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.196 [2024-10-07 11:28:53.273848] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.196 [2024-10-07 11:28:53.273858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76856 len:8 PRP1 0x0 PRP2 0x0 00:18:26.196 [2024-10-07 11:28:53.273872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.196 [2024-10-07 11:28:53.273885] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.196 [2024-10-07 11:28:53.273895] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.196 [2024-10-07 11:28:53.273906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76864 len:8 PRP1 0x0 PRP2 0x0 00:18:26.196 [2024-10-07 11:28:53.273919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.196 [2024-10-07 11:28:53.273932] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.196 [2024-10-07 11:28:53.273942] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.196 [2024-10-07 11:28:53.273952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:76872 len:8 PRP1 0x0 PRP2 0x0 00:18:26.196 [2024-10-07 11:28:53.273965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.196 [2024-10-07 11:28:53.274022] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x148c6e0 was disconnected and freed. reset controller. 00:18:26.196 [2024-10-07 11:28:53.275178] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.196 [2024-10-07 11:28:53.275310] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.196 [2024-10-07 11:28:53.275839] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.196 [2024-10-07 11:28:53.275877] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.196 [2024-10-07 11:28:53.275895] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.196 [2024-10-07 11:28:53.275929] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.196 [2024-10-07 11:28:53.275964] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.196 [2024-10-07 11:28:53.275981] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.196 [2024-10-07 11:28:53.275996] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.196 [2024-10-07 11:28:53.276028] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.196 [2024-10-07 11:28:53.286379] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.196 [2024-10-07 11:28:53.286723] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.196 [2024-10-07 11:28:53.286757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.196 [2024-10-07 11:28:53.286775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.196 [2024-10-07 11:28:53.286871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.196 [2024-10-07 11:28:53.286931] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.196 [2024-10-07 11:28:53.286971] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.196 [2024-10-07 11:28:53.286987] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.196 [2024-10-07 11:28:53.287036] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.196 [2024-10-07 11:28:53.297307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.196 [2024-10-07 11:28:53.297464] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.196 [2024-10-07 11:28:53.297510] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.196 [2024-10-07 11:28:53.297531] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.197 [2024-10-07 11:28:53.297564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.197 [2024-10-07 11:28:53.297596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.197 [2024-10-07 11:28:53.297612] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.197 [2024-10-07 11:28:53.297627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.197 [2024-10-07 11:28:53.297656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.197 [2024-10-07 11:28:53.307431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.197 [2024-10-07 11:28:53.308624] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.198 [2024-10-07 11:28:53.308669] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.198 [2024-10-07 11:28:53.308689] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.198 [2024-10-07 11:28:53.308908] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.198 [2024-10-07 11:28:53.309951] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.198 [2024-10-07 11:28:53.309988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.198 [2024-10-07 11:28:53.310007] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.198 [2024-10-07 11:28:53.310239] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.198 [2024-10-07 11:28:53.317535] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.198 [2024-10-07 11:28:53.317658] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.198 [2024-10-07 11:28:53.317689] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.198 [2024-10-07 11:28:53.317706] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.198 [2024-10-07 11:28:53.317737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.198 [2024-10-07 11:28:53.317767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.198 [2024-10-07 11:28:53.317784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.198 [2024-10-07 11:28:53.317798] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.198 [2024-10-07 11:28:53.317827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.198 [2024-10-07 11:28:53.328708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.198 [2024-10-07 11:28:53.328873] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.198 [2024-10-07 11:28:53.328906] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.198 [2024-10-07 11:28:53.328923] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.198 [2024-10-07 11:28:53.328954] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.198 [2024-10-07 11:28:53.328984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.198 [2024-10-07 11:28:53.329000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.198 [2024-10-07 11:28:53.329014] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.198 [2024-10-07 11:28:53.329044] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.198 [2024-10-07 11:28:53.338835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.198 [2024-10-07 11:28:53.338952] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.198 [2024-10-07 11:28:53.338982] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.198 [2024-10-07 11:28:53.338999] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.198 [2024-10-07 11:28:53.340005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.198 [2024-10-07 11:28:53.340223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.198 [2024-10-07 11:28:53.340258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.198 [2024-10-07 11:28:53.340276] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.198 [2024-10-07 11:28:53.340386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.198 [2024-10-07 11:28:53.349692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.198 [2024-10-07 11:28:53.349809] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.198 [2024-10-07 11:28:53.349841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.198 [2024-10-07 11:28:53.349859] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.198 [2024-10-07 11:28:53.349889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.198 [2024-10-07 11:28:53.350974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.198 [2024-10-07 11:28:53.351011] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.198 [2024-10-07 11:28:53.351029] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.198 [2024-10-07 11:28:53.351241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.198 [2024-10-07 11:28:53.359785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.198 [2024-10-07 11:28:53.359899] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.198 [2024-10-07 11:28:53.359930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.198 [2024-10-07 11:28:53.359946] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.198 [2024-10-07 11:28:53.359998] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.198 [2024-10-07 11:28:53.360029] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.198 [2024-10-07 11:28:53.360045] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.198 [2024-10-07 11:28:53.360059] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.198 [2024-10-07 11:28:53.360088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.198 [2024-10-07 11:28:53.370911] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.198 [2024-10-07 11:28:53.371031] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.199 [2024-10-07 11:28:53.371062] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.199 [2024-10-07 11:28:53.371080] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.199 [2024-10-07 11:28:53.371111] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.199 [2024-10-07 11:28:53.371141] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.199 [2024-10-07 11:28:53.371157] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.199 [2024-10-07 11:28:53.371171] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.199 [2024-10-07 11:28:53.371200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.199 [2024-10-07 11:28:53.381014] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.199 [2024-10-07 11:28:53.381152] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.199 [2024-10-07 11:28:53.381183] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.199 [2024-10-07 11:28:53.381200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.199 [2024-10-07 11:28:53.382211] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.199 [2024-10-07 11:28:53.382447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.199 [2024-10-07 11:28:53.382474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.199 [2024-10-07 11:28:53.382489] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.199 [2024-10-07 11:28:53.383715] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.199 [2024-10-07 11:28:53.391957] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.199 [2024-10-07 11:28:53.392081] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.199 [2024-10-07 11:28:53.392112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.199 [2024-10-07 11:28:53.392129] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.199 [2024-10-07 11:28:53.392161] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.199 [2024-10-07 11:28:53.393262] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.199 [2024-10-07 11:28:53.393299] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.199 [2024-10-07 11:28:53.393338] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.199 [2024-10-07 11:28:53.393583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.199 [2024-10-07 11:28:53.402048] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.199 [2024-10-07 11:28:53.402167] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.199 [2024-10-07 11:28:53.402198] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.199 [2024-10-07 11:28:53.402215] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.199 [2024-10-07 11:28:53.402247] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.199 [2024-10-07 11:28:53.402277] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.199 [2024-10-07 11:28:53.402293] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.199 [2024-10-07 11:28:53.402307] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.199 [2024-10-07 11:28:53.402336] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.199 [2024-10-07 11:28:53.413271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.199 [2024-10-07 11:28:53.413433] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.199 [2024-10-07 11:28:53.413466] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.199 [2024-10-07 11:28:53.413483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.199 [2024-10-07 11:28:53.413515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.199 [2024-10-07 11:28:53.413545] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.199 [2024-10-07 11:28:53.413562] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.199 [2024-10-07 11:28:53.413576] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.199 [2024-10-07 11:28:53.413605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.199 [2024-10-07 11:28:53.423372] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.199 [2024-10-07 11:28:53.423516] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.199 [2024-10-07 11:28:53.423548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.199 [2024-10-07 11:28:53.423565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.199 [2024-10-07 11:28:53.423597] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.199 [2024-10-07 11:28:53.423633] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.199 [2024-10-07 11:28:53.423649] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.199 [2024-10-07 11:28:53.423665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.199 [2024-10-07 11:28:53.424673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.199 [2024-10-07 11:28:53.434540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.199 [2024-10-07 11:28:53.434712] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.199 [2024-10-07 11:28:53.434764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.199 [2024-10-07 11:28:53.434784] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.199 [2024-10-07 11:28:53.435883] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.199 [2024-10-07 11:28:53.436125] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.199 [2024-10-07 11:28:53.436160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.199 [2024-10-07 11:28:53.436179] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.199 [2024-10-07 11:28:53.437200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.199 [2024-10-07 11:28:53.444882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.199 [2024-10-07 11:28:53.445030] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.199 [2024-10-07 11:28:53.445074] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.199 [2024-10-07 11:28:53.445095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.199 [2024-10-07 11:28:53.445127] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.199 [2024-10-07 11:28:53.445168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.199 [2024-10-07 11:28:53.445185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.199 [2024-10-07 11:28:53.445199] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.199 [2024-10-07 11:28:53.445228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.199 [2024-10-07 11:28:53.457286] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.199 [2024-10-07 11:28:53.457643] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.199 [2024-10-07 11:28:53.457697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.199 [2024-10-07 11:28:53.457731] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.199 [2024-10-07 11:28:53.457821] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.199 [2024-10-07 11:28:53.457880] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.199 [2024-10-07 11:28:53.457910] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.199 [2024-10-07 11:28:53.457935] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.199 [2024-10-07 11:28:53.457985] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.199 [2024-10-07 11:28:53.467778] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.199 [2024-10-07 11:28:53.467972] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.199 [2024-10-07 11:28:53.468016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.199 [2024-10-07 11:28:53.468045] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.199 [2024-10-07 11:28:53.468100] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.199 [2024-10-07 11:28:53.468192] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.199 [2024-10-07 11:28:53.468221] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.199 [2024-10-07 11:28:53.468248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.199 [2024-10-07 11:28:53.469345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.199 [2024-10-07 11:28:53.477913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.199 [2024-10-07 11:28:53.478815] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.199 [2024-10-07 11:28:53.478868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.199 [2024-10-07 11:28:53.478902] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.199 [2024-10-07 11:28:53.479638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.199 [2024-10-07 11:28:53.480008] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.199 [2024-10-07 11:28:53.480057] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.199 [2024-10-07 11:28:53.480089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.199 [2024-10-07 11:28:53.480196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.199 [2024-10-07 11:28:53.488300] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.199 [2024-10-07 11:28:53.488511] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.199 [2024-10-07 11:28:53.488561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.199 [2024-10-07 11:28:53.488595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.199 [2024-10-07 11:28:53.488648] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.199 [2024-10-07 11:28:53.488698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.200 [2024-10-07 11:28:53.488728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.200 [2024-10-07 11:28:53.488753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.200 [2024-10-07 11:28:53.488802] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.200 [2024-10-07 11:28:53.498937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.200 [2024-10-07 11:28:53.499138] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.200 [2024-10-07 11:28:53.499184] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.200 [2024-10-07 11:28:53.499213] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.200 [2024-10-07 11:28:53.499267] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.200 [2024-10-07 11:28:53.499327] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.200 [2024-10-07 11:28:53.499357] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.200 [2024-10-07 11:28:53.499384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.200 [2024-10-07 11:28:53.499772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.200 [2024-10-07 11:28:53.509084] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.200 [2024-10-07 11:28:53.509289] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.200 [2024-10-07 11:28:53.509334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.200 [2024-10-07 11:28:53.509364] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.200 [2024-10-07 11:28:53.510465] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.200 [2024-10-07 11:28:53.510731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.200 [2024-10-07 11:28:53.510774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.200 [2024-10-07 11:28:53.510805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.200 [2024-10-07 11:28:53.510968] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.200 [2024-10-07 11:28:53.519225] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.200 [2024-10-07 11:28:53.519419] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.200 [2024-10-07 11:28:53.519467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.200 [2024-10-07 11:28:53.519496] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.200 [2024-10-07 11:28:53.519551] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.200 [2024-10-07 11:28:53.519601] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.200 [2024-10-07 11:28:53.519629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.200 [2024-10-07 11:28:53.519655] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.200 [2024-10-07 11:28:53.519703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.200 [2024-10-07 11:28:53.529334] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.200 [2024-10-07 11:28:53.529534] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.200 [2024-10-07 11:28:53.529592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.200 [2024-10-07 11:28:53.529626] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.200 [2024-10-07 11:28:53.529680] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.200 [2024-10-07 11:28:53.529731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.200 [2024-10-07 11:28:53.529760] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.200 [2024-10-07 11:28:53.529787] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.200 [2024-10-07 11:28:53.529836] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.200 [2024-10-07 11:28:53.539606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.200 [2024-10-07 11:28:53.539775] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.200 [2024-10-07 11:28:53.539820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.200 [2024-10-07 11:28:53.539881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.200 [2024-10-07 11:28:53.539949] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.200 [2024-10-07 11:28:53.539998] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.200 [2024-10-07 11:28:53.540025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.200 [2024-10-07 11:28:53.540050] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.200 [2024-10-07 11:28:53.541151] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.200 [2024-10-07 11:28:53.549714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.200 [2024-10-07 11:28:53.549878] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.200 [2024-10-07 11:28:53.549930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.200 [2024-10-07 11:28:53.549963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.200 [2024-10-07 11:28:53.550015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.200 [2024-10-07 11:28:53.550064] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.200 [2024-10-07 11:28:53.550094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.200 [2024-10-07 11:28:53.550118] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.200 [2024-10-07 11:28:53.550979] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.200 [2024-10-07 11:28:53.560485] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.200 [2024-10-07 11:28:53.560649] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.200 [2024-10-07 11:28:53.560706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.200 [2024-10-07 11:28:53.560740] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.200 [2024-10-07 11:28:53.560793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.200 [2024-10-07 11:28:53.560843] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.200 [2024-10-07 11:28:53.560872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.200 [2024-10-07 11:28:53.560898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.200 [2024-10-07 11:28:53.560945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.200 [2024-10-07 11:28:53.571299] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.200 [2024-10-07 11:28:53.571482] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.200 [2024-10-07 11:28:53.571530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.200 [2024-10-07 11:28:53.571562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.200 [2024-10-07 11:28:53.571615] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.200 [2024-10-07 11:28:53.571664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.200 [2024-10-07 11:28:53.571730] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.200 [2024-10-07 11:28:53.571758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.200 [2024-10-07 11:28:53.571807] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.200 [2024-10-07 11:28:53.581430] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.200 [2024-10-07 11:28:53.581610] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.200 [2024-10-07 11:28:53.581656] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.200 [2024-10-07 11:28:53.581686] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.200 [2024-10-07 11:28:53.581739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.200 [2024-10-07 11:28:53.581791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.200 [2024-10-07 11:28:53.581821] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.200 [2024-10-07 11:28:53.581846] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.200 [2024-10-07 11:28:53.581895] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.200 [2024-10-07 11:28:53.591543] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.200 [2024-10-07 11:28:53.591696] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.200 [2024-10-07 11:28:53.591739] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.200 [2024-10-07 11:28:53.591770] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.200 [2024-10-07 11:28:53.593014] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.200 [2024-10-07 11:28:53.594128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.200 [2024-10-07 11:28:53.594172] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.200 [2024-10-07 11:28:53.594202] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.200 [2024-10-07 11:28:53.594358] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.201 [2024-10-07 11:28:53.601651] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.201 [2024-10-07 11:28:53.602724] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.201 [2024-10-07 11:28:53.602777] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.201 [2024-10-07 11:28:53.602809] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.201 [2024-10-07 11:28:53.603076] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.201 [2024-10-07 11:28:53.603237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.201 [2024-10-07 11:28:53.603274] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.201 [2024-10-07 11:28:53.603314] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.201 [2024-10-07 11:28:53.604477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.201 [2024-10-07 11:28:53.612805] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.201 [2024-10-07 11:28:53.613219] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.201 [2024-10-07 11:28:53.613270] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.201 [2024-10-07 11:28:53.613303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.201 [2024-10-07 11:28:53.613425] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.201 [2024-10-07 11:28:53.613491] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.201 [2024-10-07 11:28:53.613522] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.201 [2024-10-07 11:28:53.613547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.201 [2024-10-07 11:28:53.613597] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.201 [2024-10-07 11:28:53.622917] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.201 [2024-10-07 11:28:53.623086] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.201 [2024-10-07 11:28:53.623142] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.201 [2024-10-07 11:28:53.623175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.201 [2024-10-07 11:28:53.623227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.201 [2024-10-07 11:28:53.623276] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.201 [2024-10-07 11:28:53.623306] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.201 [2024-10-07 11:28:53.623330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.201 [2024-10-07 11:28:53.623380] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.201 [2024-10-07 11:28:53.633540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.201 [2024-10-07 11:28:53.633732] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.201 [2024-10-07 11:28:53.633783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.201 [2024-10-07 11:28:53.633816] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.201 [2024-10-07 11:28:53.633869] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.201 [2024-10-07 11:28:53.633919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.201 [2024-10-07 11:28:53.633950] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.201 [2024-10-07 11:28:53.633974] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.201 [2024-10-07 11:28:53.634022] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.201 [2024-10-07 11:28:53.644920] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.201 [2024-10-07 11:28:53.645336] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.201 [2024-10-07 11:28:53.645386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.201 [2024-10-07 11:28:53.645435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.201 [2024-10-07 11:28:53.645581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.201 [2024-10-07 11:28:53.645652] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.201 [2024-10-07 11:28:53.645685] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.201 [2024-10-07 11:28:53.645709] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.201 [2024-10-07 11:28:53.645759] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.201 [2024-10-07 11:28:53.657291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.201 [2024-10-07 11:28:53.657496] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.201 [2024-10-07 11:28:53.657553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.201 [2024-10-07 11:28:53.657587] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.201 [2024-10-07 11:28:53.657640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.201 [2024-10-07 11:28:53.657690] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.201 [2024-10-07 11:28:53.657720] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.201 [2024-10-07 11:28:53.657745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.201 [2024-10-07 11:28:53.657794] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.201 [2024-10-07 11:28:53.667396] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.201 [2024-10-07 11:28:53.668539] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.201 [2024-10-07 11:28:53.668591] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.201 [2024-10-07 11:28:53.668623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.201 [2024-10-07 11:28:53.668887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.201 [2024-10-07 11:28:53.669044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.201 [2024-10-07 11:28:53.669095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.201 [2024-10-07 11:28:53.669125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.201 [2024-10-07 11:28:53.670370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.201 [2024-10-07 11:28:53.678348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.201 [2024-10-07 11:28:53.678527] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.201 [2024-10-07 11:28:53.678577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.201 [2024-10-07 11:28:53.678630] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.201 [2024-10-07 11:28:53.679827] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.201 [2024-10-07 11:28:53.680137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.201 [2024-10-07 11:28:53.680178] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.201 [2024-10-07 11:28:53.680236] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.201 [2024-10-07 11:28:53.681382] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.201 [2024-10-07 11:28:53.688471] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.201 [2024-10-07 11:28:53.688661] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.201 [2024-10-07 11:28:53.688718] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.201 [2024-10-07 11:28:53.688760] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.201 [2024-10-07 11:28:53.688818] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.201 [2024-10-07 11:28:53.688900] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.201 [2024-10-07 11:28:53.688934] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.201 [2024-10-07 11:28:53.688989] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.201 [2024-10-07 11:28:53.689043] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.201 [2024-10-07 11:28:53.700107] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.201 [2024-10-07 11:28:53.700291] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.201 [2024-10-07 11:28:53.700342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.201 [2024-10-07 11:28:53.700375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.201 [2024-10-07 11:28:53.700444] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.201 [2024-10-07 11:28:53.700498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.201 [2024-10-07 11:28:53.700528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.201 [2024-10-07 11:28:53.700552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.201 [2024-10-07 11:28:53.700601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.201 [2024-10-07 11:28:53.710211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.201 [2024-10-07 11:28:53.710357] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.201 [2024-10-07 11:28:53.710427] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.201 [2024-10-07 11:28:53.710464] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.202 [2024-10-07 11:28:53.711519] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.202 [2024-10-07 11:28:53.711786] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.202 [2024-10-07 11:28:53.711828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.202 [2024-10-07 11:28:53.711862] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.202 [2024-10-07 11:28:53.712031] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.202 [2024-10-07 11:28:53.721283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.202 [2024-10-07 11:28:53.721469] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.202 [2024-10-07 11:28:53.721521] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.202 [2024-10-07 11:28:53.721554] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.202 [2024-10-07 11:28:53.722694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.202 [2024-10-07 11:28:53.722979] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.202 [2024-10-07 11:28:53.723020] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.202 [2024-10-07 11:28:53.723049] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.202 [2024-10-07 11:28:53.724114] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.202 [2024-10-07 11:28:53.731418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.202 [2024-10-07 11:28:53.731567] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.202 [2024-10-07 11:28:53.731614] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.202 [2024-10-07 11:28:53.731645] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.202 [2024-10-07 11:28:53.731696] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.202 [2024-10-07 11:28:53.731746] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.202 [2024-10-07 11:28:53.731774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.202 [2024-10-07 11:28:53.731797] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.202 [2024-10-07 11:28:53.731844] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.202 [2024-10-07 11:28:53.743536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.202 [2024-10-07 11:28:53.743775] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.202 [2024-10-07 11:28:53.743826] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.202 [2024-10-07 11:28:53.743860] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.202 [2024-10-07 11:28:53.744676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.202 [2024-10-07 11:28:53.745626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.202 [2024-10-07 11:28:53.745672] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.202 [2024-10-07 11:28:53.745703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.202 [2024-10-07 11:28:53.745862] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.202 [2024-10-07 11:28:53.754546] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.202 [2024-10-07 11:28:53.754724] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.202 [2024-10-07 11:28:53.754784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.202 [2024-10-07 11:28:53.754830] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.202 [2024-10-07 11:28:53.756125] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.202 [2024-10-07 11:28:53.757374] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.202 [2024-10-07 11:28:53.757428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.202 [2024-10-07 11:28:53.757459] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.202 [2024-10-07 11:28:53.757723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.202 [2024-10-07 11:28:53.765778] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.202 [2024-10-07 11:28:53.766942] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.202 [2024-10-07 11:28:53.766995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.202 [2024-10-07 11:28:53.767027] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.202 [2024-10-07 11:28:53.767287] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.202 [2024-10-07 11:28:53.767385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.202 [2024-10-07 11:28:53.767435] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.202 [2024-10-07 11:28:53.767462] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.202 [2024-10-07 11:28:53.767519] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.202 [2024-10-07 11:28:53.776693] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.202 [2024-10-07 11:28:53.776878] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.202 [2024-10-07 11:28:53.776924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.202 [2024-10-07 11:28:53.776956] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.202 [2024-10-07 11:28:53.777006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.202 [2024-10-07 11:28:53.777068] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.202 [2024-10-07 11:28:53.777100] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.202 [2024-10-07 11:28:53.777124] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.202 [2024-10-07 11:28:53.777184] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.202 [2024-10-07 11:28:53.787825] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.202 [2024-10-07 11:28:53.788262] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.202 [2024-10-07 11:28:53.788315] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.202 [2024-10-07 11:28:53.788347] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.202 [2024-10-07 11:28:53.788474] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.202 [2024-10-07 11:28:53.788560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.202 [2024-10-07 11:28:53.788593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.202 [2024-10-07 11:28:53.788648] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.202 [2024-10-07 11:28:53.788725] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.202 [2024-10-07 11:28:53.799963] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.202 [2024-10-07 11:28:53.800147] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.202 [2024-10-07 11:28:53.800201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.202 [2024-10-07 11:28:53.800234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.202 [2024-10-07 11:28:53.800287] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.202 [2024-10-07 11:28:53.800337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.202 [2024-10-07 11:28:53.800366] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.202 [2024-10-07 11:28:53.800391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.202 [2024-10-07 11:28:53.800460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.202 [2024-10-07 11:28:53.810067] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.202 [2024-10-07 11:28:53.810227] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.202 [2024-10-07 11:28:53.810286] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.202 [2024-10-07 11:28:53.810320] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.203 [2024-10-07 11:28:53.811392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.203 [2024-10-07 11:28:53.811674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.203 [2024-10-07 11:28:53.811716] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.203 [2024-10-07 11:28:53.811745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.203 [2024-10-07 11:28:53.811895] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.203 [2024-10-07 11:28:53.821085] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.203 [2024-10-07 11:28:53.821255] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.203 [2024-10-07 11:28:53.821310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.203 [2024-10-07 11:28:53.821344] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.203 [2024-10-07 11:28:53.822513] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.203 [2024-10-07 11:28:53.822773] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.203 [2024-10-07 11:28:53.822813] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.203 [2024-10-07 11:28:53.822842] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.203 [2024-10-07 11:28:53.823907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.203 [2024-10-07 11:28:53.831198] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.203 [2024-10-07 11:28:53.831352] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.203 [2024-10-07 11:28:53.831442] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.203 [2024-10-07 11:28:53.831476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.203 [2024-10-07 11:28:53.831530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.203 [2024-10-07 11:28:53.831580] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.203 [2024-10-07 11:28:53.831609] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.203 [2024-10-07 11:28:53.831634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.203 [2024-10-07 11:28:53.831680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.203 [2024-10-07 11:28:53.842597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.203 [2024-10-07 11:28:53.842794] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.203 [2024-10-07 11:28:53.842842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.203 [2024-10-07 11:28:53.842874] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.203 [2024-10-07 11:28:53.842929] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.203 [2024-10-07 11:28:53.842979] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.203 [2024-10-07 11:28:53.843006] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.203 [2024-10-07 11:28:53.843030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.203 [2024-10-07 11:28:53.843078] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.203 [2024-10-07 11:28:53.852730] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.203 [2024-10-07 11:28:53.852893] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.203 [2024-10-07 11:28:53.852950] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.203 [2024-10-07 11:28:53.852985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.203 [2024-10-07 11:28:53.854068] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.203 [2024-10-07 11:28:53.854352] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.203 [2024-10-07 11:28:53.854394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.203 [2024-10-07 11:28:53.854447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.203 [2024-10-07 11:28:53.854602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.203 [2024-10-07 11:28:53.863904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.203 [2024-10-07 11:28:53.864061] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.203 [2024-10-07 11:28:53.864117] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.203 [2024-10-07 11:28:53.864152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.203 [2024-10-07 11:28:53.865311] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.203 [2024-10-07 11:28:53.865620] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.203 [2024-10-07 11:28:53.865661] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.203 [2024-10-07 11:28:53.865691] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.203 [2024-10-07 11:28:53.866764] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.203 [2024-10-07 11:28:53.874008] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.203 [2024-10-07 11:28:53.874158] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.203 [2024-10-07 11:28:53.874214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.203 [2024-10-07 11:28:53.874248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.203 [2024-10-07 11:28:53.874301] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.203 [2024-10-07 11:28:53.874349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.203 [2024-10-07 11:28:53.874378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.203 [2024-10-07 11:28:53.874421] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.203 [2024-10-07 11:28:53.874474] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.203 [2024-10-07 11:28:53.885329] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.203 [2024-10-07 11:28:53.885495] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.203 [2024-10-07 11:28:53.885549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.203 [2024-10-07 11:28:53.885582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.203 [2024-10-07 11:28:53.885635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.203 [2024-10-07 11:28:53.885685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.203 [2024-10-07 11:28:53.885714] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.203 [2024-10-07 11:28:53.885737] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.203 [2024-10-07 11:28:53.885785] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.203 [2024-10-07 11:28:53.895445] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.203 [2024-10-07 11:28:53.896565] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.203 [2024-10-07 11:28:53.896616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.203 [2024-10-07 11:28:53.896647] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.203 [2024-10-07 11:28:53.896920] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.203 [2024-10-07 11:28:53.897091] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.203 [2024-10-07 11:28:53.897129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.203 [2024-10-07 11:28:53.897158] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.203 [2024-10-07 11:28:53.898442] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.203 [2024-10-07 11:28:53.906321] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.203 [2024-10-07 11:28:53.906484] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.203 [2024-10-07 11:28:53.906540] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.203 [2024-10-07 11:28:53.906573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.203 [2024-10-07 11:28:53.907709] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.203 [2024-10-07 11:28:53.907969] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.203 [2024-10-07 11:28:53.908010] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.203 [2024-10-07 11:28:53.908039] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.203 [2024-10-07 11:28:53.909121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.203 [2024-10-07 11:28:53.916435] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.203 [2024-10-07 11:28:53.916595] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.203 [2024-10-07 11:28:53.916648] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.203 [2024-10-07 11:28:53.916681] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.203 [2024-10-07 11:28:53.916732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.203 [2024-10-07 11:28:53.916782] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.203 [2024-10-07 11:28:53.916810] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.203 [2024-10-07 11:28:53.916836] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.203 [2024-10-07 11:28:53.916881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.203 [2024-10-07 11:28:53.927762] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.203 [2024-10-07 11:28:53.927908] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.204 [2024-10-07 11:28:53.927963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.204 [2024-10-07 11:28:53.927997] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.204 [2024-10-07 11:28:53.928051] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.204 [2024-10-07 11:28:53.928100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.204 [2024-10-07 11:28:53.928130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.204 [2024-10-07 11:28:53.928153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.204 [2024-10-07 11:28:53.928201] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.204 [2024-10-07 11:28:53.937859] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.204 [2024-10-07 11:28:53.938000] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.204 [2024-10-07 11:28:53.938055] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.204 [2024-10-07 11:28:53.938119] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.204 [2024-10-07 11:28:53.939180] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.204 [2024-10-07 11:28:53.939485] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.204 [2024-10-07 11:28:53.939526] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.204 [2024-10-07 11:28:53.939554] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.204 [2024-10-07 11:28:53.939704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.204 [2024-10-07 11:28:53.948848] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.204 [2024-10-07 11:28:53.948994] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.204 [2024-10-07 11:28:53.949046] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.204 [2024-10-07 11:28:53.949093] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.204 [2024-10-07 11:28:53.950243] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.204 [2024-10-07 11:28:53.950544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.204 [2024-10-07 11:28:53.950585] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.204 [2024-10-07 11:28:53.950614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.204 [2024-10-07 11:28:53.951675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.204 [2024-10-07 11:28:53.958951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.204 [2024-10-07 11:28:53.959099] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.204 [2024-10-07 11:28:53.959154] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.204 [2024-10-07 11:28:53.959195] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.204 [2024-10-07 11:28:53.959248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.204 [2024-10-07 11:28:53.959298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.204 [2024-10-07 11:28:53.959328] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.204 [2024-10-07 11:28:53.959353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.204 [2024-10-07 11:28:53.959414] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.204 [2024-10-07 11:28:53.970331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.204 [2024-10-07 11:28:53.970547] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.204 [2024-10-07 11:28:53.970605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.204 [2024-10-07 11:28:53.970640] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.204 [2024-10-07 11:28:53.970695] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.204 [2024-10-07 11:28:53.970746] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.204 [2024-10-07 11:28:53.970806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.204 [2024-10-07 11:28:53.970833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.204 [2024-10-07 11:28:53.970885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.204 [2024-10-07 11:28:53.980488] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.204 [2024-10-07 11:28:53.980704] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.204 [2024-10-07 11:28:53.980749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.204 [2024-10-07 11:28:53.980779] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.204 [2024-10-07 11:28:53.981872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.204 [2024-10-07 11:28:53.982180] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.204 [2024-10-07 11:28:53.982223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.204 [2024-10-07 11:28:53.982254] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.204 [2024-10-07 11:28:53.982425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.204 [2024-10-07 11:28:53.991600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.204 [2024-10-07 11:28:53.991752] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.204 [2024-10-07 11:28:53.991808] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.204 [2024-10-07 11:28:53.991842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.204 [2024-10-07 11:28:53.992978] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.204 [2024-10-07 11:28:53.993273] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.204 [2024-10-07 11:28:53.993314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.204 [2024-10-07 11:28:53.993343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.204 [2024-10-07 11:28:53.994421] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.204 [2024-10-07 11:28:54.001705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.204 [2024-10-07 11:28:54.001916] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.204 [2024-10-07 11:28:54.001993] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.204 [2024-10-07 11:28:54.002051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.204 [2024-10-07 11:28:54.002139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.204 [2024-10-07 11:28:54.002198] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.204 [2024-10-07 11:28:54.002229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.204 [2024-10-07 11:28:54.002254] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.204 [2024-10-07 11:28:54.002303] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.204 [2024-10-07 11:28:54.013146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.204 [2024-10-07 11:28:54.013306] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.204 [2024-10-07 11:28:54.013359] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.204 [2024-10-07 11:28:54.013393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.204 [2024-10-07 11:28:54.013463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.204 [2024-10-07 11:28:54.013513] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.204 [2024-10-07 11:28:54.013543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.204 [2024-10-07 11:28:54.013575] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.204 [2024-10-07 11:28:54.013625] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.204 [2024-10-07 11:28:54.023246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.204 [2024-10-07 11:28:54.023397] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.204 [2024-10-07 11:28:54.023468] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.204 [2024-10-07 11:28:54.023502] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.204 [2024-10-07 11:28:54.024561] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.204 [2024-10-07 11:28:54.024824] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.204 [2024-10-07 11:28:54.024866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.204 [2024-10-07 11:28:54.024895] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.204 [2024-10-07 11:28:54.025045] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.204 [2024-10-07 11:28:54.033356] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.204 [2024-10-07 11:28:54.033542] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.204 [2024-10-07 11:28:54.033587] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.204 [2024-10-07 11:28:54.033616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.204 [2024-10-07 11:28:54.034604] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.204 [2024-10-07 11:28:54.034853] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.204 [2024-10-07 11:28:54.034894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.204 [2024-10-07 11:28:54.034925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.205 [2024-10-07 11:28:54.035035] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.205 [2024-10-07 11:28:54.044573] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.205 [2024-10-07 11:28:54.044755] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.205 [2024-10-07 11:28:54.044814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.205 [2024-10-07 11:28:54.044849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.205 [2024-10-07 11:28:54.045200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.205 [2024-10-07 11:28:54.045319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.205 [2024-10-07 11:28:54.045355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.205 [2024-10-07 11:28:54.045383] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.205 [2024-10-07 11:28:54.045451] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.205 [2024-10-07 11:28:54.054699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.205 [2024-10-07 11:28:54.054854] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.205 [2024-10-07 11:28:54.054919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.205 [2024-10-07 11:28:54.054954] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.205 [2024-10-07 11:28:54.056200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.205 [2024-10-07 11:28:54.057459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.205 [2024-10-07 11:28:54.057502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.205 [2024-10-07 11:28:54.057532] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.205 [2024-10-07 11:28:54.057821] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.205 [2024-10-07 11:28:54.065289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.205 [2024-10-07 11:28:54.066563] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.205 [2024-10-07 11:28:54.066615] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.205 [2024-10-07 11:28:54.066649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.205 [2024-10-07 11:28:54.066916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.205 [2024-10-07 11:28:54.068010] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.205 [2024-10-07 11:28:54.068054] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.205 [2024-10-07 11:28:54.068085] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.205 [2024-10-07 11:28:54.068380] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.205 [2024-10-07 11:28:54.075423] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.205 [2024-10-07 11:28:54.075589] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.205 [2024-10-07 11:28:54.075642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.205 [2024-10-07 11:28:54.075687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.205 [2024-10-07 11:28:54.075741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.205 [2024-10-07 11:28:54.075790] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.205 [2024-10-07 11:28:54.075820] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.205 [2024-10-07 11:28:54.075875] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.205 [2024-10-07 11:28:54.075925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.205 [2024-10-07 11:28:54.086634] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.205 [2024-10-07 11:28:54.086844] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.205 [2024-10-07 11:28:54.086898] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.205 [2024-10-07 11:28:54.086932] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.205 [2024-10-07 11:28:54.086985] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.205 [2024-10-07 11:28:54.087036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.205 [2024-10-07 11:28:54.087065] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.205 [2024-10-07 11:28:54.087092] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.205 [2024-10-07 11:28:54.087138] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.205 [2024-10-07 11:28:54.099377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.205 8270.50 IOPS, 32.31 MiB/s [2024-10-07T11:29:07.916Z] [2024-10-07 11:28:54.099773] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.205 [2024-10-07 11:28:54.099824] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.205 [2024-10-07 11:28:54.099856] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.205 [2024-10-07 11:28:54.100010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.205 [2024-10-07 11:28:54.101271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.205 [2024-10-07 11:28:54.101314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.205 [2024-10-07 11:28:54.101343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.205 [2024-10-07 11:28:54.102572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.205 [2024-10-07 11:28:54.109601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.205 [2024-10-07 11:28:54.110753] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.205 [2024-10-07 11:28:54.110805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.205 [2024-10-07 11:28:54.110838] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.205 [2024-10-07 11:28:54.111109] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.205 [2024-10-07 11:28:54.111207] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.205 [2024-10-07 11:28:54.111244] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.205 [2024-10-07 11:28:54.111270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.205 [2024-10-07 11:28:54.111322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.205 [2024-10-07 11:28:54.120467] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.205 [2024-10-07 11:28:54.120674] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.205 [2024-10-07 11:28:54.120725] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.205 [2024-10-07 11:28:54.120757] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.205 [2024-10-07 11:28:54.120811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.205 [2024-10-07 11:28:54.120861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.205 [2024-10-07 11:28:54.120891] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.205 [2024-10-07 11:28:54.120920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.205 [2024-10-07 11:28:54.120969] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.205 [2024-10-07 11:28:54.131558] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.205 [2024-10-07 11:28:54.131952] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.205 [2024-10-07 11:28:54.132002] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.205 [2024-10-07 11:28:54.132034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.205 [2024-10-07 11:28:54.132139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.205 [2024-10-07 11:28:54.132216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.205 [2024-10-07 11:28:54.132249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.205 [2024-10-07 11:28:54.132275] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.205 [2024-10-07 11:28:54.132322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.205 [2024-10-07 11:28:54.143489] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.205 [2024-10-07 11:28:54.143778] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.205 [2024-10-07 11:28:54.143829] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.205 [2024-10-07 11:28:54.143861] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.205 [2024-10-07 11:28:54.143946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.205 [2024-10-07 11:28:54.144001] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.205 [2024-10-07 11:28:54.144030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.205 [2024-10-07 11:28:54.144054] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.205 [2024-10-07 11:28:54.144103] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.205 [2024-10-07 11:28:54.153599] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.205 [2024-10-07 11:28:54.153749] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.205 [2024-10-07 11:28:54.153805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.205 [2024-10-07 11:28:54.153839] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.205 [2024-10-07 11:28:54.154932] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.206 [2024-10-07 11:28:54.155182] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.206 [2024-10-07 11:28:54.155222] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.206 [2024-10-07 11:28:54.155252] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.206 [2024-10-07 11:28:54.155437] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.206 [2024-10-07 11:28:54.164755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.206 [2024-10-07 11:28:54.164912] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.206 [2024-10-07 11:28:54.164957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.206 [2024-10-07 11:28:54.164988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.206 [2024-10-07 11:28:54.166144] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.206 [2024-10-07 11:28:54.166466] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.206 [2024-10-07 11:28:54.166506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.206 [2024-10-07 11:28:54.166537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.206 [2024-10-07 11:28:54.167601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.206 [2024-10-07 11:28:54.174862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.206 [2024-10-07 11:28:54.175011] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.206 [2024-10-07 11:28:54.175066] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.206 [2024-10-07 11:28:54.175100] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.206 [2024-10-07 11:28:54.175152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.206 [2024-10-07 11:28:54.175201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.206 [2024-10-07 11:28:54.175229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.206 [2024-10-07 11:28:54.175254] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.206 [2024-10-07 11:28:54.175301] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.206 [2024-10-07 11:28:54.186116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.206 [2024-10-07 11:28:54.186322] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.206 [2024-10-07 11:28:54.186380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.206 [2024-10-07 11:28:54.186433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.206 [2024-10-07 11:28:54.186489] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.206 [2024-10-07 11:28:54.186540] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.206 [2024-10-07 11:28:54.186570] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.206 [2024-10-07 11:28:54.186626] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.206 [2024-10-07 11:28:54.186677] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.206 [2024-10-07 11:28:54.196229] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.206 [2024-10-07 11:28:54.196391] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.206 [2024-10-07 11:28:54.196450] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.206 [2024-10-07 11:28:54.196481] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.206 [2024-10-07 11:28:54.197554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.206 [2024-10-07 11:28:54.197827] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.206 [2024-10-07 11:28:54.197868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.206 [2024-10-07 11:28:54.197898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.206 [2024-10-07 11:28:54.198051] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.206 [2024-10-07 11:28:54.207297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.206 [2024-10-07 11:28:54.207468] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.206 [2024-10-07 11:28:54.207523] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.206 [2024-10-07 11:28:54.207557] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.206 [2024-10-07 11:28:54.208705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.206 [2024-10-07 11:28:54.209018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.206 [2024-10-07 11:28:54.209069] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.206 [2024-10-07 11:28:54.209100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.206 [2024-10-07 11:28:54.210167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.206 [2024-10-07 11:28:54.217420] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.206 [2024-10-07 11:28:54.217589] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.206 [2024-10-07 11:28:54.217642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.206 [2024-10-07 11:28:54.217677] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.206 [2024-10-07 11:28:54.217730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.206 [2024-10-07 11:28:54.217781] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.206 [2024-10-07 11:28:54.217812] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.206 [2024-10-07 11:28:54.217836] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.206 [2024-10-07 11:28:54.217885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.206 [2024-10-07 11:28:54.229106] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.206 [2024-10-07 11:28:54.229413] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.206 [2024-10-07 11:28:54.229491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.206 [2024-10-07 11:28:54.229525] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.206 [2024-10-07 11:28:54.229597] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.206 [2024-10-07 11:28:54.229650] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.206 [2024-10-07 11:28:54.229679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.206 [2024-10-07 11:28:54.229704] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.206 [2024-10-07 11:28:54.229755] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.206 [2024-10-07 11:28:54.239216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.206 [2024-10-07 11:28:54.239367] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.206 [2024-10-07 11:28:54.239433] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.206 [2024-10-07 11:28:54.239469] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.206 [2024-10-07 11:28:54.239522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.206 [2024-10-07 11:28:54.240585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.206 [2024-10-07 11:28:54.240628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.206 [2024-10-07 11:28:54.240658] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.206 [2024-10-07 11:28:54.240910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.206 [2024-10-07 11:28:54.249321] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.206 [2024-10-07 11:28:54.250364] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.206 [2024-10-07 11:28:54.250432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.206 [2024-10-07 11:28:54.250468] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.206 [2024-10-07 11:28:54.250705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.206 [2024-10-07 11:28:54.250862] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.206 [2024-10-07 11:28:54.250914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.206 [2024-10-07 11:28:54.250943] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.206 [2024-10-07 11:28:54.252087] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.206 [2024-10-07 11:28:54.259828] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.207 [2024-10-07 11:28:54.260210] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.207 [2024-10-07 11:28:54.260260] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.207 [2024-10-07 11:28:54.260292] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.207 [2024-10-07 11:28:54.260396] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.207 [2024-10-07 11:28:54.260519] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.207 [2024-10-07 11:28:54.260552] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.207 [2024-10-07 11:28:54.260582] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.207 [2024-10-07 11:28:54.260631] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.207 [2024-10-07 11:28:54.271825] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.207 [2024-10-07 11:28:54.272016] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.207 [2024-10-07 11:28:54.272060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.207 [2024-10-07 11:28:54.272089] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.207 [2024-10-07 11:28:54.272141] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.207 [2024-10-07 11:28:54.272190] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.207 [2024-10-07 11:28:54.272218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.207 [2024-10-07 11:28:54.272241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.207 [2024-10-07 11:28:54.272288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.207 [2024-10-07 11:28:54.281927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.207 [2024-10-07 11:28:54.282080] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.207 [2024-10-07 11:28:54.282132] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.207 [2024-10-07 11:28:54.282165] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.207 [2024-10-07 11:28:54.283223] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.207 [2024-10-07 11:28:54.283488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.207 [2024-10-07 11:28:54.283527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.207 [2024-10-07 11:28:54.283557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.207 [2024-10-07 11:28:54.283704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.207 [2024-10-07 11:28:54.292891] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.207 [2024-10-07 11:28:54.293046] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.207 [2024-10-07 11:28:54.293115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.207 [2024-10-07 11:28:54.293149] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.207 [2024-10-07 11:28:54.294294] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.207 [2024-10-07 11:28:54.294600] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.207 [2024-10-07 11:28:54.294642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.207 [2024-10-07 11:28:54.294672] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.207 [2024-10-07 11:28:54.295757] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.207 [2024-10-07 11:28:54.302992] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.207 [2024-10-07 11:28:54.303151] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.207 [2024-10-07 11:28:54.303207] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.207 [2024-10-07 11:28:54.303240] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.207 [2024-10-07 11:28:54.303292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.207 [2024-10-07 11:28:54.303343] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.207 [2024-10-07 11:28:54.303372] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.207 [2024-10-07 11:28:54.303398] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.207 [2024-10-07 11:28:54.303468] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.207 [2024-10-07 11:28:54.314270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.207 [2024-10-07 11:28:54.314468] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.207 [2024-10-07 11:28:54.314513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.207 [2024-10-07 11:28:54.314544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.207 [2024-10-07 11:28:54.314600] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.207 [2024-10-07 11:28:54.314651] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.207 [2024-10-07 11:28:54.314680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.207 [2024-10-07 11:28:54.314707] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.207 [2024-10-07 11:28:54.314756] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.207 [2024-10-07 11:28:54.324393] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.207 [2024-10-07 11:28:54.324588] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.207 [2024-10-07 11:28:54.324639] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.207 [2024-10-07 11:28:54.324672] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.207 [2024-10-07 11:28:54.325755] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.207 [2024-10-07 11:28:54.326010] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.207 [2024-10-07 11:28:54.326050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.207 [2024-10-07 11:28:54.326082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.207 [2024-10-07 11:28:54.326236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.207 [2024-10-07 11:28:54.335561] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.207 [2024-10-07 11:28:54.335747] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.207 [2024-10-07 11:28:54.335793] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.207 [2024-10-07 11:28:54.335856] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.207 [2024-10-07 11:28:54.337005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.207 [2024-10-07 11:28:54.337309] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.207 [2024-10-07 11:28:54.337350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.207 [2024-10-07 11:28:54.337381] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.207 [2024-10-07 11:28:54.338462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.207 [2024-10-07 11:28:54.345685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.207 [2024-10-07 11:28:54.345868] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.207 [2024-10-07 11:28:54.345926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.207 [2024-10-07 11:28:54.345961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.207 [2024-10-07 11:28:54.346283] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.207 [2024-10-07 11:28:54.346418] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.207 [2024-10-07 11:28:54.346461] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.207 [2024-10-07 11:28:54.346491] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.207 [2024-10-07 11:28:54.346546] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.207 [2024-10-07 11:28:54.356385] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.207 [2024-10-07 11:28:54.356583] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.207 [2024-10-07 11:28:54.356628] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.207 [2024-10-07 11:28:54.356659] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.207 [2024-10-07 11:28:54.357925] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.207 [2024-10-07 11:28:54.359153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.207 [2024-10-07 11:28:54.359196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.207 [2024-10-07 11:28:54.359227] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.207 [2024-10-07 11:28:54.359549] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.207 [2024-10-07 11:28:54.366516] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.207 [2024-10-07 11:28:54.367769] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.207 [2024-10-07 11:28:54.367823] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.207 [2024-10-07 11:28:54.367855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.207 [2024-10-07 11:28:54.368139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.207 [2024-10-07 11:28:54.369223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.208 [2024-10-07 11:28:54.369288] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.208 [2024-10-07 11:28:54.369321] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.208 [2024-10-07 11:28:54.369642] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.208 [2024-10-07 11:28:54.376627] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.208 [2024-10-07 11:28:54.376790] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.208 [2024-10-07 11:28:54.376847] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.208 [2024-10-07 11:28:54.376880] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.208 [2024-10-07 11:28:54.376933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.208 [2024-10-07 11:28:54.376984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.208 [2024-10-07 11:28:54.377013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.208 [2024-10-07 11:28:54.377037] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.208 [2024-10-07 11:28:54.377101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.208 [2024-10-07 11:28:54.389123] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.208 [2024-10-07 11:28:54.389468] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.208 [2024-10-07 11:28:54.389521] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.208 [2024-10-07 11:28:54.389555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.208 [2024-10-07 11:28:54.389644] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.208 [2024-10-07 11:28:54.389702] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.208 [2024-10-07 11:28:54.389733] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.208 [2024-10-07 11:28:54.389758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.208 [2024-10-07 11:28:54.389808] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.208 [2024-10-07 11:28:54.399365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.208 [2024-10-07 11:28:54.399562] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.208 [2024-10-07 11:28:54.399610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.208 [2024-10-07 11:28:54.399642] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.208 [2024-10-07 11:28:54.399694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.208 [2024-10-07 11:28:54.399744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.208 [2024-10-07 11:28:54.399773] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.208 [2024-10-07 11:28:54.399798] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.208 [2024-10-07 11:28:54.399852] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.208 [2024-10-07 11:28:54.409497] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.208 [2024-10-07 11:28:54.409665] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.208 [2024-10-07 11:28:54.409725] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.208 [2024-10-07 11:28:54.409759] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.208 [2024-10-07 11:28:54.410750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.208 [2024-10-07 11:28:54.411017] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.208 [2024-10-07 11:28:54.411058] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.208 [2024-10-07 11:28:54.411087] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.208 [2024-10-07 11:28:54.411237] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.208 [2024-10-07 11:28:54.420088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.208 [2024-10-07 11:28:54.420523] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.208 [2024-10-07 11:28:54.420574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.208 [2024-10-07 11:28:54.420607] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.208 [2024-10-07 11:28:54.420715] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.208 [2024-10-07 11:28:54.420773] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.208 [2024-10-07 11:28:54.420803] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.208 [2024-10-07 11:28:54.420828] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.208 [2024-10-07 11:28:54.420887] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.208 [2024-10-07 11:28:54.432108] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.208 [2024-10-07 11:28:54.432323] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.208 [2024-10-07 11:28:54.432379] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.208 [2024-10-07 11:28:54.432428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.208 [2024-10-07 11:28:54.432485] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.208 [2024-10-07 11:28:54.432534] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.208 [2024-10-07 11:28:54.432563] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.208 [2024-10-07 11:28:54.432589] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.208 [2024-10-07 11:28:54.432638] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.208 [2024-10-07 11:28:54.443201] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.208 [2024-10-07 11:28:54.443553] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.208 [2024-10-07 11:28:54.443603] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.208 [2024-10-07 11:28:54.443635] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.208 [2024-10-07 11:28:54.443819] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.208 [2024-10-07 11:28:54.445083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.208 [2024-10-07 11:28:54.445125] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.208 [2024-10-07 11:28:54.445155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.208 [2024-10-07 11:28:54.446376] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.208 [2024-10-07 11:28:54.454538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.208 [2024-10-07 11:28:54.455700] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.208 [2024-10-07 11:28:54.455760] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.208 [2024-10-07 11:28:54.455793] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.208 [2024-10-07 11:28:54.456058] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.208 [2024-10-07 11:28:54.456157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.208 [2024-10-07 11:28:54.456194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.208 [2024-10-07 11:28:54.456223] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.208 [2024-10-07 11:28:54.457310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.208 [2024-10-07 11:28:54.464662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.208 [2024-10-07 11:28:54.464849] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.208 [2024-10-07 11:28:54.464896] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.208 [2024-10-07 11:28:54.464927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.208 [2024-10-07 11:28:54.464981] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.208 [2024-10-07 11:28:54.465031] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.208 [2024-10-07 11:28:54.465073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.208 [2024-10-07 11:28:54.465102] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.208 [2024-10-07 11:28:54.465959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.208 [2024-10-07 11:28:54.475345] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.208 [2024-10-07 11:28:54.475573] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.208 [2024-10-07 11:28:54.475624] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.208 [2024-10-07 11:28:54.475657] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.208 [2024-10-07 11:28:54.475712] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.208 [2024-10-07 11:28:54.475763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.208 [2024-10-07 11:28:54.475792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.208 [2024-10-07 11:28:54.475859] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.208 [2024-10-07 11:28:54.475911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.208 [2024-10-07 11:28:54.485484] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.208 [2024-10-07 11:28:54.486663] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.208 [2024-10-07 11:28:54.486716] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.208 [2024-10-07 11:28:54.486748] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.209 [2024-10-07 11:28:54.487019] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.209 [2024-10-07 11:28:54.487179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.209 [2024-10-07 11:28:54.487218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.209 [2024-10-07 11:28:54.487248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.209 [2024-10-07 11:28:54.488507] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.209 [2024-10-07 11:28:54.495607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.209 [2024-10-07 11:28:54.495775] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.209 [2024-10-07 11:28:54.495831] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.209 [2024-10-07 11:28:54.495867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.209 [2024-10-07 11:28:54.495919] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.209 [2024-10-07 11:28:54.496911] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.209 [2024-10-07 11:28:54.496954] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.209 [2024-10-07 11:28:54.496984] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.209 [2024-10-07 11:28:54.497297] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.209 [2024-10-07 11:28:54.506374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.209 [2024-10-07 11:28:54.506820] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.209 [2024-10-07 11:28:54.506872] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.209 [2024-10-07 11:28:54.506905] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.209 [2024-10-07 11:28:54.507014] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.209 [2024-10-07 11:28:54.507090] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.209 [2024-10-07 11:28:54.507136] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.209 [2024-10-07 11:28:54.507168] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.209 [2024-10-07 11:28:54.507221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.209 [2024-10-07 11:28:54.518374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.209 [2024-10-07 11:28:54.518633] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.209 [2024-10-07 11:28:54.518691] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.209 [2024-10-07 11:28:54.518726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.209 [2024-10-07 11:28:54.518780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.209 [2024-10-07 11:28:54.518830] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.209 [2024-10-07 11:28:54.518859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.209 [2024-10-07 11:28:54.518883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.209 [2024-10-07 11:28:54.518933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.209 [2024-10-07 11:28:54.529707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.209 [2024-10-07 11:28:54.529876] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.209 [2024-10-07 11:28:54.529929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.209 [2024-10-07 11:28:54.529962] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.209 [2024-10-07 11:28:54.531208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.209 [2024-10-07 11:28:54.532470] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.209 [2024-10-07 11:28:54.532512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.209 [2024-10-07 11:28:54.532543] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.209 [2024-10-07 11:28:54.532821] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.209 [2024-10-07 11:28:54.540791] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.209 [2024-10-07 11:28:54.541961] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.209 [2024-10-07 11:28:54.542014] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.209 [2024-10-07 11:28:54.542047] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.209 [2024-10-07 11:28:54.542300] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.209 [2024-10-07 11:28:54.542397] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.209 [2024-10-07 11:28:54.542450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.209 [2024-10-07 11:28:54.542476] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.209 [2024-10-07 11:28:54.542530] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.209 [2024-10-07 11:28:54.551699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.209 [2024-10-07 11:28:54.551907] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.209 [2024-10-07 11:28:54.551958] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.209 [2024-10-07 11:28:54.551992] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.209 [2024-10-07 11:28:54.552076] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.209 [2024-10-07 11:28:54.552150] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.209 [2024-10-07 11:28:54.552183] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.209 [2024-10-07 11:28:54.552209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.209 [2024-10-07 11:28:54.552256] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.209 [2024-10-07 11:28:54.562774] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.209 [2024-10-07 11:28:54.563193] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.209 [2024-10-07 11:28:54.563245] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.209 [2024-10-07 11:28:54.563278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.209 [2024-10-07 11:28:54.563383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.209 [2024-10-07 11:28:54.563460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.209 [2024-10-07 11:28:54.563492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.209 [2024-10-07 11:28:54.563517] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.209 [2024-10-07 11:28:54.563565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.209 [2024-10-07 11:28:54.574883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.209 [2024-10-07 11:28:54.575104] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.209 [2024-10-07 11:28:54.575161] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.209 [2024-10-07 11:28:54.575195] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.209 [2024-10-07 11:28:54.575250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.209 [2024-10-07 11:28:54.575301] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.209 [2024-10-07 11:28:54.575329] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.209 [2024-10-07 11:28:54.575354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.209 [2024-10-07 11:28:54.575420] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.209 [2024-10-07 11:28:54.585007] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.209 [2024-10-07 11:28:54.585202] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.209 [2024-10-07 11:28:54.585255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.209 [2024-10-07 11:28:54.585288] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.209 [2024-10-07 11:28:54.586362] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.209 [2024-10-07 11:28:54.586647] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.209 [2024-10-07 11:28:54.586689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.209 [2024-10-07 11:28:54.586757] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.209 [2024-10-07 11:28:54.586910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.209 [2024-10-07 11:28:54.596095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.209 [2024-10-07 11:28:54.596279] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.209 [2024-10-07 11:28:54.596336] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.209 [2024-10-07 11:28:54.596372] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.209 [2024-10-07 11:28:54.597554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.209 [2024-10-07 11:28:54.597820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.209 [2024-10-07 11:28:54.597861] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.209 [2024-10-07 11:28:54.597891] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.210 [2024-10-07 11:28:54.598970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.210 [2024-10-07 11:28:54.606219] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.210 [2024-10-07 11:28:54.606446] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.210 [2024-10-07 11:28:54.606505] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.210 [2024-10-07 11:28:54.606541] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.210 [2024-10-07 11:28:54.606597] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.210 [2024-10-07 11:28:54.606650] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.210 [2024-10-07 11:28:54.606682] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.210 [2024-10-07 11:28:54.606708] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.210 [2024-10-07 11:28:54.606757] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.210 [2024-10-07 11:28:54.618785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.210 [2024-10-07 11:28:54.619098] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.210 [2024-10-07 11:28:54.619148] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.210 [2024-10-07 11:28:54.619170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.210 [2024-10-07 11:28:54.619228] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.210 [2024-10-07 11:28:54.619266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.210 [2024-10-07 11:28:54.619283] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.210 [2024-10-07 11:28:54.619299] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.210 [2024-10-07 11:28:54.619331] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.210 [2024-10-07 11:28:54.629358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.210 [2024-10-07 11:28:54.629539] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.210 [2024-10-07 11:28:54.629600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.210 [2024-10-07 11:28:54.629621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.210 [2024-10-07 11:28:54.629656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.210 [2024-10-07 11:28:54.629687] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.210 [2024-10-07 11:28:54.629704] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.210 [2024-10-07 11:28:54.629719] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.210 [2024-10-07 11:28:54.629749] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.210 [2024-10-07 11:28:54.639503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.210 [2024-10-07 11:28:54.639679] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.210 [2024-10-07 11:28:54.639714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.210 [2024-10-07 11:28:54.639733] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.210 [2024-10-07 11:28:54.639767] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.210 [2024-10-07 11:28:54.639797] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.210 [2024-10-07 11:28:54.639814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.210 [2024-10-07 11:28:54.639830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.210 [2024-10-07 11:28:54.639860] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.210 [2024-10-07 11:28:54.649647] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.210 [2024-10-07 11:28:54.649835] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.210 [2024-10-07 11:28:54.649869] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.210 [2024-10-07 11:28:54.649888] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.210 [2024-10-07 11:28:54.649922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.210 [2024-10-07 11:28:54.649953] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.210 [2024-10-07 11:28:54.649970] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.210 [2024-10-07 11:28:54.649986] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.210 [2024-10-07 11:28:54.650016] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.210 [2024-10-07 11:28:54.660336] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.210 [2024-10-07 11:28:54.660550] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.210 [2024-10-07 11:28:54.660587] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.210 [2024-10-07 11:28:54.660605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.210 [2024-10-07 11:28:54.660640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.210 [2024-10-07 11:28:54.660701] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.210 [2024-10-07 11:28:54.660719] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.210 [2024-10-07 11:28:54.660734] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.210 [2024-10-07 11:28:54.660765] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.210 [2024-10-07 11:28:54.671138] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.210 [2024-10-07 11:28:54.671349] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.210 [2024-10-07 11:28:54.671398] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.210 [2024-10-07 11:28:54.671437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.210 [2024-10-07 11:28:54.671475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.210 [2024-10-07 11:28:54.671506] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.210 [2024-10-07 11:28:54.671523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.210 [2024-10-07 11:28:54.671539] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.210 [2024-10-07 11:28:54.671570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.210 [2024-10-07 11:28:54.682551] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.210 [2024-10-07 11:28:54.682977] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.210 [2024-10-07 11:28:54.683024] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.210 [2024-10-07 11:28:54.683046] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.210 [2024-10-07 11:28:54.683133] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.210 [2024-10-07 11:28:54.683171] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.210 [2024-10-07 11:28:54.683189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.210 [2024-10-07 11:28:54.683205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.210 [2024-10-07 11:28:54.683236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.210 [2024-10-07 11:28:54.692824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.210 [2024-10-07 11:28:54.693014] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.210 [2024-10-07 11:28:54.693049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.210 [2024-10-07 11:28:54.693085] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.210 [2024-10-07 11:28:54.693131] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.210 [2024-10-07 11:28:54.693164] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.210 [2024-10-07 11:28:54.693182] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.210 [2024-10-07 11:28:54.693197] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.210 [2024-10-07 11:28:54.693260] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.210 [2024-10-07 11:28:54.702982] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.210 [2024-10-07 11:28:54.704130] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.210 [2024-10-07 11:28:54.704190] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.210 [2024-10-07 11:28:54.704213] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.210 [2024-10-07 11:28:54.704431] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.210 [2024-10-07 11:28:54.704530] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.210 [2024-10-07 11:28:54.704561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.210 [2024-10-07 11:28:54.704579] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.210 [2024-10-07 11:28:54.704616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.210 [2024-10-07 11:28:54.713129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.210 [2024-10-07 11:28:54.714019] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.210 [2024-10-07 11:28:54.714078] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.210 [2024-10-07 11:28:54.714100] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.210 [2024-10-07 11:28:54.714750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.211 [2024-10-07 11:28:54.715092] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.211 [2024-10-07 11:28:54.715133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.211 [2024-10-07 11:28:54.715152] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.211 [2024-10-07 11:28:54.715228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.211 [2024-10-07 11:28:54.723277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.211 [2024-10-07 11:28:54.723484] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.211 [2024-10-07 11:28:54.723521] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.211 [2024-10-07 11:28:54.723540] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.211 [2024-10-07 11:28:54.724563] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.211 [2024-10-07 11:28:54.724800] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.211 [2024-10-07 11:28:54.724835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.211 [2024-10-07 11:28:54.724854] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.211 [2024-10-07 11:28:54.724916] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.211 [2024-10-07 11:28:54.733455] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.211 [2024-10-07 11:28:54.733624] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.211 [2024-10-07 11:28:54.733660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.211 [2024-10-07 11:28:54.733709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.211 [2024-10-07 11:28:54.733983] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.211 [2024-10-07 11:28:54.734082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.211 [2024-10-07 11:28:54.734111] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.211 [2024-10-07 11:28:54.734128] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.211 [2024-10-07 11:28:54.734162] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.211 [2024-10-07 11:28:54.744730] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.211 [2024-10-07 11:28:54.744957] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.211 [2024-10-07 11:28:54.745003] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.211 [2024-10-07 11:28:54.745022] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.211 [2024-10-07 11:28:54.745070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.211 [2024-10-07 11:28:54.745105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.211 [2024-10-07 11:28:54.745122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.211 [2024-10-07 11:28:54.745137] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.211 [2024-10-07 11:28:54.745168] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.211 [2024-10-07 11:28:54.755189] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.211 [2024-10-07 11:28:54.755391] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.211 [2024-10-07 11:28:54.755442] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.211 [2024-10-07 11:28:54.755462] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.211 [2024-10-07 11:28:54.755497] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.211 [2024-10-07 11:28:54.755528] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.211 [2024-10-07 11:28:54.755546] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.211 [2024-10-07 11:28:54.755561] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.211 [2024-10-07 11:28:54.755592] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.211 [2024-10-07 11:28:54.766038] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.211 [2024-10-07 11:28:54.766220] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.211 [2024-10-07 11:28:54.766266] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.211 [2024-10-07 11:28:54.766284] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.211 [2024-10-07 11:28:54.766495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.211 [2024-10-07 11:28:54.766650] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.211 [2024-10-07 11:28:54.766716] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.211 [2024-10-07 11:28:54.766736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.211 [2024-10-07 11:28:54.766795] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.211 [2024-10-07 11:28:54.776847] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.211 [2024-10-07 11:28:54.777039] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.211 [2024-10-07 11:28:54.777090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.211 [2024-10-07 11:28:54.777109] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.211 [2024-10-07 11:28:54.777145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.211 [2024-10-07 11:28:54.777176] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.211 [2024-10-07 11:28:54.777195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.211 [2024-10-07 11:28:54.777210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.211 [2024-10-07 11:28:54.777241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.211 [2024-10-07 11:28:54.787001] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.211 [2024-10-07 11:28:54.787182] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.211 [2024-10-07 11:28:54.787217] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.211 [2024-10-07 11:28:54.787235] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.211 [2024-10-07 11:28:54.787526] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.211 [2024-10-07 11:28:54.787607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.211 [2024-10-07 11:28:54.787632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.211 [2024-10-07 11:28:54.787648] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.211 [2024-10-07 11:28:54.787680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.211 [2024-10-07 11:28:54.797145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.211 [2024-10-07 11:28:54.797312] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.211 [2024-10-07 11:28:54.797347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.211 [2024-10-07 11:28:54.797365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.211 [2024-10-07 11:28:54.797415] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.211 [2024-10-07 11:28:54.797451] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.211 [2024-10-07 11:28:54.797468] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.211 [2024-10-07 11:28:54.797483] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.211 [2024-10-07 11:28:54.797513] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.211 [2024-10-07 11:28:54.807274] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.211 [2024-10-07 11:28:54.807510] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.211 [2024-10-07 11:28:54.807548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.211 [2024-10-07 11:28:54.807567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.211 [2024-10-07 11:28:54.807602] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.211 [2024-10-07 11:28:54.807634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.211 [2024-10-07 11:28:54.807650] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.212 [2024-10-07 11:28:54.807665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.212 [2024-10-07 11:28:54.807696] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.212 [2024-10-07 11:28:54.819479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.212 [2024-10-07 11:28:54.819680] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.212 [2024-10-07 11:28:54.819717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.212 [2024-10-07 11:28:54.819735] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.212 [2024-10-07 11:28:54.819934] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.212 [2024-10-07 11:28:54.820136] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.212 [2024-10-07 11:28:54.820189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.212 [2024-10-07 11:28:54.820212] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.212 [2024-10-07 11:28:54.820295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.212 [2024-10-07 11:28:54.830593] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.212 [2024-10-07 11:28:54.830820] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.212 [2024-10-07 11:28:54.830869] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.212 [2024-10-07 11:28:54.830897] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.212 [2024-10-07 11:28:54.831976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.212 [2024-10-07 11:28:54.832205] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.212 [2024-10-07 11:28:54.832237] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.212 [2024-10-07 11:28:54.832256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.212 [2024-10-07 11:28:54.832319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.212 [2024-10-07 11:28:54.840898] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.212 [2024-10-07 11:28:54.841189] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.212 [2024-10-07 11:28:54.841242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.212 [2024-10-07 11:28:54.841277] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.212 [2024-10-07 11:28:54.841365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.212 [2024-10-07 11:28:54.841435] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.212 [2024-10-07 11:28:54.841462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.212 [2024-10-07 11:28:54.841489] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.212 [2024-10-07 11:28:54.841532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.212 [2024-10-07 11:28:54.851660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.212 [2024-10-07 11:28:54.851848] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.212 [2024-10-07 11:28:54.851885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.212 [2024-10-07 11:28:54.851903] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.212 [2024-10-07 11:28:54.851938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.212 [2024-10-07 11:28:54.851969] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.212 [2024-10-07 11:28:54.851986] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.212 [2024-10-07 11:28:54.852001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.212 [2024-10-07 11:28:54.852031] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.212 [2024-10-07 11:28:54.861802] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.212 [2024-10-07 11:28:54.861980] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.212 [2024-10-07 11:28:54.862014] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.212 [2024-10-07 11:28:54.862032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.212 [2024-10-07 11:28:54.862066] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.212 [2024-10-07 11:28:54.862098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.212 [2024-10-07 11:28:54.862115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.212 [2024-10-07 11:28:54.862131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.212 [2024-10-07 11:28:54.862161] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.212 [2024-10-07 11:28:54.872036] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.212 [2024-10-07 11:28:54.872230] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.212 [2024-10-07 11:28:54.872265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.212 [2024-10-07 11:28:54.872283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.212 [2024-10-07 11:28:54.872318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.212 [2024-10-07 11:28:54.872349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.212 [2024-10-07 11:28:54.872367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.212 [2024-10-07 11:28:54.872440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.212 [2024-10-07 11:28:54.872476] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.212 [2024-10-07 11:28:54.883337] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.212 [2024-10-07 11:28:54.883515] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.212 [2024-10-07 11:28:54.883551] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.212 [2024-10-07 11:28:54.883569] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.212 [2024-10-07 11:28:54.883603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.212 [2024-10-07 11:28:54.883634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.212 [2024-10-07 11:28:54.883651] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.212 [2024-10-07 11:28:54.883666] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.212 [2024-10-07 11:28:54.884680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.212 [2024-10-07 11:28:54.893481] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.212 [2024-10-07 11:28:54.893647] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.212 [2024-10-07 11:28:54.893682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.212 [2024-10-07 11:28:54.893699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.212 [2024-10-07 11:28:54.893758] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.212 [2024-10-07 11:28:54.893792] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.212 [2024-10-07 11:28:54.893809] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.212 [2024-10-07 11:28:54.893825] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.212 [2024-10-07 11:28:54.893855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.212 [2024-10-07 11:28:54.904164] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.212 [2024-10-07 11:28:54.904336] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.212 [2024-10-07 11:28:54.904372] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.212 [2024-10-07 11:28:54.904391] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.212 [2024-10-07 11:28:54.904445] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.212 [2024-10-07 11:28:54.904477] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.212 [2024-10-07 11:28:54.904494] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.212 [2024-10-07 11:28:54.904511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.212 [2024-10-07 11:28:54.904541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.212 [2024-10-07 11:28:54.914299] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.212 [2024-10-07 11:28:54.914530] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.212 [2024-10-07 11:28:54.914568] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.212 [2024-10-07 11:28:54.914593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.212 [2024-10-07 11:28:54.914630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.212 [2024-10-07 11:28:54.914661] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.212 [2024-10-07 11:28:54.914678] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.212 [2024-10-07 11:28:54.914692] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.212 [2024-10-07 11:28:54.914724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.212 [2024-10-07 11:28:54.925037] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.212 [2024-10-07 11:28:54.925226] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.212 [2024-10-07 11:28:54.925262] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.212 [2024-10-07 11:28:54.925281] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.213 [2024-10-07 11:28:54.925495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.213 [2024-10-07 11:28:54.925652] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.213 [2024-10-07 11:28:54.925685] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.213 [2024-10-07 11:28:54.925703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.213 [2024-10-07 11:28:54.925758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.213 [2024-10-07 11:28:54.935652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.213 [2024-10-07 11:28:54.935841] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.213 [2024-10-07 11:28:54.935877] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.213 [2024-10-07 11:28:54.935896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.213 [2024-10-07 11:28:54.936921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.213 [2024-10-07 11:28:54.937172] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.213 [2024-10-07 11:28:54.937201] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.213 [2024-10-07 11:28:54.937217] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.213 [2024-10-07 11:28:54.937277] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.213 [2024-10-07 11:28:54.945827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.213 [2024-10-07 11:28:54.946009] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.213 [2024-10-07 11:28:54.946044] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.213 [2024-10-07 11:28:54.946062] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.213 [2024-10-07 11:28:54.946096] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.213 [2024-10-07 11:28:54.946162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.213 [2024-10-07 11:28:54.946181] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.213 [2024-10-07 11:28:54.946196] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.213 [2024-10-07 11:28:54.946226] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.213 [2024-10-07 11:28:54.956199] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.213 [2024-10-07 11:28:54.956387] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.213 [2024-10-07 11:28:54.956439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.213 [2024-10-07 11:28:54.956458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.213 [2024-10-07 11:28:54.956494] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.213 [2024-10-07 11:28:54.956525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.213 [2024-10-07 11:28:54.956542] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.213 [2024-10-07 11:28:54.956557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.213 [2024-10-07 11:28:54.956587] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.213 [2024-10-07 11:28:54.966349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.213 [2024-10-07 11:28:54.966569] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.213 [2024-10-07 11:28:54.966608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.213 [2024-10-07 11:28:54.966628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.213 [2024-10-07 11:28:54.967575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.213 [2024-10-07 11:28:54.967815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.213 [2024-10-07 11:28:54.967843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.213 [2024-10-07 11:28:54.967859] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.213 [2024-10-07 11:28:54.967939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.213 [2024-10-07 11:28:54.976512] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.213 [2024-10-07 11:28:54.976692] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.213 [2024-10-07 11:28:54.976726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.213 [2024-10-07 11:28:54.976744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.213 [2024-10-07 11:28:54.976778] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.213 [2024-10-07 11:28:54.976809] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.213 [2024-10-07 11:28:54.976826] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.213 [2024-10-07 11:28:54.976842] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.213 [2024-10-07 11:28:54.976905] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.213 [2024-10-07 11:28:54.986693] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.213 [2024-10-07 11:28:54.986884] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.213 [2024-10-07 11:28:54.986920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.213 [2024-10-07 11:28:54.986940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.213 [2024-10-07 11:28:54.987965] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.213 [2024-10-07 11:28:54.988199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.213 [2024-10-07 11:28:54.988235] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.213 [2024-10-07 11:28:54.988255] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.213 [2024-10-07 11:28:54.988316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.213 [2024-10-07 11:28:54.996842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.213 [2024-10-07 11:28:54.997019] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.213 [2024-10-07 11:28:54.997068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.213 [2024-10-07 11:28:54.997090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.213 [2024-10-07 11:28:54.997143] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.213 [2024-10-07 11:28:54.997178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.213 [2024-10-07 11:28:54.997195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.213 [2024-10-07 11:28:54.997210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.213 [2024-10-07 11:28:54.997241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.213 [2024-10-07 11:28:55.006980] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.213 [2024-10-07 11:28:55.007161] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.213 [2024-10-07 11:28:55.007196] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.213 [2024-10-07 11:28:55.007214] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.213 [2024-10-07 11:28:55.008246] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.213 [2024-10-07 11:28:55.008480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.213 [2024-10-07 11:28:55.008515] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.213 [2024-10-07 11:28:55.008534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.213 [2024-10-07 11:28:55.008605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.213 [2024-10-07 11:28:55.017129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.213 [2024-10-07 11:28:55.017327] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.213 [2024-10-07 11:28:55.017364] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.213 [2024-10-07 11:28:55.017436] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.213 [2024-10-07 11:28:55.017475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.213 [2024-10-07 11:28:55.017507] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.213 [2024-10-07 11:28:55.017524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.213 [2024-10-07 11:28:55.017539] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.213 [2024-10-07 11:28:55.017569] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.213 [2024-10-07 11:28:55.027289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.213 [2024-10-07 11:28:55.027495] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.213 [2024-10-07 11:28:55.027531] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.213 [2024-10-07 11:28:55.027549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.213 [2024-10-07 11:28:55.027584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.213 [2024-10-07 11:28:55.027615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.213 [2024-10-07 11:28:55.027633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.213 [2024-10-07 11:28:55.027648] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.213 [2024-10-07 11:28:55.028853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.213 [2024-10-07 11:28:55.037632] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.213 [2024-10-07 11:28:55.037818] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.214 [2024-10-07 11:28:55.037854] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.214 [2024-10-07 11:28:55.037871] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.214 [2024-10-07 11:28:55.037906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.214 [2024-10-07 11:28:55.037937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.214 [2024-10-07 11:28:55.037954] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.214 [2024-10-07 11:28:55.037969] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.214 [2024-10-07 11:28:55.037999] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.214 [2024-10-07 11:28:55.048624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.214 [2024-10-07 11:28:55.048811] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.214 [2024-10-07 11:28:55.048847] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.214 [2024-10-07 11:28:55.048865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.214 [2024-10-07 11:28:55.048899] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.214 [2024-10-07 11:28:55.048961] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.214 [2024-10-07 11:28:55.048981] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.214 [2024-10-07 11:28:55.048996] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.214 [2024-10-07 11:28:55.049026] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.214 [2024-10-07 11:28:55.059708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.214 [2024-10-07 11:28:55.059898] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.214 [2024-10-07 11:28:55.059935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.214 [2024-10-07 11:28:55.059953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.214 [2024-10-07 11:28:55.060979] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.214 [2024-10-07 11:28:55.061231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.214 [2024-10-07 11:28:55.061270] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.214 [2024-10-07 11:28:55.061289] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.214 [2024-10-07 11:28:55.061351] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.214 [2024-10-07 11:28:55.069855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.214 [2024-10-07 11:28:55.070049] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.214 [2024-10-07 11:28:55.070086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.214 [2024-10-07 11:28:55.070104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.214 [2024-10-07 11:28:55.070374] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.214 [2024-10-07 11:28:55.070482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.214 [2024-10-07 11:28:55.070517] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.214 [2024-10-07 11:28:55.070542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.214 [2024-10-07 11:28:55.070577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.214 [2024-10-07 11:28:55.079986] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.214 [2024-10-07 11:28:55.080156] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.214 [2024-10-07 11:28:55.080190] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.214 [2024-10-07 11:28:55.080209] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.214 [2024-10-07 11:28:55.080242] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.214 [2024-10-07 11:28:55.080284] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.214 [2024-10-07 11:28:55.080300] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.214 [2024-10-07 11:28:55.080315] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.214 [2024-10-07 11:28:55.080345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.214 [2024-10-07 11:28:55.090114] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.214 [2024-10-07 11:28:55.090290] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.214 [2024-10-07 11:28:55.090326] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.214 [2024-10-07 11:28:55.090344] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.214 [2024-10-07 11:28:55.090378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.214 [2024-10-07 11:28:55.090426] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.214 [2024-10-07 11:28:55.090447] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.214 [2024-10-07 11:28:55.090477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.214 [2024-10-07 11:28:55.090524] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.214 8238.33 IOPS, 32.18 MiB/s [2024-10-07T11:29:07.925Z] [2024-10-07 11:28:55.101077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.214 [2024-10-07 11:28:55.101248] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.214 [2024-10-07 11:28:55.101284] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.214 [2024-10-07 11:28:55.101302] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.214 [2024-10-07 11:28:55.101336] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.214 [2024-10-07 11:28:55.101367] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.214 [2024-10-07 11:28:55.101384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.214 [2024-10-07 11:28:55.101415] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.214 [2024-10-07 11:28:55.101450] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.214 [2024-10-07 11:28:55.112041] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.214 [2024-10-07 11:28:55.112279] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.214 [2024-10-07 11:28:55.112316] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.214 [2024-10-07 11:28:55.112334] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.214 [2024-10-07 11:28:55.112370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.214 [2024-10-07 11:28:55.112417] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.214 [2024-10-07 11:28:55.112439] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.214 [2024-10-07 11:28:55.112454] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.214 [2024-10-07 11:28:55.112486] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.214 [2024-10-07 11:28:55.123580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.214 [2024-10-07 11:28:55.123778] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.214 [2024-10-07 11:28:55.123814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.214 [2024-10-07 11:28:55.123865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.214 [2024-10-07 11:28:55.123902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.214 [2024-10-07 11:28:55.123936] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.214 [2024-10-07 11:28:55.123963] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.214 [2024-10-07 11:28:55.123979] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.214 [2024-10-07 11:28:55.124011] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.214 [2024-10-07 11:28:55.134417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.214 [2024-10-07 11:28:55.134633] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.214 [2024-10-07 11:28:55.134671] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.214 [2024-10-07 11:28:55.134690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.214 [2024-10-07 11:28:55.134724] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.214 [2024-10-07 11:28:55.134756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.214 [2024-10-07 11:28:55.134774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.214 [2024-10-07 11:28:55.134789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.214 [2024-10-07 11:28:55.134819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.214 [2024-10-07 11:28:55.144592] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.214 [2024-10-07 11:28:55.144783] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.214 [2024-10-07 11:28:55.144817] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.214 [2024-10-07 11:28:55.144836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.214 [2024-10-07 11:28:55.144871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.214 [2024-10-07 11:28:55.144915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.214 [2024-10-07 11:28:55.144933] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.215 [2024-10-07 11:28:55.144949] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.215 [2024-10-07 11:28:55.144978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.215 [2024-10-07 11:28:55.155980] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.215 [2024-10-07 11:28:55.156177] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.215 [2024-10-07 11:28:55.156214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.215 [2024-10-07 11:28:55.156232] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.215 [2024-10-07 11:28:55.156267] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.215 [2024-10-07 11:28:55.156298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.215 [2024-10-07 11:28:55.156348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.215 [2024-10-07 11:28:55.156366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.215 [2024-10-07 11:28:55.156398] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.215 [2024-10-07 11:28:55.166135] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.215 [2024-10-07 11:28:55.166330] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.215 [2024-10-07 11:28:55.166367] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.215 [2024-10-07 11:28:55.166385] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.215 [2024-10-07 11:28:55.166438] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.215 [2024-10-07 11:28:55.166473] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.215 [2024-10-07 11:28:55.166491] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.215 [2024-10-07 11:28:55.166506] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.215 [2024-10-07 11:28:55.166536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.215 [2024-10-07 11:28:55.177759] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.215 [2024-10-07 11:28:55.177979] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.215 [2024-10-07 11:28:55.178016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.215 [2024-10-07 11:28:55.178035] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.215 [2024-10-07 11:28:55.178070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.215 [2024-10-07 11:28:55.178102] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.215 [2024-10-07 11:28:55.178119] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.215 [2024-10-07 11:28:55.178135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.215 [2024-10-07 11:28:55.178170] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.215 [2024-10-07 11:28:55.187915] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.215 [2024-10-07 11:28:55.188094] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.215 [2024-10-07 11:28:55.188129] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.215 [2024-10-07 11:28:55.188147] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.215 [2024-10-07 11:28:55.189200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.215 [2024-10-07 11:28:55.189441] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.215 [2024-10-07 11:28:55.189476] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.215 [2024-10-07 11:28:55.189501] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.215 [2024-10-07 11:28:55.189615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.215 [2024-10-07 11:28:55.198981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.215 [2024-10-07 11:28:55.199159] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.215 [2024-10-07 11:28:55.199195] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.215 [2024-10-07 11:28:55.199214] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.215 [2024-10-07 11:28:55.200320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.215 [2024-10-07 11:28:55.200576] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.215 [2024-10-07 11:28:55.200616] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.215 [2024-10-07 11:28:55.200635] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.215 [2024-10-07 11:28:55.201703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.215 [2024-10-07 11:28:55.209125] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.215 [2024-10-07 11:28:55.209311] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.215 [2024-10-07 11:28:55.209347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.215 [2024-10-07 11:28:55.209365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.215 [2024-10-07 11:28:55.209414] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.215 [2024-10-07 11:28:55.209450] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.215 [2024-10-07 11:28:55.209468] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.215 [2024-10-07 11:28:55.209483] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.215 [2024-10-07 11:28:55.209514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.215 [2024-10-07 11:28:55.220430] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.215 [2024-10-07 11:28:55.220652] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.215 [2024-10-07 11:28:55.220690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.215 [2024-10-07 11:28:55.220708] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.215 [2024-10-07 11:28:55.220743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.215 [2024-10-07 11:28:55.220775] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.215 [2024-10-07 11:28:55.220792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.215 [2024-10-07 11:28:55.220808] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.215 [2024-10-07 11:28:55.220839] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.215 [2024-10-07 11:28:55.230601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.215 [2024-10-07 11:28:55.231784] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.215 [2024-10-07 11:28:55.231835] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.215 [2024-10-07 11:28:55.231857] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.215 [2024-10-07 11:28:55.232089] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.215 [2024-10-07 11:28:55.232219] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.215 [2024-10-07 11:28:55.232248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.215 [2024-10-07 11:28:55.232267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.215 [2024-10-07 11:28:55.233510] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.215 [2024-10-07 11:28:55.241686] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.215 [2024-10-07 11:28:55.241869] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.215 [2024-10-07 11:28:55.241905] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.215 [2024-10-07 11:28:55.241923] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.215 [2024-10-07 11:28:55.243034] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.215 [2024-10-07 11:28:55.243272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.215 [2024-10-07 11:28:55.243307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.215 [2024-10-07 11:28:55.243326] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.215 [2024-10-07 11:28:55.244342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.216 [2024-10-07 11:28:55.251824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.216 [2024-10-07 11:28:55.252009] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.216 [2024-10-07 11:28:55.252045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.216 [2024-10-07 11:28:55.252063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.216 [2024-10-07 11:28:55.252097] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.216 [2024-10-07 11:28:55.252128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.216 [2024-10-07 11:28:55.252145] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.216 [2024-10-07 11:28:55.252162] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.216 [2024-10-07 11:28:55.252203] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.216 [2024-10-07 11:28:55.263268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.216 [2024-10-07 11:28:55.263481] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.216 [2024-10-07 11:28:55.263518] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.216 [2024-10-07 11:28:55.263537] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.216 [2024-10-07 11:28:55.263573] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.216 [2024-10-07 11:28:55.263604] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.216 [2024-10-07 11:28:55.263623] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.216 [2024-10-07 11:28:55.263671] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.216 [2024-10-07 11:28:55.263705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.216 [2024-10-07 11:28:55.273438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.216 [2024-10-07 11:28:55.274644] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.216 [2024-10-07 11:28:55.274692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.216 [2024-10-07 11:28:55.274714] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.216 [2024-10-07 11:28:55.274915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.216 [2024-10-07 11:28:55.275034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.216 [2024-10-07 11:28:55.275074] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.216 [2024-10-07 11:28:55.275092] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.216 [2024-10-07 11:28:55.276295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.216 [2024-10-07 11:28:55.284418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.216 [2024-10-07 11:28:55.284627] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.216 [2024-10-07 11:28:55.284664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.216 [2024-10-07 11:28:55.284683] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.216 [2024-10-07 11:28:55.285815] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.216 [2024-10-07 11:28:55.286048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.216 [2024-10-07 11:28:55.286084] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.216 [2024-10-07 11:28:55.286104] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.216 [2024-10-07 11:28:55.287135] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.216 [2024-10-07 11:28:55.294591] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.216 [2024-10-07 11:28:55.294772] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.216 [2024-10-07 11:28:55.294807] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.216 [2024-10-07 11:28:55.294825] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.216 [2024-10-07 11:28:55.294859] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.216 [2024-10-07 11:28:55.294890] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.216 [2024-10-07 11:28:55.294907] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.216 [2024-10-07 11:28:55.294933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.216 [2024-10-07 11:28:55.294965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.216 [2024-10-07 11:28:55.305983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.216 [2024-10-07 11:28:55.306209] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.216 [2024-10-07 11:28:55.306250] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.216 [2024-10-07 11:28:55.306269] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.216 [2024-10-07 11:28:55.306303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.216 [2024-10-07 11:28:55.306334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.216 [2024-10-07 11:28:55.306351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.216 [2024-10-07 11:28:55.306367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.216 [2024-10-07 11:28:55.306415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.216 [2024-10-07 11:28:55.316171] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.216 [2024-10-07 11:28:55.317392] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.216 [2024-10-07 11:28:55.317455] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.216 [2024-10-07 11:28:55.317477] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.216 [2024-10-07 11:28:55.317682] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.216 [2024-10-07 11:28:55.317804] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.216 [2024-10-07 11:28:55.317831] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.216 [2024-10-07 11:28:55.317849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.216 [2024-10-07 11:28:55.319059] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.216 [2024-10-07 11:28:55.327230] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.216 [2024-10-07 11:28:55.327452] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.216 [2024-10-07 11:28:55.327490] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.216 [2024-10-07 11:28:55.327508] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.216 [2024-10-07 11:28:55.328639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.216 [2024-10-07 11:28:55.328878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.216 [2024-10-07 11:28:55.328906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.216 [2024-10-07 11:28:55.328923] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.216 [2024-10-07 11:28:55.329962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.216 [2024-10-07 11:28:55.337395] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.216 [2024-10-07 11:28:55.337610] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.216 [2024-10-07 11:28:55.337647] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.216 [2024-10-07 11:28:55.337666] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.216 [2024-10-07 11:28:55.337701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.216 [2024-10-07 11:28:55.337761] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.216 [2024-10-07 11:28:55.337778] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.216 [2024-10-07 11:28:55.337795] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.216 [2024-10-07 11:28:55.337826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.216 [2024-10-07 11:28:55.348798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.216 [2024-10-07 11:28:55.349000] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.216 [2024-10-07 11:28:55.349036] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.216 [2024-10-07 11:28:55.349069] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.216 [2024-10-07 11:28:55.349110] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.216 [2024-10-07 11:28:55.349142] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.216 [2024-10-07 11:28:55.349159] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.216 [2024-10-07 11:28:55.349175] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.216 [2024-10-07 11:28:55.349206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.216 [2024-10-07 11:28:55.359953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.216 [2024-10-07 11:28:55.360315] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.216 [2024-10-07 11:28:55.360355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.216 [2024-10-07 11:28:55.360374] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.217 [2024-10-07 11:28:55.360530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.217 [2024-10-07 11:28:55.361772] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.217 [2024-10-07 11:28:55.361809] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.217 [2024-10-07 11:28:55.361830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.217 [2024-10-07 11:28:55.363000] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.217 [2024-10-07 11:28:55.371380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.217 [2024-10-07 11:28:55.372589] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.217 [2024-10-07 11:28:55.372638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.217 [2024-10-07 11:28:55.372660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.217 [2024-10-07 11:28:55.372910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.217 [2024-10-07 11:28:55.372951] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.217 [2024-10-07 11:28:55.372969] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.217 [2024-10-07 11:28:55.372986] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.217 [2024-10-07 11:28:55.373051] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.217 [2024-10-07 11:28:55.382343] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.217 [2024-10-07 11:28:55.382585] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.217 [2024-10-07 11:28:55.382623] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.217 [2024-10-07 11:28:55.382642] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.217 [2024-10-07 11:28:55.382676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.217 [2024-10-07 11:28:55.382725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.217 [2024-10-07 11:28:55.382745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.217 [2024-10-07 11:28:55.382761] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.217 [2024-10-07 11:28:55.382793] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.217 [2024-10-07 11:28:55.393478] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.217 [2024-10-07 11:28:55.393909] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.217 [2024-10-07 11:28:55.393957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.217 [2024-10-07 11:28:55.393979] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.217 [2024-10-07 11:28:55.394053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.217 [2024-10-07 11:28:55.394090] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.217 [2024-10-07 11:28:55.394108] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.217 [2024-10-07 11:28:55.394125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.217 [2024-10-07 11:28:55.394156] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.217 [2024-10-07 11:28:55.405592] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.217 [2024-10-07 11:28:55.405808] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.217 [2024-10-07 11:28:55.405845] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.217 [2024-10-07 11:28:55.405863] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.217 [2024-10-07 11:28:55.405899] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.217 [2024-10-07 11:28:55.405931] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.217 [2024-10-07 11:28:55.405948] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.217 [2024-10-07 11:28:55.405963] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.217 [2024-10-07 11:28:55.405994] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.217 [2024-10-07 11:28:55.415746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.217 [2024-10-07 11:28:55.416958] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.217 [2024-10-07 11:28:55.417041] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.217 [2024-10-07 11:28:55.417082] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.217 [2024-10-07 11:28:55.417308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.217 [2024-10-07 11:28:55.417446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.217 [2024-10-07 11:28:55.417469] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.217 [2024-10-07 11:28:55.417486] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.217 [2024-10-07 11:28:55.418696] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.217 [2024-10-07 11:28:55.426834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.217 [2024-10-07 11:28:55.427033] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.217 [2024-10-07 11:28:55.427069] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.217 [2024-10-07 11:28:55.427087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.217 [2024-10-07 11:28:55.428208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.217 [2024-10-07 11:28:55.428458] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.217 [2024-10-07 11:28:55.428497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.217 [2024-10-07 11:28:55.428522] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.217 [2024-10-07 11:28:55.429570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.217 [2024-10-07 11:28:55.436992] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.217 [2024-10-07 11:28:55.437241] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.217 [2024-10-07 11:28:55.437299] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.217 [2024-10-07 11:28:55.437335] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.217 [2024-10-07 11:28:55.437382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.217 [2024-10-07 11:28:55.437460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.217 [2024-10-07 11:28:55.437492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.217 [2024-10-07 11:28:55.437521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.217 [2024-10-07 11:28:55.437574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.217 [2024-10-07 11:28:55.448588] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.217 [2024-10-07 11:28:55.448814] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.217 [2024-10-07 11:28:55.448851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.217 [2024-10-07 11:28:55.448870] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.217 [2024-10-07 11:28:55.448907] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.217 [2024-10-07 11:28:55.448967] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.217 [2024-10-07 11:28:55.448986] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.217 [2024-10-07 11:28:55.449002] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.217 [2024-10-07 11:28:55.449033] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.217 [2024-10-07 11:28:55.458750] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.217 [2024-10-07 11:28:55.458944] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.217 [2024-10-07 11:28:55.458980] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.217 [2024-10-07 11:28:55.458998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.217 [2024-10-07 11:28:55.460027] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.217 [2024-10-07 11:28:55.460264] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.217 [2024-10-07 11:28:55.460299] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.217 [2024-10-07 11:28:55.460319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.217 [2024-10-07 11:28:55.460447] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.217 [2024-10-07 11:28:55.469917] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.217 [2024-10-07 11:28:55.470111] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.217 [2024-10-07 11:28:55.470146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.217 [2024-10-07 11:28:55.470165] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.217 [2024-10-07 11:28:55.471274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.217 [2024-10-07 11:28:55.471517] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.217 [2024-10-07 11:28:55.471551] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.217 [2024-10-07 11:28:55.471570] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.217 [2024-10-07 11:28:55.472599] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.217 [2024-10-07 11:28:55.480067] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.217 [2024-10-07 11:28:55.480248] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.217 [2024-10-07 11:28:55.480285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.217 [2024-10-07 11:28:55.480303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.217 [2024-10-07 11:28:55.480338] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.217 [2024-10-07 11:28:55.480369] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.218 [2024-10-07 11:28:55.480386] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.218 [2024-10-07 11:28:55.480415] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.218 [2024-10-07 11:28:55.480453] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.218 [2024-10-07 11:28:55.491555] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.218 [2024-10-07 11:28:55.491760] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.218 [2024-10-07 11:28:55.491796] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.218 [2024-10-07 11:28:55.491815] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.218 [2024-10-07 11:28:55.491850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.218 [2024-10-07 11:28:55.491881] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.218 [2024-10-07 11:28:55.491898] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.218 [2024-10-07 11:28:55.491914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.218 [2024-10-07 11:28:55.491945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.218 [2024-10-07 11:28:55.501722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.218 [2024-10-07 11:28:55.502944] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.218 [2024-10-07 11:28:55.503013] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.218 [2024-10-07 11:28:55.503052] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.218 [2024-10-07 11:28:55.503320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.218 [2024-10-07 11:28:55.503474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.218 [2024-10-07 11:28:55.503502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.218 [2024-10-07 11:28:55.503520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.218 [2024-10-07 11:28:55.504736] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.218 [2024-10-07 11:28:55.512846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.218 [2024-10-07 11:28:55.513021] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.218 [2024-10-07 11:28:55.513069] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.218 [2024-10-07 11:28:55.513090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.218 [2024-10-07 11:28:55.514197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.218 [2024-10-07 11:28:55.514442] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.218 [2024-10-07 11:28:55.514476] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.218 [2024-10-07 11:28:55.514495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.218 [2024-10-07 11:28:55.515510] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.218 [2024-10-07 11:28:55.522976] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.218 [2024-10-07 11:28:55.523128] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.218 [2024-10-07 11:28:55.523162] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.218 [2024-10-07 11:28:55.523210] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.218 [2024-10-07 11:28:55.523246] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.218 [2024-10-07 11:28:55.523277] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.218 [2024-10-07 11:28:55.523294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.218 [2024-10-07 11:28:55.523309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.218 [2024-10-07 11:28:55.523339] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.218 [2024-10-07 11:28:55.534332] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.218 [2024-10-07 11:28:55.534503] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.218 [2024-10-07 11:28:55.534537] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.218 [2024-10-07 11:28:55.534555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.218 [2024-10-07 11:28:55.534589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.218 [2024-10-07 11:28:55.534621] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.218 [2024-10-07 11:28:55.534637] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.218 [2024-10-07 11:28:55.534652] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.218 [2024-10-07 11:28:55.534682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.218 [2024-10-07 11:28:55.544472] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.218 [2024-10-07 11:28:55.545617] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.218 [2024-10-07 11:28:55.545664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.218 [2024-10-07 11:28:55.545685] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.218 [2024-10-07 11:28:55.545895] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.218 [2024-10-07 11:28:55.547160] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.218 [2024-10-07 11:28:55.547199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.218 [2024-10-07 11:28:55.547218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.218 [2024-10-07 11:28:55.548384] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.218 [2024-10-07 11:28:55.555522] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.218 [2024-10-07 11:28:55.555671] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.218 [2024-10-07 11:28:55.555705] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.218 [2024-10-07 11:28:55.555723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.218 [2024-10-07 11:28:55.556833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.218 [2024-10-07 11:28:55.557092] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.218 [2024-10-07 11:28:55.557154] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.218 [2024-10-07 11:28:55.557174] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.218 [2024-10-07 11:28:55.558190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.218 [2024-10-07 11:28:55.565635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.218 [2024-10-07 11:28:55.565777] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.218 [2024-10-07 11:28:55.565811] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.218 [2024-10-07 11:28:55.565838] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.218 [2024-10-07 11:28:55.565871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.218 [2024-10-07 11:28:55.565901] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.218 [2024-10-07 11:28:55.565918] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.218 [2024-10-07 11:28:55.565933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.218 [2024-10-07 11:28:55.565962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.218 [2024-10-07 11:28:55.577164] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.218 [2024-10-07 11:28:55.577369] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.218 [2024-10-07 11:28:55.577420] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.218 [2024-10-07 11:28:55.577442] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.218 [2024-10-07 11:28:55.577490] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.218 [2024-10-07 11:28:55.577533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.218 [2024-10-07 11:28:55.577551] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.218 [2024-10-07 11:28:55.577567] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.218 [2024-10-07 11:28:55.577598] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.218 [2024-10-07 11:28:55.589271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.218 [2024-10-07 11:28:55.590995] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.218 [2024-10-07 11:28:55.591048] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.218 [2024-10-07 11:28:55.591070] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.218 [2024-10-07 11:28:55.592210] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.218 [2024-10-07 11:28:55.592463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.218 [2024-10-07 11:28:55.592500] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.218 [2024-10-07 11:28:55.592520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.218 [2024-10-07 11:28:55.592582] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.218 [2024-10-07 11:28:55.602495] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.218 [2024-10-07 11:28:55.603716] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.218 [2024-10-07 11:28:55.603764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.218 [2024-10-07 11:28:55.603786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.218 [2024-10-07 11:28:55.605262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.218 [2024-10-07 11:28:55.606440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.218 [2024-10-07 11:28:55.606478] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.218 [2024-10-07 11:28:55.606499] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.218 [2024-10-07 11:28:55.606753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.218 [2024-10-07 11:28:55.614255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.218 [2024-10-07 11:28:55.615661] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.219 [2024-10-07 11:28:55.615714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.219 [2024-10-07 11:28:55.615737] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.219 [2024-10-07 11:28:55.616964] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.219 [2024-10-07 11:28:55.617219] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.219 [2024-10-07 11:28:55.617257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.219 [2024-10-07 11:28:55.617277] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.219 [2024-10-07 11:28:55.618312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.219 [2024-10-07 11:28:55.624485] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.219 [2024-10-07 11:28:55.624688] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.219 [2024-10-07 11:28:55.624725] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.219 [2024-10-07 11:28:55.624744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.219 [2024-10-07 11:28:55.624779] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.219 [2024-10-07 11:28:55.624811] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.219 [2024-10-07 11:28:55.624827] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.219 [2024-10-07 11:28:55.624844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.219 [2024-10-07 11:28:55.624874] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.219 [2024-10-07 11:28:55.636002] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.219 [2024-10-07 11:28:55.636312] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.219 [2024-10-07 11:28:55.636349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.219 [2024-10-07 11:28:55.636368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.219 [2024-10-07 11:28:55.636486] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.219 [2024-10-07 11:28:55.636525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.219 [2024-10-07 11:28:55.636543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.219 [2024-10-07 11:28:55.636559] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.219 [2024-10-07 11:28:55.636591] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.219 [2024-10-07 11:28:55.646160] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.219 [2024-10-07 11:28:55.646354] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.219 [2024-10-07 11:28:55.646392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.219 [2024-10-07 11:28:55.646428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.219 [2024-10-07 11:28:55.646466] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.219 [2024-10-07 11:28:55.646497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.219 [2024-10-07 11:28:55.646514] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.219 [2024-10-07 11:28:55.646530] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.219 [2024-10-07 11:28:55.646560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.219 [2024-10-07 11:28:55.656311] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.219 [2024-10-07 11:28:55.656513] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.219 [2024-10-07 11:28:55.656548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.219 [2024-10-07 11:28:55.656567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.219 [2024-10-07 11:28:55.657526] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.219 [2024-10-07 11:28:55.657745] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.219 [2024-10-07 11:28:55.657774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.219 [2024-10-07 11:28:55.657791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.219 [2024-10-07 11:28:55.657870] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.219 [2024-10-07 11:28:55.667161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.219 [2024-10-07 11:28:55.667620] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.219 [2024-10-07 11:28:55.667660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.219 [2024-10-07 11:28:55.667680] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.219 [2024-10-07 11:28:55.667753] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.219 [2024-10-07 11:28:55.667810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.219 [2024-10-07 11:28:55.667830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.219 [2024-10-07 11:28:55.667876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.219 [2024-10-07 11:28:55.667910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.219 [2024-10-07 11:28:55.679311] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.219 [2024-10-07 11:28:55.679650] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.219 [2024-10-07 11:28:55.679699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.219 [2024-10-07 11:28:55.679721] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.219 [2024-10-07 11:28:55.679778] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.219 [2024-10-07 11:28:55.679814] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.219 [2024-10-07 11:28:55.679832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.219 [2024-10-07 11:28:55.679848] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.219 [2024-10-07 11:28:55.679880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.219 [2024-10-07 11:28:55.689818] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.219 [2024-10-07 11:28:55.691031] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.219 [2024-10-07 11:28:55.691081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.219 [2024-10-07 11:28:55.691103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.219 [2024-10-07 11:28:55.691305] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.219 [2024-10-07 11:28:55.691453] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.219 [2024-10-07 11:28:55.691496] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.219 [2024-10-07 11:28:55.691518] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.219 [2024-10-07 11:28:55.692818] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.219 [2024-10-07 11:28:55.700854] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.219 [2024-10-07 11:28:55.701049] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.219 [2024-10-07 11:28:55.701102] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.219 [2024-10-07 11:28:55.701121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.219 [2024-10-07 11:28:55.702254] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.219 [2024-10-07 11:28:55.702509] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.219 [2024-10-07 11:28:55.702547] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.219 [2024-10-07 11:28:55.702567] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.219 [2024-10-07 11:28:55.703611] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.219 [2024-10-07 11:28:55.711011] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.219 [2024-10-07 11:28:55.711204] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.219 [2024-10-07 11:28:55.711270] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.219 [2024-10-07 11:28:55.711291] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.219 [2024-10-07 11:28:55.711328] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.219 [2024-10-07 11:28:55.711359] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.219 [2024-10-07 11:28:55.711377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.219 [2024-10-07 11:28:55.711392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.219 [2024-10-07 11:28:55.711442] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.219 [2024-10-07 11:28:55.723583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.219 [2024-10-07 11:28:55.723891] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.220 [2024-10-07 11:28:55.723935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.220 [2024-10-07 11:28:55.723955] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.220 [2024-10-07 11:28:55.724012] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.220 [2024-10-07 11:28:55.724049] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.220 [2024-10-07 11:28:55.724067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.220 [2024-10-07 11:28:55.724083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.220 [2024-10-07 11:28:55.724116] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.220 [2024-10-07 11:28:55.733734] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.220 [2024-10-07 11:28:55.733920] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.220 [2024-10-07 11:28:55.733955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.220 [2024-10-07 11:28:55.733973] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.220 [2024-10-07 11:28:55.734008] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.220 [2024-10-07 11:28:55.734038] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.220 [2024-10-07 11:28:55.734055] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.220 [2024-10-07 11:28:55.734070] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.220 [2024-10-07 11:28:55.735095] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.220 [2024-10-07 11:28:55.743881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.220 [2024-10-07 11:28:55.744970] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.220 [2024-10-07 11:28:55.745018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.220 [2024-10-07 11:28:55.745039] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.220 [2024-10-07 11:28:55.745252] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.220 [2024-10-07 11:28:55.746446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.220 [2024-10-07 11:28:55.746484] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.220 [2024-10-07 11:28:55.746503] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.220 [2024-10-07 11:28:55.746735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.220 [2024-10-07 11:28:55.754513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.220 [2024-10-07 11:28:55.754933] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.220 [2024-10-07 11:28:55.754980] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.220 [2024-10-07 11:28:55.755002] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.220 [2024-10-07 11:28:55.755075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.220 [2024-10-07 11:28:55.755130] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.220 [2024-10-07 11:28:55.755150] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.220 [2024-10-07 11:28:55.755165] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.220 [2024-10-07 11:28:55.755197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.220 [2024-10-07 11:28:55.766633] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.220 [2024-10-07 11:28:55.766934] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.220 [2024-10-07 11:28:55.766989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.220 [2024-10-07 11:28:55.767010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.220 [2024-10-07 11:28:55.767067] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.220 [2024-10-07 11:28:55.767102] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.220 [2024-10-07 11:28:55.767120] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.220 [2024-10-07 11:28:55.767137] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.220 [2024-10-07 11:28:55.767167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.220 [2024-10-07 11:28:55.776783] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.220 [2024-10-07 11:28:55.776958] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.220 [2024-10-07 11:28:55.776992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.220 [2024-10-07 11:28:55.777010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.220 [2024-10-07 11:28:55.777043] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.220 [2024-10-07 11:28:55.778080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.220 [2024-10-07 11:28:55.778117] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.220 [2024-10-07 11:28:55.778137] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.220 [2024-10-07 11:28:55.778367] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.220 [2024-10-07 11:28:55.786916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.220 [2024-10-07 11:28:55.787983] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.220 [2024-10-07 11:28:55.788030] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.220 [2024-10-07 11:28:55.788051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.220 [2024-10-07 11:28:55.788248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.220 [2024-10-07 11:28:55.788377] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.220 [2024-10-07 11:28:55.788420] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.220 [2024-10-07 11:28:55.788440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.220 [2024-10-07 11:28:55.789551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.220 [2024-10-07 11:28:55.797465] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.220 [2024-10-07 11:28:55.797861] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.220 [2024-10-07 11:28:55.797906] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.220 [2024-10-07 11:28:55.797927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.220 [2024-10-07 11:28:55.797999] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.220 [2024-10-07 11:28:55.798053] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.220 [2024-10-07 11:28:55.798072] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.220 [2024-10-07 11:28:55.798088] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.220 [2024-10-07 11:28:55.798118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.220 [2024-10-07 11:28:55.808745] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.220 [2024-10-07 11:28:55.810073] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.220 [2024-10-07 11:28:55.810121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.220 [2024-10-07 11:28:55.810142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.220 [2024-10-07 11:28:55.810358] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.220 [2024-10-07 11:28:55.810449] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.220 [2024-10-07 11:28:55.810474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.220 [2024-10-07 11:28:55.810490] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.220 [2024-10-07 11:28:55.810523] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.220 [2024-10-07 11:28:55.819950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.220 [2024-10-07 11:28:55.820109] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.220 [2024-10-07 11:28:55.820143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.220 [2024-10-07 11:28:55.820189] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.220 [2024-10-07 11:28:55.820225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.220 [2024-10-07 11:28:55.820256] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.220 [2024-10-07 11:28:55.820273] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.220 [2024-10-07 11:28:55.820288] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.220 [2024-10-07 11:28:55.820319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.220 [2024-10-07 11:28:55.830076] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.220 [2024-10-07 11:28:55.830247] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.220 [2024-10-07 11:28:55.830281] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.220 [2024-10-07 11:28:55.830298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.220 [2024-10-07 11:28:55.831237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.220 [2024-10-07 11:28:55.831473] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.220 [2024-10-07 11:28:55.831502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.220 [2024-10-07 11:28:55.831519] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.220 [2024-10-07 11:28:55.832659] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.220 [2024-10-07 11:28:55.841019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.220 [2024-10-07 11:28:55.841174] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.220 [2024-10-07 11:28:55.841208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.220 [2024-10-07 11:28:55.841226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.220 [2024-10-07 11:28:55.841502] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.220 [2024-10-07 11:28:55.841582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.220 [2024-10-07 11:28:55.841605] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.221 [2024-10-07 11:28:55.841622] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.221 [2024-10-07 11:28:55.841669] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.221 [2024-10-07 11:28:55.853446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.221 [2024-10-07 11:28:55.853748] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.221 [2024-10-07 11:28:55.853790] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.221 [2024-10-07 11:28:55.853810] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.221 [2024-10-07 11:28:55.853850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.221 [2024-10-07 11:28:55.853882] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.221 [2024-10-07 11:28:55.853930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.221 [2024-10-07 11:28:55.853947] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.221 [2024-10-07 11:28:55.854681] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.221 [2024-10-07 11:28:55.863851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.221 [2024-10-07 11:28:55.864046] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.221 [2024-10-07 11:28:55.864083] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.221 [2024-10-07 11:28:55.864101] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.221 [2024-10-07 11:28:55.865170] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.221 [2024-10-07 11:28:55.865425] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.221 [2024-10-07 11:28:55.865464] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.221 [2024-10-07 11:28:55.865495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.221 [2024-10-07 11:28:55.865618] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.221 [2024-10-07 11:28:55.875043] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.221 [2024-10-07 11:28:55.875225] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.221 [2024-10-07 11:28:55.875261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.221 [2024-10-07 11:28:55.875279] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.221 [2024-10-07 11:28:55.876390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.221 [2024-10-07 11:28:55.876676] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.221 [2024-10-07 11:28:55.876717] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.221 [2024-10-07 11:28:55.876736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.221 [2024-10-07 11:28:55.877776] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.221 [2024-10-07 11:28:55.885183] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.221 [2024-10-07 11:28:55.885335] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.221 [2024-10-07 11:28:55.885369] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.221 [2024-10-07 11:28:55.885390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.221 [2024-10-07 11:28:55.885455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.221 [2024-10-07 11:28:55.885489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.221 [2024-10-07 11:28:55.885506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.221 [2024-10-07 11:28:55.885521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.221 [2024-10-07 11:28:55.885551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.221 [2024-10-07 11:28:55.897126] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.221 [2024-10-07 11:28:55.897438] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.221 [2024-10-07 11:28:55.897476] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.221 [2024-10-07 11:28:55.897495] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.221 [2024-10-07 11:28:55.897563] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.221 [2024-10-07 11:28:55.897600] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.221 [2024-10-07 11:28:55.897617] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.221 [2024-10-07 11:28:55.897633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.221 [2024-10-07 11:28:55.897665] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.221 [2024-10-07 11:28:55.908218] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.221 [2024-10-07 11:28:55.908419] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.221 [2024-10-07 11:28:55.908455] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.221 [2024-10-07 11:28:55.908474] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.221 [2024-10-07 11:28:55.908510] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.221 [2024-10-07 11:28:55.908541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.221 [2024-10-07 11:28:55.908557] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.221 [2024-10-07 11:28:55.908573] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.221 [2024-10-07 11:28:55.908603] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.221 [2024-10-07 11:28:55.918474] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.221 [2024-10-07 11:28:55.918650] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.221 [2024-10-07 11:28:55.918684] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.221 [2024-10-07 11:28:55.918703] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.221 [2024-10-07 11:28:55.918737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.221 [2024-10-07 11:28:55.918768] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.221 [2024-10-07 11:28:55.918786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.221 [2024-10-07 11:28:55.918801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.221 [2024-10-07 11:28:55.918831] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.221 [2024-10-07 11:28:55.928628] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.221 [2024-10-07 11:28:55.928826] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.221 [2024-10-07 11:28:55.928864] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.221 [2024-10-07 11:28:55.928915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.221 [2024-10-07 11:28:55.928953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.221 [2024-10-07 11:28:55.928999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.221 [2024-10-07 11:28:55.929022] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.221 [2024-10-07 11:28:55.929038] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.221 [2024-10-07 11:28:55.929087] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.221 [2024-10-07 11:28:55.939838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.221 [2024-10-07 11:28:55.940047] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.221 [2024-10-07 11:28:55.940084] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.221 [2024-10-07 11:28:55.940103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.221 [2024-10-07 11:28:55.940138] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.221 [2024-10-07 11:28:55.940170] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.221 [2024-10-07 11:28:55.940187] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.221 [2024-10-07 11:28:55.940203] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.221 [2024-10-07 11:28:55.940253] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.221 [2024-10-07 11:28:55.950336] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.221 [2024-10-07 11:28:55.950583] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.221 [2024-10-07 11:28:55.950622] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.221 [2024-10-07 11:28:55.950641] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.221 [2024-10-07 11:28:55.950676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.221 [2024-10-07 11:28:55.950707] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.221 [2024-10-07 11:28:55.950724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.221 [2024-10-07 11:28:55.950740] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.221 [2024-10-07 11:28:55.950771] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.221 [2024-10-07 11:28:55.960507] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.221 [2024-10-07 11:28:55.960685] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.221 [2024-10-07 11:28:55.960720] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.221 [2024-10-07 11:28:55.960739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.221 [2024-10-07 11:28:55.961489] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.221 [2024-10-07 11:28:55.962146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.221 [2024-10-07 11:28:55.962209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.221 [2024-10-07 11:28:55.962232] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.221 [2024-10-07 11:28:55.962589] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.221 [2024-10-07 11:28:55.971572] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.221 [2024-10-07 11:28:55.971766] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.221 [2024-10-07 11:28:55.971808] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.222 [2024-10-07 11:28:55.971826] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.222 [2024-10-07 11:28:55.973037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.222 [2024-10-07 11:28:55.974355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.222 [2024-10-07 11:28:55.974414] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.222 [2024-10-07 11:28:55.974438] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.222 [2024-10-07 11:28:55.974701] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.222 [2024-10-07 11:28:55.981718] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.222 [2024-10-07 11:28:55.982978] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.222 [2024-10-07 11:28:55.983027] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.222 [2024-10-07 11:28:55.983049] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.222 [2024-10-07 11:28:55.983268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.222 [2024-10-07 11:28:55.984296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.222 [2024-10-07 11:28:55.984334] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.222 [2024-10-07 11:28:55.984353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.222 [2024-10-07 11:28:55.984633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.222 [2024-10-07 11:28:55.991850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.222 [2024-10-07 11:28:55.992032] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.222 [2024-10-07 11:28:55.992066] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.222 [2024-10-07 11:28:55.992084] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.222 [2024-10-07 11:28:55.992118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.222 [2024-10-07 11:28:55.992149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.222 [2024-10-07 11:28:55.992166] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.222 [2024-10-07 11:28:55.992180] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.222 [2024-10-07 11:28:55.992211] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.222 [2024-10-07 11:28:56.003343] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.222 [2024-10-07 11:28:56.003611] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.222 [2024-10-07 11:28:56.003649] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.222 [2024-10-07 11:28:56.003667] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.222 [2024-10-07 11:28:56.003702] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.222 [2024-10-07 11:28:56.003734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.222 [2024-10-07 11:28:56.003752] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.222 [2024-10-07 11:28:56.003767] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.222 [2024-10-07 11:28:56.003798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.222 [2024-10-07 11:28:56.013547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.222 [2024-10-07 11:28:56.013752] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.222 [2024-10-07 11:28:56.013789] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.222 [2024-10-07 11:28:56.013808] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.222 [2024-10-07 11:28:56.013843] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.222 [2024-10-07 11:28:56.013875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.222 [2024-10-07 11:28:56.013892] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.222 [2024-10-07 11:28:56.013907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.222 [2024-10-07 11:28:56.014942] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.222 [2024-10-07 11:28:56.023700] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.222 [2024-10-07 11:28:56.023881] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.222 [2024-10-07 11:28:56.023916] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.222 [2024-10-07 11:28:56.023934] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.222 [2024-10-07 11:28:56.023969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.222 [2024-10-07 11:28:56.023999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.222 [2024-10-07 11:28:56.024017] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.222 [2024-10-07 11:28:56.024032] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.222 [2024-10-07 11:28:56.024063] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.222 [2024-10-07 11:28:56.034962] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.222 [2024-10-07 11:28:56.035418] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.222 [2024-10-07 11:28:56.035459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.222 [2024-10-07 11:28:56.035478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.222 [2024-10-07 11:28:56.035590] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.222 [2024-10-07 11:28:56.035649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.222 [2024-10-07 11:28:56.035670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.222 [2024-10-07 11:28:56.035686] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.222 [2024-10-07 11:28:56.035726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.222 [2024-10-07 11:28:56.047245] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.222 [2024-10-07 11:28:56.047478] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.222 [2024-10-07 11:28:56.047514] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.222 [2024-10-07 11:28:56.047540] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.222 [2024-10-07 11:28:56.047576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.222 [2024-10-07 11:28:56.047608] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.222 [2024-10-07 11:28:56.047625] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.222 [2024-10-07 11:28:56.047641] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.222 [2024-10-07 11:28:56.047672] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.222 [2024-10-07 11:28:56.057424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.222 [2024-10-07 11:28:56.057626] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.222 [2024-10-07 11:28:56.057663] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.222 [2024-10-07 11:28:56.057681] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.222 [2024-10-07 11:28:56.057716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.222 [2024-10-07 11:28:56.058744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.222 [2024-10-07 11:28:56.058783] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.222 [2024-10-07 11:28:56.058803] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.222 [2024-10-07 11:28:56.059011] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.222 [2024-10-07 11:28:56.067583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.222 [2024-10-07 11:28:56.067775] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.222 [2024-10-07 11:28:56.067811] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.222 [2024-10-07 11:28:56.067829] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.222 [2024-10-07 11:28:56.067862] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.222 [2024-10-07 11:28:56.067893] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.222 [2024-10-07 11:28:56.067910] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.222 [2024-10-07 11:28:56.067958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.222 [2024-10-07 11:28:56.068904] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.222 [2024-10-07 11:28:56.078537] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.222 [2024-10-07 11:28:56.078968] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.222 [2024-10-07 11:28:56.079018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.222 [2024-10-07 11:28:56.079039] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.222 [2024-10-07 11:28:56.079113] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.222 [2024-10-07 11:28:56.079168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.222 [2024-10-07 11:28:56.079188] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.222 [2024-10-07 11:28:56.079204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.222 [2024-10-07 11:28:56.079236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.222 [2024-10-07 11:28:56.090735] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.222 [2024-10-07 11:28:56.090933] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.222 [2024-10-07 11:28:56.090968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.222 [2024-10-07 11:28:56.090987] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.222 [2024-10-07 11:28:56.091022] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.222 [2024-10-07 11:28:56.091055] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.222 [2024-10-07 11:28:56.091072] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.222 [2024-10-07 11:28:56.091087] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.223 [2024-10-07 11:28:56.091118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.223 8349.75 IOPS, 32.62 MiB/s [2024-10-07T11:29:07.934Z] [2024-10-07 11:28:56.103008] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.223 [2024-10-07 11:28:56.103360] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.223 [2024-10-07 11:28:56.103418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.223 [2024-10-07 11:28:56.103441] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.223 [2024-10-07 11:28:56.104642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.223 [2024-10-07 11:28:56.105863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.223 [2024-10-07 11:28:56.105902] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.223 [2024-10-07 11:28:56.105922] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.223 [2024-10-07 11:28:56.106159] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.223 [2024-10-07 11:28:56.113127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.223 [2024-10-07 11:28:56.114481] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.223 [2024-10-07 11:28:56.114533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.223 [2024-10-07 11:28:56.114555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.223 [2024-10-07 11:28:56.114776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.223 [2024-10-07 11:28:56.115858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.223 [2024-10-07 11:28:56.115899] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.223 [2024-10-07 11:28:56.115919] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.223 [2024-10-07 11:28:56.116167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.223 [2024-10-07 11:28:56.123288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.223 [2024-10-07 11:28:56.123427] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.223 [2024-10-07 11:28:56.123460] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.223 [2024-10-07 11:28:56.123478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.223 [2024-10-07 11:28:56.123511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.223 [2024-10-07 11:28:56.123541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.223 [2024-10-07 11:28:56.123557] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.223 [2024-10-07 11:28:56.123571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.223 [2024-10-07 11:28:56.123601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.223 [2024-10-07 11:28:56.134724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.223 [2024-10-07 11:28:56.134949] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.223 [2024-10-07 11:28:56.134986] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.223 [2024-10-07 11:28:56.135004] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.223 [2024-10-07 11:28:56.135040] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.223 [2024-10-07 11:28:56.135072] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.223 [2024-10-07 11:28:56.135089] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.223 [2024-10-07 11:28:56.135105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.223 [2024-10-07 11:28:56.135135] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.223 [2024-10-07 11:28:56.144875] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.223 [2024-10-07 11:28:56.145077] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.223 [2024-10-07 11:28:56.145113] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.223 [2024-10-07 11:28:56.145131] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.223 [2024-10-07 11:28:56.145167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.223 [2024-10-07 11:28:56.145235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.223 [2024-10-07 11:28:56.145253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.223 [2024-10-07 11:28:56.145268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.223 [2024-10-07 11:28:56.145299] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.223 [2024-10-07 11:28:56.155023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.223 [2024-10-07 11:28:56.155211] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.223 [2024-10-07 11:28:56.155246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.223 [2024-10-07 11:28:56.155264] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.223 [2024-10-07 11:28:56.156220] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.223 [2024-10-07 11:28:56.156471] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.223 [2024-10-07 11:28:56.156512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.223 [2024-10-07 11:28:56.156532] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.223 [2024-10-07 11:28:56.156612] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.223 [2024-10-07 11:28:56.165899] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.223 [2024-10-07 11:28:56.166312] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.223 [2024-10-07 11:28:56.166358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.223 [2024-10-07 11:28:56.166379] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.223 [2024-10-07 11:28:56.166470] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.223 [2024-10-07 11:28:56.166510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.223 [2024-10-07 11:28:56.166527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.223 [2024-10-07 11:28:56.166542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.223 [2024-10-07 11:28:56.166572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.223 [2024-10-07 11:28:56.178009] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.223 [2024-10-07 11:28:56.178316] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.223 [2024-10-07 11:28:56.178353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.223 [2024-10-07 11:28:56.178371] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.223 [2024-10-07 11:28:56.178447] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.223 [2024-10-07 11:28:56.178488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.223 [2024-10-07 11:28:56.178506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.223 [2024-10-07 11:28:56.178521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.223 [2024-10-07 11:28:56.178584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.223 [2024-10-07 11:28:56.188159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.223 [2024-10-07 11:28:56.188342] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.223 [2024-10-07 11:28:56.188377] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.223 [2024-10-07 11:28:56.188395] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.223 [2024-10-07 11:28:56.189444] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.223 [2024-10-07 11:28:56.189662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.223 [2024-10-07 11:28:56.189697] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.223 [2024-10-07 11:28:56.189716] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.223 [2024-10-07 11:28:56.189784] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.223 [2024-10-07 11:28:56.199385] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.223 [2024-10-07 11:28:56.199577] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.223 [2024-10-07 11:28:56.199610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.223 [2024-10-07 11:28:56.199628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.223 [2024-10-07 11:28:56.200732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.223 [2024-10-07 11:28:56.200958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.223 [2024-10-07 11:28:56.200985] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.223 [2024-10-07 11:28:56.201000] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.223 [2024-10-07 11:28:56.202023] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.223 [2024-10-07 11:28:56.209535] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.223 [2024-10-07 11:28:56.209707] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.224 [2024-10-07 11:28:56.209743] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.224 [2024-10-07 11:28:56.209761] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.224 [2024-10-07 11:28:56.209795] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.224 [2024-10-07 11:28:56.209826] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.224 [2024-10-07 11:28:56.209842] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.224 [2024-10-07 11:28:56.209858] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.224 [2024-10-07 11:28:56.209887] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.224 [2024-10-07 11:28:56.220973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.224 [2024-10-07 11:28:56.221188] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.224 [2024-10-07 11:28:56.221223] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.224 [2024-10-07 11:28:56.221274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.224 [2024-10-07 11:28:56.221311] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.224 [2024-10-07 11:28:56.221342] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.224 [2024-10-07 11:28:56.221359] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.224 [2024-10-07 11:28:56.221374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.224 [2024-10-07 11:28:56.221420] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.224 [2024-10-07 11:28:56.231127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.224 [2024-10-07 11:28:56.231305] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.224 [2024-10-07 11:28:56.231340] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.224 [2024-10-07 11:28:56.231358] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.224 [2024-10-07 11:28:56.232378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.224 [2024-10-07 11:28:56.232606] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.224 [2024-10-07 11:28:56.232637] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.224 [2024-10-07 11:28:56.232655] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.224 [2024-10-07 11:28:56.233892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.224 [2024-10-07 11:28:56.242314] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.224 [2024-10-07 11:28:56.242503] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.224 [2024-10-07 11:28:56.242538] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.224 [2024-10-07 11:28:56.242556] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.224 [2024-10-07 11:28:56.242599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.224 [2024-10-07 11:28:56.243704] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.224 [2024-10-07 11:28:56.243741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.224 [2024-10-07 11:28:56.243759] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.224 [2024-10-07 11:28:56.243966] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.224 [2024-10-07 11:28:56.252705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.224 [2024-10-07 11:28:56.252887] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.224 [2024-10-07 11:28:56.252921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.224 [2024-10-07 11:28:56.252939] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.224 [2024-10-07 11:28:56.252974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.224 [2024-10-07 11:28:56.253005] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.224 [2024-10-07 11:28:56.253048] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.224 [2024-10-07 11:28:56.253079] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.224 [2024-10-07 11:28:56.253113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.224 [2024-10-07 11:28:56.265338] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.224 [2024-10-07 11:28:56.265676] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.224 [2024-10-07 11:28:56.265725] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.224 [2024-10-07 11:28:56.265747] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.224 [2024-10-07 11:28:56.265807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.224 [2024-10-07 11:28:56.265846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.224 [2024-10-07 11:28:56.265876] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.224 [2024-10-07 11:28:56.265896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.224 [2024-10-07 11:28:56.265931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.224 [2024-10-07 11:28:56.275508] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.224 [2024-10-07 11:28:56.275744] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.224 [2024-10-07 11:28:56.275785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.224 [2024-10-07 11:28:56.275804] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.224 [2024-10-07 11:28:56.275842] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.224 [2024-10-07 11:28:56.275892] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.224 [2024-10-07 11:28:56.275914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.224 [2024-10-07 11:28:56.275930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.224 [2024-10-07 11:28:56.276971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.224 [2024-10-07 11:28:56.285667] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.224 [2024-10-07 11:28:56.285871] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.224 [2024-10-07 11:28:56.285911] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.224 [2024-10-07 11:28:56.285929] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.224 [2024-10-07 11:28:56.285967] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.224 [2024-10-07 11:28:56.286922] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.224 [2024-10-07 11:28:56.286963] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.224 [2024-10-07 11:28:56.286984] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.224 [2024-10-07 11:28:56.287190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.224 [2024-10-07 11:28:56.296604] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.224 [2024-10-07 11:28:56.297030] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.224 [2024-10-07 11:28:56.297094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.224 [2024-10-07 11:28:56.297117] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.224 [2024-10-07 11:28:56.297192] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.224 [2024-10-07 11:28:56.297232] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.224 [2024-10-07 11:28:56.297249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.224 [2024-10-07 11:28:56.297265] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.224 [2024-10-07 11:28:56.297296] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.224 [2024-10-07 11:28:56.308907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.224 [2024-10-07 11:28:56.309219] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.224 [2024-10-07 11:28:56.309267] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.224 [2024-10-07 11:28:56.309289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.224 [2024-10-07 11:28:56.309348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.224 [2024-10-07 11:28:56.309384] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.224 [2024-10-07 11:28:56.309418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.224 [2024-10-07 11:28:56.309436] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.224 [2024-10-07 11:28:56.309469] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.224 [2024-10-07 11:28:56.319052] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.224 [2024-10-07 11:28:56.319232] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.224 [2024-10-07 11:28:56.319266] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.224 [2024-10-07 11:28:56.319285] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.224 [2024-10-07 11:28:56.319318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.224 [2024-10-07 11:28:56.319349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.224 [2024-10-07 11:28:56.319365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.224 [2024-10-07 11:28:56.319380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.224 [2024-10-07 11:28:56.319426] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.224 [2024-10-07 11:28:56.329186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.224 [2024-10-07 11:28:56.329361] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.224 [2024-10-07 11:28:56.329395] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.224 [2024-10-07 11:28:56.329458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.224 [2024-10-07 11:28:56.330394] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.224 [2024-10-07 11:28:56.330627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.224 [2024-10-07 11:28:56.330662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.224 [2024-10-07 11:28:56.330681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.224 [2024-10-07 11:28:56.330761] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.224 [2024-10-07 11:28:56.339952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.224 [2024-10-07 11:28:56.340364] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.224 [2024-10-07 11:28:56.340425] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.224 [2024-10-07 11:28:56.340448] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.225 [2024-10-07 11:28:56.340520] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.225 [2024-10-07 11:28:56.340557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.225 [2024-10-07 11:28:56.340575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.225 [2024-10-07 11:28:56.340590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.225 [2024-10-07 11:28:56.340622] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.225 [2024-10-07 11:28:56.352232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.225 [2024-10-07 11:28:56.352458] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.225 [2024-10-07 11:28:56.352495] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.225 [2024-10-07 11:28:56.352514] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.225 [2024-10-07 11:28:56.352550] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.225 [2024-10-07 11:28:56.352581] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.225 [2024-10-07 11:28:56.352598] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.225 [2024-10-07 11:28:56.352614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.225 [2024-10-07 11:28:56.352645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.225 [2024-10-07 11:28:56.362377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.225 [2024-10-07 11:28:56.362572] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.225 [2024-10-07 11:28:56.362607] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.225 [2024-10-07 11:28:56.362625] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.225 [2024-10-07 11:28:56.363651] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.225 [2024-10-07 11:28:56.363888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.225 [2024-10-07 11:28:56.363955] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.225 [2024-10-07 11:28:56.363976] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.225 [2024-10-07 11:28:56.364092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.225 [2024-10-07 11:28:56.373583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.225 [2024-10-07 11:28:56.373769] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.225 [2024-10-07 11:28:56.373806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.225 [2024-10-07 11:28:56.373824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.225 [2024-10-07 11:28:56.374937] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.225 [2024-10-07 11:28:56.375166] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.225 [2024-10-07 11:28:56.375201] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.225 [2024-10-07 11:28:56.375220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.225 [2024-10-07 11:28:56.376243] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.225 [2024-10-07 11:28:56.383728] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.225 [2024-10-07 11:28:56.383924] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.225 [2024-10-07 11:28:56.383960] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.225 [2024-10-07 11:28:56.383978] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.225 [2024-10-07 11:28:56.384012] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.225 [2024-10-07 11:28:56.384044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.225 [2024-10-07 11:28:56.384060] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.225 [2024-10-07 11:28:56.384075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.225 [2024-10-07 11:28:56.384106] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.225 [2024-10-07 11:28:56.395280] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.225 [2024-10-07 11:28:56.395509] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.225 [2024-10-07 11:28:56.395546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.225 [2024-10-07 11:28:56.395564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.225 [2024-10-07 11:28:56.395598] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.225 [2024-10-07 11:28:56.395630] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.225 [2024-10-07 11:28:56.395647] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.225 [2024-10-07 11:28:56.395662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.225 [2024-10-07 11:28:56.395693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.225 [2024-10-07 11:28:56.405449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.225 [2024-10-07 11:28:56.405676] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.225 [2024-10-07 11:28:56.405714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.225 [2024-10-07 11:28:56.405732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.225 [2024-10-07 11:28:56.406770] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.225 [2024-10-07 11:28:56.407027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.225 [2024-10-07 11:28:56.407063] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.225 [2024-10-07 11:28:56.407083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.225 [2024-10-07 11:28:56.407199] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.225 [2024-10-07 11:28:56.415634] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.225 [2024-10-07 11:28:56.416730] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.225 [2024-10-07 11:28:56.416779] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.225 [2024-10-07 11:28:56.416800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.225 [2024-10-07 11:28:56.417000] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.225 [2024-10-07 11:28:56.417145] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.225 [2024-10-07 11:28:56.417175] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.225 [2024-10-07 11:28:56.417194] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.225 [2024-10-07 11:28:56.418298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.225 [2024-10-07 11:28:56.426249] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.225 [2024-10-07 11:28:56.426687] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.225 [2024-10-07 11:28:56.426735] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.225 [2024-10-07 11:28:56.426755] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.225 [2024-10-07 11:28:56.426828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.225 [2024-10-07 11:28:56.426865] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.225 [2024-10-07 11:28:56.426882] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.225 [2024-10-07 11:28:56.426898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.225 [2024-10-07 11:28:56.426928] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.225 [2024-10-07 11:28:56.438499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.225 [2024-10-07 11:28:56.438709] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.225 [2024-10-07 11:28:56.438746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.225 [2024-10-07 11:28:56.438765] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.225 [2024-10-07 11:28:56.438831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.225 [2024-10-07 11:28:56.438863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.225 [2024-10-07 11:28:56.438880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.225 [2024-10-07 11:28:56.438895] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.225 [2024-10-07 11:28:56.438926] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.225 [2024-10-07 11:28:56.448648] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.225 [2024-10-07 11:28:56.448830] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.225 [2024-10-07 11:28:56.448865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.225 [2024-10-07 11:28:56.448883] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.225 [2024-10-07 11:28:56.449923] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.225 [2024-10-07 11:28:56.450161] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.225 [2024-10-07 11:28:56.450197] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.225 [2024-10-07 11:28:56.450216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.225 [2024-10-07 11:28:56.451475] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.225 [2024-10-07 11:28:56.459878] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.225 [2024-10-07 11:28:56.460061] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.225 [2024-10-07 11:28:56.460096] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.225 [2024-10-07 11:28:56.460115] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.225 [2024-10-07 11:28:56.461239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.225 [2024-10-07 11:28:56.461497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.225 [2024-10-07 11:28:56.461533] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.225 [2024-10-07 11:28:56.461553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.225 [2024-10-07 11:28:56.462568] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.225 [2024-10-07 11:28:56.470026] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.225 [2024-10-07 11:28:56.470240] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.225 [2024-10-07 11:28:56.470278] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.225 [2024-10-07 11:28:56.470297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.225 [2024-10-07 11:28:56.470332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.225 [2024-10-07 11:28:56.470363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.225 [2024-10-07 11:28:56.470380] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.225 [2024-10-07 11:28:56.470436] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.225 [2024-10-07 11:28:56.470471] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.225 [2024-10-07 11:28:56.481937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.225 [2024-10-07 11:28:56.482242] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.225 [2024-10-07 11:28:56.482292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.225 [2024-10-07 11:28:56.482314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.225 [2024-10-07 11:28:56.482372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.226 [2024-10-07 11:28:56.482424] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.226 [2024-10-07 11:28:56.482445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.226 [2024-10-07 11:28:56.482461] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.226 [2024-10-07 11:28:56.482492] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.226 [2024-10-07 11:28:56.493768] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.226 [2024-10-07 11:28:56.495369] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.226 [2024-10-07 11:28:56.495432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.226 [2024-10-07 11:28:56.495456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.226 [2024-10-07 11:28:56.496662] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.226 [2024-10-07 11:28:56.497131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.226 [2024-10-07 11:28:56.497194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.226 [2024-10-07 11:28:56.497226] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.226 [2024-10-07 11:28:56.497481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.226 [2024-10-07 11:28:56.504529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.226 [2024-10-07 11:28:56.505842] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.226 [2024-10-07 11:28:56.505915] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.226 [2024-10-07 11:28:56.505953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.226 [2024-10-07 11:28:56.506244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.226 [2024-10-07 11:28:56.507584] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.226 [2024-10-07 11:28:56.507653] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.226 [2024-10-07 11:28:56.507690] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.226 [2024-10-07 11:28:56.509051] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.226 [2024-10-07 11:28:56.514688] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.226 [2024-10-07 11:28:56.514884] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.226 [2024-10-07 11:28:56.514962] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.226 [2024-10-07 11:28:56.514986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.226 [2024-10-07 11:28:56.515025] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.226 [2024-10-07 11:28:56.515057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.226 [2024-10-07 11:28:56.515075] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.226 [2024-10-07 11:28:56.515090] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.226 [2024-10-07 11:28:56.515121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.226 [2024-10-07 11:28:56.526301] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.226 [2024-10-07 11:28:56.526534] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.226 [2024-10-07 11:28:56.526581] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.226 [2024-10-07 11:28:56.526603] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.226 [2024-10-07 11:28:56.526638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.226 [2024-10-07 11:28:56.526670] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.226 [2024-10-07 11:28:56.526688] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.226 [2024-10-07 11:28:56.526703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.226 [2024-10-07 11:28:56.526734] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.226 [2024-10-07 11:28:56.536464] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.226 [2024-10-07 11:28:56.536650] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.226 [2024-10-07 11:28:56.536686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.226 [2024-10-07 11:28:56.536704] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.226 [2024-10-07 11:28:56.536737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.226 [2024-10-07 11:28:56.536768] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.226 [2024-10-07 11:28:56.536784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.226 [2024-10-07 11:28:56.536799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.226 [2024-10-07 11:28:56.536829] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.226 [2024-10-07 11:28:56.546630] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.226 [2024-10-07 11:28:56.546816] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.226 [2024-10-07 11:28:56.546849] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.226 [2024-10-07 11:28:56.546868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.226 [2024-10-07 11:28:56.546900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.226 [2024-10-07 11:28:56.546965] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.226 [2024-10-07 11:28:56.546983] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.226 [2024-10-07 11:28:56.546999] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.226 [2024-10-07 11:28:56.547029] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.226 [2024-10-07 11:28:56.557788] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.226 [2024-10-07 11:28:56.558199] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.226 [2024-10-07 11:28:56.558247] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.226 [2024-10-07 11:28:56.558268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.226 [2024-10-07 11:28:56.558340] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.226 [2024-10-07 11:28:56.558394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.226 [2024-10-07 11:28:56.558429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.226 [2024-10-07 11:28:56.558446] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.226 [2024-10-07 11:28:56.558479] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.226 [2024-10-07 11:28:56.569874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.226 [2024-10-07 11:28:56.570158] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.226 [2024-10-07 11:28:56.570204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.226 [2024-10-07 11:28:56.570226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.226 [2024-10-07 11:28:56.570282] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.226 [2024-10-07 11:28:56.570318] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.226 [2024-10-07 11:28:56.570336] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.226 [2024-10-07 11:28:56.570352] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.226 [2024-10-07 11:28:56.570383] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.226 [2024-10-07 11:28:56.580006] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.226 [2024-10-07 11:28:56.580174] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.226 [2024-10-07 11:28:56.580209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.226 [2024-10-07 11:28:56.580227] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.226 [2024-10-07 11:28:56.580261] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.226 [2024-10-07 11:28:56.580292] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.226 [2024-10-07 11:28:56.580309] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.226 [2024-10-07 11:28:56.580324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.226 [2024-10-07 11:28:56.581391] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.226 [2024-10-07 11:28:56.590133] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.226 [2024-10-07 11:28:56.591216] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.226 [2024-10-07 11:28:56.591264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.226 [2024-10-07 11:28:56.591285] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.226 [2024-10-07 11:28:56.591502] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.226 [2024-10-07 11:28:56.591588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.226 [2024-10-07 11:28:56.591609] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.226 [2024-10-07 11:28:56.591626] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.226 [2024-10-07 11:28:56.592728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.226 [2024-10-07 11:28:56.600852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.226 [2024-10-07 11:28:56.601296] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.226 [2024-10-07 11:28:56.601345] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.226 [2024-10-07 11:28:56.601366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.226 [2024-10-07 11:28:56.601455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.226 [2024-10-07 11:28:56.601512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.226 [2024-10-07 11:28:56.601534] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.226 [2024-10-07 11:28:56.601550] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.226 [2024-10-07 11:28:56.601582] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.226 [2024-10-07 11:28:56.613547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.226 [2024-10-07 11:28:56.613833] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.226 [2024-10-07 11:28:56.613884] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.226 [2024-10-07 11:28:56.613915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.226 [2024-10-07 11:28:56.614817] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.226 [2024-10-07 11:28:56.615943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.226 [2024-10-07 11:28:56.615988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.226 [2024-10-07 11:28:56.616020] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.226 [2024-10-07 11:28:56.616161] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.226 [2024-10-07 11:28:56.624663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.226 [2024-10-07 11:28:56.624850] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.226 [2024-10-07 11:28:56.624888] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.226 [2024-10-07 11:28:56.624938] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.226 [2024-10-07 11:28:56.626168] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.226 [2024-10-07 11:28:56.627419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.226 [2024-10-07 11:28:56.627460] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.226 [2024-10-07 11:28:56.627480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.227 [2024-10-07 11:28:56.627732] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.227 [2024-10-07 11:28:56.637086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.227 [2024-10-07 11:28:56.637486] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.227 [2024-10-07 11:28:56.637536] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.227 [2024-10-07 11:28:56.637559] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.227 [2024-10-07 11:28:56.637625] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.227 [2024-10-07 11:28:56.637660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.227 [2024-10-07 11:28:56.637678] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.227 [2024-10-07 11:28:56.637693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.227 [2024-10-07 11:28:56.637726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.227 [2024-10-07 11:28:56.647232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.227 [2024-10-07 11:28:56.647442] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.227 [2024-10-07 11:28:56.647478] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.227 [2024-10-07 11:28:56.647498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.227 [2024-10-07 11:28:56.647533] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.227 [2024-10-07 11:28:56.647564] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.227 [2024-10-07 11:28:56.647580] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.227 [2024-10-07 11:28:56.647595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.227 [2024-10-07 11:28:56.647626] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.227 [2024-10-07 11:28:56.658815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.227 [2024-10-07 11:28:56.659049] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.227 [2024-10-07 11:28:56.659087] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.227 [2024-10-07 11:28:56.659106] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.227 [2024-10-07 11:28:56.659142] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.227 [2024-10-07 11:28:56.659174] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.227 [2024-10-07 11:28:56.659223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.227 [2024-10-07 11:28:56.659240] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.227 [2024-10-07 11:28:56.659274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.227 [2024-10-07 11:28:56.670828] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.227 [2024-10-07 11:28:56.671146] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.227 [2024-10-07 11:28:56.671190] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.227 [2024-10-07 11:28:56.671214] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.227 [2024-10-07 11:28:56.671288] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.227 [2024-10-07 11:28:56.671327] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.227 [2024-10-07 11:28:56.671345] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.227 [2024-10-07 11:28:56.671361] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.227 [2024-10-07 11:28:56.671393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.227 [2024-10-07 11:28:56.680984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.227 [2024-10-07 11:28:56.681191] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.227 [2024-10-07 11:28:56.681228] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.227 [2024-10-07 11:28:56.681247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.227 [2024-10-07 11:28:56.681281] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.227 [2024-10-07 11:28:56.681312] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.227 [2024-10-07 11:28:56.681329] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.227 [2024-10-07 11:28:56.681345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.227 [2024-10-07 11:28:56.682371] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.227 [2024-10-07 11:28:56.691141] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.227 [2024-10-07 11:28:56.692228] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.227 [2024-10-07 11:28:56.692276] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.227 [2024-10-07 11:28:56.692298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.227 [2024-10-07 11:28:56.692527] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.227 [2024-10-07 11:28:56.693697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.227 [2024-10-07 11:28:56.693735] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.227 [2024-10-07 11:28:56.693755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.227 [2024-10-07 11:28:56.693963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.227 [2024-10-07 11:28:56.701772] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.227 [2024-10-07 11:28:56.702163] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.227 [2024-10-07 11:28:56.702208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.227 [2024-10-07 11:28:56.702229] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.227 [2024-10-07 11:28:56.702300] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.227 [2024-10-07 11:28:56.702338] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.227 [2024-10-07 11:28:56.702356] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.227 [2024-10-07 11:28:56.702371] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.227 [2024-10-07 11:28:56.702417] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.227 [2024-10-07 11:28:56.713996] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.227 [2024-10-07 11:28:56.714211] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.227 [2024-10-07 11:28:56.714247] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.227 [2024-10-07 11:28:56.714266] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.227 [2024-10-07 11:28:56.714300] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.227 [2024-10-07 11:28:56.714332] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.227 [2024-10-07 11:28:56.714348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.227 [2024-10-07 11:28:56.714364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.227 [2024-10-07 11:28:56.714395] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.227 [2024-10-07 11:28:56.724143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.227 [2024-10-07 11:28:56.724328] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.227 [2024-10-07 11:28:56.724365] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.227 [2024-10-07 11:28:56.724383] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.227 [2024-10-07 11:28:56.725427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.227 [2024-10-07 11:28:56.725646] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.227 [2024-10-07 11:28:56.725681] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.227 [2024-10-07 11:28:56.725701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.227 [2024-10-07 11:28:56.725815] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.227 [2024-10-07 11:28:56.735331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.227 [2024-10-07 11:28:56.735521] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.227 [2024-10-07 11:28:56.735557] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.227 [2024-10-07 11:28:56.735575] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.227 [2024-10-07 11:28:56.736718] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.227 [2024-10-07 11:28:56.736947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.227 [2024-10-07 11:28:56.736980] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.227 [2024-10-07 11:28:56.736998] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.227 [2024-10-07 11:28:56.738024] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.227 [2024-10-07 11:28:56.745485] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.227 [2024-10-07 11:28:56.745675] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.227 [2024-10-07 11:28:56.745710] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.227 [2024-10-07 11:28:56.745728] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.227 [2024-10-07 11:28:56.745761] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.227 [2024-10-07 11:28:56.745792] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.227 [2024-10-07 11:28:56.745809] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.227 [2024-10-07 11:28:56.745825] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.227 [2024-10-07 11:28:56.745855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.227 [2024-10-07 11:28:56.756913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.227 [2024-10-07 11:28:56.757232] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.227 [2024-10-07 11:28:56.757270] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.227 [2024-10-07 11:28:56.757289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.228 [2024-10-07 11:28:56.757346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.228 [2024-10-07 11:28:56.757382] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.228 [2024-10-07 11:28:56.757414] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.228 [2024-10-07 11:28:56.757434] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.228 [2024-10-07 11:28:56.757468] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.228 [2024-10-07 11:28:56.767061] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.228 [2024-10-07 11:28:56.767252] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.228 [2024-10-07 11:28:56.767288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.228 [2024-10-07 11:28:56.767306] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.228 [2024-10-07 11:28:56.767341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.228 [2024-10-07 11:28:56.767371] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.228 [2024-10-07 11:28:56.767388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.228 [2024-10-07 11:28:56.767453] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.228 [2024-10-07 11:28:56.768480] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.228 [2024-10-07 11:28:56.777214] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.228 [2024-10-07 11:28:56.778304] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.228 [2024-10-07 11:28:56.778352] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.228 [2024-10-07 11:28:56.778373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.228 [2024-10-07 11:28:56.778601] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.228 [2024-10-07 11:28:56.779754] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.228 [2024-10-07 11:28:56.779791] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.228 [2024-10-07 11:28:56.779810] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.228 [2024-10-07 11:28:56.780018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.228 [2024-10-07 11:28:56.788616] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.228 [2024-10-07 11:28:56.788771] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.228 [2024-10-07 11:28:56.788806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.228 [2024-10-07 11:28:56.788824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.228 [2024-10-07 11:28:56.788872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.228 [2024-10-07 11:28:56.788906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.228 [2024-10-07 11:28:56.788923] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.228 [2024-10-07 11:28:56.788938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.228 [2024-10-07 11:28:56.788969] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.228 [2024-10-07 11:28:56.800126] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.228 [2024-10-07 11:28:56.800340] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.228 [2024-10-07 11:28:56.800375] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.228 [2024-10-07 11:28:56.800393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.228 [2024-10-07 11:28:56.800448] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.228 [2024-10-07 11:28:56.800480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.228 [2024-10-07 11:28:56.800498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.228 [2024-10-07 11:28:56.800514] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.228 [2024-10-07 11:28:56.800545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.228 [2024-10-07 11:28:56.810984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.228 [2024-10-07 11:28:56.812543] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.228 [2024-10-07 11:28:56.812599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.228 [2024-10-07 11:28:56.812623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.228 [2024-10-07 11:28:56.812865] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.228 [2024-10-07 11:28:56.813037] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.228 [2024-10-07 11:28:56.813082] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.228 [2024-10-07 11:28:56.813100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.228 [2024-10-07 11:28:56.814471] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.228 [2024-10-07 11:28:56.821342] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.228 [2024-10-07 11:28:56.821629] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.228 [2024-10-07 11:28:56.821683] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.228 [2024-10-07 11:28:56.821719] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.228 [2024-10-07 11:28:56.822922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.228 [2024-10-07 11:28:56.823236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.228 [2024-10-07 11:28:56.823303] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.228 [2024-10-07 11:28:56.823335] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.228 [2024-10-07 11:28:56.823511] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.228 [2024-10-07 11:28:56.832650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.228 [2024-10-07 11:28:56.833104] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.228 [2024-10-07 11:28:56.833154] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.228 [2024-10-07 11:28:56.833178] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.228 [2024-10-07 11:28:56.833314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.228 [2024-10-07 11:28:56.833362] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.228 [2024-10-07 11:28:56.833381] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.228 [2024-10-07 11:28:56.833396] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.228 [2024-10-07 11:28:56.833449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.228 [2024-10-07 11:28:56.845360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.228 [2024-10-07 11:28:56.845597] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.228 [2024-10-07 11:28:56.845634] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.228 [2024-10-07 11:28:56.845652] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.228 [2024-10-07 11:28:56.845715] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.228 [2024-10-07 11:28:56.845748] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.228 [2024-10-07 11:28:56.845776] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.228 [2024-10-07 11:28:56.845792] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.228 [2024-10-07 11:28:56.846531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.228 [2024-10-07 11:28:56.855532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.228 [2024-10-07 11:28:56.856713] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.228 [2024-10-07 11:28:56.856763] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.228 [2024-10-07 11:28:56.856785] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.228 [2024-10-07 11:28:56.857050] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.228 [2024-10-07 11:28:56.857199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.228 [2024-10-07 11:28:56.857228] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.228 [2024-10-07 11:28:56.857246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.228 [2024-10-07 11:28:56.858466] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.228 [2024-10-07 11:28:56.867426] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.228 [2024-10-07 11:28:56.868668] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.228 [2024-10-07 11:28:56.868717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.228 [2024-10-07 11:28:56.868739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.228 [2024-10-07 11:28:56.869956] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.228 [2024-10-07 11:28:56.870235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.228 [2024-10-07 11:28:56.870271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.228 [2024-10-07 11:28:56.870290] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.228 [2024-10-07 11:28:56.871412] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.228 [2024-10-07 11:28:56.877618] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.228 [2024-10-07 11:28:56.877902] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.228 [2024-10-07 11:28:56.877956] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.228 [2024-10-07 11:28:56.877988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.228 [2024-10-07 11:28:56.878047] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.228 [2024-10-07 11:28:56.878106] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.228 [2024-10-07 11:28:56.878136] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.228 [2024-10-07 11:28:56.878197] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.228 [2024-10-07 11:28:56.878259] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.228 [2024-10-07 11:28:56.888987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.228 [2024-10-07 11:28:56.889204] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.228 [2024-10-07 11:28:56.889240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.228 [2024-10-07 11:28:56.889259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.228 [2024-10-07 11:28:56.889299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.228 [2024-10-07 11:28:56.889334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.228 [2024-10-07 11:28:56.889351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.228 [2024-10-07 11:28:56.889367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.228 [2024-10-07 11:28:56.889418] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.228 [2024-10-07 11:28:56.900846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.228 [2024-10-07 11:28:56.901268] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.228 [2024-10-07 11:28:56.901315] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.228 [2024-10-07 11:28:56.901337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.228 [2024-10-07 11:28:56.902569] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.228 [2024-10-07 11:28:56.903784] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.228 [2024-10-07 11:28:56.903824] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.228 [2024-10-07 11:28:56.903844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.229 [2024-10-07 11:28:56.904079] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.229 [2024-10-07 11:28:56.911040] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.229 [2024-10-07 11:28:56.911214] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.229 [2024-10-07 11:28:56.911248] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.229 [2024-10-07 11:28:56.911267] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.229 [2024-10-07 11:28:56.912375] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.229 [2024-10-07 11:28:56.912618] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.229 [2024-10-07 11:28:56.912655] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.229 [2024-10-07 11:28:56.912674] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.229 [2024-10-07 11:28:56.913710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.229 [2024-10-07 11:28:56.921182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.229 [2024-10-07 11:28:56.921375] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.229 [2024-10-07 11:28:56.921447] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.229 [2024-10-07 11:28:56.921481] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.229 [2024-10-07 11:28:56.921521] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.229 [2024-10-07 11:28:56.921558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.229 [2024-10-07 11:28:56.921575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.229 [2024-10-07 11:28:56.921591] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.229 [2024-10-07 11:28:56.921626] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.229 [2024-10-07 11:28:56.933257] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.229 [2024-10-07 11:28:56.933481] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.229 [2024-10-07 11:28:56.933524] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.229 [2024-10-07 11:28:56.933545] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.229 [2024-10-07 11:28:56.933587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.229 [2024-10-07 11:28:56.933623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.229 [2024-10-07 11:28:56.933640] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.229 [2024-10-07 11:28:56.933656] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.229 [2024-10-07 11:28:56.933692] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.229 [2024-10-07 11:28:56.943521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.229 [2024-10-07 11:28:56.948706] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.229 [2024-10-07 11:28:56.948763] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.229 [2024-10-07 11:28:56.948786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.229 [2024-10-07 11:28:56.949051] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.229 [2024-10-07 11:28:56.949210] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.229 [2024-10-07 11:28:56.949238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.229 [2024-10-07 11:28:56.949255] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.229 [2024-10-07 11:28:56.950488] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.229 [2024-10-07 11:28:56.958419] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.229 [2024-10-07 11:28:56.958628] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.229 [2024-10-07 11:28:56.958665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.229 [2024-10-07 11:28:56.958683] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.229 [2024-10-07 11:28:56.958722] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.229 [2024-10-07 11:28:56.958849] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.229 [2024-10-07 11:28:56.958874] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.229 [2024-10-07 11:28:56.958889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.229 [2024-10-07 11:28:56.958925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.229 [2024-10-07 11:28:56.968579] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.229 [2024-10-07 11:28:56.968776] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.229 [2024-10-07 11:28:56.968812] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.229 [2024-10-07 11:28:56.968831] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.229 [2024-10-07 11:28:56.968870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.229 [2024-10-07 11:28:56.968942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.229 [2024-10-07 11:28:56.968963] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.229 [2024-10-07 11:28:56.968978] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.229 [2024-10-07 11:28:56.969941] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.229 [2024-10-07 11:28:56.979603] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.229 [2024-10-07 11:28:56.980022] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.229 [2024-10-07 11:28:56.980067] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.229 [2024-10-07 11:28:56.980088] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.229 [2024-10-07 11:28:56.980165] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.229 [2024-10-07 11:28:56.980206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.229 [2024-10-07 11:28:56.980223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.229 [2024-10-07 11:28:56.980238] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.229 [2024-10-07 11:28:56.980273] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.229 [2024-10-07 11:28:56.992306] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.229 [2024-10-07 11:28:56.992550] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.229 [2024-10-07 11:28:56.992588] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.229 [2024-10-07 11:28:56.992606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.229 [2024-10-07 11:28:56.992645] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.229 [2024-10-07 11:28:56.992681] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.229 [2024-10-07 11:28:56.992698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.229 [2024-10-07 11:28:56.992714] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.229 [2024-10-07 11:28:56.993489] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.229 [2024-10-07 11:28:57.003680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.229 [2024-10-07 11:28:57.003893] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.229 [2024-10-07 11:28:57.003931] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.229 [2024-10-07 11:28:57.003951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.229 [2024-10-07 11:28:57.005192] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.229 [2024-10-07 11:28:57.006447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.229 [2024-10-07 11:28:57.006487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.229 [2024-10-07 11:28:57.006507] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.229 [2024-10-07 11:28:57.006726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.229 [2024-10-07 11:28:57.015092] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.229 [2024-10-07 11:28:57.016273] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.229 [2024-10-07 11:28:57.016320] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.229 [2024-10-07 11:28:57.016341] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.229 [2024-10-07 11:28:57.016603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.229 [2024-10-07 11:28:57.016658] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.229 [2024-10-07 11:28:57.016679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.229 [2024-10-07 11:28:57.016695] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.229 [2024-10-07 11:28:57.016733] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.229 [2024-10-07 11:28:57.026212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.229 [2024-10-07 11:28:57.026438] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.229 [2024-10-07 11:28:57.026474] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.229 [2024-10-07 11:28:57.026493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.229 [2024-10-07 11:28:57.026554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.229 [2024-10-07 11:28:57.026593] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.229 [2024-10-07 11:28:57.026610] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.229 [2024-10-07 11:28:57.026625] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.229 [2024-10-07 11:28:57.026661] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.229 [2024-10-07 11:28:57.037439] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.229 [2024-10-07 11:28:57.037850] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.229 [2024-10-07 11:28:57.037895] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.229 [2024-10-07 11:28:57.037945] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.229 [2024-10-07 11:28:57.038028] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.229 [2024-10-07 11:28:57.038071] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.229 [2024-10-07 11:28:57.038090] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.229 [2024-10-07 11:28:57.038105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.229 [2024-10-07 11:28:57.038141] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.229 [2024-10-07 11:28:57.051100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.229 [2024-10-07 11:28:57.052599] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.229 [2024-10-07 11:28:57.052677] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.229 [2024-10-07 11:28:57.052719] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.229 [2024-10-07 11:28:57.053875] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.229 [2024-10-07 11:28:57.054034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.229 [2024-10-07 11:28:57.054069] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.229 [2024-10-07 11:28:57.054090] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.229 [2024-10-07 11:28:57.054134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.229 [2024-10-07 11:28:57.061656] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.229 [2024-10-07 11:28:57.063018] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.230 [2024-10-07 11:28:57.063068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.230 [2024-10-07 11:28:57.063090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.230 [2024-10-07 11:28:57.064273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.230 [2024-10-07 11:28:57.064531] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.230 [2024-10-07 11:28:57.064581] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.230 [2024-10-07 11:28:57.064602] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.230 [2024-10-07 11:28:57.064666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.230 [2024-10-07 11:28:57.072147] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.230 [2024-10-07 11:28:57.073447] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.230 [2024-10-07 11:28:57.073497] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.230 [2024-10-07 11:28:57.073519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.230 [2024-10-07 11:28:57.074719] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.230 [2024-10-07 11:28:57.074977] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.230 [2024-10-07 11:28:57.075043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.230 [2024-10-07 11:28:57.075065] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.230 [2024-10-07 11:28:57.075117] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.230 [2024-10-07 11:28:57.082307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.230 [2024-10-07 11:28:57.082542] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.230 [2024-10-07 11:28:57.082594] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.230 [2024-10-07 11:28:57.082619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.230 [2024-10-07 11:28:57.082662] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.230 [2024-10-07 11:28:57.082698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.230 [2024-10-07 11:28:57.082716] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.230 [2024-10-07 11:28:57.082732] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.230 [2024-10-07 11:28:57.082768] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.230 [2024-10-07 11:28:57.093781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.230 [2024-10-07 11:28:57.093972] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.230 [2024-10-07 11:28:57.094007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.230 [2024-10-07 11:28:57.094026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.230 [2024-10-07 11:28:57.094064] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.230 [2024-10-07 11:28:57.094100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.230 [2024-10-07 11:28:57.094117] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.230 [2024-10-07 11:28:57.094133] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.230 [2024-10-07 11:28:57.094168] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.230 8441.80 IOPS, 32.98 MiB/s [2024-10-07T11:29:07.941Z] [2024-10-07 11:28:57.104017] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.230 [2024-10-07 11:28:57.104190] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.230 [2024-10-07 11:28:57.104227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.230 [2024-10-07 11:28:57.104245] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.230 [2024-10-07 11:28:57.105289] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.230 [2024-10-07 11:28:57.105544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.230 [2024-10-07 11:28:57.105580] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.230 [2024-10-07 11:28:57.105600] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.230 [2024-10-07 11:28:57.105719] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.230 [2024-10-07 11:28:57.114162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.230 [2024-10-07 11:28:57.114330] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.230 [2024-10-07 11:28:57.114365] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.230 [2024-10-07 11:28:57.114384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.230 [2024-10-07 11:28:57.114440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.230 [2024-10-07 11:28:57.114479] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.230 [2024-10-07 11:28:57.114496] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.230 [2024-10-07 11:28:57.114511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.230 [2024-10-07 11:28:57.114546] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.230 [2024-10-07 11:28:57.124366] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.230 [2024-10-07 11:28:57.124566] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.230 [2024-10-07 11:28:57.124601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.230 [2024-10-07 11:28:57.124620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.230 [2024-10-07 11:28:57.124657] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.230 [2024-10-07 11:28:57.124693] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.230 [2024-10-07 11:28:57.124710] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.230 [2024-10-07 11:28:57.124725] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.230 [2024-10-07 11:28:57.124759] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.230 [2024-10-07 11:28:57.134850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.230 [2024-10-07 11:28:57.135034] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.230 [2024-10-07 11:28:57.135070] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.230 [2024-10-07 11:28:57.135088] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.230 [2024-10-07 11:28:57.135125] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.230 [2024-10-07 11:28:57.135160] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.230 [2024-10-07 11:28:57.135177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.230 [2024-10-07 11:28:57.135193] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.230 [2024-10-07 11:28:57.135228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.230 [2024-10-07 11:28:57.145000] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.230 [2024-10-07 11:28:57.145202] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.230 [2024-10-07 11:28:57.145239] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.230 [2024-10-07 11:28:57.145292] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.230 [2024-10-07 11:28:57.145333] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.230 [2024-10-07 11:28:57.146280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.230 [2024-10-07 11:28:57.146320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.230 [2024-10-07 11:28:57.146341] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.230 [2024-10-07 11:28:57.146564] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.230 [2024-10-07 11:28:57.156823] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.230 [2024-10-07 11:28:57.157071] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.230 [2024-10-07 11:28:57.157110] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.230 [2024-10-07 11:28:57.157129] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.230 [2024-10-07 11:28:57.157170] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.230 [2024-10-07 11:28:57.157206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.230 [2024-10-07 11:28:57.157223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.230 [2024-10-07 11:28:57.157239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.230 [2024-10-07 11:28:57.157275] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.230 [2024-10-07 11:28:57.168913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.230 [2024-10-07 11:28:57.169243] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.230 [2024-10-07 11:28:57.169288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.230 [2024-10-07 11:28:57.169308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.230 [2024-10-07 11:28:57.169369] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.230 [2024-10-07 11:28:57.169424] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.230 [2024-10-07 11:28:57.169445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.230 [2024-10-07 11:28:57.169461] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.230 [2024-10-07 11:28:57.169498] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.230 [2024-10-07 11:28:57.179538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.230 [2024-10-07 11:28:57.179730] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.230 [2024-10-07 11:28:57.179777] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.230 [2024-10-07 11:28:57.179796] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.230 [2024-10-07 11:28:57.179834] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.230 [2024-10-07 11:28:57.179869] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.230 [2024-10-07 11:28:57.179886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.230 [2024-10-07 11:28:57.179933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.230 [2024-10-07 11:28:57.179971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.230 [2024-10-07 11:28:57.189848] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.230 [2024-10-07 11:28:57.190087] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.230 [2024-10-07 11:28:57.190127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.230 [2024-10-07 11:28:57.190146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.230 [2024-10-07 11:28:57.191121] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.230 [2024-10-07 11:28:57.191380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.231 [2024-10-07 11:28:57.191432] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.231 [2024-10-07 11:28:57.191474] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.231 [2024-10-07 11:28:57.191601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.231 [2024-10-07 11:28:57.200079] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.231 [2024-10-07 11:28:57.200381] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.231 [2024-10-07 11:28:57.200452] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.231 [2024-10-07 11:28:57.200483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.231 [2024-10-07 11:28:57.200583] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.231 [2024-10-07 11:28:57.200662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.231 [2024-10-07 11:28:57.200704] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.231 [2024-10-07 11:28:57.200736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.231 [2024-10-07 11:28:57.201661] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.231 [2024-10-07 11:28:57.210374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.231 [2024-10-07 11:28:57.211588] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.231 [2024-10-07 11:28:57.211638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.231 [2024-10-07 11:28:57.211660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.231 [2024-10-07 11:28:57.211890] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.231 [2024-10-07 11:28:57.212039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.231 [2024-10-07 11:28:57.212074] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.231 [2024-10-07 11:28:57.212093] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.231 [2024-10-07 11:28:57.213372] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.231 [2024-10-07 11:28:57.220555] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.231 [2024-10-07 11:28:57.220769] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.231 [2024-10-07 11:28:57.220805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.231 [2024-10-07 11:28:57.220824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.231 [2024-10-07 11:28:57.220868] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.231 [2024-10-07 11:28:57.220915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.231 [2024-10-07 11:28:57.220933] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.231 [2024-10-07 11:28:57.220949] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.231 [2024-10-07 11:28:57.220985] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.231 [2024-10-07 11:28:57.231809] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.231 [2024-10-07 11:28:57.232248] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.231 [2024-10-07 11:28:57.232295] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.231 [2024-10-07 11:28:57.232317] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.231 [2024-10-07 11:28:57.232394] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.231 [2024-10-07 11:28:57.232474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.231 [2024-10-07 11:28:57.232496] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.231 [2024-10-07 11:28:57.232512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.231 [2024-10-07 11:28:57.232548] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.231 [2024-10-07 11:28:57.243941] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.231 [2024-10-07 11:28:57.245498] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.231 [2024-10-07 11:28:57.245552] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.231 [2024-10-07 11:28:57.245575] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.231 [2024-10-07 11:28:57.246495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.231 [2024-10-07 11:28:57.247393] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.231 [2024-10-07 11:28:57.247446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.231 [2024-10-07 11:28:57.247467] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.231 [2024-10-07 11:28:57.247586] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.231 [2024-10-07 11:28:57.254350] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.231 [2024-10-07 11:28:57.254529] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.231 [2024-10-07 11:28:57.254565] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.231 [2024-10-07 11:28:57.254583] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.231 [2024-10-07 11:28:57.254657] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.231 [2024-10-07 11:28:57.254694] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.231 [2024-10-07 11:28:57.254710] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.231 [2024-10-07 11:28:57.254725] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.231 [2024-10-07 11:28:57.254760] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.231 [2024-10-07 11:28:57.264622] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.231 [2024-10-07 11:28:57.264806] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.231 [2024-10-07 11:28:57.264842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.231 [2024-10-07 11:28:57.264860] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.231 [2024-10-07 11:28:57.264898] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.231 [2024-10-07 11:28:57.264934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.231 [2024-10-07 11:28:57.264950] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.231 [2024-10-07 11:28:57.264965] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.231 [2024-10-07 11:28:57.264999] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.231 [2024-10-07 11:28:57.276061] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.231 [2024-10-07 11:28:57.276485] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.231 [2024-10-07 11:28:57.276521] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.231 [2024-10-07 11:28:57.276540] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.231 [2024-10-07 11:28:57.276639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.231 [2024-10-07 11:28:57.276681] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.231 [2024-10-07 11:28:57.276699] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.231 [2024-10-07 11:28:57.276714] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.231 [2024-10-07 11:28:57.276750] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.231 [2024-10-07 11:28:57.287082] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:18:26.231 [2024-10-07 11:28:57.287177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287198] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:26.231 [2024-10-07 11:28:57.287213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287228] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:26.231 [2024-10-07 11:28:57.287241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287282] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:26.231 [2024-10-07 11:28:57.287298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.231 [2024-10-07 11:28:57.287415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:88608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.231 [2024-10-07 11:28:57.287442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:88616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.231 [2024-10-07 11:28:57.287483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:88624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.231 [2024-10-07 11:28:57.287514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:88632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.231 [2024-10-07 11:28:57.287543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:88640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.231 [2024-10-07 11:28:57.287573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:88648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.231 [2024-10-07 11:28:57.287603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:88656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.231 [2024-10-07 11:28:57.287632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:88664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.231 [2024-10-07 11:28:57.287662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:88672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.231 [2024-10-07 11:28:57.287693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:88680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.231 [2024-10-07 11:28:57.287722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:88688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.231 [2024-10-07 11:28:57.287752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:88696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.231 [2024-10-07 11:28:57.287794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:88704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.231 [2024-10-07 11:28:57.287826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:89032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.231 [2024-10-07 11:28:57.287857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:89040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.231 [2024-10-07 11:28:57.287887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:89048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.231 [2024-10-07 11:28:57.287918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:89056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.231 [2024-10-07 11:28:57.287948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:89064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.231 [2024-10-07 11:28:57.287979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.231 [2024-10-07 11:28:57.287996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:89072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:89080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:89088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:89096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:89104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:89112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:89120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:89128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:89136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:89144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:89152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:89160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:89168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:89176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:89184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:88712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.232 [2024-10-07 11:28:57.288491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:88720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.232 [2024-10-07 11:28:57.288521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:88728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.232 [2024-10-07 11:28:57.288551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:88736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.232 [2024-10-07 11:28:57.288589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:88744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.232 [2024-10-07 11:28:57.288620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:88752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.232 [2024-10-07 11:28:57.288650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:88760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.232 [2024-10-07 11:28:57.288680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:88768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.232 [2024-10-07 11:28:57.288711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:89192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:89200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:89208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:89216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:89224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:89232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:89240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.288979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.288996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:89248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:89256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:89264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:89272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:89280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:89288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:89296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:89304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:89312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:89320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:89328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:88776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.232 [2024-10-07 11:28:57.289371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:88784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.232 [2024-10-07 11:28:57.289415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:88792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.232 [2024-10-07 11:28:57.289451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:88800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.232 [2024-10-07 11:28:57.289491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:88808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.232 [2024-10-07 11:28:57.289521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:88816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.232 [2024-10-07 11:28:57.289551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:88824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.232 [2024-10-07 11:28:57.289581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:88832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.232 [2024-10-07 11:28:57.289612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:89336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:89344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:89352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:89360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:89368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:89376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:89384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:89392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.232 [2024-10-07 11:28:57.289882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:89400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.232 [2024-10-07 11:28:57.289896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.289913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:89408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.289926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.289942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:89416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.289957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.289974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:89424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.289999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:89432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:89440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:89448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:89456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:89464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:89472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:88840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.290210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:88848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.290239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:88856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.290277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:88864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.290307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:88872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.290337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:88880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.290367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:88888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.290397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:88896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.290441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:89480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:89488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:89496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:89504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:89512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:89520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:89528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:89536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:89544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:89552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:89560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:89568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:89576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:89584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:89592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:89600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:89608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.290979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:89616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.290994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.291010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:89624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:26.233 [2024-10-07 11:28:57.291024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.291041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:88904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.291061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.291078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:88912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.291092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.291108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:88920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.291122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.291147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:88928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.291161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.291176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:88936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.291190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.291206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:88944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.291220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.291236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:88952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.291249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.291265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:88960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.291279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.291295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:88968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.291309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.291325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:88976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.291339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.291355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:88984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.291369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.291385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:88992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.291409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.291427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:89000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.291442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.291466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:89008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.291482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.291498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:89016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:26.233 [2024-10-07 11:28:57.291512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.291586] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:26.233 [2024-10-07 11:28:57.291603] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:26.233 [2024-10-07 11:28:57.291615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:89024 len:8 PRP1 0x0 PRP2 0x0 00:18:26.233 [2024-10-07 11:28:57.291629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:26.233 [2024-10-07 11:28:57.291686] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1490020 was disconnected and freed. reset controller. 00:18:26.233 [2024-10-07 11:28:57.292846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.234 [2024-10-07 11:28:57.292884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.234 [2024-10-07 11:28:57.292913] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.234 [2024-10-07 11:28:57.293168] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.234 [2024-10-07 11:28:57.293200] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.234 [2024-10-07 11:28:57.293217] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.234 [2024-10-07 11:28:57.293430] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.234 [2024-10-07 11:28:57.293460] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.234 [2024-10-07 11:28:57.293477] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.234 [2024-10-07 11:28:57.293495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.234 [2024-10-07 11:28:57.293736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.234 [2024-10-07 11:28:57.293766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.234 [2024-10-07 11:28:57.293781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.234 [2024-10-07 11:28:57.293797] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.234 [2024-10-07 11:28:57.293849] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.234 [2024-10-07 11:28:57.293871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.234 [2024-10-07 11:28:57.293886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.234 [2024-10-07 11:28:57.293900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.234 [2024-10-07 11:28:57.293929] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.234 [2024-10-07 11:28:57.303443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.234 [2024-10-07 11:28:57.303598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.234 [2024-10-07 11:28:57.303736] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.234 [2024-10-07 11:28:57.303772] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.234 [2024-10-07 11:28:57.303791] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.234 [2024-10-07 11:28:57.304976] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.234 [2024-10-07 11:28:57.305023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.234 [2024-10-07 11:28:57.305043] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.234 [2024-10-07 11:28:57.305082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.234 [2024-10-07 11:28:57.305326] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.234 [2024-10-07 11:28:57.305366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.234 [2024-10-07 11:28:57.305385] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.234 [2024-10-07 11:28:57.305413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.234 [2024-10-07 11:28:57.306463] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.234 [2024-10-07 11:28:57.306502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.234 [2024-10-07 11:28:57.306519] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.234 [2024-10-07 11:28:57.306534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.234 [2024-10-07 11:28:57.306820] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.234 [2024-10-07 11:28:57.313631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.234 [2024-10-07 11:28:57.313855] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.234 [2024-10-07 11:28:57.313892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.234 [2024-10-07 11:28:57.313911] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.234 [2024-10-07 11:28:57.313965] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.234 [2024-10-07 11:28:57.314004] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.234 [2024-10-07 11:28:57.314034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.234 [2024-10-07 11:28:57.314050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.234 [2024-10-07 11:28:57.314067] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.234 [2024-10-07 11:28:57.314096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.234 [2024-10-07 11:28:57.314151] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.234 [2024-10-07 11:28:57.314176] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.234 [2024-10-07 11:28:57.314192] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.234 [2024-10-07 11:28:57.314248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.234 [2024-10-07 11:28:57.314280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.234 [2024-10-07 11:28:57.314297] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.234 [2024-10-07 11:28:57.314311] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.234 [2024-10-07 11:28:57.314339] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.234 [2024-10-07 11:28:57.325729] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.234 [2024-10-07 11:28:57.325808] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.234 [2024-10-07 11:28:57.325966] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.234 [2024-10-07 11:28:57.326002] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.234 [2024-10-07 11:28:57.326021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.234 [2024-10-07 11:28:57.326069] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.234 [2024-10-07 11:28:57.326092] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.234 [2024-10-07 11:28:57.326108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.234 [2024-10-07 11:28:57.326142] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.234 [2024-10-07 11:28:57.326164] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.234 [2024-10-07 11:28:57.326190] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.234 [2024-10-07 11:28:57.326207] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.234 [2024-10-07 11:28:57.326222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.234 [2024-10-07 11:28:57.326239] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.234 [2024-10-07 11:28:57.326253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.234 [2024-10-07 11:28:57.326266] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.234 [2024-10-07 11:28:57.326296] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.234 [2024-10-07 11:28:57.326313] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.234 [2024-10-07 11:28:57.335900] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.234 [2024-10-07 11:28:57.336016] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.234 [2024-10-07 11:28:57.336127] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.234 [2024-10-07 11:28:57.336159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.234 [2024-10-07 11:28:57.336176] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.234 [2024-10-07 11:28:57.337265] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.234 [2024-10-07 11:28:57.337307] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.234 [2024-10-07 11:28:57.337327] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.234 [2024-10-07 11:28:57.337372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.234 [2024-10-07 11:28:57.337596] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.234 [2024-10-07 11:28:57.337626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.234 [2024-10-07 11:28:57.337641] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.234 [2024-10-07 11:28:57.337656] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.234 [2024-10-07 11:28:57.337769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.234 [2024-10-07 11:28:57.337789] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.234 [2024-10-07 11:28:57.337802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.234 [2024-10-07 11:28:57.337816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.234 [2024-10-07 11:28:57.339012] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.234 [2024-10-07 11:28:57.346049] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.234 [2024-10-07 11:28:57.346222] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.234 [2024-10-07 11:28:57.346257] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.234 [2024-10-07 11:28:57.346275] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.234 [2024-10-07 11:28:57.347237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.234 [2024-10-07 11:28:57.347479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.234 [2024-10-07 11:28:57.347529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.234 [2024-10-07 11:28:57.347549] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.234 [2024-10-07 11:28:57.347565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.234 [2024-10-07 11:28:57.347677] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.234 [2024-10-07 11:28:57.347755] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.234 [2024-10-07 11:28:57.347783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.234 [2024-10-07 11:28:57.347799] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.234 [2024-10-07 11:28:57.348918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.234 [2024-10-07 11:28:57.350176] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.234 [2024-10-07 11:28:57.350218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.234 [2024-10-07 11:28:57.350238] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.234 [2024-10-07 11:28:57.350482] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.234 [2024-10-07 11:28:57.356907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.234 [2024-10-07 11:28:57.357335] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.234 [2024-10-07 11:28:57.357422] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.234 [2024-10-07 11:28:57.357455] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.234 [2024-10-07 11:28:57.357532] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.234 [2024-10-07 11:28:57.357591] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.234 [2024-10-07 11:28:57.357612] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.234 [2024-10-07 11:28:57.357627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.234 [2024-10-07 11:28:57.357670] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.234 [2024-10-07 11:28:57.357702] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.234 [2024-10-07 11:28:57.357784] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.234 [2024-10-07 11:28:57.357812] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.234 [2024-10-07 11:28:57.357828] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.234 [2024-10-07 11:28:57.357858] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.234 [2024-10-07 11:28:57.357888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.234 [2024-10-07 11:28:57.357904] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.234 [2024-10-07 11:28:57.357917] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.234 [2024-10-07 11:28:57.357945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.234 [2024-10-07 11:28:57.369161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.234 [2024-10-07 11:28:57.369249] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.234 [2024-10-07 11:28:57.369512] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.234 [2024-10-07 11:28:57.369548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.234 [2024-10-07 11:28:57.369566] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.234 [2024-10-07 11:28:57.369615] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.234 [2024-10-07 11:28:57.369637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.235 [2024-10-07 11:28:57.369652] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.235 [2024-10-07 11:28:57.369707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.235 [2024-10-07 11:28:57.369734] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.235 [2024-10-07 11:28:57.369761] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.235 [2024-10-07 11:28:57.369778] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.235 [2024-10-07 11:28:57.369793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.235 [2024-10-07 11:28:57.369811] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.235 [2024-10-07 11:28:57.369848] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.235 [2024-10-07 11:28:57.369863] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.235 [2024-10-07 11:28:57.369894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.235 [2024-10-07 11:28:57.369911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.235 [2024-10-07 11:28:57.379468] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.235 [2024-10-07 11:28:57.379572] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.235 [2024-10-07 11:28:57.379707] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.235 [2024-10-07 11:28:57.379742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.235 [2024-10-07 11:28:57.379760] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.235 [2024-10-07 11:28:57.379807] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.235 [2024-10-07 11:28:57.379829] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.235 [2024-10-07 11:28:57.379845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.235 [2024-10-07 11:28:57.379879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.235 [2024-10-07 11:28:57.379902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.235 [2024-10-07 11:28:57.380924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.235 [2024-10-07 11:28:57.380962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.235 [2024-10-07 11:28:57.380981] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.235 [2024-10-07 11:28:57.380999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.235 [2024-10-07 11:28:57.381012] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.235 [2024-10-07 11:28:57.381026] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.235 [2024-10-07 11:28:57.381262] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.235 [2024-10-07 11:28:57.381288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.235 [2024-10-07 11:28:57.389663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.235 [2024-10-07 11:28:57.389764] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.235 [2024-10-07 11:28:57.389867] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.235 [2024-10-07 11:28:57.389898] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.235 [2024-10-07 11:28:57.389922] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.235 [2024-10-07 11:28:57.391146] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.235 [2024-10-07 11:28:57.391219] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.235 [2024-10-07 11:28:57.391258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.235 [2024-10-07 11:28:57.391299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.235 [2024-10-07 11:28:57.391678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.235 [2024-10-07 11:28:57.391745] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.235 [2024-10-07 11:28:57.391779] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.235 [2024-10-07 11:28:57.391808] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.235 [2024-10-07 11:28:57.392005] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.235 [2024-10-07 11:28:57.392047] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.235 [2024-10-07 11:28:57.392076] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.235 [2024-10-07 11:28:57.392105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.235 [2024-10-07 11:28:57.393633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.235 [2024-10-07 11:28:57.402378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.235 [2024-10-07 11:28:57.402538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.235 [2024-10-07 11:28:57.402859] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.235 [2024-10-07 11:28:57.402924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.235 [2024-10-07 11:28:57.402960] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.235 [2024-10-07 11:28:57.403052] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.235 [2024-10-07 11:28:57.403093] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.235 [2024-10-07 11:28:57.403124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.235 [2024-10-07 11:28:57.404231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.235 [2024-10-07 11:28:57.404304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.235 [2024-10-07 11:28:57.404605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.235 [2024-10-07 11:28:57.404664] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.235 [2024-10-07 11:28:57.404698] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.235 [2024-10-07 11:28:57.404737] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.235 [2024-10-07 11:28:57.404769] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.235 [2024-10-07 11:28:57.404799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.235 [2024-10-07 11:28:57.406029] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.235 [2024-10-07 11:28:57.406077] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.235 [2024-10-07 11:28:57.414097] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.235 [2024-10-07 11:28:57.414239] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.235 [2024-10-07 11:28:57.415369] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.235 [2024-10-07 11:28:57.415519] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.235 [2024-10-07 11:28:57.415558] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.235 [2024-10-07 11:28:57.415644] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.235 [2024-10-07 11:28:57.415689] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.235 [2024-10-07 11:28:57.415723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.235 [2024-10-07 11:28:57.416851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.235 [2024-10-07 11:28:57.416933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.235 [2024-10-07 11:28:57.417132] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.235 [2024-10-07 11:28:57.417186] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.235 [2024-10-07 11:28:57.417221] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.235 [2024-10-07 11:28:57.417263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.235 [2024-10-07 11:28:57.417294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.235 [2024-10-07 11:28:57.417320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.235 [2024-10-07 11:28:57.417380] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.235 [2024-10-07 11:28:57.417444] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.235 [2024-10-07 11:28:57.425388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.235 [2024-10-07 11:28:57.425554] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.235 [2024-10-07 11:28:57.426994] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.235 [2024-10-07 11:28:57.427049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.235 [2024-10-07 11:28:57.427073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.235 [2024-10-07 11:28:57.427131] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.235 [2024-10-07 11:28:57.427155] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.235 [2024-10-07 11:28:57.427171] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.235 [2024-10-07 11:28:57.428232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.235 [2024-10-07 11:28:57.428282] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.235 [2024-10-07 11:28:57.428622] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.235 [2024-10-07 11:28:57.428663] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.235 [2024-10-07 11:28:57.428684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.235 [2024-10-07 11:28:57.428709] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.235 [2024-10-07 11:28:57.428723] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.235 [2024-10-07 11:28:57.428765] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.235 [2024-10-07 11:28:57.428917] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.235 [2024-10-07 11:28:57.428944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.235 [2024-10-07 11:28:57.435837] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.235 [2024-10-07 11:28:57.435953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.235 [2024-10-07 11:28:57.436105] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.235 [2024-10-07 11:28:57.436143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.235 [2024-10-07 11:28:57.436162] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.235 [2024-10-07 11:28:57.436211] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.235 [2024-10-07 11:28:57.436234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.235 [2024-10-07 11:28:57.436250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.235 [2024-10-07 11:28:57.436284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.235 [2024-10-07 11:28:57.436307] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.235 [2024-10-07 11:28:57.436356] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.236 [2024-10-07 11:28:57.436376] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.236 [2024-10-07 11:28:57.436393] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.236 [2024-10-07 11:28:57.436426] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.236 [2024-10-07 11:28:57.436443] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.236 [2024-10-07 11:28:57.436456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.236 [2024-10-07 11:28:57.436487] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.236 [2024-10-07 11:28:57.436505] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.236 [2024-10-07 11:28:57.447330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.236 [2024-10-07 11:28:57.447440] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.236 [2024-10-07 11:28:57.447696] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.236 [2024-10-07 11:28:57.447743] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.236 [2024-10-07 11:28:57.447764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.236 [2024-10-07 11:28:57.447815] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.236 [2024-10-07 11:28:57.447838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.236 [2024-10-07 11:28:57.447854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.236 [2024-10-07 11:28:57.447910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.236 [2024-10-07 11:28:57.447964] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.236 [2024-10-07 11:28:57.447994] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.236 [2024-10-07 11:28:57.448012] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.236 [2024-10-07 11:28:57.448027] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.236 [2024-10-07 11:28:57.448045] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.236 [2024-10-07 11:28:57.448059] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.236 [2024-10-07 11:28:57.448073] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.236 [2024-10-07 11:28:57.448103] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.236 [2024-10-07 11:28:57.448119] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.236 [2024-10-07 11:28:57.457624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.236 [2024-10-07 11:28:57.457708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.236 [2024-10-07 11:28:57.457834] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.236 [2024-10-07 11:28:57.457868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.236 [2024-10-07 11:28:57.457885] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.236 [2024-10-07 11:28:57.457933] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.236 [2024-10-07 11:28:57.457956] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.236 [2024-10-07 11:28:57.457972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.236 [2024-10-07 11:28:57.458005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.236 [2024-10-07 11:28:57.458028] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.236 [2024-10-07 11:28:57.458053] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.236 [2024-10-07 11:28:57.458070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.236 [2024-10-07 11:28:57.458085] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.236 [2024-10-07 11:28:57.458101] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.236 [2024-10-07 11:28:57.458115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.236 [2024-10-07 11:28:57.458128] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.236 [2024-10-07 11:28:57.459154] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.236 [2024-10-07 11:28:57.459192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.236 [2024-10-07 11:28:57.467798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.236 [2024-10-07 11:28:57.467904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.236 [2024-10-07 11:28:57.468009] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.236 [2024-10-07 11:28:57.468040] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.236 [2024-10-07 11:28:57.468093] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.236 [2024-10-07 11:28:57.469091] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.236 [2024-10-07 11:28:57.469135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.236 [2024-10-07 11:28:57.469155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.236 [2024-10-07 11:28:57.469176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.236 [2024-10-07 11:28:57.469373] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.236 [2024-10-07 11:28:57.469441] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.236 [2024-10-07 11:28:57.469464] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.236 [2024-10-07 11:28:57.469479] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.236 [2024-10-07 11:28:57.469598] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.236 [2024-10-07 11:28:57.469619] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.236 [2024-10-07 11:28:57.469632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.236 [2024-10-07 11:28:57.469646] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.236 [2024-10-07 11:28:57.470755] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.236 [2024-10-07 11:28:57.477941] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.236 [2024-10-07 11:28:57.478817] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.236 [2024-10-07 11:28:57.478863] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.236 [2024-10-07 11:28:57.478884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.236 [2024-10-07 11:28:57.479741] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.236 [2024-10-07 11:28:57.479797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.236 [2024-10-07 11:28:57.479952] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.236 [2024-10-07 11:28:57.479982] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.236 [2024-10-07 11:28:57.479999] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.236 [2024-10-07 11:28:57.480013] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.236 [2024-10-07 11:28:57.480027] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.236 [2024-10-07 11:28:57.480042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.236 [2024-10-07 11:28:57.480096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.236 [2024-10-07 11:28:57.480120] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.236 [2024-10-07 11:28:57.480148] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.236 [2024-10-07 11:28:57.480165] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.236 [2024-10-07 11:28:57.480208] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.236 [2024-10-07 11:28:57.480239] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.236 [2024-10-07 11:28:57.488936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.236 [2024-10-07 11:28:57.489123] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.236 [2024-10-07 11:28:57.489157] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.236 [2024-10-07 11:28:57.489175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.236 [2024-10-07 11:28:57.490385] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.236 [2024-10-07 11:28:57.491465] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.236 [2024-10-07 11:28:57.491503] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.236 [2024-10-07 11:28:57.491523] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.236 [2024-10-07 11:28:57.491793] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.236 [2024-10-07 11:28:57.491825] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.236 [2024-10-07 11:28:57.492027] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.236 [2024-10-07 11:28:57.492060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.236 [2024-10-07 11:28:57.492077] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.236 [2024-10-07 11:28:57.492161] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.236 [2024-10-07 11:28:57.492228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.236 [2024-10-07 11:28:57.492262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.236 [2024-10-07 11:28:57.492286] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.236 [2024-10-07 11:28:57.492336] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.236 [2024-10-07 11:28:57.499075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.236 [2024-10-07 11:28:57.499226] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.237 [2024-10-07 11:28:57.499261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.237 [2024-10-07 11:28:57.499280] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.237 [2024-10-07 11:28:57.499315] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.237 [2024-10-07 11:28:57.500543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.237 [2024-10-07 11:28:57.500594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.237 [2024-10-07 11:28:57.500624] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.237 [2024-10-07 11:28:57.500926] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.237 [2024-10-07 11:28:57.504305] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.237 [2024-10-07 11:28:57.504560] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.237 [2024-10-07 11:28:57.504610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.237 [2024-10-07 11:28:57.504633] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.237 [2024-10-07 11:28:57.505705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.237 [2024-10-07 11:28:57.505963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.237 [2024-10-07 11:28:57.506012] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.237 [2024-10-07 11:28:57.506048] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.237 [2024-10-07 11:28:57.506214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.237 [2024-10-07 11:28:57.509209] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.237 [2024-10-07 11:28:57.509480] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.237 [2024-10-07 11:28:57.509543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.237 [2024-10-07 11:28:57.509580] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.237 [2024-10-07 11:28:57.510511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.237 [2024-10-07 11:28:57.511573] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.237 [2024-10-07 11:28:57.511619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.237 [2024-10-07 11:28:57.511641] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.237 [2024-10-07 11:28:57.511764] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.237 [2024-10-07 11:28:57.514796] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.237 [2024-10-07 11:28:57.514945] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.237 [2024-10-07 11:28:57.514991] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.237 [2024-10-07 11:28:57.515012] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.237 [2024-10-07 11:28:57.515046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.237 [2024-10-07 11:28:57.515078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.237 [2024-10-07 11:28:57.515094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.237 [2024-10-07 11:28:57.515110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.237 [2024-10-07 11:28:57.515140] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.237 [2024-10-07 11:28:57.519445] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.237 [2024-10-07 11:28:57.519578] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.237 [2024-10-07 11:28:57.519617] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.237 [2024-10-07 11:28:57.519636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.237 [2024-10-07 11:28:57.519669] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.237 [2024-10-07 11:28:57.519730] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.237 [2024-10-07 11:28:57.519747] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.237 [2024-10-07 11:28:57.519762] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.237 [2024-10-07 11:28:57.519792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.237 [2024-10-07 11:28:57.526068] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.237 [2024-10-07 11:28:57.526476] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.237 [2024-10-07 11:28:57.526520] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.237 [2024-10-07 11:28:57.526542] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.237 [2024-10-07 11:28:57.526615] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.237 [2024-10-07 11:28:57.526652] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.237 [2024-10-07 11:28:57.526670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.237 [2024-10-07 11:28:57.526686] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.237 [2024-10-07 11:28:57.526717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.237 [2024-10-07 11:28:57.529541] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.237 [2024-10-07 11:28:57.529665] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.237 [2024-10-07 11:28:57.529697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.237 [2024-10-07 11:28:57.529714] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.237 [2024-10-07 11:28:57.529745] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.237 [2024-10-07 11:28:57.529775] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.237 [2024-10-07 11:28:57.529791] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.237 [2024-10-07 11:28:57.529806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.237 [2024-10-07 11:28:57.529836] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.237 [2024-10-07 11:28:57.538353] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.237 [2024-10-07 11:28:57.538539] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.237 [2024-10-07 11:28:57.538584] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.237 [2024-10-07 11:28:57.538606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.237 [2024-10-07 11:28:57.538640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.237 [2024-10-07 11:28:57.538672] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.237 [2024-10-07 11:28:57.538689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.237 [2024-10-07 11:28:57.538704] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.237 [2024-10-07 11:28:57.538767] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.237 [2024-10-07 11:28:57.540444] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.237 [2024-10-07 11:28:57.540788] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.237 [2024-10-07 11:28:57.540830] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.237 [2024-10-07 11:28:57.540851] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.237 [2024-10-07 11:28:57.540921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.237 [2024-10-07 11:28:57.540958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.237 [2024-10-07 11:28:57.540975] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.237 [2024-10-07 11:28:57.540989] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.237 [2024-10-07 11:28:57.541039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.237 [2024-10-07 11:28:57.548485] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.237 [2024-10-07 11:28:57.548646] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.237 [2024-10-07 11:28:57.548681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.237 [2024-10-07 11:28:57.548700] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.237 [2024-10-07 11:28:57.548733] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.237 [2024-10-07 11:28:57.548764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.237 [2024-10-07 11:28:57.548781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.237 [2024-10-07 11:28:57.548797] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.237 [2024-10-07 11:28:57.548827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.237 [2024-10-07 11:28:57.552909] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.237 [2024-10-07 11:28:57.553197] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.237 [2024-10-07 11:28:57.553247] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.237 [2024-10-07 11:28:57.553267] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.237 [2024-10-07 11:28:57.553334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.237 [2024-10-07 11:28:57.553370] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.237 [2024-10-07 11:28:57.553388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.237 [2024-10-07 11:28:57.553420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.237 [2024-10-07 11:28:57.553455] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.237 [2024-10-07 11:28:57.558682] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.237 [2024-10-07 11:28:57.558877] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.237 [2024-10-07 11:28:57.558948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.237 [2024-10-07 11:28:57.558969] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.237 [2024-10-07 11:28:57.559006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.237 [2024-10-07 11:28:57.559037] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.237 [2024-10-07 11:28:57.559054] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.237 [2024-10-07 11:28:57.559069] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.237 [2024-10-07 11:28:57.559099] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.237 [2024-10-07 11:28:57.563370] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.237 [2024-10-07 11:28:57.563582] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.237 [2024-10-07 11:28:57.563618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.237 [2024-10-07 11:28:57.563636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.237 [2024-10-07 11:28:57.563671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.237 [2024-10-07 11:28:57.563702] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.237 [2024-10-07 11:28:57.563719] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.237 [2024-10-07 11:28:57.563734] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.237 [2024-10-07 11:28:57.563775] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.237 [2024-10-07 11:28:57.568846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.237 [2024-10-07 11:28:57.569784] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.237 [2024-10-07 11:28:57.569834] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.237 [2024-10-07 11:28:57.569855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.237 [2024-10-07 11:28:57.570729] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.237 [2024-10-07 11:28:57.570863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.238 [2024-10-07 11:28:57.570891] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.238 [2024-10-07 11:28:57.570907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.238 [2024-10-07 11:28:57.570943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.238 [2024-10-07 11:28:57.573665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.238 [2024-10-07 11:28:57.573864] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.238 [2024-10-07 11:28:57.573900] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.238 [2024-10-07 11:28:57.573919] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.238 [2024-10-07 11:28:57.573955] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.238 [2024-10-07 11:28:57.574028] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.238 [2024-10-07 11:28:57.574046] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.238 [2024-10-07 11:28:57.574063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.238 [2024-10-07 11:28:57.574094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.238 [2024-10-07 11:28:57.580180] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.238 [2024-10-07 11:28:57.580422] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.238 [2024-10-07 11:28:57.580460] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.238 [2024-10-07 11:28:57.580479] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.238 [2024-10-07 11:28:57.581739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.238 [2024-10-07 11:28:57.582977] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.238 [2024-10-07 11:28:57.583022] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.238 [2024-10-07 11:28:57.583044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.238 [2024-10-07 11:28:57.583279] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.238 [2024-10-07 11:28:57.585205] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.238 [2024-10-07 11:28:57.585633] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.238 [2024-10-07 11:28:57.585681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.238 [2024-10-07 11:28:57.585703] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.238 [2024-10-07 11:28:57.585792] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.238 [2024-10-07 11:28:57.585830] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.238 [2024-10-07 11:28:57.585847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.238 [2024-10-07 11:28:57.585864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.238 [2024-10-07 11:28:57.585896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.238 [2024-10-07 11:28:57.590361] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.238 [2024-10-07 11:28:57.591663] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.238 [2024-10-07 11:28:57.591718] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.238 [2024-10-07 11:28:57.591740] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.238 [2024-10-07 11:28:57.591967] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.238 [2024-10-07 11:28:57.593037] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.238 [2024-10-07 11:28:57.593095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.238 [2024-10-07 11:28:57.593116] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.238 [2024-10-07 11:28:57.593415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.238 [2024-10-07 11:28:57.597742] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.238 [2024-10-07 11:28:57.597986] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.238 [2024-10-07 11:28:57.598022] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.238 [2024-10-07 11:28:57.598041] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.238 [2024-10-07 11:28:57.598077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.238 [2024-10-07 11:28:57.598110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.238 [2024-10-07 11:28:57.598126] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.238 [2024-10-07 11:28:57.598142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.238 [2024-10-07 11:28:57.598173] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.238 [2024-10-07 11:28:57.600524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.238 [2024-10-07 11:28:57.600669] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.238 [2024-10-07 11:28:57.600703] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.238 [2024-10-07 11:28:57.600721] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.238 [2024-10-07 11:28:57.600755] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.238 [2024-10-07 11:28:57.600786] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.238 [2024-10-07 11:28:57.600803] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.238 [2024-10-07 11:28:57.600818] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.238 [2024-10-07 11:28:57.600847] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.238 [2024-10-07 11:28:57.607919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.238 [2024-10-07 11:28:57.608115] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.238 [2024-10-07 11:28:57.608151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.238 [2024-10-07 11:28:57.608169] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.238 [2024-10-07 11:28:57.608204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.238 [2024-10-07 11:28:57.609283] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.238 [2024-10-07 11:28:57.609326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.238 [2024-10-07 11:28:57.609346] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.238 [2024-10-07 11:28:57.609565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.238 [2024-10-07 11:28:57.612345] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.238 [2024-10-07 11:28:57.612564] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.238 [2024-10-07 11:28:57.612600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.238 [2024-10-07 11:28:57.612650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.238 [2024-10-07 11:28:57.612689] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.238 [2024-10-07 11:28:57.612720] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.238 [2024-10-07 11:28:57.612738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.238 [2024-10-07 11:28:57.612753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.238 [2024-10-07 11:28:57.612785] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.238 [2024-10-07 11:28:57.618085] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.238 [2024-10-07 11:28:57.618315] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.238 [2024-10-07 11:28:57.618353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.238 [2024-10-07 11:28:57.618372] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.238 [2024-10-07 11:28:57.619332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.238 [2024-10-07 11:28:57.619589] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.238 [2024-10-07 11:28:57.619625] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.238 [2024-10-07 11:28:57.619644] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.238 [2024-10-07 11:28:57.619724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.238 [2024-10-07 11:28:57.622481] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.238 [2024-10-07 11:28:57.622614] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.238 [2024-10-07 11:28:57.622647] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.238 [2024-10-07 11:28:57.622664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.238 [2024-10-07 11:28:57.622696] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.238 [2024-10-07 11:28:57.622725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.238 [2024-10-07 11:28:57.622742] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.238 [2024-10-07 11:28:57.622757] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.238 [2024-10-07 11:28:57.622786] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.238 [2024-10-07 11:28:57.629161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.238 [2024-10-07 11:28:57.629666] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.238 [2024-10-07 11:28:57.629715] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.238 [2024-10-07 11:28:57.629736] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.238 [2024-10-07 11:28:57.629813] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.238 [2024-10-07 11:28:57.629852] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.238 [2024-10-07 11:28:57.629906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.238 [2024-10-07 11:28:57.629924] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.238 [2024-10-07 11:28:57.629958] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.238 [2024-10-07 11:28:57.632936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.238 [2024-10-07 11:28:57.633202] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.238 [2024-10-07 11:28:57.633239] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.238 [2024-10-07 11:28:57.633258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.238 [2024-10-07 11:28:57.633294] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.238 [2024-10-07 11:28:57.633325] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.238 [2024-10-07 11:28:57.633342] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.238 [2024-10-07 11:28:57.633358] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.238 [2024-10-07 11:28:57.633390] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.238 [2024-10-07 11:28:57.639521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.238 [2024-10-07 11:28:57.639779] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.238 [2024-10-07 11:28:57.639820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.238 [2024-10-07 11:28:57.639839] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.238 [2024-10-07 11:28:57.641123] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.238 [2024-10-07 11:28:57.642371] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.238 [2024-10-07 11:28:57.642429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.238 [2024-10-07 11:28:57.642452] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.238 [2024-10-07 11:28:57.642725] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.238 [2024-10-07 11:28:57.643788] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.238 [2024-10-07 11:28:57.644554] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.238 [2024-10-07 11:28:57.644601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.238 [2024-10-07 11:28:57.644622] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.238 [2024-10-07 11:28:57.644968] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.238 [2024-10-07 11:28:57.645088] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.238 [2024-10-07 11:28:57.645123] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.238 [2024-10-07 11:28:57.645139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.238 [2024-10-07 11:28:57.645175] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.238 [2024-10-07 11:28:57.649720] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.238 [2024-10-07 11:28:57.651082] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.238 [2024-10-07 11:28:57.651135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.238 [2024-10-07 11:28:57.651157] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.238 [2024-10-07 11:28:57.651417] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.238 [2024-10-07 11:28:57.652465] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.238 [2024-10-07 11:28:57.652502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.238 [2024-10-07 11:28:57.652523] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.238 [2024-10-07 11:28:57.652786] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.239 [2024-10-07 11:28:57.654292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.239 [2024-10-07 11:28:57.654459] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.239 [2024-10-07 11:28:57.654495] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.239 [2024-10-07 11:28:57.654513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.239 [2024-10-07 11:28:57.655872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.239 [2024-10-07 11:28:57.657335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.239 [2024-10-07 11:28:57.657394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.239 [2024-10-07 11:28:57.657432] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.239 [2024-10-07 11:28:57.657684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.239 [2024-10-07 11:28:57.659968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.239 [2024-10-07 11:28:57.660158] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.239 [2024-10-07 11:28:57.660194] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.239 [2024-10-07 11:28:57.660213] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.239 [2024-10-07 11:28:57.660250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.239 [2024-10-07 11:28:57.660282] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.239 [2024-10-07 11:28:57.660299] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.239 [2024-10-07 11:28:57.660315] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.239 [2024-10-07 11:28:57.660346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.239 [2024-10-07 11:28:57.664547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.239 [2024-10-07 11:28:57.664765] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.239 [2024-10-07 11:28:57.664800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.239 [2024-10-07 11:28:57.664819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.239 [2024-10-07 11:28:57.666039] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.239 [2024-10-07 11:28:57.666300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.239 [2024-10-07 11:28:57.666336] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.239 [2024-10-07 11:28:57.666356] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.239 [2024-10-07 11:28:57.667388] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.239 [2024-10-07 11:28:57.671819] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.239 [2024-10-07 11:28:57.672041] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.239 [2024-10-07 11:28:57.672081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.239 [2024-10-07 11:28:57.672100] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.239 [2024-10-07 11:28:57.672306] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.239 [2024-10-07 11:28:57.672500] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.239 [2024-10-07 11:28:57.672527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.239 [2024-10-07 11:28:57.672544] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.239 [2024-10-07 11:28:57.672601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.239 [2024-10-07 11:28:57.674907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.239 [2024-10-07 11:28:57.675317] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.239 [2024-10-07 11:28:57.675363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.239 [2024-10-07 11:28:57.675385] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.239 [2024-10-07 11:28:57.675472] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.239 [2024-10-07 11:28:57.675513] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.239 [2024-10-07 11:28:57.675530] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.239 [2024-10-07 11:28:57.675546] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.239 [2024-10-07 11:28:57.675577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.239 [2024-10-07 11:28:57.682945] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.239 [2024-10-07 11:28:57.683145] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.239 [2024-10-07 11:28:57.683180] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.239 [2024-10-07 11:28:57.683198] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.239 [2024-10-07 11:28:57.683232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.239 [2024-10-07 11:28:57.683263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.239 [2024-10-07 11:28:57.683280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.239 [2024-10-07 11:28:57.683330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.239 [2024-10-07 11:28:57.683364] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.239 [2024-10-07 11:28:57.687516] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.239 [2024-10-07 11:28:57.687716] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.239 [2024-10-07 11:28:57.687752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.239 [2024-10-07 11:28:57.687771] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.239 [2024-10-07 11:28:57.687805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.239 [2024-10-07 11:28:57.687837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.239 [2024-10-07 11:28:57.687854] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.239 [2024-10-07 11:28:57.687869] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.239 [2024-10-07 11:28:57.687900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.239 [2024-10-07 11:28:57.693114] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.239 [2024-10-07 11:28:57.693281] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.239 [2024-10-07 11:28:57.693314] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.239 [2024-10-07 11:28:57.693333] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.239 [2024-10-07 11:28:57.693366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.239 [2024-10-07 11:28:57.693396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.239 [2024-10-07 11:28:57.693430] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.239 [2024-10-07 11:28:57.693446] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.239 [2024-10-07 11:28:57.693477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.239 [2024-10-07 11:28:57.697649] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.239 [2024-10-07 11:28:57.697805] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.239 [2024-10-07 11:28:57.697838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.239 [2024-10-07 11:28:57.697858] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.239 [2024-10-07 11:28:57.697908] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.239 [2024-10-07 11:28:57.698980] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.239 [2024-10-07 11:28:57.699019] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.239 [2024-10-07 11:28:57.699038] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.239 [2024-10-07 11:28:57.699257] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.239 [2024-10-07 11:28:57.704171] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.239 [2024-10-07 11:28:57.704658] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.239 [2024-10-07 11:28:57.704741] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.239 [2024-10-07 11:28:57.704764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.239 [2024-10-07 11:28:57.704849] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.239 [2024-10-07 11:28:57.704888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.239 [2024-10-07 11:28:57.704905] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.239 [2024-10-07 11:28:57.704920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.239 [2024-10-07 11:28:57.704951] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.239 [2024-10-07 11:28:57.707766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.239 [2024-10-07 11:28:57.707888] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.239 [2024-10-07 11:28:57.707919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.239 [2024-10-07 11:28:57.707937] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.239 [2024-10-07 11:28:57.707968] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.239 [2024-10-07 11:28:57.708011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.239 [2024-10-07 11:28:57.708030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.239 [2024-10-07 11:28:57.708044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.239 [2024-10-07 11:28:57.708984] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.239 [2024-10-07 11:28:57.716518] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.239 [2024-10-07 11:28:57.716825] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.239 [2024-10-07 11:28:57.716868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.239 [2024-10-07 11:28:57.716889] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.239 [2024-10-07 11:28:57.716947] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.239 [2024-10-07 11:28:57.716985] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.239 [2024-10-07 11:28:57.717002] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.239 [2024-10-07 11:28:57.717018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.239 [2024-10-07 11:28:57.717049] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.239 [2024-10-07 11:28:57.718775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.239 [2024-10-07 11:28:57.719120] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.239 [2024-10-07 11:28:57.719162] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.239 [2024-10-07 11:28:57.719182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.239 [2024-10-07 11:28:57.719251] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.239 [2024-10-07 11:28:57.719318] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.239 [2024-10-07 11:28:57.719337] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.239 [2024-10-07 11:28:57.719351] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.239 [2024-10-07 11:28:57.719381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.239 [2024-10-07 11:28:57.726679] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.239 [2024-10-07 11:28:57.726873] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.239 [2024-10-07 11:28:57.726908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.239 [2024-10-07 11:28:57.726927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.239 [2024-10-07 11:28:57.726961] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.239 [2024-10-07 11:28:57.726992] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.239 [2024-10-07 11:28:57.727009] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.239 [2024-10-07 11:28:57.727024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.239 [2024-10-07 11:28:57.727054] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.239 [2024-10-07 11:28:57.728873] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.239 [2024-10-07 11:28:57.729002] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.239 [2024-10-07 11:28:57.729035] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.239 [2024-10-07 11:28:57.729068] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.239 [2024-10-07 11:28:57.730327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.239 [2024-10-07 11:28:57.731602] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.239 [2024-10-07 11:28:57.731644] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.239 [2024-10-07 11:28:57.731664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.239 [2024-10-07 11:28:57.731892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.239 [2024-10-07 11:28:57.737586] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.239 [2024-10-07 11:28:57.737779] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.239 [2024-10-07 11:28:57.737816] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.239 [2024-10-07 11:28:57.737834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.239 [2024-10-07 11:28:57.737877] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.239 [2024-10-07 11:28:57.737925] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.239 [2024-10-07 11:28:57.737945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.239 [2024-10-07 11:28:57.737960] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.240 [2024-10-07 11:28:57.738015] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.240 [2024-10-07 11:28:57.739471] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.240 [2024-10-07 11:28:57.739593] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.240 [2024-10-07 11:28:57.739625] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.240 [2024-10-07 11:28:57.739642] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.240 [2024-10-07 11:28:57.740782] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.240 [2024-10-07 11:28:57.741120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.240 [2024-10-07 11:28:57.741178] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.240 [2024-10-07 11:28:57.741213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.240 [2024-10-07 11:28:57.742375] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.240 [2024-10-07 11:28:57.749124] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.240 [2024-10-07 11:28:57.749595] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.240 [2024-10-07 11:28:57.749642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.240 [2024-10-07 11:28:57.749665] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.240 [2024-10-07 11:28:57.749741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.240 [2024-10-07 11:28:57.749798] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.240 [2024-10-07 11:28:57.749819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.240 [2024-10-07 11:28:57.749835] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.240 [2024-10-07 11:28:57.749874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.240 [2024-10-07 11:28:57.749908] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.240 [2024-10-07 11:28:57.750008] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.240 [2024-10-07 11:28:57.750039] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.240 [2024-10-07 11:28:57.750056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.240 [2024-10-07 11:28:57.750087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.240 [2024-10-07 11:28:57.750117] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.240 [2024-10-07 11:28:57.750135] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.240 [2024-10-07 11:28:57.750149] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.240 [2024-10-07 11:28:57.750178] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.240 [2024-10-07 11:28:57.761532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.240 [2024-10-07 11:28:57.761626] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.240 [2024-10-07 11:28:57.761948] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.240 [2024-10-07 11:28:57.761991] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.240 [2024-10-07 11:28:57.762011] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.240 [2024-10-07 11:28:57.762065] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.240 [2024-10-07 11:28:57.762089] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.240 [2024-10-07 11:28:57.762104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.240 [2024-10-07 11:28:57.762161] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.240 [2024-10-07 11:28:57.762189] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.240 [2024-10-07 11:28:57.762217] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.240 [2024-10-07 11:28:57.762234] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.240 [2024-10-07 11:28:57.762249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.240 [2024-10-07 11:28:57.762267] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.240 [2024-10-07 11:28:57.762281] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.240 [2024-10-07 11:28:57.762294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.240 [2024-10-07 11:28:57.763021] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.240 [2024-10-07 11:28:57.763058] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.240 [2024-10-07 11:28:57.771774] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.240 [2024-10-07 11:28:57.771915] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.240 [2024-10-07 11:28:57.772037] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.240 [2024-10-07 11:28:57.772071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.240 [2024-10-07 11:28:57.772090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.240 [2024-10-07 11:28:57.772156] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.240 [2024-10-07 11:28:57.772182] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.240 [2024-10-07 11:28:57.772197] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.240 [2024-10-07 11:28:57.772218] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.240 [2024-10-07 11:28:57.773284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.240 [2024-10-07 11:28:57.773329] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.240 [2024-10-07 11:28:57.773348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.240 [2024-10-07 11:28:57.773364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.240 [2024-10-07 11:28:57.773585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.240 [2024-10-07 11:28:57.773611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.240 [2024-10-07 11:28:57.773655] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.240 [2024-10-07 11:28:57.773670] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.240 [2024-10-07 11:28:57.773783] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.240 [2024-10-07 11:28:57.782012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.240 [2024-10-07 11:28:57.782171] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.240 [2024-10-07 11:28:57.782310] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.240 [2024-10-07 11:28:57.782349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.240 [2024-10-07 11:28:57.782369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.240 [2024-10-07 11:28:57.782456] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.240 [2024-10-07 11:28:57.782484] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.240 [2024-10-07 11:28:57.782500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.240 [2024-10-07 11:28:57.782523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.240 [2024-10-07 11:28:57.782558] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.240 [2024-10-07 11:28:57.782578] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.240 [2024-10-07 11:28:57.782592] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.240 [2024-10-07 11:28:57.782609] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.240 [2024-10-07 11:28:57.783584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.240 [2024-10-07 11:28:57.783625] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.240 [2024-10-07 11:28:57.783642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.240 [2024-10-07 11:28:57.783657] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.240 [2024-10-07 11:28:57.783898] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.240 [2024-10-07 11:28:57.793503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.240 [2024-10-07 11:28:57.793600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.240 [2024-10-07 11:28:57.793998] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.240 [2024-10-07 11:28:57.794048] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.240 [2024-10-07 11:28:57.794070] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.240 [2024-10-07 11:28:57.794124] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.240 [2024-10-07 11:28:57.794147] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.240 [2024-10-07 11:28:57.794163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.240 [2024-10-07 11:28:57.794238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.240 [2024-10-07 11:28:57.794295] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.240 [2024-10-07 11:28:57.794326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.240 [2024-10-07 11:28:57.794343] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.240 [2024-10-07 11:28:57.794359] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.240 [2024-10-07 11:28:57.794376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.240 [2024-10-07 11:28:57.794390] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.240 [2024-10-07 11:28:57.794420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.240 [2024-10-07 11:28:57.794454] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.240 [2024-10-07 11:28:57.794471] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.240 [2024-10-07 11:28:57.805748] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.240 [2024-10-07 11:28:57.805839] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.240 [2024-10-07 11:28:57.806106] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.240 [2024-10-07 11:28:57.806143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.240 [2024-10-07 11:28:57.806162] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.240 [2024-10-07 11:28:57.806211] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.240 [2024-10-07 11:28:57.806234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.240 [2024-10-07 11:28:57.806250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.240 [2024-10-07 11:28:57.806307] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.240 [2024-10-07 11:28:57.806335] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.240 [2024-10-07 11:28:57.806362] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.240 [2024-10-07 11:28:57.806379] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.240 [2024-10-07 11:28:57.806394] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.240 [2024-10-07 11:28:57.806429] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.241 [2024-10-07 11:28:57.806445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.241 [2024-10-07 11:28:57.806458] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.241 [2024-10-07 11:28:57.806490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.241 [2024-10-07 11:28:57.806506] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.241 [2024-10-07 11:28:57.815943] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.241 [2024-10-07 11:28:57.816058] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.241 [2024-10-07 11:28:57.816169] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.241 [2024-10-07 11:28:57.816202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.241 [2024-10-07 11:28:57.816251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.241 [2024-10-07 11:28:57.817339] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.241 [2024-10-07 11:28:57.817383] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.241 [2024-10-07 11:28:57.817416] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.241 [2024-10-07 11:28:57.817441] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.241 [2024-10-07 11:28:57.817640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.241 [2024-10-07 11:28:57.817676] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.241 [2024-10-07 11:28:57.817694] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.241 [2024-10-07 11:28:57.817709] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.241 [2024-10-07 11:28:57.817822] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.241 [2024-10-07 11:28:57.817842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.241 [2024-10-07 11:28:57.817860] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.241 [2024-10-07 11:28:57.817883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.241 [2024-10-07 11:28:57.819123] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.241 [2024-10-07 11:28:57.826098] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.241 [2024-10-07 11:28:57.827224] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.241 [2024-10-07 11:28:57.827273] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.241 [2024-10-07 11:28:57.827295] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.241 [2024-10-07 11:28:57.827532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.241 [2024-10-07 11:28:57.827586] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.241 [2024-10-07 11:28:57.827712] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.241 [2024-10-07 11:28:57.827750] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.241 [2024-10-07 11:28:57.827769] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.241 [2024-10-07 11:28:57.827785] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.241 [2024-10-07 11:28:57.827798] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.241 [2024-10-07 11:28:57.827813] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.241 [2024-10-07 11:28:57.828919] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.241 [2024-10-07 11:28:57.828961] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.241 [2024-10-07 11:28:57.829185] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.241 [2024-10-07 11:28:57.829242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.241 [2024-10-07 11:28:57.829261] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.241 [2024-10-07 11:28:57.830306] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.241 [2024-10-07 11:28:57.837658] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.241 [2024-10-07 11:28:57.837935] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.241 [2024-10-07 11:28:57.837976] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.241 [2024-10-07 11:28:57.837996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.241 [2024-10-07 11:28:57.838035] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.241 [2024-10-07 11:28:57.838072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.241 [2024-10-07 11:28:57.838144] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.241 [2024-10-07 11:28:57.838171] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.241 [2024-10-07 11:28:57.838187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.241 [2024-10-07 11:28:57.838202] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.241 [2024-10-07 11:28:57.838216] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.241 [2024-10-07 11:28:57.838231] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.241 [2024-10-07 11:28:57.838264] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.241 [2024-10-07 11:28:57.838285] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.241 [2024-10-07 11:28:57.838311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.241 [2024-10-07 11:28:57.838328] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.241 [2024-10-07 11:28:57.838341] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.241 [2024-10-07 11:28:57.838368] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.241 [2024-10-07 11:28:57.850118] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.241 [2024-10-07 11:28:57.850216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.241 [2024-10-07 11:28:57.850479] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.241 [2024-10-07 11:28:57.850516] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.241 [2024-10-07 11:28:57.850534] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.241 [2024-10-07 11:28:57.850584] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.241 [2024-10-07 11:28:57.850607] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.241 [2024-10-07 11:28:57.850623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.241 [2024-10-07 11:28:57.850679] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.241 [2024-10-07 11:28:57.850707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.241 [2024-10-07 11:28:57.850768] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.241 [2024-10-07 11:28:57.850786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.241 [2024-10-07 11:28:57.850802] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.241 [2024-10-07 11:28:57.850819] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.241 [2024-10-07 11:28:57.850833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.241 [2024-10-07 11:28:57.850847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.241 [2024-10-07 11:28:57.850891] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.241 [2024-10-07 11:28:57.850911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.241 [2024-10-07 11:28:57.862631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.241 [2024-10-07 11:28:57.862729] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.241 [2024-10-07 11:28:57.862957] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.241 [2024-10-07 11:28:57.863004] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.241 [2024-10-07 11:28:57.863025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.241 [2024-10-07 11:28:57.863077] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.241 [2024-10-07 11:28:57.863101] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.241 [2024-10-07 11:28:57.863117] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.241 [2024-10-07 11:28:57.864496] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.241 [2024-10-07 11:28:57.864566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.241 [2024-10-07 11:28:57.865786] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.241 [2024-10-07 11:28:57.865831] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.241 [2024-10-07 11:28:57.865853] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.241 [2024-10-07 11:28:57.865885] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.241 [2024-10-07 11:28:57.865907] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.241 [2024-10-07 11:28:57.865920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.241 [2024-10-07 11:28:57.866825] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.241 [2024-10-07 11:28:57.866875] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.241 [2024-10-07 11:28:57.874024] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.241 [2024-10-07 11:28:57.874117] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.241 [2024-10-07 11:28:57.875377] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.241 [2024-10-07 11:28:57.875467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.241 [2024-10-07 11:28:57.875544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.241 [2024-10-07 11:28:57.875640] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.241 [2024-10-07 11:28:57.875692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.241 [2024-10-07 11:28:57.875722] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.241 [2024-10-07 11:28:57.876024] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.241 [2024-10-07 11:28:57.876095] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.241 [2024-10-07 11:28:57.877428] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.241 [2024-10-07 11:28:57.877493] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.241 [2024-10-07 11:28:57.877526] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.241 [2024-10-07 11:28:57.877551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.241 [2024-10-07 11:28:57.877567] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.241 [2024-10-07 11:28:57.877580] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.241 [2024-10-07 11:28:57.879066] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.241 [2024-10-07 11:28:57.879110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.241 [2024-10-07 11:28:57.884225] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.241 [2024-10-07 11:28:57.884338] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.241 [2024-10-07 11:28:57.884468] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.241 [2024-10-07 11:28:57.884503] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.241 [2024-10-07 11:28:57.884522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.241 [2024-10-07 11:28:57.884610] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.241 [2024-10-07 11:28:57.884638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.241 [2024-10-07 11:28:57.884654] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.241 [2024-10-07 11:28:57.884674] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.241 [2024-10-07 11:28:57.884707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.241 [2024-10-07 11:28:57.884726] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.241 [2024-10-07 11:28:57.884741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.241 [2024-10-07 11:28:57.884756] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.241 [2024-10-07 11:28:57.884787] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.241 [2024-10-07 11:28:57.884805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.241 [2024-10-07 11:28:57.884818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.241 [2024-10-07 11:28:57.884872] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.241 [2024-10-07 11:28:57.884913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.241 [2024-10-07 11:28:57.896173] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.241 [2024-10-07 11:28:57.896267] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.241 [2024-10-07 11:28:57.896532] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.241 [2024-10-07 11:28:57.896576] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.241 [2024-10-07 11:28:57.896594] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.241 [2024-10-07 11:28:57.896643] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.241 [2024-10-07 11:28:57.896666] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.241 [2024-10-07 11:28:57.896682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.241 [2024-10-07 11:28:57.896738] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.241 [2024-10-07 11:28:57.896766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.241 [2024-10-07 11:28:57.896793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.242 [2024-10-07 11:28:57.896811] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.242 [2024-10-07 11:28:57.896826] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.242 [2024-10-07 11:28:57.896844] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.242 [2024-10-07 11:28:57.896864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.242 [2024-10-07 11:28:57.896889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.242 [2024-10-07 11:28:57.896936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.242 [2024-10-07 11:28:57.896955] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.242 [2024-10-07 11:28:57.907364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.242 [2024-10-07 11:28:57.907673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.242 [2024-10-07 11:28:57.907790] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.242 [2024-10-07 11:28:57.907833] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.242 [2024-10-07 11:28:57.907854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.242 [2024-10-07 11:28:57.907953] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.242 [2024-10-07 11:28:57.907987] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.242 [2024-10-07 11:28:57.908004] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.242 [2024-10-07 11:28:57.908024] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.242 [2024-10-07 11:28:57.908057] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.242 [2024-10-07 11:28:57.908103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.242 [2024-10-07 11:28:57.908119] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.242 [2024-10-07 11:28:57.908134] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.242 [2024-10-07 11:28:57.908167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.242 [2024-10-07 11:28:57.908185] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.242 [2024-10-07 11:28:57.908198] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.242 [2024-10-07 11:28:57.908211] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.242 [2024-10-07 11:28:57.909248] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.242 [2024-10-07 11:28:57.917539] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.242 [2024-10-07 11:28:57.917730] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.242 [2024-10-07 11:28:57.917765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.242 [2024-10-07 11:28:57.917783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.242 [2024-10-07 11:28:57.917818] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.242 [2024-10-07 11:28:57.917883] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.242 [2024-10-07 11:28:57.917906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.242 [2024-10-07 11:28:57.917921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.242 [2024-10-07 11:28:57.917953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.242 [2024-10-07 11:28:57.917975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.242 [2024-10-07 11:28:57.918045] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.242 [2024-10-07 11:28:57.918072] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.242 [2024-10-07 11:28:57.918088] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.242 [2024-10-07 11:28:57.918118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.242 [2024-10-07 11:28:57.918148] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.242 [2024-10-07 11:28:57.918164] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.242 [2024-10-07 11:28:57.918177] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.242 [2024-10-07 11:28:57.918205] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.242 [2024-10-07 11:28:57.929231] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.242 [2024-10-07 11:28:57.929482] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.242 [2024-10-07 11:28:57.929610] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.242 [2024-10-07 11:28:57.929642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.242 [2024-10-07 11:28:57.929659] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.242 [2024-10-07 11:28:57.929782] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.242 [2024-10-07 11:28:57.929811] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.242 [2024-10-07 11:28:57.929828] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.242 [2024-10-07 11:28:57.929848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.242 [2024-10-07 11:28:57.929881] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.242 [2024-10-07 11:28:57.929901] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.242 [2024-10-07 11:28:57.929915] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.242 [2024-10-07 11:28:57.929930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.242 [2024-10-07 11:28:57.929961] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.242 [2024-10-07 11:28:57.929978] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.242 [2024-10-07 11:28:57.929991] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.242 [2024-10-07 11:28:57.930005] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.242 [2024-10-07 11:28:57.930031] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.242 [2024-10-07 11:28:57.939552] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.242 [2024-10-07 11:28:57.939759] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.242 [2024-10-07 11:28:57.939793] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.242 [2024-10-07 11:28:57.939812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.242 [2024-10-07 11:28:57.940845] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.242 [2024-10-07 11:28:57.940901] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.242 [2024-10-07 11:28:57.941159] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.242 [2024-10-07 11:28:57.941199] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.242 [2024-10-07 11:28:57.941219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.242 [2024-10-07 11:28:57.941236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.242 [2024-10-07 11:28:57.941250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.242 [2024-10-07 11:28:57.941265] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.242 [2024-10-07 11:28:57.941327] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.242 [2024-10-07 11:28:57.941350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.242 [2024-10-07 11:28:57.941377] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.242 [2024-10-07 11:28:57.941394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.242 [2024-10-07 11:28:57.941435] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.242 [2024-10-07 11:28:57.941510] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.242 [2024-10-07 11:28:57.949708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.242 [2024-10-07 11:28:57.949895] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.242 [2024-10-07 11:28:57.949929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.242 [2024-10-07 11:28:57.949947] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.242 [2024-10-07 11:28:57.949981] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.242 [2024-10-07 11:28:57.950800] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.242 [2024-10-07 11:28:57.950836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.242 [2024-10-07 11:28:57.950856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.242 [2024-10-07 11:28:57.951052] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.242 [2024-10-07 11:28:57.951261] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.242 [2024-10-07 11:28:57.951366] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.242 [2024-10-07 11:28:57.951395] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.242 [2024-10-07 11:28:57.951428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.242 [2024-10-07 11:28:57.951461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.242 [2024-10-07 11:28:57.951491] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.242 [2024-10-07 11:28:57.951508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.242 [2024-10-07 11:28:57.951522] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.242 [2024-10-07 11:28:57.951551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.242 [2024-10-07 11:28:57.960349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.242 [2024-10-07 11:28:57.960579] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.242 [2024-10-07 11:28:57.960616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.242 [2024-10-07 11:28:57.960634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.242 [2024-10-07 11:28:57.960669] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.242 [2024-10-07 11:28:57.960700] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.242 [2024-10-07 11:28:57.960717] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.242 [2024-10-07 11:28:57.960732] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.242 [2024-10-07 11:28:57.960762] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.242 [2024-10-07 11:28:57.962589] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.242 [2024-10-07 11:28:57.962931] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.242 [2024-10-07 11:28:57.962973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.242 [2024-10-07 11:28:57.963023] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.242 [2024-10-07 11:28:57.963096] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.242 [2024-10-07 11:28:57.963146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.242 [2024-10-07 11:28:57.963164] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.242 [2024-10-07 11:28:57.963179] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.242 [2024-10-07 11:28:57.963208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.242 [2024-10-07 11:28:57.970524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.242 [2024-10-07 11:28:57.970705] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.242 [2024-10-07 11:28:57.970738] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.242 [2024-10-07 11:28:57.970756] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.242 [2024-10-07 11:28:57.970791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.242 [2024-10-07 11:28:57.970822] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.242 [2024-10-07 11:28:57.970839] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.242 [2024-10-07 11:28:57.970854] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.242 [2024-10-07 11:28:57.970884] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.242 [2024-10-07 11:28:57.974871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.242 [2024-10-07 11:28:57.975116] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.242 [2024-10-07 11:28:57.975159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.243 [2024-10-07 11:28:57.975180] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.243 [2024-10-07 11:28:57.975235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.243 [2024-10-07 11:28:57.975271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.243 [2024-10-07 11:28:57.975289] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.243 [2024-10-07 11:28:57.975304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.243 [2024-10-07 11:28:57.975333] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.243 [2024-10-07 11:28:57.980665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.243 [2024-10-07 11:28:57.980823] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.243 [2024-10-07 11:28:57.980855] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.243 [2024-10-07 11:28:57.980873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.243 [2024-10-07 11:28:57.980906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.243 [2024-10-07 11:28:57.980937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.243 [2024-10-07 11:28:57.980988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.243 [2024-10-07 11:28:57.981003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.243 [2024-10-07 11:28:57.981960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.243 [2024-10-07 11:28:57.984985] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.243 [2024-10-07 11:28:57.985125] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.243 [2024-10-07 11:28:57.985158] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.243 [2024-10-07 11:28:57.985174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.243 [2024-10-07 11:28:57.985207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.243 [2024-10-07 11:28:57.985238] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.243 [2024-10-07 11:28:57.985255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.243 [2024-10-07 11:28:57.985269] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.243 [2024-10-07 11:28:57.985298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.243 [2024-10-07 11:28:57.991624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.243 [2024-10-07 11:28:57.992024] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.243 [2024-10-07 11:28:57.992069] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.243 [2024-10-07 11:28:57.992091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.243 [2024-10-07 11:28:57.992164] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.243 [2024-10-07 11:28:57.992221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.243 [2024-10-07 11:28:57.992242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.243 [2024-10-07 11:28:57.992257] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.243 [2024-10-07 11:28:57.992289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.243 [2024-10-07 11:28:57.995083] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.243 [2024-10-07 11:28:57.995207] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.243 [2024-10-07 11:28:57.995238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.243 [2024-10-07 11:28:57.995254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.243 [2024-10-07 11:28:57.995286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.243 [2024-10-07 11:28:57.995316] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.243 [2024-10-07 11:28:57.995333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.243 [2024-10-07 11:28:57.995347] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.243 [2024-10-07 11:28:57.995375] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.243 [2024-10-07 11:28:58.002517] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.243 [2024-10-07 11:28:58.002698] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.243 [2024-10-07 11:28:58.002732] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.243 [2024-10-07 11:28:58.002749] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.243 [2024-10-07 11:28:58.003955] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.243 [2024-10-07 11:28:58.005028] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.243 [2024-10-07 11:28:58.005080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.243 [2024-10-07 11:28:58.005100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.243 [2024-10-07 11:28:58.005389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.243 [2024-10-07 11:28:58.005619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.243 [2024-10-07 11:28:58.005733] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.243 [2024-10-07 11:28:58.005769] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.243 [2024-10-07 11:28:58.005788] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.243 [2024-10-07 11:28:58.005820] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.243 [2024-10-07 11:28:58.005850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.243 [2024-10-07 11:28:58.005868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.243 [2024-10-07 11:28:58.005882] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.243 [2024-10-07 11:28:58.005911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.243 [2024-10-07 11:28:58.012786] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.243 [2024-10-07 11:28:58.012962] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.243 [2024-10-07 11:28:58.012995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.243 [2024-10-07 11:28:58.013013] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.243 [2024-10-07 11:28:58.014134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.243 [2024-10-07 11:28:58.014396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.243 [2024-10-07 11:28:58.014444] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.243 [2024-10-07 11:28:58.014463] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.243 [2024-10-07 11:28:58.014524] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.243 [2024-10-07 11:28:58.015864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.243 [2024-10-07 11:28:58.015979] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.243 [2024-10-07 11:28:58.016009] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.243 [2024-10-07 11:28:58.016026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.243 [2024-10-07 11:28:58.016081] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.243 [2024-10-07 11:28:58.016112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.243 [2024-10-07 11:28:58.016128] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.243 [2024-10-07 11:28:58.016142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.243 [2024-10-07 11:28:58.016171] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.243 [2024-10-07 11:28:58.022932] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.243 [2024-10-07 11:28:58.023125] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.243 [2024-10-07 11:28:58.023162] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.243 [2024-10-07 11:28:58.023180] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.243 [2024-10-07 11:28:58.023918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.243 [2024-10-07 11:28:58.024588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.243 [2024-10-07 11:28:58.024648] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.243 [2024-10-07 11:28:58.024669] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.243 [2024-10-07 11:28:58.024788] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.243 [2024-10-07 11:28:58.025955] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.243 [2024-10-07 11:28:58.026075] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.243 [2024-10-07 11:28:58.026107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.243 [2024-10-07 11:28:58.026124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.243 [2024-10-07 11:28:58.026156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.243 [2024-10-07 11:28:58.026206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.243 [2024-10-07 11:28:58.026238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.243 [2024-10-07 11:28:58.026259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.243 [2024-10-07 11:28:58.026292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.243 [2024-10-07 11:28:58.033093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.243 [2024-10-07 11:28:58.033274] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.243 [2024-10-07 11:28:58.033310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.243 [2024-10-07 11:28:58.033329] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.243 [2024-10-07 11:28:58.034466] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.243 [2024-10-07 11:28:58.034738] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.243 [2024-10-07 11:28:58.034795] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.243 [2024-10-07 11:28:58.034874] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.243 [2024-10-07 11:28:58.034983] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.243 [2024-10-07 11:28:58.036633] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.243 [2024-10-07 11:28:58.036785] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.243 [2024-10-07 11:28:58.036825] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.243 [2024-10-07 11:28:58.036845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.243 [2024-10-07 11:28:58.036877] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.243 [2024-10-07 11:28:58.036909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.243 [2024-10-07 11:28:58.036926] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.243 [2024-10-07 11:28:58.036940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.243 [2024-10-07 11:28:58.036971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.243 [2024-10-07 11:28:58.043247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.243 [2024-10-07 11:28:58.043449] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.243 [2024-10-07 11:28:58.043486] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.243 [2024-10-07 11:28:58.043505] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.243 [2024-10-07 11:28:58.043539] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.244 [2024-10-07 11:28:58.044263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.244 [2024-10-07 11:28:58.044303] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.244 [2024-10-07 11:28:58.044323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.244 [2024-10-07 11:28:58.044970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.244 [2024-10-07 11:28:58.046745] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.244 [2024-10-07 11:28:58.046869] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.244 [2024-10-07 11:28:58.046902] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.244 [2024-10-07 11:28:58.046919] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.244 [2024-10-07 11:28:58.046951] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.244 [2024-10-07 11:28:58.046982] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.244 [2024-10-07 11:28:58.046999] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.244 [2024-10-07 11:28:58.047013] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.244 [2024-10-07 11:28:58.047043] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.244 [2024-10-07 11:28:58.054373] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.244 [2024-10-07 11:28:58.054606] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.244 [2024-10-07 11:28:58.054642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.244 [2024-10-07 11:28:58.054660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.244 [2024-10-07 11:28:58.054695] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.244 [2024-10-07 11:28:58.054727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.244 [2024-10-07 11:28:58.054743] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.244 [2024-10-07 11:28:58.054759] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.244 [2024-10-07 11:28:58.054789] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.244 [2024-10-07 11:28:58.058862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.244 [2024-10-07 11:28:58.059132] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.244 [2024-10-07 11:28:58.059178] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.244 [2024-10-07 11:28:58.059199] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.244 [2024-10-07 11:28:58.059256] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.244 [2024-10-07 11:28:58.059294] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.244 [2024-10-07 11:28:58.059312] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.244 [2024-10-07 11:28:58.059327] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.244 [2024-10-07 11:28:58.059359] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.244 [2024-10-07 11:28:58.064562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.244 [2024-10-07 11:28:58.064731] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.244 [2024-10-07 11:28:58.064765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.244 [2024-10-07 11:28:58.064783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.244 [2024-10-07 11:28:58.064817] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.244 [2024-10-07 11:28:58.064848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.244 [2024-10-07 11:28:58.064864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.244 [2024-10-07 11:28:58.064880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.244 [2024-10-07 11:28:58.064910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.244 [2024-10-07 11:28:58.069124] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.244 [2024-10-07 11:28:58.069293] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.244 [2024-10-07 11:28:58.069327] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.244 [2024-10-07 11:28:58.069345] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.244 [2024-10-07 11:28:58.069396] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.244 [2024-10-07 11:28:58.069464] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.244 [2024-10-07 11:28:58.069483] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.244 [2024-10-07 11:28:58.069498] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.244 [2024-10-07 11:28:58.069528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.244 [2024-10-07 11:28:58.075366] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.244 [2024-10-07 11:28:58.076171] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.244 [2024-10-07 11:28:58.076220] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.244 [2024-10-07 11:28:58.076242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.244 [2024-10-07 11:28:58.076600] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.244 [2024-10-07 11:28:58.076692] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.244 [2024-10-07 11:28:58.076717] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.244 [2024-10-07 11:28:58.076733] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.244 [2024-10-07 11:28:58.076766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.244 [2024-10-07 11:28:58.079567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.244 [2024-10-07 11:28:58.079734] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.244 [2024-10-07 11:28:58.079768] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.244 [2024-10-07 11:28:58.079786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.244 [2024-10-07 11:28:58.079818] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.244 [2024-10-07 11:28:58.079850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.244 [2024-10-07 11:28:58.079867] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.244 [2024-10-07 11:28:58.079881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.244 [2024-10-07 11:28:58.079911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.244 [2024-10-07 11:28:58.086130] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.244 [2024-10-07 11:28:58.086354] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.244 [2024-10-07 11:28:58.086390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.244 [2024-10-07 11:28:58.086424] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.244 [2024-10-07 11:28:58.087649] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.244 [2024-10-07 11:28:58.088729] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.244 [2024-10-07 11:28:58.088769] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.244 [2024-10-07 11:28:58.088827] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.244 [2024-10-07 11:28:58.089137] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.244 [2024-10-07 11:28:58.089676] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.244 [2024-10-07 11:28:58.089817] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.244 [2024-10-07 11:28:58.089861] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.244 [2024-10-07 11:28:58.089882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.244 [2024-10-07 11:28:58.089916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.244 [2024-10-07 11:28:58.089964] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.244 [2024-10-07 11:28:58.089984] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.244 [2024-10-07 11:28:58.089998] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.244 [2024-10-07 11:28:58.090729] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.244 [2024-10-07 11:28:58.096602] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.244 [2024-10-07 11:28:58.096791] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.244 [2024-10-07 11:28:58.096826] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.244 [2024-10-07 11:28:58.096844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.244 [2024-10-07 11:28:58.097980] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.244 8429.00 IOPS, 32.93 MiB/s [2024-10-07T11:29:07.955Z] [2024-10-07 11:28:58.099903] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.244 [2024-10-07 11:28:58.099937] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.244 [2024-10-07 11:28:58.099956] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.244 [2024-10-07 11:28:58.101039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.244 [2024-10-07 11:28:58.102263] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.244 [2024-10-07 11:28:58.102598] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.244 [2024-10-07 11:28:58.102644] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.244 [2024-10-07 11:28:58.102665] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.244 [2024-10-07 11:28:58.102785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.244 [2024-10-07 11:28:58.104002] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.244 [2024-10-07 11:28:58.104039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.244 [2024-10-07 11:28:58.104057] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.244 [2024-10-07 11:28:58.105250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.244 [2024-10-07 11:28:58.107150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.244 [2024-10-07 11:28:58.107289] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.244 [2024-10-07 11:28:58.107361] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.244 [2024-10-07 11:28:58.107384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.244 [2024-10-07 11:28:58.107434] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.244 [2024-10-07 11:28:58.107468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.244 [2024-10-07 11:28:58.107485] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.244 [2024-10-07 11:28:58.107500] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.244 [2024-10-07 11:28:58.107530] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.244 [2024-10-07 11:28:58.113069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.244 [2024-10-07 11:28:58.114237] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.244 [2024-10-07 11:28:58.114289] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.244 [2024-10-07 11:28:58.114310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.244 [2024-10-07 11:28:58.114531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.244 [2024-10-07 11:28:58.114598] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.244 [2024-10-07 11:28:58.114618] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.244 [2024-10-07 11:28:58.114633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.244 [2024-10-07 11:28:58.114667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.244 [2024-10-07 11:28:58.118823] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.244 [2024-10-07 11:28:58.119101] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.244 [2024-10-07 11:28:58.119146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.244 [2024-10-07 11:28:58.119167] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.244 [2024-10-07 11:28:58.119223] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.244 [2024-10-07 11:28:58.119260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.244 [2024-10-07 11:28:58.119277] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.244 [2024-10-07 11:28:58.119293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.244 [2024-10-07 11:28:58.119325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.244 [2024-10-07 11:28:58.123197] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.244 [2024-10-07 11:28:58.123351] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.245 [2024-10-07 11:28:58.123384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.245 [2024-10-07 11:28:58.123417] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.245 [2024-10-07 11:28:58.124232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.245 [2024-10-07 11:28:58.124489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.245 [2024-10-07 11:28:58.124524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.245 [2024-10-07 11:28:58.124544] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.245 [2024-10-07 11:28:58.124689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.245 [2024-10-07 11:28:58.129210] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.245 [2024-10-07 11:28:58.129384] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.245 [2024-10-07 11:28:58.129433] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.245 [2024-10-07 11:28:58.129455] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.245 [2024-10-07 11:28:58.129492] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.245 [2024-10-07 11:28:58.129524] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.245 [2024-10-07 11:28:58.129541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.245 [2024-10-07 11:28:58.129556] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.245 [2024-10-07 11:28:58.129586] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.245 [2024-10-07 11:28:58.133791] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.245 [2024-10-07 11:28:58.133972] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.245 [2024-10-07 11:28:58.134009] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.245 [2024-10-07 11:28:58.134028] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.245 [2024-10-07 11:28:58.134062] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.245 [2024-10-07 11:28:58.134093] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.245 [2024-10-07 11:28:58.134110] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.245 [2024-10-07 11:28:58.134125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.245 [2024-10-07 11:28:58.134156] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.245 [2024-10-07 11:28:58.139355] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.245 [2024-10-07 11:28:58.139538] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.245 [2024-10-07 11:28:58.139573] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.245 [2024-10-07 11:28:58.139591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.245 [2024-10-07 11:28:58.139645] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.245 [2024-10-07 11:28:58.139679] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.245 [2024-10-07 11:28:58.139695] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.245 [2024-10-07 11:28:58.139710] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.245 [2024-10-07 11:28:58.139772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.245 [2024-10-07 11:28:58.144062] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.245 [2024-10-07 11:28:58.144219] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.245 [2024-10-07 11:28:58.144253] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.245 [2024-10-07 11:28:58.144271] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.245 [2024-10-07 11:28:58.144304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.245 [2024-10-07 11:28:58.144335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.245 [2024-10-07 11:28:58.144351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.245 [2024-10-07 11:28:58.144367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.245 [2024-10-07 11:28:58.144396] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.245 [2024-10-07 11:28:58.150197] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.245 [2024-10-07 11:28:58.151044] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.245 [2024-10-07 11:28:58.151095] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.245 [2024-10-07 11:28:58.151117] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.245 [2024-10-07 11:28:58.151471] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.245 [2024-10-07 11:28:58.151562] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.245 [2024-10-07 11:28:58.151587] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.245 [2024-10-07 11:28:58.151603] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.245 [2024-10-07 11:28:58.151641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.245 [2024-10-07 11:28:58.154184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.245 [2024-10-07 11:28:58.154348] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.245 [2024-10-07 11:28:58.154383] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.245 [2024-10-07 11:28:58.154418] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.245 [2024-10-07 11:28:58.154457] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.245 [2024-10-07 11:28:58.154488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.245 [2024-10-07 11:28:58.154506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.245 [2024-10-07 11:28:58.154521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.245 [2024-10-07 11:28:58.154551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.245 [2024-10-07 11:28:58.160580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.245 [2024-10-07 11:28:58.160806] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.245 [2024-10-07 11:28:58.160847] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.245 [2024-10-07 11:28:58.160909] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.245 [2024-10-07 11:28:58.162175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.245 [2024-10-07 11:28:58.163466] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.245 [2024-10-07 11:28:58.163511] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.245 [2024-10-07 11:28:58.163530] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.245 [2024-10-07 11:28:58.163760] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.245 [2024-10-07 11:28:58.165523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.245 [2024-10-07 11:28:58.165922] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.245 [2024-10-07 11:28:58.165972] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.245 [2024-10-07 11:28:58.165994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.245 [2024-10-07 11:28:58.166070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.245 [2024-10-07 11:28:58.166108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.245 [2024-10-07 11:28:58.166126] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.245 [2024-10-07 11:28:58.166141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.245 [2024-10-07 11:28:58.166172] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.245 [2024-10-07 11:28:58.170755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.245 [2024-10-07 11:28:58.172076] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.245 [2024-10-07 11:28:58.172133] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.245 [2024-10-07 11:28:58.172156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.245 [2024-10-07 11:28:58.172384] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.245 [2024-10-07 11:28:58.173468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.245 [2024-10-07 11:28:58.173508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.245 [2024-10-07 11:28:58.173528] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.245 [2024-10-07 11:28:58.173789] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.245 [2024-10-07 11:28:58.177939] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.245 [2024-10-07 11:28:58.178270] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.245 [2024-10-07 11:28:58.178309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.245 [2024-10-07 11:28:58.178327] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.245 [2024-10-07 11:28:58.178385] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.245 [2024-10-07 11:28:58.178440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.245 [2024-10-07 11:28:58.178486] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.245 [2024-10-07 11:28:58.178504] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.245 [2024-10-07 11:28:58.178537] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.245 [2024-10-07 11:28:58.180918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.245 [2024-10-07 11:28:58.181093] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.245 [2024-10-07 11:28:58.181127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.245 [2024-10-07 11:28:58.181145] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.245 [2024-10-07 11:28:58.181179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.245 [2024-10-07 11:28:58.181210] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.245 [2024-10-07 11:28:58.181227] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.245 [2024-10-07 11:28:58.181242] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.245 [2024-10-07 11:28:58.181273] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.245 [2024-10-07 11:28:58.188203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.245 [2024-10-07 11:28:58.188420] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.245 [2024-10-07 11:28:58.188456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.245 [2024-10-07 11:28:58.188476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.245 [2024-10-07 11:28:58.188513] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.245 [2024-10-07 11:28:58.188544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.245 [2024-10-07 11:28:58.188562] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.245 [2024-10-07 11:28:58.188578] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.245 [2024-10-07 11:28:58.188608] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.245 [2024-10-07 11:28:58.192650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.245 [2024-10-07 11:28:58.192982] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.245 [2024-10-07 11:28:58.193020] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.245 [2024-10-07 11:28:58.193039] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.245 [2024-10-07 11:28:58.193117] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.245 [2024-10-07 11:28:58.193156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.245 [2024-10-07 11:28:58.193173] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.245 [2024-10-07 11:28:58.193189] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.245 [2024-10-07 11:28:58.193219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.245 [2024-10-07 11:28:58.198371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.245 [2024-10-07 11:28:58.198607] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.245 [2024-10-07 11:28:58.198645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.245 [2024-10-07 11:28:58.198665] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.245 [2024-10-07 11:28:58.198700] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.245 [2024-10-07 11:28:58.199712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.245 [2024-10-07 11:28:58.199771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.245 [2024-10-07 11:28:58.199793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.245 [2024-10-07 11:28:58.200015] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.245 [2024-10-07 11:28:58.202818] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.245 [2024-10-07 11:28:58.203019] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.245 [2024-10-07 11:28:58.203056] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.245 [2024-10-07 11:28:58.203075] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.245 [2024-10-07 11:28:58.203111] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.245 [2024-10-07 11:28:58.203144] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.245 [2024-10-07 11:28:58.203160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.246 [2024-10-07 11:28:58.203178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.246 [2024-10-07 11:28:58.203208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.246 [2024-10-07 11:28:58.208562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.246 [2024-10-07 11:28:58.208775] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.246 [2024-10-07 11:28:58.208811] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.246 [2024-10-07 11:28:58.208830] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.246 [2024-10-07 11:28:58.209581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.246 [2024-10-07 11:28:58.210357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.246 [2024-10-07 11:28:58.210455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.246 [2024-10-07 11:28:58.210491] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.246 [2024-10-07 11:28:58.210667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.246 [2024-10-07 11:28:58.212964] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.246 [2024-10-07 11:28:58.213142] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.246 [2024-10-07 11:28:58.213196] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.246 [2024-10-07 11:28:58.213231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.246 [2024-10-07 11:28:58.213308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.246 [2024-10-07 11:28:58.213340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.246 [2024-10-07 11:28:58.213357] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.246 [2024-10-07 11:28:58.213372] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.246 [2024-10-07 11:28:58.214199] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.246 [2024-10-07 11:28:58.218774] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.246 [2024-10-07 11:28:58.218971] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.246 [2024-10-07 11:28:58.219007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.246 [2024-10-07 11:28:58.219026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.246 [2024-10-07 11:28:58.219060] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.246 [2024-10-07 11:28:58.219092] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.246 [2024-10-07 11:28:58.219110] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.246 [2024-10-07 11:28:58.219126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.246 [2024-10-07 11:28:58.220173] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.246 [2024-10-07 11:28:58.223100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.246 [2024-10-07 11:28:58.223305] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.246 [2024-10-07 11:28:58.223340] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.246 [2024-10-07 11:28:58.223358] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.246 [2024-10-07 11:28:58.224598] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.246 [2024-10-07 11:28:58.225682] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.246 [2024-10-07 11:28:58.225722] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.246 [2024-10-07 11:28:58.225742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.246 [2024-10-07 11:28:58.225873] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.246 [2024-10-07 11:28:58.228947] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.246 [2024-10-07 11:28:58.229127] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.246 [2024-10-07 11:28:58.229164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.246 [2024-10-07 11:28:58.229182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.246 [2024-10-07 11:28:58.229220] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.246 [2024-10-07 11:28:58.229266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.246 [2024-10-07 11:28:58.229285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.246 [2024-10-07 11:28:58.229331] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.246 [2024-10-07 11:28:58.229365] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.246 [2024-10-07 11:28:58.233251] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.246 [2024-10-07 11:28:58.233442] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.246 [2024-10-07 11:28:58.233476] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.246 [2024-10-07 11:28:58.233494] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.246 [2024-10-07 11:28:58.233529] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.246 [2024-10-07 11:28:58.233561] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.246 [2024-10-07 11:28:58.233578] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.246 [2024-10-07 11:28:58.233593] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.246 [2024-10-07 11:28:58.233623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.246 [2024-10-07 11:28:58.239070] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.246 [2024-10-07 11:28:58.239253] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.246 [2024-10-07 11:28:58.239287] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.246 [2024-10-07 11:28:58.239305] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.246 [2024-10-07 11:28:58.239361] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.246 [2024-10-07 11:28:58.239396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.246 [2024-10-07 11:28:58.239431] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.246 [2024-10-07 11:28:58.239447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.246 [2024-10-07 11:28:58.239479] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.246 [2024-10-07 11:28:58.244145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.246 [2024-10-07 11:28:58.244314] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.246 [2024-10-07 11:28:58.244348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.246 [2024-10-07 11:28:58.244366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.246 [2024-10-07 11:28:58.244421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.246 [2024-10-07 11:28:58.244477] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.246 [2024-10-07 11:28:58.244505] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.246 [2024-10-07 11:28:58.244521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.246 [2024-10-07 11:28:58.244724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.246 [2024-10-07 11:28:58.249227] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.246 [2024-10-07 11:28:58.249488] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.246 [2024-10-07 11:28:58.249526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.246 [2024-10-07 11:28:58.249546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.246 [2024-10-07 11:28:58.249584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.246 [2024-10-07 11:28:58.249615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.246 [2024-10-07 11:28:58.249633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.246 [2024-10-07 11:28:58.249648] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.246 [2024-10-07 11:28:58.249680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.246 [2024-10-07 11:28:58.254377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.246 [2024-10-07 11:28:58.254616] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.246 [2024-10-07 11:28:58.254656] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.246 [2024-10-07 11:28:58.254675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.246 [2024-10-07 11:28:58.254713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.246 [2024-10-07 11:28:58.254744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.246 [2024-10-07 11:28:58.254761] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.246 [2024-10-07 11:28:58.254778] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.246 [2024-10-07 11:28:58.254809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.246 [2024-10-07 11:28:58.260134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.246 [2024-10-07 11:28:58.260340] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.246 [2024-10-07 11:28:58.260374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.246 [2024-10-07 11:28:58.260393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.246 [2024-10-07 11:28:58.260451] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.246 [2024-10-07 11:28:58.260484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.246 [2024-10-07 11:28:58.260501] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.246 [2024-10-07 11:28:58.260516] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.246 [2024-10-07 11:28:58.260547] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.246 [2024-10-07 11:28:58.264560] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.246 [2024-10-07 11:28:58.264723] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.246 [2024-10-07 11:28:58.264756] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.246 [2024-10-07 11:28:58.264774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.246 [2024-10-07 11:28:58.265549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.246 [2024-10-07 11:28:58.266199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.246 [2024-10-07 11:28:58.266237] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.246 [2024-10-07 11:28:58.266256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.246 [2024-10-07 11:28:58.266595] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.246 [2024-10-07 11:28:58.271167] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.246 [2024-10-07 11:28:58.271342] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.246 [2024-10-07 11:28:58.271377] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.246 [2024-10-07 11:28:58.271396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.246 [2024-10-07 11:28:58.271449] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.246 [2024-10-07 11:28:58.272555] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.246 [2024-10-07 11:28:58.272593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.246 [2024-10-07 11:28:58.272613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.246 [2024-10-07 11:28:58.272861] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.246 [2024-10-07 11:28:58.275807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.246 [2024-10-07 11:28:58.275954] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.246 [2024-10-07 11:28:58.275987] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.246 [2024-10-07 11:28:58.276005] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.246 [2024-10-07 11:28:58.276039] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.247 [2024-10-07 11:28:58.277271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.247 [2024-10-07 11:28:58.277309] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.247 [2024-10-07 11:28:58.277328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.247 [2024-10-07 11:28:58.278545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.247 [2024-10-07 11:28:58.281318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.247 [2024-10-07 11:28:58.281471] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.247 [2024-10-07 11:28:58.281517] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.247 [2024-10-07 11:28:58.281538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.247 [2024-10-07 11:28:58.281573] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.247 [2024-10-07 11:28:58.281604] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.247 [2024-10-07 11:28:58.281620] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.247 [2024-10-07 11:28:58.281644] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.247 [2024-10-07 11:28:58.281689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.247 [2024-10-07 11:28:58.285916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.247 [2024-10-07 11:28:58.287134] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.247 [2024-10-07 11:28:58.287180] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.247 [2024-10-07 11:28:58.287201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.247 [2024-10-07 11:28:58.287424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.247 [2024-10-07 11:28:58.288451] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.247 [2024-10-07 11:28:58.288487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.247 [2024-10-07 11:28:58.288506] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.247 [2024-10-07 11:28:58.288749] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.247 [2024-10-07 11:28:58.293089] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.247 [2024-10-07 11:28:58.293260] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.247 [2024-10-07 11:28:58.293294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.247 [2024-10-07 11:28:58.293312] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.247 [2024-10-07 11:28:58.293346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.247 [2024-10-07 11:28:58.293377] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.247 [2024-10-07 11:28:58.293394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.247 [2024-10-07 11:28:58.293430] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.247 [2024-10-07 11:28:58.293465] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.247 [2024-10-07 11:28:58.296028] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.247 [2024-10-07 11:28:58.296145] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.247 [2024-10-07 11:28:58.296177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.247 [2024-10-07 11:28:58.296194] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.247 [2024-10-07 11:28:58.296225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.247 [2024-10-07 11:28:58.296255] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.247 [2024-10-07 11:28:58.296271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.247 [2024-10-07 11:28:58.296285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.247 [2024-10-07 11:28:58.296315] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.247 [2024-10-07 11:28:58.304111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.247 [2024-10-07 11:28:58.304276] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.247 [2024-10-07 11:28:58.304337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.247 [2024-10-07 11:28:58.304358] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.247 [2024-10-07 11:28:58.304392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.247 [2024-10-07 11:28:58.304453] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.247 [2024-10-07 11:28:58.304471] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.247 [2024-10-07 11:28:58.304487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.247 [2024-10-07 11:28:58.304518] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.247 [2024-10-07 11:28:58.306394] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.247 [2024-10-07 11:28:58.306523] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.247 [2024-10-07 11:28:58.306554] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.247 [2024-10-07 11:28:58.306571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.247 [2024-10-07 11:28:58.306602] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.247 [2024-10-07 11:28:58.306649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.247 [2024-10-07 11:28:58.306668] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.247 [2024-10-07 11:28:58.306682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.247 [2024-10-07 11:28:58.306712] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.247 [2024-10-07 11:28:58.314953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.247 [2024-10-07 11:28:58.315154] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.247 [2024-10-07 11:28:58.315189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.247 [2024-10-07 11:28:58.315208] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.247 [2024-10-07 11:28:58.315258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.247 [2024-10-07 11:28:58.315292] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.247 [2024-10-07 11:28:58.315310] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.247 [2024-10-07 11:28:58.315325] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.247 [2024-10-07 11:28:58.315355] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.247 [2024-10-07 11:28:58.316779] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.247 [2024-10-07 11:28:58.316887] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.247 [2024-10-07 11:28:58.316917] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.247 [2024-10-07 11:28:58.316934] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.247 [2024-10-07 11:28:58.316966] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.247 [2024-10-07 11:28:58.318120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.247 [2024-10-07 11:28:58.318158] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.247 [2024-10-07 11:28:58.318177] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.247 [2024-10-07 11:28:58.318386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.247 [2024-10-07 11:28:58.326238] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.247 [2024-10-07 11:28:58.326680] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.247 [2024-10-07 11:28:58.326728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.247 [2024-10-07 11:28:58.326749] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.247 [2024-10-07 11:28:58.326828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.247 [2024-10-07 11:28:58.326867] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.247 [2024-10-07 11:28:58.326884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.247 [2024-10-07 11:28:58.326900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.247 [2024-10-07 11:28:58.326944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.247 [2024-10-07 11:28:58.326978] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.247 [2024-10-07 11:28:58.327058] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.247 [2024-10-07 11:28:58.327087] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.247 [2024-10-07 11:28:58.327103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.247 [2024-10-07 11:28:58.327133] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.247 [2024-10-07 11:28:58.327163] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.247 [2024-10-07 11:28:58.327178] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.247 [2024-10-07 11:28:58.327192] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.247 [2024-10-07 11:28:58.327221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.247 [2024-10-07 11:28:58.338567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.247 [2024-10-07 11:28:58.338663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.247 [2024-10-07 11:28:58.338817] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.247 [2024-10-07 11:28:58.338854] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.247 [2024-10-07 11:28:58.338872] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.247 [2024-10-07 11:28:58.338922] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.247 [2024-10-07 11:28:58.338945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.247 [2024-10-07 11:28:58.338961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.247 [2024-10-07 11:28:58.339026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.247 [2024-10-07 11:28:58.339051] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.247 [2024-10-07 11:28:58.339077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.247 [2024-10-07 11:28:58.339095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.247 [2024-10-07 11:28:58.339110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.247 [2024-10-07 11:28:58.339127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.247 [2024-10-07 11:28:58.339141] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.247 [2024-10-07 11:28:58.339154] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.247 [2024-10-07 11:28:58.339183] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.247 [2024-10-07 11:28:58.339200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.247 [2024-10-07 11:28:58.348762] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.247 [2024-10-07 11:28:58.349882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.247 [2024-10-07 11:28:58.350014] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.247 [2024-10-07 11:28:58.350049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.247 [2024-10-07 11:28:58.350068] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.247 [2024-10-07 11:28:58.350318] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.247 [2024-10-07 11:28:58.350358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.247 [2024-10-07 11:28:58.350377] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.247 [2024-10-07 11:28:58.350416] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.247 [2024-10-07 11:28:58.350538] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.247 [2024-10-07 11:28:58.350560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.247 [2024-10-07 11:28:58.350574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.247 [2024-10-07 11:28:58.350590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.247 [2024-10-07 11:28:58.351804] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.247 [2024-10-07 11:28:58.351841] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.247 [2024-10-07 11:28:58.351858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.247 [2024-10-07 11:28:58.351873] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.247 [2024-10-07 11:28:58.353009] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.247 [2024-10-07 11:28:58.359995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.247 [2024-10-07 11:28:58.360177] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.247 [2024-10-07 11:28:58.360212] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.247 [2024-10-07 11:28:58.360256] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.247 [2024-10-07 11:28:58.361378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.247 [2024-10-07 11:28:58.361450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.247 [2024-10-07 11:28:58.361704] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.247 [2024-10-07 11:28:58.361744] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.247 [2024-10-07 11:28:58.361764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.247 [2024-10-07 11:28:58.361780] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.247 [2024-10-07 11:28:58.361793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.247 [2024-10-07 11:28:58.361808] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.247 [2024-10-07 11:28:58.362830] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.248 [2024-10-07 11:28:58.362870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.248 [2024-10-07 11:28:58.363134] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.248 [2024-10-07 11:28:58.363169] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.248 [2024-10-07 11:28:58.363186] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.248 [2024-10-07 11:28:58.363219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.248 [2024-10-07 11:28:58.370121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.248 [2024-10-07 11:28:58.370286] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.248 [2024-10-07 11:28:58.370319] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.248 [2024-10-07 11:28:58.370337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.248 [2024-10-07 11:28:58.370371] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.248 [2024-10-07 11:28:58.370416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.248 [2024-10-07 11:28:58.370436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.248 [2024-10-07 11:28:58.370451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.248 [2024-10-07 11:28:58.370482] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.248 [2024-10-07 11:28:58.372479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.248 [2024-10-07 11:28:58.372615] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.248 [2024-10-07 11:28:58.372661] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.248 [2024-10-07 11:28:58.372680] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.248 [2024-10-07 11:28:58.372712] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.248 [2024-10-07 11:28:58.372742] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.248 [2024-10-07 11:28:58.372782] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.248 [2024-10-07 11:28:58.372797] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.248 [2024-10-07 11:28:58.372828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.248 [2024-10-07 11:28:58.381566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.248 [2024-10-07 11:28:58.381745] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.248 [2024-10-07 11:28:58.381780] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.248 [2024-10-07 11:28:58.381798] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.248 [2024-10-07 11:28:58.381832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.248 [2024-10-07 11:28:58.381863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.248 [2024-10-07 11:28:58.381879] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.248 [2024-10-07 11:28:58.381894] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.248 [2024-10-07 11:28:58.381923] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.248 [2024-10-07 11:28:58.383635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.248 [2024-10-07 11:28:58.383983] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.248 [2024-10-07 11:28:58.384024] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.248 [2024-10-07 11:28:58.384044] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.248 [2024-10-07 11:28:58.384114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.248 [2024-10-07 11:28:58.384151] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.248 [2024-10-07 11:28:58.384168] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.248 [2024-10-07 11:28:58.384182] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.248 [2024-10-07 11:28:58.384230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.248 [2024-10-07 11:28:58.391717] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.248 [2024-10-07 11:28:58.391901] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.248 [2024-10-07 11:28:58.391936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.248 [2024-10-07 11:28:58.391954] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.248 [2024-10-07 11:28:58.392983] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.248 [2024-10-07 11:28:58.393238] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.248 [2024-10-07 11:28:58.393274] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.248 [2024-10-07 11:28:58.393293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.248 [2024-10-07 11:28:58.393428] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.248 [2024-10-07 11:28:58.395990] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.248 [2024-10-07 11:28:58.396158] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.248 [2024-10-07 11:28:58.396195] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.248 [2024-10-07 11:28:58.396214] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.248 [2024-10-07 11:28:58.396247] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.248 [2024-10-07 11:28:58.396278] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.248 [2024-10-07 11:28:58.396294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.248 [2024-10-07 11:28:58.396308] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.248 [2024-10-07 11:28:58.396338] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.248 [2024-10-07 11:28:58.401867] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.248 [2024-10-07 11:28:58.402962] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.248 [2024-10-07 11:28:58.403007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.248 [2024-10-07 11:28:58.403029] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.248 [2024-10-07 11:28:58.403229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.248 [2024-10-07 11:28:58.404385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.248 [2024-10-07 11:28:58.404437] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.248 [2024-10-07 11:28:58.404457] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.248 [2024-10-07 11:28:58.404666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.248 [2024-10-07 11:28:58.406098] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.248 [2024-10-07 11:28:58.406224] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.248 [2024-10-07 11:28:58.406255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.248 [2024-10-07 11:28:58.406272] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.248 [2024-10-07 11:28:58.406303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.248 [2024-10-07 11:28:58.406334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.248 [2024-10-07 11:28:58.406350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.248 [2024-10-07 11:28:58.406364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.248 [2024-10-07 11:28:58.407380] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.248 [2024-10-07 11:28:58.412546] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.248 [2024-10-07 11:28:58.413215] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.248 [2024-10-07 11:28:58.413261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.248 [2024-10-07 11:28:58.413282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.248 [2024-10-07 11:28:58.413435] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.248 [2024-10-07 11:28:58.413477] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.248 [2024-10-07 11:28:58.413494] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.248 [2024-10-07 11:28:58.413509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.248 [2024-10-07 11:28:58.413540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.248 [2024-10-07 11:28:58.417233] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.248 [2024-10-07 11:28:58.417380] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.248 [2024-10-07 11:28:58.417426] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.248 [2024-10-07 11:28:58.417446] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.248 [2024-10-07 11:28:58.417480] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.248 [2024-10-07 11:28:58.417510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.248 [2024-10-07 11:28:58.417527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.248 [2024-10-07 11:28:58.417542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.248 [2024-10-07 11:28:58.417572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.248 [2024-10-07 11:28:58.423662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.248 [2024-10-07 11:28:58.423818] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.248 [2024-10-07 11:28:58.423851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.248 [2024-10-07 11:28:58.423869] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.248 [2024-10-07 11:28:58.425085] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.248 [2024-10-07 11:28:58.426298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.248 [2024-10-07 11:28:58.426337] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.248 [2024-10-07 11:28:58.426356] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.248 [2024-10-07 11:28:58.426575] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.248 [2024-10-07 11:28:58.428556] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.248 [2024-10-07 11:28:58.428909] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.248 [2024-10-07 11:28:58.428952] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.248 [2024-10-07 11:28:58.428972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.248 [2024-10-07 11:28:58.429042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.248 [2024-10-07 11:28:58.429094] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.248 [2024-10-07 11:28:58.429113] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.248 [2024-10-07 11:28:58.429151] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.248 [2024-10-07 11:28:58.429183] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.248 [2024-10-07 11:28:58.435040] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.248 [2024-10-07 11:28:58.436207] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.248 [2024-10-07 11:28:58.436254] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.248 [2024-10-07 11:28:58.436276] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.248 [2024-10-07 11:28:58.436524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.248 [2024-10-07 11:28:58.436602] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.248 [2024-10-07 11:28:58.436623] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.248 [2024-10-07 11:28:58.436638] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.248 [2024-10-07 11:28:58.436670] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.248 [2024-10-07 11:28:58.440672] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.248 [2024-10-07 11:28:58.440918] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.248 [2024-10-07 11:28:58.440961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.248 [2024-10-07 11:28:58.440982] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.248 [2024-10-07 11:28:58.441037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.248 [2024-10-07 11:28:58.441088] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.248 [2024-10-07 11:28:58.441107] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.248 [2024-10-07 11:28:58.441121] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.248 [2024-10-07 11:28:58.441151] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.248 [2024-10-07 11:28:58.446012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.248 [2024-10-07 11:28:58.446177] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.248 [2024-10-07 11:28:58.446209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.248 [2024-10-07 11:28:58.446228] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.248 [2024-10-07 11:28:58.446260] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.248 [2024-10-07 11:28:58.446304] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.248 [2024-10-07 11:28:58.446323] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.248 [2024-10-07 11:28:58.446337] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.248 [2024-10-07 11:28:58.446367] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.248 [2024-10-07 11:28:58.450785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.248 [2024-10-07 11:28:58.450959] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.248 [2024-10-07 11:28:58.450993] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.248 [2024-10-07 11:28:58.451010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.248 [2024-10-07 11:28:58.451042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.249 [2024-10-07 11:28:58.451072] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.249 [2024-10-07 11:28:58.451089] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.249 [2024-10-07 11:28:58.451104] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.249 [2024-10-07 11:28:58.452121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.249 [2024-10-07 11:28:58.456127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.249 [2024-10-07 11:28:58.456985] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.249 [2024-10-07 11:28:58.457032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.249 [2024-10-07 11:28:58.457066] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.249 [2024-10-07 11:28:58.457728] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.249 [2024-10-07 11:28:58.457858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.249 [2024-10-07 11:28:58.457884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.249 [2024-10-07 11:28:58.457900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.249 [2024-10-07 11:28:58.457934] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.249 [2024-10-07 11:28:58.461586] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.249 [2024-10-07 11:28:58.461755] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.249 [2024-10-07 11:28:58.461794] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.249 [2024-10-07 11:28:58.461812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.249 [2024-10-07 11:28:58.461844] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.249 [2024-10-07 11:28:58.461895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.249 [2024-10-07 11:28:58.461915] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.249 [2024-10-07 11:28:58.461929] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.249 [2024-10-07 11:28:58.461959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.249 [2024-10-07 11:28:58.466272] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.249 [2024-10-07 11:28:58.466425] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.249 [2024-10-07 11:28:58.466458] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.249 [2024-10-07 11:28:58.466475] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.249 [2024-10-07 11:28:58.466541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.249 [2024-10-07 11:28:58.466574] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.249 [2024-10-07 11:28:58.466591] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.249 [2024-10-07 11:28:58.466606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.249 [2024-10-07 11:28:58.466635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.249 [2024-10-07 11:28:58.472967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.249 [2024-10-07 11:28:58.473456] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.249 [2024-10-07 11:28:58.473502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.249 [2024-10-07 11:28:58.473523] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.249 [2024-10-07 11:28:58.473596] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.249 [2024-10-07 11:28:58.473635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.249 [2024-10-07 11:28:58.473652] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.249 [2024-10-07 11:28:58.473667] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.249 [2024-10-07 11:28:58.473698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.249 [2024-10-07 11:28:58.476378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.249 [2024-10-07 11:28:58.476533] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.249 [2024-10-07 11:28:58.476565] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.249 [2024-10-07 11:28:58.476582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.249 [2024-10-07 11:28:58.476615] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.249 [2024-10-07 11:28:58.476645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.249 [2024-10-07 11:28:58.476662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.249 [2024-10-07 11:28:58.476675] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.249 [2024-10-07 11:28:58.476705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.249 [2024-10-07 11:28:58.485277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.249 [2024-10-07 11:28:58.485493] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.249 [2024-10-07 11:28:58.485529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.249 [2024-10-07 11:28:58.485546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.249 [2024-10-07 11:28:58.485581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.249 [2024-10-07 11:28:58.485611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.249 [2024-10-07 11:28:58.485629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.249 [2024-10-07 11:28:58.485669] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.249 [2024-10-07 11:28:58.485702] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.249 [2024-10-07 11:28:58.487376] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.249 [2024-10-07 11:28:58.487727] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.249 [2024-10-07 11:28:58.487768] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.249 [2024-10-07 11:28:58.487787] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.249 [2024-10-07 11:28:58.487856] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.249 [2024-10-07 11:28:58.487893] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.249 [2024-10-07 11:28:58.487910] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.249 [2024-10-07 11:28:58.487924] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.249 [2024-10-07 11:28:58.487974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.249 [2024-10-07 11:28:58.495441] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.249 [2024-10-07 11:28:58.495624] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.249 [2024-10-07 11:28:58.495659] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.249 [2024-10-07 11:28:58.495677] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.249 [2024-10-07 11:28:58.496715] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.249 [2024-10-07 11:28:58.496961] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.249 [2024-10-07 11:28:58.496997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.249 [2024-10-07 11:28:58.497017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.249 [2024-10-07 11:28:58.497147] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.249 [2024-10-07 11:28:58.499684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.249 [2024-10-07 11:28:58.499848] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.249 [2024-10-07 11:28:58.499888] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.249 [2024-10-07 11:28:58.499907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.249 [2024-10-07 11:28:58.499941] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.249 [2024-10-07 11:28:58.499972] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.249 [2024-10-07 11:28:58.499989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.249 [2024-10-07 11:28:58.500004] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.249 [2024-10-07 11:28:58.500034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.249 [2024-10-07 11:28:58.505587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.249 [2024-10-07 11:28:58.505761] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.249 [2024-10-07 11:28:58.505818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.249 [2024-10-07 11:28:58.505837] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.249 [2024-10-07 11:28:58.505872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.249 [2024-10-07 11:28:58.505904] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.249 [2024-10-07 11:28:58.505921] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.249 [2024-10-07 11:28:58.505936] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.249 [2024-10-07 11:28:58.505966] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.249 [2024-10-07 11:28:58.510758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.249 [2024-10-07 11:28:58.510909] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.249 [2024-10-07 11:28:58.510941] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.249 [2024-10-07 11:28:58.510958] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.249 [2024-10-07 11:28:58.510991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.249 [2024-10-07 11:28:58.511022] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.249 [2024-10-07 11:28:58.511038] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.249 [2024-10-07 11:28:58.511053] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.249 [2024-10-07 11:28:58.511083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.249 [2024-10-07 11:28:58.515724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.249 [2024-10-07 11:28:58.515875] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.249 [2024-10-07 11:28:58.515908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.249 [2024-10-07 11:28:58.515926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.249 [2024-10-07 11:28:58.515959] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.249 [2024-10-07 11:28:58.515989] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.249 [2024-10-07 11:28:58.516006] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.249 [2024-10-07 11:28:58.516021] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.249 [2024-10-07 11:28:58.516051] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.249 [2024-10-07 11:28:58.520875] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.249 [2024-10-07 11:28:58.521027] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.249 [2024-10-07 11:28:58.521073] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.249 [2024-10-07 11:28:58.521093] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.249 [2024-10-07 11:28:58.521126] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.249 [2024-10-07 11:28:58.521190] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.249 [2024-10-07 11:28:58.521208] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.249 [2024-10-07 11:28:58.521224] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.249 [2024-10-07 11:28:58.521253] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.249 [2024-10-07 11:28:58.525838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.249 [2024-10-07 11:28:58.526972] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.249 [2024-10-07 11:28:58.527018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.249 [2024-10-07 11:28:58.527038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.249 [2024-10-07 11:28:58.527254] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.249 [2024-10-07 11:28:58.527374] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.249 [2024-10-07 11:28:58.527413] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.249 [2024-10-07 11:28:58.527433] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.249 [2024-10-07 11:28:58.528640] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.250 [2024-10-07 11:28:58.532002] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.250 [2024-10-07 11:28:58.532378] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.250 [2024-10-07 11:28:58.532437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.250 [2024-10-07 11:28:58.532459] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.250 [2024-10-07 11:28:58.532532] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.250 [2024-10-07 11:28:58.532576] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.250 [2024-10-07 11:28:58.532593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.250 [2024-10-07 11:28:58.532608] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.250 [2024-10-07 11:28:58.532638] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.250 [2024-10-07 11:28:58.536935] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.250 [2024-10-07 11:28:58.537099] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.250 [2024-10-07 11:28:58.537132] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.250 [2024-10-07 11:28:58.537150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.250 [2024-10-07 11:28:58.538262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.250 [2024-10-07 11:28:58.538503] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.250 [2024-10-07 11:28:58.538538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.250 [2024-10-07 11:28:58.538557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.250 [2024-10-07 11:28:58.539609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.250 [2024-10-07 11:28:58.542112] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.250 [2024-10-07 11:28:58.542266] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.250 [2024-10-07 11:28:58.542306] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.250 [2024-10-07 11:28:58.542325] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.250 [2024-10-07 11:28:58.542360] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.250 [2024-10-07 11:28:58.542391] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.250 [2024-10-07 11:28:58.542423] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.250 [2024-10-07 11:28:58.542440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.250 [2024-10-07 11:28:58.542471] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.250 [2024-10-07 11:28:58.547490] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.250 [2024-10-07 11:28:58.547899] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.250 [2024-10-07 11:28:58.547945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.250 [2024-10-07 11:28:58.547966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.250 [2024-10-07 11:28:58.548058] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.250 [2024-10-07 11:28:58.548097] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.250 [2024-10-07 11:28:58.548115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.250 [2024-10-07 11:28:58.548131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.250 [2024-10-07 11:28:58.548162] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.250 [2024-10-07 11:28:58.552523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.250 [2024-10-07 11:28:58.552686] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.250 [2024-10-07 11:28:58.552720] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.250 [2024-10-07 11:28:58.552738] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.250 [2024-10-07 11:28:58.553862] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.250 [2024-10-07 11:28:58.554092] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.250 [2024-10-07 11:28:58.554127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.250 [2024-10-07 11:28:58.554146] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.250 [2024-10-07 11:28:58.555162] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.250 [2024-10-07 11:28:58.559825] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.250 [2024-10-07 11:28:58.560084] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.250 [2024-10-07 11:28:58.560130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.250 [2024-10-07 11:28:58.560182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.250 [2024-10-07 11:28:58.560242] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.250 [2024-10-07 11:28:58.560279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.250 [2024-10-07 11:28:58.560296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.250 [2024-10-07 11:28:58.560311] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.250 [2024-10-07 11:28:58.560342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.250 [2024-10-07 11:28:58.562639] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.250 [2024-10-07 11:28:58.562747] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.250 [2024-10-07 11:28:58.562777] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.250 [2024-10-07 11:28:58.562794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.250 [2024-10-07 11:28:58.562824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.250 [2024-10-07 11:28:58.562854] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.250 [2024-10-07 11:28:58.562870] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.250 [2024-10-07 11:28:58.562884] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.250 [2024-10-07 11:28:58.562913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.250 [2024-10-07 11:28:58.569964] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.250 [2024-10-07 11:28:58.570133] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.250 [2024-10-07 11:28:58.570166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.250 [2024-10-07 11:28:58.570184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.250 [2024-10-07 11:28:58.570218] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.250 [2024-10-07 11:28:58.570249] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.250 [2024-10-07 11:28:58.570266] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.250 [2024-10-07 11:28:58.570282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.250 [2024-10-07 11:28:58.570312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.250 [2024-10-07 11:28:58.574421] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.250 [2024-10-07 11:28:58.574596] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.250 [2024-10-07 11:28:58.574629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.250 [2024-10-07 11:28:58.574646] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.250 [2024-10-07 11:28:58.574679] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.250 [2024-10-07 11:28:58.574709] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.250 [2024-10-07 11:28:58.574756] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.250 [2024-10-07 11:28:58.574773] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.250 [2024-10-07 11:28:58.574805] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.250 [2024-10-07 11:28:58.580193] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.250 [2024-10-07 11:28:58.580350] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.250 [2024-10-07 11:28:58.580382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.250 [2024-10-07 11:28:58.580415] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.250 [2024-10-07 11:28:58.580453] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.250 [2024-10-07 11:28:58.580497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.250 [2024-10-07 11:28:58.580515] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.250 [2024-10-07 11:28:58.580530] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.250 [2024-10-07 11:28:58.580560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.250 [2024-10-07 11:28:58.584775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.250 [2024-10-07 11:28:58.584909] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.250 [2024-10-07 11:28:58.584940] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.250 [2024-10-07 11:28:58.584957] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.250 [2024-10-07 11:28:58.584990] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.250 [2024-10-07 11:28:58.585020] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.250 [2024-10-07 11:28:58.585036] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.250 [2024-10-07 11:28:58.585051] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.250 [2024-10-07 11:28:58.585097] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.250 [2024-10-07 11:28:58.591415] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.250 [2024-10-07 11:28:58.591829] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.250 [2024-10-07 11:28:58.591875] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.250 [2024-10-07 11:28:58.591896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.250 [2024-10-07 11:28:58.591969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.250 [2024-10-07 11:28:58.592007] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.250 [2024-10-07 11:28:58.592025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.250 [2024-10-07 11:28:58.592040] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.250 [2024-10-07 11:28:58.592070] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.250 [2024-10-07 11:28:58.594876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.250 [2024-10-07 11:28:58.594998] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.250 [2024-10-07 11:28:58.595029] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.250 [2024-10-07 11:28:58.595046] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.250 [2024-10-07 11:28:58.595078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.250 [2024-10-07 11:28:58.595108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.250 [2024-10-07 11:28:58.595124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.250 [2024-10-07 11:28:58.595138] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.250 [2024-10-07 11:28:58.595167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.250 [2024-10-07 11:28:58.603580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.250 [2024-10-07 11:28:58.603767] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.250 [2024-10-07 11:28:58.603802] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.250 [2024-10-07 11:28:58.603820] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.250 [2024-10-07 11:28:58.603855] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.250 [2024-10-07 11:28:58.603886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.250 [2024-10-07 11:28:58.603903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.250 [2024-10-07 11:28:58.603918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.250 [2024-10-07 11:28:58.603950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.250 [2024-10-07 11:28:58.605684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.250 [2024-10-07 11:28:58.606022] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.250 [2024-10-07 11:28:58.606063] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.250 [2024-10-07 11:28:58.606083] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.250 [2024-10-07 11:28:58.606152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.250 [2024-10-07 11:28:58.606189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.250 [2024-10-07 11:28:58.606206] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.250 [2024-10-07 11:28:58.606220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.250 [2024-10-07 11:28:58.606249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.250 [2024-10-07 11:28:58.613707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.250 [2024-10-07 11:28:58.613871] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.250 [2024-10-07 11:28:58.613904] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.250 [2024-10-07 11:28:58.613921] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.250 [2024-10-07 11:28:58.614980] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.250 [2024-10-07 11:28:58.615216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.250 [2024-10-07 11:28:58.615252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.250 [2024-10-07 11:28:58.615270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.250 [2024-10-07 11:28:58.615385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.250 [2024-10-07 11:28:58.617919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.250 [2024-10-07 11:28:58.618058] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.251 [2024-10-07 11:28:58.618090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.251 [2024-10-07 11:28:58.618108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.251 [2024-10-07 11:28:58.618140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.251 [2024-10-07 11:28:58.618169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.251 [2024-10-07 11:28:58.618185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.251 [2024-10-07 11:28:58.618199] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.251 [2024-10-07 11:28:58.618229] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.251 [2024-10-07 11:28:58.624889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.251 [2024-10-07 11:28:58.625078] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.251 [2024-10-07 11:28:58.625112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.251 [2024-10-07 11:28:58.625130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.251 [2024-10-07 11:28:58.626239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.251 [2024-10-07 11:28:58.626482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.251 [2024-10-07 11:28:58.626517] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.251 [2024-10-07 11:28:58.626535] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.251 [2024-10-07 11:28:58.627551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.251 [2024-10-07 11:28:58.628015] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.251 [2024-10-07 11:28:58.628123] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.251 [2024-10-07 11:28:58.628154] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.251 [2024-10-07 11:28:58.628171] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.251 [2024-10-07 11:28:58.629204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.251 [2024-10-07 11:28:58.629454] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.251 [2024-10-07 11:28:58.629489] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.251 [2024-10-07 11:28:58.629537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.251 [2024-10-07 11:28:58.630768] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.251 [2024-10-07 11:28:58.635025] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.251 [2024-10-07 11:28:58.635163] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.251 [2024-10-07 11:28:58.635195] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.251 [2024-10-07 11:28:58.635213] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.251 [2024-10-07 11:28:58.635246] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.251 [2024-10-07 11:28:58.635276] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.251 [2024-10-07 11:28:58.635293] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.251 [2024-10-07 11:28:58.635308] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.251 [2024-10-07 11:28:58.635337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.251 [2024-10-07 11:28:58.638097] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.251 [2024-10-07 11:28:58.639113] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.251 [2024-10-07 11:28:58.639155] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.251 [2024-10-07 11:28:58.639175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.251 [2024-10-07 11:28:58.639370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.251 [2024-10-07 11:28:58.639477] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.251 [2024-10-07 11:28:58.639506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.251 [2024-10-07 11:28:58.639522] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.251 [2024-10-07 11:28:58.640704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.251 [2024-10-07 11:28:58.646693] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.251 [2024-10-07 11:28:58.646873] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.251 [2024-10-07 11:28:58.646923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.251 [2024-10-07 11:28:58.646945] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.251 [2024-10-07 11:28:58.646980] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.251 [2024-10-07 11:28:58.647011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.251 [2024-10-07 11:28:58.647029] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.251 [2024-10-07 11:28:58.647044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.251 [2024-10-07 11:28:58.647075] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.251 [2024-10-07 11:28:58.648842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.251 [2024-10-07 11:28:58.648984] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.251 [2024-10-07 11:28:58.649020] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.251 [2024-10-07 11:28:58.649038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.251 [2024-10-07 11:28:58.649318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.251 [2024-10-07 11:28:58.649422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.251 [2024-10-07 11:28:58.649447] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.251 [2024-10-07 11:28:58.649462] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.251 [2024-10-07 11:28:58.649493] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.251 [2024-10-07 11:28:58.656822] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.251 [2024-10-07 11:28:58.656996] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.251 [2024-10-07 11:28:58.657032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.251 [2024-10-07 11:28:58.657050] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.251 [2024-10-07 11:28:58.657098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.251 [2024-10-07 11:28:58.657130] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.251 [2024-10-07 11:28:58.657148] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.251 [2024-10-07 11:28:58.657163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.251 [2024-10-07 11:28:58.658186] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.251 [2024-10-07 11:28:58.658958] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.251 [2024-10-07 11:28:58.660237] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.251 [2024-10-07 11:28:58.660281] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.251 [2024-10-07 11:28:58.660302] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.251 [2024-10-07 11:28:58.661374] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.251 [2024-10-07 11:28:58.661677] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.251 [2024-10-07 11:28:58.661714] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.251 [2024-10-07 11:28:58.661733] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.251 [2024-10-07 11:28:58.661878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.251 [2024-10-07 11:28:58.667321] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.251 [2024-10-07 11:28:58.667526] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.251 [2024-10-07 11:28:58.667572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.251 [2024-10-07 11:28:58.667593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.251 [2024-10-07 11:28:58.667629] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.251 [2024-10-07 11:28:58.667695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.251 [2024-10-07 11:28:58.667713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.251 [2024-10-07 11:28:58.667728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.251 [2024-10-07 11:28:58.667759] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.251 [2024-10-07 11:28:58.669184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.251 [2024-10-07 11:28:58.669298] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.251 [2024-10-07 11:28:58.669337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.251 [2024-10-07 11:28:58.669357] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.251 [2024-10-07 11:28:58.670464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.251 [2024-10-07 11:28:58.670690] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.251 [2024-10-07 11:28:58.670724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.251 [2024-10-07 11:28:58.670742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.251 [2024-10-07 11:28:58.671769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.251 [2024-10-07 11:28:58.679189] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.251 [2024-10-07 11:28:58.679429] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.251 [2024-10-07 11:28:58.679469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.251 [2024-10-07 11:28:58.679488] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.251 [2024-10-07 11:28:58.679542] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.251 [2024-10-07 11:28:58.679584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.251 [2024-10-07 11:28:58.679615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.251 [2024-10-07 11:28:58.679632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.251 [2024-10-07 11:28:58.679647] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.251 [2024-10-07 11:28:58.679677] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.251 [2024-10-07 11:28:58.679735] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.251 [2024-10-07 11:28:58.679760] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.251 [2024-10-07 11:28:58.679776] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.251 [2024-10-07 11:28:58.679807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.251 [2024-10-07 11:28:58.679837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.251 [2024-10-07 11:28:58.679854] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.251 [2024-10-07 11:28:58.679867] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.251 [2024-10-07 11:28:58.679920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.251 [2024-10-07 11:28:58.690979] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.251 [2024-10-07 11:28:58.691154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.251 [2024-10-07 11:28:58.691308] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.251 [2024-10-07 11:28:58.691375] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.251 [2024-10-07 11:28:58.691416] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.251 [2024-10-07 11:28:58.691510] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.251 [2024-10-07 11:28:58.691554] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.251 [2024-10-07 11:28:58.691585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.251 [2024-10-07 11:28:58.691623] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.251 [2024-10-07 11:28:58.692382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.251 [2024-10-07 11:28:58.692443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.251 [2024-10-07 11:28:58.692462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.251 [2024-10-07 11:28:58.692478] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.251 [2024-10-07 11:28:58.693356] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.251 [2024-10-07 11:28:58.693395] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.251 [2024-10-07 11:28:58.693428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.251 [2024-10-07 11:28:58.693443] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.251 [2024-10-07 11:28:58.693553] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.251 [2024-10-07 11:28:58.701139] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.251 [2024-10-07 11:28:58.702325] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.251 [2024-10-07 11:28:58.702374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.251 [2024-10-07 11:28:58.702396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.251 [2024-10-07 11:28:58.702630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.251 [2024-10-07 11:28:58.702779] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.251 [2024-10-07 11:28:58.702824] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.251 [2024-10-07 11:28:58.702843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.251 [2024-10-07 11:28:58.702858] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.252 [2024-10-07 11:28:58.704058] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.252 [2024-10-07 11:28:58.704146] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.252 [2024-10-07 11:28:58.704174] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.252 [2024-10-07 11:28:58.704217] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.252 [2024-10-07 11:28:58.705386] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.252 [2024-10-07 11:28:58.705635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.252 [2024-10-07 11:28:58.705671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.252 [2024-10-07 11:28:58.705690] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.252 [2024-10-07 11:28:58.705747] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.252 [2024-10-07 11:28:58.712149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.252 [2024-10-07 11:28:58.712321] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.252 [2024-10-07 11:28:58.712365] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.252 [2024-10-07 11:28:58.712383] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.252 [2024-10-07 11:28:58.713518] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.252 [2024-10-07 11:28:58.713775] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.252 [2024-10-07 11:28:58.713812] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.252 [2024-10-07 11:28:58.713831] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.252 [2024-10-07 11:28:58.714851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.252 [2024-10-07 11:28:58.714893] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.252 [2024-10-07 11:28:58.715192] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.252 [2024-10-07 11:28:58.715233] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.252 [2024-10-07 11:28:58.715253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.252 [2024-10-07 11:28:58.715302] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.252 [2024-10-07 11:28:58.715335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.252 [2024-10-07 11:28:58.715352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.252 [2024-10-07 11:28:58.715366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.252 [2024-10-07 11:28:58.716395] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.252 [2024-10-07 11:28:58.722288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.252 [2024-10-07 11:28:58.722475] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.252 [2024-10-07 11:28:58.722510] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.252 [2024-10-07 11:28:58.722528] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.252 [2024-10-07 11:28:58.722564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.252 [2024-10-07 11:28:58.722626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.252 [2024-10-07 11:28:58.722645] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.252 [2024-10-07 11:28:58.722660] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.252 [2024-10-07 11:28:58.722691] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.252 [2024-10-07 11:28:58.724958] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.252 [2024-10-07 11:28:58.725096] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.252 [2024-10-07 11:28:58.725128] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.252 [2024-10-07 11:28:58.725146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.252 [2024-10-07 11:28:58.725178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.252 [2024-10-07 11:28:58.725209] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.252 [2024-10-07 11:28:58.725225] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.252 [2024-10-07 11:28:58.725239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.252 [2024-10-07 11:28:58.725269] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.252 [2024-10-07 11:28:58.733773] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.252 [2024-10-07 11:28:58.733978] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.252 [2024-10-07 11:28:58.734013] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.252 [2024-10-07 11:28:58.734032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.252 [2024-10-07 11:28:58.734066] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.252 [2024-10-07 11:28:58.734098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.252 [2024-10-07 11:28:58.734115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.252 [2024-10-07 11:28:58.734131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.252 [2024-10-07 11:28:58.734161] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.252 [2024-10-07 11:28:58.735800] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.252 [2024-10-07 11:28:58.736134] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.252 [2024-10-07 11:28:58.736175] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.252 [2024-10-07 11:28:58.736195] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.252 [2024-10-07 11:28:58.736264] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.252 [2024-10-07 11:28:58.736300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.252 [2024-10-07 11:28:58.736317] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.252 [2024-10-07 11:28:58.736331] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.252 [2024-10-07 11:28:58.736360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.252 [2024-10-07 11:28:58.743914] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.252 [2024-10-07 11:28:58.745071] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.252 [2024-10-07 11:28:58.745118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.252 [2024-10-07 11:28:58.745139] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.252 [2024-10-07 11:28:58.745338] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.252 [2024-10-07 11:28:58.745480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.252 [2024-10-07 11:28:58.745510] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.252 [2024-10-07 11:28:58.745529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.252 [2024-10-07 11:28:58.746739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.252 [2024-10-07 11:28:58.748116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.252 [2024-10-07 11:28:58.748258] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.252 [2024-10-07 11:28:58.748298] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.252 [2024-10-07 11:28:58.748318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.252 [2024-10-07 11:28:58.748351] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.252 [2024-10-07 11:28:58.748382] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.252 [2024-10-07 11:28:58.748412] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.252 [2024-10-07 11:28:58.748430] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.252 [2024-10-07 11:28:58.748461] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.252 [2024-10-07 11:28:58.755018] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.252 [2024-10-07 11:28:58.755159] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.252 [2024-10-07 11:28:58.755192] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.252 [2024-10-07 11:28:58.755209] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.252 [2024-10-07 11:28:58.756308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.252 [2024-10-07 11:28:58.756543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.252 [2024-10-07 11:28:58.756578] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.252 [2024-10-07 11:28:58.756595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.252 [2024-10-07 11:28:58.757623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.252 [2024-10-07 11:28:58.758208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.252 [2024-10-07 11:28:58.759296] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.252 [2024-10-07 11:28:58.759339] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.252 [2024-10-07 11:28:58.759381] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.252 [2024-10-07 11:28:58.759611] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.252 [2024-10-07 11:28:58.760851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.252 [2024-10-07 11:28:58.760888] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.252 [2024-10-07 11:28:58.760906] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.252 [2024-10-07 11:28:58.762081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.252 [2024-10-07 11:28:58.765127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.252 [2024-10-07 11:28:58.765262] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.252 [2024-10-07 11:28:58.765295] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.252 [2024-10-07 11:28:58.765313] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.252 [2024-10-07 11:28:58.765345] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.252 [2024-10-07 11:28:58.765376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.252 [2024-10-07 11:28:58.765392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.252 [2024-10-07 11:28:58.765425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.252 [2024-10-07 11:28:58.765458] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.252 [2024-10-07 11:28:58.769200] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.252 [2024-10-07 11:28:58.769312] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.252 [2024-10-07 11:28:58.769342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.252 [2024-10-07 11:28:58.769359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.252 [2024-10-07 11:28:58.769391] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.252 [2024-10-07 11:28:58.770502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.252 [2024-10-07 11:28:58.770538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.252 [2024-10-07 11:28:58.770556] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.252 [2024-10-07 11:28:58.770759] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.252 [2024-10-07 11:28:58.776460] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.252 [2024-10-07 11:28:58.776610] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.252 [2024-10-07 11:28:58.776643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.252 [2024-10-07 11:28:58.776662] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.252 [2024-10-07 11:28:58.776695] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.252 [2024-10-07 11:28:58.776726] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.252 [2024-10-07 11:28:58.776770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.252 [2024-10-07 11:28:58.776786] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.252 [2024-10-07 11:28:58.776817] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.252 [2024-10-07 11:28:58.779289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.252 [2024-10-07 11:28:58.779414] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.252 [2024-10-07 11:28:58.779445] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.253 [2024-10-07 11:28:58.779463] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.253 [2024-10-07 11:28:58.779494] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.253 [2024-10-07 11:28:58.779524] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.253 [2024-10-07 11:28:58.779540] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.253 [2024-10-07 11:28:58.779555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.253 [2024-10-07 11:28:58.779584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.253 [2024-10-07 11:28:58.786567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.253 [2024-10-07 11:28:58.786734] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.253 [2024-10-07 11:28:58.786768] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.253 [2024-10-07 11:28:58.786786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.253 [2024-10-07 11:28:58.787863] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.253 [2024-10-07 11:28:58.788104] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.253 [2024-10-07 11:28:58.788146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.253 [2024-10-07 11:28:58.788179] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.253 [2024-10-07 11:28:58.788334] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.253 [2024-10-07 11:28:58.791137] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.253 [2024-10-07 11:28:58.791342] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.253 [2024-10-07 11:28:58.791418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.253 [2024-10-07 11:28:58.791451] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.253 [2024-10-07 11:28:58.792208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.253 [2024-10-07 11:28:58.792878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.253 [2024-10-07 11:28:58.792917] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.253 [2024-10-07 11:28:58.792936] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.253 [2024-10-07 11:28:58.793269] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.253 [2024-10-07 11:28:58.796698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.253 [2024-10-07 11:28:58.796876] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.253 [2024-10-07 11:28:58.796911] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.253 [2024-10-07 11:28:58.796928] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.253 [2024-10-07 11:28:58.796962] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.253 [2024-10-07 11:28:58.796993] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.253 [2024-10-07 11:28:58.797009] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.253 [2024-10-07 11:28:58.797024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.253 [2024-10-07 11:28:58.797067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.253 [2024-10-07 11:28:58.801427] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.253 [2024-10-07 11:28:58.801556] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.253 [2024-10-07 11:28:58.801587] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.253 [2024-10-07 11:28:58.801605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.253 [2024-10-07 11:28:58.801641] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.253 [2024-10-07 11:28:58.801689] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.253 [2024-10-07 11:28:58.801711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.253 [2024-10-07 11:28:58.801726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.253 [2024-10-07 11:28:58.801756] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.253 [2024-10-07 11:28:58.808415] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.253 [2024-10-07 11:28:58.808708] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.253 [2024-10-07 11:28:58.808755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.253 [2024-10-07 11:28:58.808776] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.253 [2024-10-07 11:28:58.808833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.253 [2024-10-07 11:28:58.808870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.253 [2024-10-07 11:28:58.808887] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.253 [2024-10-07 11:28:58.808903] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.253 [2024-10-07 11:28:58.808934] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.253 [2024-10-07 11:28:58.811534] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.253 [2024-10-07 11:28:58.811650] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.253 [2024-10-07 11:28:58.811681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.253 [2024-10-07 11:28:58.811698] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.253 [2024-10-07 11:28:58.811761] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.253 [2024-10-07 11:28:58.811793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.253 [2024-10-07 11:28:58.811810] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.253 [2024-10-07 11:28:58.811824] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.253 [2024-10-07 11:28:58.811853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.253 [2024-10-07 11:28:58.818673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.253 [2024-10-07 11:28:58.818852] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.253 [2024-10-07 11:28:58.818887] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.253 [2024-10-07 11:28:58.818905] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.253 [2024-10-07 11:28:58.818940] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.253 [2024-10-07 11:28:58.818971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.253 [2024-10-07 11:28:58.818987] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.253 [2024-10-07 11:28:58.819002] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.253 [2024-10-07 11:28:58.819032] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.253 [2024-10-07 11:28:58.823122] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.253 [2024-10-07 11:28:58.823373] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.253 [2024-10-07 11:28:58.823429] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.253 [2024-10-07 11:28:58.823451] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.253 [2024-10-07 11:28:58.823509] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.253 [2024-10-07 11:28:58.823551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.253 [2024-10-07 11:28:58.823570] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.253 [2024-10-07 11:28:58.823585] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.253 [2024-10-07 11:28:58.823616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.253 [2024-10-07 11:28:58.828816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.253 [2024-10-07 11:28:58.828977] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.253 [2024-10-07 11:28:58.829010] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.253 [2024-10-07 11:28:58.829027] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.253 [2024-10-07 11:28:58.829078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.253 [2024-10-07 11:28:58.829113] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.253 [2024-10-07 11:28:58.829130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.253 [2024-10-07 11:28:58.829190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.253 [2024-10-07 11:28:58.830150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.253 [2024-10-07 11:28:58.833237] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.253 [2024-10-07 11:28:58.833377] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.253 [2024-10-07 11:28:58.833424] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.253 [2024-10-07 11:28:58.833444] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.253 [2024-10-07 11:28:58.833479] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.253 [2024-10-07 11:28:58.833510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.253 [2024-10-07 11:28:58.833527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.253 [2024-10-07 11:28:58.833542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.253 [2024-10-07 11:28:58.833573] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.253 [2024-10-07 11:28:58.839719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.253 [2024-10-07 11:28:58.840120] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.253 [2024-10-07 11:28:58.840166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.253 [2024-10-07 11:28:58.840187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.253 [2024-10-07 11:28:58.840259] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.253 [2024-10-07 11:28:58.840316] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.253 [2024-10-07 11:28:58.840339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.253 [2024-10-07 11:28:58.840354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.253 [2024-10-07 11:28:58.840385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.253 [2024-10-07 11:28:58.843337] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.253 [2024-10-07 11:28:58.843472] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.253 [2024-10-07 11:28:58.843504] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.253 [2024-10-07 11:28:58.843521] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.253 [2024-10-07 11:28:58.844461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.253 [2024-10-07 11:28:58.844699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.253 [2024-10-07 11:28:58.844735] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.253 [2024-10-07 11:28:58.844753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.253 [2024-10-07 11:28:58.844844] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.253 [2024-10-07 11:28:58.851930] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.253 [2024-10-07 11:28:58.852131] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.253 [2024-10-07 11:28:58.852204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.253 [2024-10-07 11:28:58.852224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.253 [2024-10-07 11:28:58.852260] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.253 [2024-10-07 11:28:58.852291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.253 [2024-10-07 11:28:58.852308] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.253 [2024-10-07 11:28:58.852322] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.253 [2024-10-07 11:28:58.852353] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.253 [2024-10-07 11:28:58.854120] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.253 [2024-10-07 11:28:58.854473] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.253 [2024-10-07 11:28:58.854515] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.253 [2024-10-07 11:28:58.854534] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.253 [2024-10-07 11:28:58.854602] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.253 [2024-10-07 11:28:58.854638] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.253 [2024-10-07 11:28:58.854655] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.253 [2024-10-07 11:28:58.854669] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.253 [2024-10-07 11:28:58.854698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.253 [2024-10-07 11:28:58.862066] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.253 [2024-10-07 11:28:58.862236] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.253 [2024-10-07 11:28:58.862271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.253 [2024-10-07 11:28:58.862288] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.253 [2024-10-07 11:28:58.862322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.253 [2024-10-07 11:28:58.863344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.253 [2024-10-07 11:28:58.863382] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.253 [2024-10-07 11:28:58.863412] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.253 [2024-10-07 11:28:58.863611] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.253 [2024-10-07 11:28:58.866335] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.253 [2024-10-07 11:28:58.866496] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.253 [2024-10-07 11:28:58.866528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.253 [2024-10-07 11:28:58.866547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.254 [2024-10-07 11:28:58.866579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.254 [2024-10-07 11:28:58.866635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.254 [2024-10-07 11:28:58.866654] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.254 [2024-10-07 11:28:58.866668] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.254 [2024-10-07 11:28:58.866698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.254 [2024-10-07 11:28:58.873317] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.254 [2024-10-07 11:28:58.873508] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.254 [2024-10-07 11:28:58.873543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.254 [2024-10-07 11:28:58.873562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.254 [2024-10-07 11:28:58.874665] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.254 [2024-10-07 11:28:58.874912] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.254 [2024-10-07 11:28:58.874948] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.254 [2024-10-07 11:28:58.874967] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.254 [2024-10-07 11:28:58.875983] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.254 [2024-10-07 11:28:58.876449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.254 [2024-10-07 11:28:58.876557] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.254 [2024-10-07 11:28:58.876588] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.254 [2024-10-07 11:28:58.876605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.254 [2024-10-07 11:28:58.877639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.254 [2024-10-07 11:28:58.877852] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.254 [2024-10-07 11:28:58.877877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.254 [2024-10-07 11:28:58.877893] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.254 [2024-10-07 11:28:58.877975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.254 [2024-10-07 11:28:58.883458] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.254 [2024-10-07 11:28:58.883609] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.254 [2024-10-07 11:28:58.883643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.254 [2024-10-07 11:28:58.883661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.254 [2024-10-07 11:28:58.883694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.254 [2024-10-07 11:28:58.883724] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.254 [2024-10-07 11:28:58.883741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.254 [2024-10-07 11:28:58.883756] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.254 [2024-10-07 11:28:58.883812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.254 [2024-10-07 11:28:58.887613] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.254 [2024-10-07 11:28:58.887734] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.254 [2024-10-07 11:28:58.887766] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.254 [2024-10-07 11:28:58.887783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.254 [2024-10-07 11:28:58.888895] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.254 [2024-10-07 11:28:58.889147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.254 [2024-10-07 11:28:58.889185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.254 [2024-10-07 11:28:58.889200] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.254 [2024-10-07 11:28:58.890217] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.254 [2024-10-07 11:28:58.894841] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.254 [2024-10-07 11:28:58.895011] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.254 [2024-10-07 11:28:58.895045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.254 [2024-10-07 11:28:58.895063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.254 [2024-10-07 11:28:58.895096] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.254 [2024-10-07 11:28:58.895127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.254 [2024-10-07 11:28:58.895144] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.254 [2024-10-07 11:28:58.895159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.254 [2024-10-07 11:28:58.895190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.254 [2024-10-07 11:28:58.897707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.254 [2024-10-07 11:28:58.897817] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.254 [2024-10-07 11:28:58.897847] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.254 [2024-10-07 11:28:58.897864] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.254 [2024-10-07 11:28:58.897894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.254 [2024-10-07 11:28:58.897924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.254 [2024-10-07 11:28:58.897940] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.254 [2024-10-07 11:28:58.897954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.254 [2024-10-07 11:28:58.897982] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.254 [2024-10-07 11:28:58.904954] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.254 [2024-10-07 11:28:58.905129] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.254 [2024-10-07 11:28:58.905163] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.254 [2024-10-07 11:28:58.905212] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.254 [2024-10-07 11:28:58.906243] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.254 [2024-10-07 11:28:58.906473] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.254 [2024-10-07 11:28:58.906516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.254 [2024-10-07 11:28:58.906534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.254 [2024-10-07 11:28:58.906647] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.254 [2024-10-07 11:28:58.909204] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.254 [2024-10-07 11:28:58.909341] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.254 [2024-10-07 11:28:58.909373] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.254 [2024-10-07 11:28:58.909390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.254 [2024-10-07 11:28:58.909438] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.254 [2024-10-07 11:28:58.909471] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.254 [2024-10-07 11:28:58.909488] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.254 [2024-10-07 11:28:58.909502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.254 [2024-10-07 11:28:58.909531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.254 [2024-10-07 11:28:58.916043] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.254 [2024-10-07 11:28:58.916201] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.254 [2024-10-07 11:28:58.916235] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.254 [2024-10-07 11:28:58.916253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.254 [2024-10-07 11:28:58.917372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.254 [2024-10-07 11:28:58.917638] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.254 [2024-10-07 11:28:58.917665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.254 [2024-10-07 11:28:58.917681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.254 [2024-10-07 11:28:58.918693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.254 [2024-10-07 11:28:58.919295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.254 [2024-10-07 11:28:58.920416] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.254 [2024-10-07 11:28:58.920469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.254 [2024-10-07 11:28:58.920489] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.254 [2024-10-07 11:28:58.920685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.254 [2024-10-07 11:28:58.920811] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.254 [2024-10-07 11:28:58.920865] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.254 [2024-10-07 11:28:58.920884] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.254 [2024-10-07 11:28:58.922100] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.254 [2024-10-07 11:28:58.926168] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.254 [2024-10-07 11:28:58.926299] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.254 [2024-10-07 11:28:58.926331] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.254 [2024-10-07 11:28:58.926348] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.254 [2024-10-07 11:28:58.926381] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.254 [2024-10-07 11:28:58.926426] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.254 [2024-10-07 11:28:58.926446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.254 [2024-10-07 11:28:58.926460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.254 [2024-10-07 11:28:58.926491] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.254 [2024-10-07 11:28:58.930257] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.254 [2024-10-07 11:28:58.930371] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.254 [2024-10-07 11:28:58.930414] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.254 [2024-10-07 11:28:58.930434] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.254 [2024-10-07 11:28:58.931531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.254 [2024-10-07 11:28:58.931754] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.254 [2024-10-07 11:28:58.931788] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.254 [2024-10-07 11:28:58.931806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.254 [2024-10-07 11:28:58.932819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.254 [2024-10-07 11:28:58.937465] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.254 [2024-10-07 11:28:58.937623] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.254 [2024-10-07 11:28:58.937664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.254 [2024-10-07 11:28:58.937684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.254 [2024-10-07 11:28:58.937718] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.254 [2024-10-07 11:28:58.937750] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.254 [2024-10-07 11:28:58.937766] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.254 [2024-10-07 11:28:58.937780] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.254 [2024-10-07 11:28:58.937810] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.254 [2024-10-07 11:28:58.940348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.254 [2024-10-07 11:28:58.940471] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.254 [2024-10-07 11:28:58.940506] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.254 [2024-10-07 11:28:58.940525] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.254 [2024-10-07 11:28:58.940557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.254 [2024-10-07 11:28:58.940587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.254 [2024-10-07 11:28:58.940603] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.254 [2024-10-07 11:28:58.940617] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.254 [2024-10-07 11:28:58.940646] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.254 [2024-10-07 11:28:58.947569] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.254 [2024-10-07 11:28:58.947717] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.254 [2024-10-07 11:28:58.947750] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.254 [2024-10-07 11:28:58.947767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.254 [2024-10-07 11:28:58.948791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.254 [2024-10-07 11:28:58.949010] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.254 [2024-10-07 11:28:58.949044] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.254 [2024-10-07 11:28:58.949072] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.254 [2024-10-07 11:28:58.949142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.254 [2024-10-07 11:28:58.951806] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.254 [2024-10-07 11:28:58.951975] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.254 [2024-10-07 11:28:58.952035] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.254 [2024-10-07 11:28:58.952066] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.254 [2024-10-07 11:28:58.952104] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.255 [2024-10-07 11:28:58.952135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.255 [2024-10-07 11:28:58.952152] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.255 [2024-10-07 11:28:58.952166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.255 [2024-10-07 11:28:58.952197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.255 [2024-10-07 11:28:58.958751] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.255 [2024-10-07 11:28:58.958936] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.255 [2024-10-07 11:28:58.958971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.255 [2024-10-07 11:28:58.959014] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.255 [2024-10-07 11:28:58.959051] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.255 [2024-10-07 11:28:58.959082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.255 [2024-10-07 11:28:58.959099] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.255 [2024-10-07 11:28:58.959115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.255 [2024-10-07 11:28:58.959145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.255 [2024-10-07 11:28:58.962895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.255 [2024-10-07 11:28:58.963019] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.255 [2024-10-07 11:28:58.963050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.255 [2024-10-07 11:28:58.963067] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.255 [2024-10-07 11:28:58.963098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.255 [2024-10-07 11:28:58.963128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.255 [2024-10-07 11:28:58.963145] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.255 [2024-10-07 11:28:58.963159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.255 [2024-10-07 11:28:58.963189] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.255 [2024-10-07 11:28:58.969018] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.255 [2024-10-07 11:28:58.969180] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.255 [2024-10-07 11:28:58.969214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.255 [2024-10-07 11:28:58.969232] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.255 [2024-10-07 11:28:58.969282] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.255 [2024-10-07 11:28:58.969316] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.255 [2024-10-07 11:28:58.969333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.255 [2024-10-07 11:28:58.969347] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.255 [2024-10-07 11:28:58.969378] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.255 [2024-10-07 11:28:58.972997] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.255 [2024-10-07 11:28:58.973144] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.255 [2024-10-07 11:28:58.973176] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.255 [2024-10-07 11:28:58.973193] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.255 [2024-10-07 11:28:58.973225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.255 [2024-10-07 11:28:58.973275] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.255 [2024-10-07 11:28:58.973296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.255 [2024-10-07 11:28:58.973340] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.255 [2024-10-07 11:28:58.973373] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.255 [2024-10-07 11:28:58.979715] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.255 [2024-10-07 11:28:58.979889] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.255 [2024-10-07 11:28:58.979924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.255 [2024-10-07 11:28:58.979941] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.255 [2024-10-07 11:28:58.979975] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.255 [2024-10-07 11:28:58.980006] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.255 [2024-10-07 11:28:58.980023] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.255 [2024-10-07 11:28:58.980038] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.255 [2024-10-07 11:28:58.980067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.255 [2024-10-07 11:28:58.984242] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.255 [2024-10-07 11:28:58.984415] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.255 [2024-10-07 11:28:58.984449] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.255 [2024-10-07 11:28:58.984467] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.255 [2024-10-07 11:28:58.984500] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.255 [2024-10-07 11:28:58.984530] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.255 [2024-10-07 11:28:58.984547] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.255 [2024-10-07 11:28:58.984562] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.255 [2024-10-07 11:28:58.984592] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.255 [2024-10-07 11:28:58.989849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.255 [2024-10-07 11:28:58.990012] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.255 [2024-10-07 11:28:58.990045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.255 [2024-10-07 11:28:58.990063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.255 [2024-10-07 11:28:58.990096] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.255 [2024-10-07 11:28:58.990127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.255 [2024-10-07 11:28:58.990144] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.255 [2024-10-07 11:28:58.990159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.255 [2024-10-07 11:28:58.991098] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.255 [2024-10-07 11:28:58.994357] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.255 [2024-10-07 11:28:58.994547] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.255 [2024-10-07 11:28:58.994581] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.255 [2024-10-07 11:28:58.994600] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.255 [2024-10-07 11:28:58.995627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.255 [2024-10-07 11:28:58.995864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.255 [2024-10-07 11:28:58.995900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.255 [2024-10-07 11:28:58.995919] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.255 [2024-10-07 11:28:58.995989] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.255 [2024-10-07 11:28:59.000748] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.255 [2024-10-07 11:28:59.001179] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.255 [2024-10-07 11:28:59.001226] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.255 [2024-10-07 11:28:59.001247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.255 [2024-10-07 11:28:59.001322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.255 [2024-10-07 11:28:59.001360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.255 [2024-10-07 11:28:59.001378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.255 [2024-10-07 11:28:59.001393] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.255 [2024-10-07 11:28:59.001456] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.255 [2024-10-07 11:28:59.005420] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.255 [2024-10-07 11:28:59.005740] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.255 [2024-10-07 11:28:59.005784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.255 [2024-10-07 11:28:59.005805] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.255 [2024-10-07 11:28:59.006954] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.255 [2024-10-07 11:28:59.007180] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.255 [2024-10-07 11:28:59.007214] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.255 [2024-10-07 11:28:59.007233] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.255 [2024-10-07 11:28:59.008258] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.255 [2024-10-07 11:28:59.012911] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.255 [2024-10-07 11:28:59.013099] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.255 [2024-10-07 11:28:59.013136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.255 [2024-10-07 11:28:59.013155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.255 [2024-10-07 11:28:59.013223] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.255 [2024-10-07 11:28:59.013254] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.255 [2024-10-07 11:28:59.013271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.255 [2024-10-07 11:28:59.013286] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.255 [2024-10-07 11:28:59.013316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.255 [2024-10-07 11:28:59.015532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.255 [2024-10-07 11:28:59.015644] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.255 [2024-10-07 11:28:59.015675] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.255 [2024-10-07 11:28:59.015692] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.255 [2024-10-07 11:28:59.015723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.255 [2024-10-07 11:28:59.015753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.255 [2024-10-07 11:28:59.015770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.255 [2024-10-07 11:28:59.015783] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.255 [2024-10-07 11:28:59.015812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.255 [2024-10-07 11:28:59.023029] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.255 [2024-10-07 11:28:59.023199] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.255 [2024-10-07 11:28:59.023232] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.255 [2024-10-07 11:28:59.023250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.255 [2024-10-07 11:28:59.024279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.255 [2024-10-07 11:28:59.024509] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.255 [2024-10-07 11:28:59.024543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.255 [2024-10-07 11:28:59.024562] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.255 [2024-10-07 11:28:59.024675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.255 [2024-10-07 11:28:59.027225] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.255 [2024-10-07 11:28:59.027369] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.255 [2024-10-07 11:28:59.027424] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.255 [2024-10-07 11:28:59.027447] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.256 [2024-10-07 11:28:59.027481] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.256 [2024-10-07 11:28:59.027512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.256 [2024-10-07 11:28:59.027529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.256 [2024-10-07 11:28:59.027567] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.256 [2024-10-07 11:28:59.027599] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.256 [2024-10-07 11:28:59.034158] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.256 [2024-10-07 11:28:59.034326] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.256 [2024-10-07 11:28:59.034361] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.256 [2024-10-07 11:28:59.034378] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.256 [2024-10-07 11:28:59.035493] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.256 [2024-10-07 11:28:59.035721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.256 [2024-10-07 11:28:59.035756] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.256 [2024-10-07 11:28:59.035774] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.256 [2024-10-07 11:28:59.036791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.256 [2024-10-07 11:28:59.037317] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.256 [2024-10-07 11:28:59.037444] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.256 [2024-10-07 11:28:59.037481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.256 [2024-10-07 11:28:59.037499] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.256 [2024-10-07 11:28:59.038519] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.256 [2024-10-07 11:28:59.038755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.256 [2024-10-07 11:28:59.038790] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.256 [2024-10-07 11:28:59.038808] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.256 [2024-10-07 11:28:59.038921] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.256 [2024-10-07 11:28:59.044288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.256 [2024-10-07 11:28:59.044467] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.256 [2024-10-07 11:28:59.044501] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.256 [2024-10-07 11:28:59.044519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.256 [2024-10-07 11:28:59.044554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.256 [2024-10-07 11:28:59.044586] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.256 [2024-10-07 11:28:59.044602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.256 [2024-10-07 11:28:59.044617] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.256 [2024-10-07 11:28:59.044648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.256 [2024-10-07 11:28:59.048382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.256 [2024-10-07 11:28:59.048529] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.256 [2024-10-07 11:28:59.048584] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.256 [2024-10-07 11:28:59.048603] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.256 [2024-10-07 11:28:59.049727] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.256 [2024-10-07 11:28:59.049961] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.256 [2024-10-07 11:28:59.049996] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.256 [2024-10-07 11:28:59.050014] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.256 [2024-10-07 11:28:59.051042] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.256 [2024-10-07 11:28:59.055722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.256 [2024-10-07 11:28:59.055935] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.256 [2024-10-07 11:28:59.055971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.256 [2024-10-07 11:28:59.055990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.256 [2024-10-07 11:28:59.056026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.256 [2024-10-07 11:28:59.056057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.256 [2024-10-07 11:28:59.056073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.256 [2024-10-07 11:28:59.056089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.256 [2024-10-07 11:28:59.056120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.256 [2024-10-07 11:28:59.058504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.256 [2024-10-07 11:28:59.058633] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.256 [2024-10-07 11:28:59.058665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.256 [2024-10-07 11:28:59.058682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.256 [2024-10-07 11:28:59.058714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.256 [2024-10-07 11:28:59.058745] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.256 [2024-10-07 11:28:59.058762] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.256 [2024-10-07 11:28:59.058776] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.256 [2024-10-07 11:28:59.058805] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.256 [2024-10-07 11:28:59.065871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.256 [2024-10-07 11:28:59.066060] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.256 [2024-10-07 11:28:59.066094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.256 [2024-10-07 11:28:59.066112] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.256 [2024-10-07 11:28:59.067144] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.256 [2024-10-07 11:28:59.067395] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.256 [2024-10-07 11:28:59.067442] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.256 [2024-10-07 11:28:59.067462] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.256 [2024-10-07 11:28:59.068700] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.256 [2024-10-07 11:28:59.070148] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.256 [2024-10-07 11:28:59.070298] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.256 [2024-10-07 11:28:59.070340] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.256 [2024-10-07 11:28:59.070361] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.256 [2024-10-07 11:28:59.070394] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.256 [2024-10-07 11:28:59.070444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.256 [2024-10-07 11:28:59.070463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.256 [2024-10-07 11:28:59.070478] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.256 [2024-10-07 11:28:59.070508] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.256 [2024-10-07 11:28:59.076019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.256 [2024-10-07 11:28:59.076206] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.256 [2024-10-07 11:28:59.076240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.256 [2024-10-07 11:28:59.076259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.256 [2024-10-07 11:28:59.076293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.256 [2024-10-07 11:28:59.076324] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.256 [2024-10-07 11:28:59.076341] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.256 [2024-10-07 11:28:59.076356] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.256 [2024-10-07 11:28:59.076386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.256 [2024-10-07 11:28:59.080943] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.256 [2024-10-07 11:28:59.081123] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.256 [2024-10-07 11:28:59.081159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.256 [2024-10-07 11:28:59.081178] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.256 [2024-10-07 11:28:59.081214] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.256 [2024-10-07 11:28:59.081246] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.256 [2024-10-07 11:28:59.081264] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.256 [2024-10-07 11:28:59.081278] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.256 [2024-10-07 11:28:59.081333] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.256 [2024-10-07 11:28:59.086362] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.256 [2024-10-07 11:28:59.086569] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.256 [2024-10-07 11:28:59.086605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.256 [2024-10-07 11:28:59.086624] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.256 [2024-10-07 11:28:59.086659] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.256 [2024-10-07 11:28:59.086690] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.256 [2024-10-07 11:28:59.086707] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.256 [2024-10-07 11:28:59.086722] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.256 [2024-10-07 11:28:59.086753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.256 [2024-10-07 11:28:59.091073] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.256 [2024-10-07 11:28:59.091221] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.256 [2024-10-07 11:28:59.091254] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.256 [2024-10-07 11:28:59.091272] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.256 [2024-10-07 11:28:59.091306] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.256 [2024-10-07 11:28:59.091337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.256 [2024-10-07 11:28:59.091354] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.256 [2024-10-07 11:28:59.091371] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.256 [2024-10-07 11:28:59.091444] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.256 [2024-10-07 11:28:59.098727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.256 8452.57 IOPS, 33.02 MiB/s [2024-10-07T11:29:07.967Z] [2024-10-07 11:28:59.101828] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.256 [2024-10-07 11:28:59.101881] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.256 [2024-10-07 11:28:59.101903] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.256 [2024-10-07 11:28:59.102131] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.256 [2024-10-07 11:28:59.102270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.256 [2024-10-07 11:28:59.102317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.256 [2024-10-07 11:28:59.102336] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.256 [2024-10-07 11:28:59.102351] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.256 [2024-10-07 11:28:59.103582] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.256 [2024-10-07 11:28:59.103674] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.256 [2024-10-07 11:28:59.103704] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.256 [2024-10-07 11:28:59.103752] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.256 [2024-10-07 11:28:59.105023] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.256 [2024-10-07 11:28:59.105295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.256 [2024-10-07 11:28:59.105335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.256 [2024-10-07 11:28:59.105354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.256 [2024-10-07 11:28:59.105430] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.256 [2024-10-07 11:28:59.108874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.256 [2024-10-07 11:28:59.109037] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.256 [2024-10-07 11:28:59.109092] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.256 [2024-10-07 11:28:59.109114] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.256 [2024-10-07 11:28:59.109148] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.256 [2024-10-07 11:28:59.109181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.256 [2024-10-07 11:28:59.109198] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.256 [2024-10-07 11:28:59.109212] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.256 [2024-10-07 11:28:59.109242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.256 [2024-10-07 11:28:59.113251] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.256 [2024-10-07 11:28:59.113395] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.256 [2024-10-07 11:28:59.113446] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.256 [2024-10-07 11:28:59.113466] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.257 [2024-10-07 11:28:59.113501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.257 [2024-10-07 11:28:59.113533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.257 [2024-10-07 11:28:59.113550] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.257 [2024-10-07 11:28:59.113565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.257 [2024-10-07 11:28:59.113595] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.257 [2024-10-07 11:28:59.119017] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.257 [2024-10-07 11:28:59.119208] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.257 [2024-10-07 11:28:59.119244] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.257 [2024-10-07 11:28:59.119263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.257 [2024-10-07 11:28:59.119298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.257 [2024-10-07 11:28:59.119329] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.257 [2024-10-07 11:28:59.119384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.257 [2024-10-07 11:28:59.119428] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.257 [2024-10-07 11:28:59.120658] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.257 [2024-10-07 11:28:59.123367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.257 [2024-10-07 11:28:59.123523] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.257 [2024-10-07 11:28:59.123567] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.257 [2024-10-07 11:28:59.123589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.257 [2024-10-07 11:28:59.124299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.257 [2024-10-07 11:28:59.124976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.257 [2024-10-07 11:28:59.125014] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.257 [2024-10-07 11:28:59.125033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.257 [2024-10-07 11:28:59.125164] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.257 [2024-10-07 11:28:59.129159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.257 [2024-10-07 11:28:59.129311] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.257 [2024-10-07 11:28:59.129345] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.257 [2024-10-07 11:28:59.129363] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.257 [2024-10-07 11:28:59.129419] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.257 [2024-10-07 11:28:59.129454] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.257 [2024-10-07 11:28:59.129472] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.257 [2024-10-07 11:28:59.129488] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.257 [2024-10-07 11:28:59.129517] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.257 [2024-10-07 11:28:59.134608] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.257 [2024-10-07 11:28:59.134762] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.257 [2024-10-07 11:28:59.134795] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.257 [2024-10-07 11:28:59.134813] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.257 [2024-10-07 11:28:59.134846] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.257 [2024-10-07 11:28:59.134876] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.257 [2024-10-07 11:28:59.134893] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.257 [2024-10-07 11:28:59.134908] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.257 [2024-10-07 11:28:59.134938] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.257 [2024-10-07 11:28:59.139566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.257 [2024-10-07 11:28:59.139729] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.257 [2024-10-07 11:28:59.139763] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.257 [2024-10-07 11:28:59.139781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.257 [2024-10-07 11:28:59.139813] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.257 [2024-10-07 11:28:59.139844] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.257 [2024-10-07 11:28:59.139861] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.257 [2024-10-07 11:28:59.139877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.257 [2024-10-07 11:28:59.139907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.257 [2024-10-07 11:28:59.144727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.257 [2024-10-07 11:28:59.144885] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.257 [2024-10-07 11:28:59.144919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.257 [2024-10-07 11:28:59.144937] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.257 [2024-10-07 11:28:59.144970] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.257 [2024-10-07 11:28:59.145001] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.257 [2024-10-07 11:28:59.145018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.257 [2024-10-07 11:28:59.145033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.257 [2024-10-07 11:28:59.145100] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.257 [2024-10-07 11:28:59.149698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.257 [2024-10-07 11:28:59.149875] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.257 [2024-10-07 11:28:59.149910] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.257 [2024-10-07 11:28:59.149930] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.257 [2024-10-07 11:28:59.151183] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.257 [2024-10-07 11:28:59.151457] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.257 [2024-10-07 11:28:59.151513] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.257 [2024-10-07 11:28:59.151545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.257 [2024-10-07 11:28:59.152783] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.257 [2024-10-07 11:28:59.155197] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.257 [2024-10-07 11:28:59.155360] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.257 [2024-10-07 11:28:59.155395] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.257 [2024-10-07 11:28:59.155465] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.257 [2024-10-07 11:28:59.155508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.257 [2024-10-07 11:28:59.155541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.257 [2024-10-07 11:28:59.155558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.257 [2024-10-07 11:28:59.155573] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.257 [2024-10-07 11:28:59.155604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.257 [2024-10-07 11:28:59.159839] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.257 [2024-10-07 11:28:59.160747] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.257 [2024-10-07 11:28:59.160797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.257 [2024-10-07 11:28:59.160819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.257 [2024-10-07 11:28:59.161504] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.257 [2024-10-07 11:28:59.161625] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.257 [2024-10-07 11:28:59.161651] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.257 [2024-10-07 11:28:59.161667] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.257 [2024-10-07 11:28:59.161702] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.257 [2024-10-07 11:28:59.165646] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.257 [2024-10-07 11:28:59.165921] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.257 [2024-10-07 11:28:59.165981] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.257 [2024-10-07 11:28:59.166017] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.257 [2024-10-07 11:28:59.166080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.257 [2024-10-07 11:28:59.166173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.257 [2024-10-07 11:28:59.166213] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.257 [2024-10-07 11:28:59.166245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.257 [2024-10-07 11:28:59.166302] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.257 [2024-10-07 11:28:59.171340] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.257 [2024-10-07 11:28:59.171619] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.257 [2024-10-07 11:28:59.171695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.257 [2024-10-07 11:28:59.171734] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.257 [2024-10-07 11:28:59.171796] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.257 [2024-10-07 11:28:59.171855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.257 [2024-10-07 11:28:59.171940] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.257 [2024-10-07 11:28:59.171971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.257 [2024-10-07 11:28:59.173354] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.257 [2024-10-07 11:28:59.176688] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.257 [2024-10-07 11:28:59.176871] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.257 [2024-10-07 11:28:59.176908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.257 [2024-10-07 11:28:59.176927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.257 [2024-10-07 11:28:59.176963] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.257 [2024-10-07 11:28:59.176995] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.257 [2024-10-07 11:28:59.177013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.257 [2024-10-07 11:28:59.177028] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.257 [2024-10-07 11:28:59.177074] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.257 [2024-10-07 11:28:59.181540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.257 [2024-10-07 11:28:59.181710] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.257 [2024-10-07 11:28:59.181745] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.257 [2024-10-07 11:28:59.181764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.257 [2024-10-07 11:28:59.181799] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.257 [2024-10-07 11:28:59.181831] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.257 [2024-10-07 11:28:59.181848] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.257 [2024-10-07 11:28:59.181863] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.257 [2024-10-07 11:28:59.181893] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.257 [2024-10-07 11:28:59.187387] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.257 [2024-10-07 11:28:59.187599] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.257 [2024-10-07 11:28:59.187634] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.257 [2024-10-07 11:28:59.187653] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.257 [2024-10-07 11:28:59.187688] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.257 [2024-10-07 11:28:59.187720] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.257 [2024-10-07 11:28:59.187738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.257 [2024-10-07 11:28:59.187753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.257 [2024-10-07 11:28:59.188787] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.257 [2024-10-07 11:28:59.192842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.257 [2024-10-07 11:28:59.194127] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.257 [2024-10-07 11:28:59.194177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.257 [2024-10-07 11:28:59.194199] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.257 [2024-10-07 11:28:59.194504] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.257 [2024-10-07 11:28:59.194672] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.258 [2024-10-07 11:28:59.194708] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.258 [2024-10-07 11:28:59.194727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.258 [2024-10-07 11:28:59.194791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.258 [2024-10-07 11:28:59.197545] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.258 [2024-10-07 11:28:59.197909] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.258 [2024-10-07 11:28:59.197953] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.258 [2024-10-07 11:28:59.197975] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.258 [2024-10-07 11:28:59.198046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.258 [2024-10-07 11:28:59.198083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.258 [2024-10-07 11:28:59.198101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.258 [2024-10-07 11:28:59.198116] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.258 [2024-10-07 11:28:59.198147] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.258 [2024-10-07 11:28:59.203587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.258 [2024-10-07 11:28:59.203794] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.258 [2024-10-07 11:28:59.203831] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.258 [2024-10-07 11:28:59.203851] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.258 [2024-10-07 11:28:59.203889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.258 [2024-10-07 11:28:59.203921] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.258 [2024-10-07 11:28:59.203938] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.258 [2024-10-07 11:28:59.203954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.258 [2024-10-07 11:28:59.205169] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.258 [2024-10-07 11:28:59.207652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.258 [2024-10-07 11:28:59.207790] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.258 [2024-10-07 11:28:59.207824] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.258 [2024-10-07 11:28:59.207843] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.258 [2024-10-07 11:28:59.208902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.258 [2024-10-07 11:28:59.209142] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.258 [2024-10-07 11:28:59.209179] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.258 [2024-10-07 11:28:59.209199] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.258 [2024-10-07 11:28:59.209270] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.258 [2024-10-07 11:28:59.213737] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.258 [2024-10-07 11:28:59.214582] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.258 [2024-10-07 11:28:59.214630] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.258 [2024-10-07 11:28:59.214651] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.258 [2024-10-07 11:28:59.215280] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.258 [2024-10-07 11:28:59.215394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.258 [2024-10-07 11:28:59.215434] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.258 [2024-10-07 11:28:59.215451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.258 [2024-10-07 11:28:59.215485] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.258 [2024-10-07 11:28:59.217754] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.258 [2024-10-07 11:28:59.217869] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.258 [2024-10-07 11:28:59.217900] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.258 [2024-10-07 11:28:59.217918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.258 [2024-10-07 11:28:59.217949] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.258 [2024-10-07 11:28:59.217979] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.258 [2024-10-07 11:28:59.217996] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.258 [2024-10-07 11:28:59.218010] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.258 [2024-10-07 11:28:59.218817] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.258 [2024-10-07 11:28:59.224788] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.258 [2024-10-07 11:28:59.224960] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.258 [2024-10-07 11:28:59.224994] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.258 [2024-10-07 11:28:59.225011] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.258 [2024-10-07 11:28:59.225046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.258 [2024-10-07 11:28:59.225095] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.258 [2024-10-07 11:28:59.225112] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.258 [2024-10-07 11:28:59.225170] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.258 [2024-10-07 11:28:59.225221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.258 [2024-10-07 11:28:59.229916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.258 [2024-10-07 11:28:59.230179] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.258 [2024-10-07 11:28:59.230217] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.258 [2024-10-07 11:28:59.230237] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.258 [2024-10-07 11:28:59.230276] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.258 [2024-10-07 11:28:59.230308] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.258 [2024-10-07 11:28:59.230325] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.258 [2024-10-07 11:28:59.230343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.258 [2024-10-07 11:28:59.230375] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.258 [2024-10-07 11:28:59.235209] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.258 [2024-10-07 11:28:59.235447] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.258 [2024-10-07 11:28:59.235486] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.258 [2024-10-07 11:28:59.235505] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.258 [2024-10-07 11:28:59.235541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.258 [2024-10-07 11:28:59.235589] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.258 [2024-10-07 11:28:59.235607] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.258 [2024-10-07 11:28:59.235625] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.258 [2024-10-07 11:28:59.235657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.258 [2024-10-07 11:28:59.240102] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.258 [2024-10-07 11:28:59.240307] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.258 [2024-10-07 11:28:59.240342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.258 [2024-10-07 11:28:59.240361] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.258 [2024-10-07 11:28:59.241439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.258 [2024-10-07 11:28:59.241664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.258 [2024-10-07 11:28:59.241699] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.258 [2024-10-07 11:28:59.241718] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.258 [2024-10-07 11:28:59.241836] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.258 [2024-10-07 11:28:59.246477] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.258 [2024-10-07 11:28:59.246933] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.258 [2024-10-07 11:28:59.247019] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.258 [2024-10-07 11:28:59.247043] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.258 [2024-10-07 11:28:59.247119] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.258 [2024-10-07 11:28:59.247180] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.258 [2024-10-07 11:28:59.247201] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.258 [2024-10-07 11:28:59.247216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.258 [2024-10-07 11:28:59.247247] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.258 [2024-10-07 11:28:59.250257] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.258 [2024-10-07 11:28:59.251392] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.258 [2024-10-07 11:28:59.251462] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.258 [2024-10-07 11:28:59.251485] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.258 [2024-10-07 11:28:59.251719] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.258 [2024-10-07 11:28:59.251848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.258 [2024-10-07 11:28:59.251878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.258 [2024-10-07 11:28:59.251896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.258 [2024-10-07 11:28:59.253006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.258 [2024-10-07 11:28:59.258703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.258 [2024-10-07 11:28:59.258902] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.258 [2024-10-07 11:28:59.258938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.258 [2024-10-07 11:28:59.258956] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.258 [2024-10-07 11:28:59.258992] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.258 [2024-10-07 11:28:59.259023] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.258 [2024-10-07 11:28:59.259039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.258 [2024-10-07 11:28:59.259054] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.258 [2024-10-07 11:28:59.259085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.258 [2024-10-07 11:28:59.260859] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.258 [2024-10-07 11:28:59.261216] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.258 [2024-10-07 11:28:59.261259] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.258 [2024-10-07 11:28:59.261279] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.258 [2024-10-07 11:28:59.261349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.258 [2024-10-07 11:28:59.261424] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.258 [2024-10-07 11:28:59.261445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.258 [2024-10-07 11:28:59.261460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.258 [2024-10-07 11:28:59.261490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.258 [2024-10-07 11:28:59.268842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.258 [2024-10-07 11:28:59.269025] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.258 [2024-10-07 11:28:59.269075] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.258 [2024-10-07 11:28:59.269099] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.258 [2024-10-07 11:28:59.270137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.258 [2024-10-07 11:28:59.270358] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.258 [2024-10-07 11:28:59.270392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.258 [2024-10-07 11:28:59.270425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.258 [2024-10-07 11:28:59.270542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.258 [2024-10-07 11:28:59.273136] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.258 [2024-10-07 11:28:59.273305] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.258 [2024-10-07 11:28:59.273338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.258 [2024-10-07 11:28:59.273356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.258 [2024-10-07 11:28:59.273389] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.258 [2024-10-07 11:28:59.273437] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.258 [2024-10-07 11:28:59.273455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.258 [2024-10-07 11:28:59.273471] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.258 [2024-10-07 11:28:59.273501] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.258 [2024-10-07 11:28:59.279992] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.259 [2024-10-07 11:28:59.280189] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.259 [2024-10-07 11:28:59.280225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.259 [2024-10-07 11:28:59.280243] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.259 [2024-10-07 11:28:59.281390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.259 [2024-10-07 11:28:59.281662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.259 [2024-10-07 11:28:59.281701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.259 [2024-10-07 11:28:59.281720] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.259 [2024-10-07 11:28:59.282795] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.259 [2024-10-07 11:28:59.284246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.259 [2024-10-07 11:28:59.284604] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.259 [2024-10-07 11:28:59.284653] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.259 [2024-10-07 11:28:59.284674] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.259 [2024-10-07 11:28:59.284793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.259 [2024-10-07 11:28:59.286024] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.259 [2024-10-07 11:28:59.286063] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.259 [2024-10-07 11:28:59.286083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.259 [2024-10-07 11:28:59.287261] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.259 [2024-10-07 11:28:59.290146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.259 [2024-10-07 11:28:59.290301] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.259 [2024-10-07 11:28:59.290334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.259 [2024-10-07 11:28:59.290352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.259 [2024-10-07 11:28:59.290386] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.259 [2024-10-07 11:28:59.290436] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.259 [2024-10-07 11:28:59.290455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.259 [2024-10-07 11:28:59.290470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.259 [2024-10-07 11:28:59.290502] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.259 [2024-10-07 11:28:59.294359] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.259 [2024-10-07 11:28:59.295622] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.259 [2024-10-07 11:28:59.295671] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.259 [2024-10-07 11:28:59.295697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.259 [2024-10-07 11:28:59.295914] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.259 [2024-10-07 11:28:59.296962] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.259 [2024-10-07 11:28:59.297001] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.259 [2024-10-07 11:28:59.297021] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.259 [2024-10-07 11:28:59.297298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.259 [2024-10-07 11:28:59.301522] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.259 [2024-10-07 11:28:59.301715] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.259 [2024-10-07 11:28:59.301751] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.259 [2024-10-07 11:28:59.301802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.259 [2024-10-07 11:28:59.301841] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.259 [2024-10-07 11:28:59.301873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.259 [2024-10-07 11:28:59.301890] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.259 [2024-10-07 11:28:59.301906] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.259 [2024-10-07 11:28:59.301938] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.259 [2024-10-07 11:28:59.304496] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.259 [2024-10-07 11:28:59.304626] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.259 [2024-10-07 11:28:59.304659] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.259 [2024-10-07 11:28:59.304676] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.259 [2024-10-07 11:28:59.304708] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.259 [2024-10-07 11:28:59.304739] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.259 [2024-10-07 11:28:59.304756] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.259 [2024-10-07 11:28:59.304770] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.259 [2024-10-07 11:28:59.304800] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.259 [2024-10-07 11:28:59.311660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.259 [2024-10-07 11:28:59.311848] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.259 [2024-10-07 11:28:59.311884] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.259 [2024-10-07 11:28:59.311926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.259 [2024-10-07 11:28:59.311968] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.259 [2024-10-07 11:28:59.312002] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.259 [2024-10-07 11:28:59.312019] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.259 [2024-10-07 11:28:59.312035] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.259 [2024-10-07 11:28:59.312065] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.259 [2024-10-07 11:28:59.316345] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.259 [2024-10-07 11:28:59.316560] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.259 [2024-10-07 11:28:59.316596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.259 [2024-10-07 11:28:59.316616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.259 [2024-10-07 11:28:59.316651] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.259 [2024-10-07 11:28:59.316699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.259 [2024-10-07 11:28:59.316747] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.259 [2024-10-07 11:28:59.316764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.259 [2024-10-07 11:28:59.316797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.259 [2024-10-07 11:28:59.321814] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.259 [2024-10-07 11:28:59.322030] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.259 [2024-10-07 11:28:59.322068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.259 [2024-10-07 11:28:59.322087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.259 [2024-10-07 11:28:59.323037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.259 [2024-10-07 11:28:59.323264] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.259 [2024-10-07 11:28:59.323300] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.259 [2024-10-07 11:28:59.323321] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.259 [2024-10-07 11:28:59.324496] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.259 [2024-10-07 11:28:59.326504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.259 [2024-10-07 11:28:59.327695] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.259 [2024-10-07 11:28:59.327753] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.259 [2024-10-07 11:28:59.327777] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.259 [2024-10-07 11:28:59.328006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.259 [2024-10-07 11:28:59.328129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.259 [2024-10-07 11:28:59.328150] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.259 [2024-10-07 11:28:59.328166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.259 [2024-10-07 11:28:59.329431] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.259 [2024-10-07 11:28:59.332706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.259 [2024-10-07 11:28:59.333156] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.259 [2024-10-07 11:28:59.333206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.259 [2024-10-07 11:28:59.333228] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.259 [2024-10-07 11:28:59.333303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.259 [2024-10-07 11:28:59.333342] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.259 [2024-10-07 11:28:59.333361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.259 [2024-10-07 11:28:59.333376] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.259 [2024-10-07 11:28:59.333422] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.259 [2024-10-07 11:28:59.338155] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.259 [2024-10-07 11:28:59.339734] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.259 [2024-10-07 11:28:59.339792] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.259 [2024-10-07 11:28:59.339816] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.259 [2024-10-07 11:28:59.341086] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.259 [2024-10-07 11:28:59.341340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.259 [2024-10-07 11:28:59.341381] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.259 [2024-10-07 11:28:59.341427] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.259 [2024-10-07 11:28:59.342493] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.259 [2024-10-07 11:28:59.345386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.259 [2024-10-07 11:28:59.345598] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.259 [2024-10-07 11:28:59.345636] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.259 [2024-10-07 11:28:59.345655] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.259 [2024-10-07 11:28:59.345691] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.259 [2024-10-07 11:28:59.346421] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.259 [2024-10-07 11:28:59.346459] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.259 [2024-10-07 11:28:59.346478] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.259 [2024-10-07 11:28:59.347109] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.259 [2024-10-07 11:28:59.348350] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.259 [2024-10-07 11:28:59.348497] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.259 [2024-10-07 11:28:59.348532] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.259 [2024-10-07 11:28:59.348550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.259 [2024-10-07 11:28:59.348582] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.259 [2024-10-07 11:28:59.348613] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.259 [2024-10-07 11:28:59.348630] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.259 [2024-10-07 11:28:59.348645] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.259 [2024-10-07 11:28:59.348674] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.259 [2024-10-07 11:28:59.356574] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.259 [2024-10-07 11:28:59.356765] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.259 [2024-10-07 11:28:59.356800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.259 [2024-10-07 11:28:59.356819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.259 [2024-10-07 11:28:59.358090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.259 [2024-10-07 11:28:59.359305] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.259 [2024-10-07 11:28:59.359345] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.259 [2024-10-07 11:28:59.359365] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.259 [2024-10-07 11:28:59.359617] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.259 [2024-10-07 11:28:59.359684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.259 [2024-10-07 11:28:59.359791] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.259 [2024-10-07 11:28:59.359833] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.259 [2024-10-07 11:28:59.359853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.259 [2024-10-07 11:28:59.359884] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.259 [2024-10-07 11:28:59.359915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.259 [2024-10-07 11:28:59.359932] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.259 [2024-10-07 11:28:59.359946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.259 [2024-10-07 11:28:59.359990] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.259 [2024-10-07 11:28:59.367916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.259 [2024-10-07 11:28:59.369164] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.259 [2024-10-07 11:28:59.369219] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.259 [2024-10-07 11:28:59.369243] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.260 [2024-10-07 11:28:59.369497] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.260 [2024-10-07 11:28:59.369581] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.260 [2024-10-07 11:28:59.369611] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.260 [2024-10-07 11:28:59.369631] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.260 [2024-10-07 11:28:59.369665] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.260 [2024-10-07 11:28:59.370928] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.260 [2024-10-07 11:28:59.371050] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.260 [2024-10-07 11:28:59.371081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.260 [2024-10-07 11:28:59.371099] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.260 [2024-10-07 11:28:59.372314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.260 [2024-10-07 11:28:59.373554] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.260 [2024-10-07 11:28:59.373594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.260 [2024-10-07 11:28:59.373637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.260 [2024-10-07 11:28:59.373883] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.260 [2024-10-07 11:28:59.378927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.260 [2024-10-07 11:28:59.379128] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.260 [2024-10-07 11:28:59.379164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.260 [2024-10-07 11:28:59.379184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.260 [2024-10-07 11:28:59.379219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.260 [2024-10-07 11:28:59.379265] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.260 [2024-10-07 11:28:59.379286] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.260 [2024-10-07 11:28:59.379302] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.260 [2024-10-07 11:28:59.379341] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.260 [2024-10-07 11:28:59.382282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.260 [2024-10-07 11:28:59.383420] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.260 [2024-10-07 11:28:59.383473] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.260 [2024-10-07 11:28:59.383515] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.260 [2024-10-07 11:28:59.383744] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.260 [2024-10-07 11:28:59.383825] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.260 [2024-10-07 11:28:59.383847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.260 [2024-10-07 11:28:59.383874] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.260 [2024-10-07 11:28:59.383907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.260 [2024-10-07 11:28:59.390127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.260 [2024-10-07 11:28:59.390610] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.260 [2024-10-07 11:28:59.390663] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.260 [2024-10-07 11:28:59.390686] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.260 [2024-10-07 11:28:59.390771] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.260 [2024-10-07 11:28:59.390846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.260 [2024-10-07 11:28:59.390868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.260 [2024-10-07 11:28:59.390884] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.260 [2024-10-07 11:28:59.390917] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.260 [2024-10-07 11:28:59.393239] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.260 [2024-10-07 11:28:59.393433] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.260 [2024-10-07 11:28:59.393477] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.260 [2024-10-07 11:28:59.393497] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.260 [2024-10-07 11:28:59.393541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.260 [2024-10-07 11:28:59.393579] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.260 [2024-10-07 11:28:59.393599] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.260 [2024-10-07 11:28:59.393613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.260 [2024-10-07 11:28:59.393645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.260 [2024-10-07 11:28:59.402304] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.260 [2024-10-07 11:28:59.402528] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.260 [2024-10-07 11:28:59.402564] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.260 [2024-10-07 11:28:59.402583] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.260 [2024-10-07 11:28:59.402618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.260 [2024-10-07 11:28:59.402649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.260 [2024-10-07 11:28:59.402666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.260 [2024-10-07 11:28:59.402681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.260 [2024-10-07 11:28:59.402713] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.260 [2024-10-07 11:28:59.404418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.260 [2024-10-07 11:28:59.404759] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.260 [2024-10-07 11:28:59.404802] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.260 [2024-10-07 11:28:59.404822] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.260 [2024-10-07 11:28:59.404892] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.260 [2024-10-07 11:28:59.404950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.260 [2024-10-07 11:28:59.404970] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.260 [2024-10-07 11:28:59.404985] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.260 [2024-10-07 11:28:59.405016] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.260 [2024-10-07 11:28:59.412466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.260 [2024-10-07 11:28:59.413629] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.260 [2024-10-07 11:28:59.413677] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.260 [2024-10-07 11:28:59.413699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.260 [2024-10-07 11:28:59.413933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.260 [2024-10-07 11:28:59.414065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.260 [2024-10-07 11:28:59.414093] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.260 [2024-10-07 11:28:59.414121] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.260 [2024-10-07 11:28:59.415325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.260 [2024-10-07 11:28:59.416721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.260 [2024-10-07 11:28:59.416900] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.260 [2024-10-07 11:28:59.416935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.260 [2024-10-07 11:28:59.416953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.260 [2024-10-07 11:28:59.416994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.260 [2024-10-07 11:28:59.417025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.260 [2024-10-07 11:28:59.417042] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.260 [2024-10-07 11:28:59.417070] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.260 [2024-10-07 11:28:59.417105] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.260 [2024-10-07 11:28:59.422597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.260 [2024-10-07 11:28:59.422780] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.260 [2024-10-07 11:28:59.422816] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.260 [2024-10-07 11:28:59.422834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.260 [2024-10-07 11:28:59.422868] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.260 [2024-10-07 11:28:59.422899] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.260 [2024-10-07 11:28:59.422916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.260 [2024-10-07 11:28:59.422931] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.260 [2024-10-07 11:28:59.422961] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.260 [2024-10-07 11:28:59.427745] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.260 [2024-10-07 11:28:59.428003] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.260 [2024-10-07 11:28:59.428058] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.260 [2024-10-07 11:28:59.428089] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.260 [2024-10-07 11:28:59.429499] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.260 [2024-10-07 11:28:59.429907] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.260 [2024-10-07 11:28:59.429968] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.260 [2024-10-07 11:28:59.430045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.260 [2024-10-07 11:28:59.430241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.260 [2024-10-07 11:28:59.434606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.260 [2024-10-07 11:28:59.435098] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.260 [2024-10-07 11:28:59.435152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.260 [2024-10-07 11:28:59.435174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.260 [2024-10-07 11:28:59.435252] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.260 [2024-10-07 11:28:59.435292] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.260 [2024-10-07 11:28:59.435309] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.260 [2024-10-07 11:28:59.435325] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.260 [2024-10-07 11:28:59.435360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.260 [2024-10-07 11:28:59.438134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.260 [2024-10-07 11:28:59.438301] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.260 [2024-10-07 11:28:59.438338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.260 [2024-10-07 11:28:59.438357] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.260 [2024-10-07 11:28:59.438425] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.260 [2024-10-07 11:28:59.438466] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.260 [2024-10-07 11:28:59.438484] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.260 [2024-10-07 11:28:59.438500] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.260 [2024-10-07 11:28:59.438532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.260 [2024-10-07 11:28:59.444746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.260 [2024-10-07 11:28:59.444923] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.260 [2024-10-07 11:28:59.444957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.260 [2024-10-07 11:28:59.444976] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.260 [2024-10-07 11:28:59.445010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.260 [2024-10-07 11:28:59.445041] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.260 [2024-10-07 11:28:59.445072] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.260 [2024-10-07 11:28:59.445090] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.260 [2024-10-07 11:28:59.445121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.260 [2024-10-07 11:28:59.449356] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.260 [2024-10-07 11:28:59.449530] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.260 [2024-10-07 11:28:59.449601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.260 [2024-10-07 11:28:59.449625] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.260 [2024-10-07 11:28:59.449661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.260 [2024-10-07 11:28:59.449694] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.260 [2024-10-07 11:28:59.449710] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.260 [2024-10-07 11:28:59.449727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.260 [2024-10-07 11:28:59.449951] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.260 [2024-10-07 11:28:59.454881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.260 [2024-10-07 11:28:59.455034] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.260 [2024-10-07 11:28:59.455078] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.260 [2024-10-07 11:28:59.455099] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.260 [2024-10-07 11:28:59.455134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.260 [2024-10-07 11:28:59.455165] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.260 [2024-10-07 11:28:59.455181] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.260 [2024-10-07 11:28:59.455197] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.261 [2024-10-07 11:28:59.455227] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.261 [2024-10-07 11:28:59.459480] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.261 [2024-10-07 11:28:59.459622] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.261 [2024-10-07 11:28:59.459665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.261 [2024-10-07 11:28:59.459685] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.261 [2024-10-07 11:28:59.459720] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.261 [2024-10-07 11:28:59.459751] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.261 [2024-10-07 11:28:59.459767] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.261 [2024-10-07 11:28:59.459782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.261 [2024-10-07 11:28:59.459812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.261 [2024-10-07 11:28:59.465593] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.261 [2024-10-07 11:28:59.465875] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.261 [2024-10-07 11:28:59.465955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.261 [2024-10-07 11:28:59.465996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.261 [2024-10-07 11:28:59.467859] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.261 [2024-10-07 11:28:59.469834] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.261 [2024-10-07 11:28:59.469912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.261 [2024-10-07 11:28:59.469951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.261 [2024-10-07 11:28:59.471233] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.261 [2024-10-07 11:28:59.472097] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.261 [2024-10-07 11:28:59.472736] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.261 [2024-10-07 11:28:59.472806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.261 [2024-10-07 11:28:59.472840] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.261 [2024-10-07 11:28:59.472948] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.261 [2024-10-07 11:28:59.473021] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.261 [2024-10-07 11:28:59.473067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.261 [2024-10-07 11:28:59.473098] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.261 [2024-10-07 11:28:59.473150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.261 [2024-10-07 11:28:59.476110] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.261 [2024-10-07 11:28:59.476346] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.261 [2024-10-07 11:28:59.476419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.261 [2024-10-07 11:28:59.476454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.261 [2024-10-07 11:28:59.476506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.261 [2024-10-07 11:28:59.476556] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.261 [2024-10-07 11:28:59.476583] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.261 [2024-10-07 11:28:59.476606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.261 [2024-10-07 11:28:59.476648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.261 [2024-10-07 11:28:59.482230] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.261 [2024-10-07 11:28:59.482439] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.261 [2024-10-07 11:28:59.482477] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.261 [2024-10-07 11:28:59.482496] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.261 [2024-10-07 11:28:59.482532] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.261 [2024-10-07 11:28:59.482564] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.261 [2024-10-07 11:28:59.482582] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.261 [2024-10-07 11:28:59.482598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.261 [2024-10-07 11:28:59.482655] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.261 [2024-10-07 11:28:59.487148] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.261 [2024-10-07 11:28:59.487293] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.261 [2024-10-07 11:28:59.487333] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.261 [2024-10-07 11:28:59.487353] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.261 [2024-10-07 11:28:59.487395] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.261 [2024-10-07 11:28:59.487450] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.261 [2024-10-07 11:28:59.487467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.261 [2024-10-07 11:28:59.487482] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.261 [2024-10-07 11:28:59.487514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.261 [2024-10-07 11:28:59.492380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.261 [2024-10-07 11:28:59.492541] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.261 [2024-10-07 11:28:59.492576] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.261 [2024-10-07 11:28:59.492594] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.261 [2024-10-07 11:28:59.492627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.261 [2024-10-07 11:28:59.492659] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.261 [2024-10-07 11:28:59.492676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.261 [2024-10-07 11:28:59.492691] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.261 [2024-10-07 11:28:59.492721] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.261 [2024-10-07 11:28:59.497263] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.261 [2024-10-07 11:28:59.497421] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.261 [2024-10-07 11:28:59.497469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.261 [2024-10-07 11:28:59.497497] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.261 [2024-10-07 11:28:59.497536] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.261 [2024-10-07 11:28:59.497568] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.261 [2024-10-07 11:28:59.497586] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.261 [2024-10-07 11:28:59.497601] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.261 [2024-10-07 11:28:59.497632] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.261 [2024-10-07 11:28:59.503203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.261 [2024-10-07 11:28:59.503369] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.261 [2024-10-07 11:28:59.503417] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.261 [2024-10-07 11:28:59.503471] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.261 [2024-10-07 11:28:59.503509] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.261 [2024-10-07 11:28:59.503542] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.261 [2024-10-07 11:28:59.503559] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.261 [2024-10-07 11:28:59.503574] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.261 [2024-10-07 11:28:59.503604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.261 [2024-10-07 11:28:59.507374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.261 [2024-10-07 11:28:59.507533] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.261 [2024-10-07 11:28:59.507576] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.261 [2024-10-07 11:28:59.507596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.261 [2024-10-07 11:28:59.507631] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.261 [2024-10-07 11:28:59.507661] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.261 [2024-10-07 11:28:59.507678] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.261 [2024-10-07 11:28:59.507693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.261 [2024-10-07 11:28:59.507723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.261 [2024-10-07 11:28:59.513977] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.261 [2024-10-07 11:28:59.514149] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.261 [2024-10-07 11:28:59.514194] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.261 [2024-10-07 11:28:59.514215] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.261 [2024-10-07 11:28:59.514251] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.261 [2024-10-07 11:28:59.514282] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.261 [2024-10-07 11:28:59.514299] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.261 [2024-10-07 11:28:59.514314] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.261 [2024-10-07 11:28:59.514345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.261 [2024-10-07 11:28:59.518330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.261 [2024-10-07 11:28:59.518493] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.261 [2024-10-07 11:28:59.518539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.261 [2024-10-07 11:28:59.518560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.261 [2024-10-07 11:28:59.518596] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.261 [2024-10-07 11:28:59.518628] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.261 [2024-10-07 11:28:59.518668] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.261 [2024-10-07 11:28:59.518684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.261 [2024-10-07 11:28:59.518716] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.261 [2024-10-07 11:28:59.525275] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.261 [2024-10-07 11:28:59.525449] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.261 [2024-10-07 11:28:59.525484] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.261 [2024-10-07 11:28:59.525503] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.261 [2024-10-07 11:28:59.525538] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.261 [2024-10-07 11:28:59.525570] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.261 [2024-10-07 11:28:59.525587] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.261 [2024-10-07 11:28:59.525602] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.261 [2024-10-07 11:28:59.525633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.261 [2024-10-07 11:28:59.528753] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.261 [2024-10-07 11:28:59.528898] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.261 [2024-10-07 11:28:59.528941] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.261 [2024-10-07 11:28:59.528962] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.261 [2024-10-07 11:28:59.528996] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.261 [2024-10-07 11:28:59.529027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.261 [2024-10-07 11:28:59.529044] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.261 [2024-10-07 11:28:59.529078] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.261 [2024-10-07 11:28:59.529113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.262 [2024-10-07 11:28:59.535909] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.262 [2024-10-07 11:28:59.536137] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.262 [2024-10-07 11:28:59.536189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.262 [2024-10-07 11:28:59.536212] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.262 [2024-10-07 11:28:59.536260] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.262 [2024-10-07 11:28:59.537444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.262 [2024-10-07 11:28:59.537490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.262 [2024-10-07 11:28:59.537511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.262 [2024-10-07 11:28:59.537732] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.262 [2024-10-07 11:28:59.539169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.262 [2024-10-07 11:28:59.539306] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.262 [2024-10-07 11:28:59.539348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.262 [2024-10-07 11:28:59.539369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.262 [2024-10-07 11:28:59.539426] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.262 [2024-10-07 11:28:59.539475] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.262 [2024-10-07 11:28:59.539495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.262 [2024-10-07 11:28:59.539510] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.262 [2024-10-07 11:28:59.539541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.262 [2024-10-07 11:28:59.546066] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.262 [2024-10-07 11:28:59.546223] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.262 [2024-10-07 11:28:59.546258] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.262 [2024-10-07 11:28:59.546276] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.262 [2024-10-07 11:28:59.547010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.262 [2024-10-07 11:28:59.547684] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.262 [2024-10-07 11:28:59.547722] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.262 [2024-10-07 11:28:59.547741] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.262 [2024-10-07 11:28:59.547861] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.262 [2024-10-07 11:28:59.549265] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.262 [2024-10-07 11:28:59.549386] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.262 [2024-10-07 11:28:59.549439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.262 [2024-10-07 11:28:59.549460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.262 [2024-10-07 11:28:59.549493] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.262 [2024-10-07 11:28:59.549524] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.262 [2024-10-07 11:28:59.549541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.262 [2024-10-07 11:28:59.549555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.262 [2024-10-07 11:28:59.549584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.262 [2024-10-07 11:28:59.556189] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.262 [2024-10-07 11:28:59.556375] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.262 [2024-10-07 11:28:59.556425] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.262 [2024-10-07 11:28:59.556447] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.262 [2024-10-07 11:28:59.556517] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.262 [2024-10-07 11:28:59.556549] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.262 [2024-10-07 11:28:59.556566] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.262 [2024-10-07 11:28:59.556583] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.262 [2024-10-07 11:28:59.556614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.262 [2024-10-07 11:28:59.560562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.262 [2024-10-07 11:28:59.560703] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.262 [2024-10-07 11:28:59.560747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.262 [2024-10-07 11:28:59.560767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.262 [2024-10-07 11:28:59.560800] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.262 [2024-10-07 11:28:59.560832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.262 [2024-10-07 11:28:59.560848] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.262 [2024-10-07 11:28:59.560863] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.262 [2024-10-07 11:28:59.560892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.262 [2024-10-07 11:28:59.566327] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.262 [2024-10-07 11:28:59.566499] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.262 [2024-10-07 11:28:59.566546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.262 [2024-10-07 11:28:59.566567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.262 [2024-10-07 11:28:59.566602] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.262 [2024-10-07 11:28:59.566634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.262 [2024-10-07 11:28:59.566651] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.262 [2024-10-07 11:28:59.566665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.262 [2024-10-07 11:28:59.566696] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.262 [2024-10-07 11:28:59.570671] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.262 [2024-10-07 11:28:59.570809] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.262 [2024-10-07 11:28:59.570851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.262 [2024-10-07 11:28:59.570873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.262 [2024-10-07 11:28:59.570906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.262 [2024-10-07 11:28:59.570937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.262 [2024-10-07 11:28:59.570954] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.262 [2024-10-07 11:28:59.570997] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.262 [2024-10-07 11:28:59.571030] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.262 [2024-10-07 11:28:59.577179] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.262 [2024-10-07 11:28:59.577350] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.262 [2024-10-07 11:28:59.577385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.262 [2024-10-07 11:28:59.577418] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.262 [2024-10-07 11:28:59.577456] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.262 [2024-10-07 11:28:59.577488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.262 [2024-10-07 11:28:59.577505] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.262 [2024-10-07 11:28:59.577520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.262 [2024-10-07 11:28:59.577551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.262 [2024-10-07 11:28:59.581692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.262 [2024-10-07 11:28:59.581880] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.262 [2024-10-07 11:28:59.581925] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.262 [2024-10-07 11:28:59.581946] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.262 [2024-10-07 11:28:59.581982] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.262 [2024-10-07 11:28:59.582014] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.262 [2024-10-07 11:28:59.582038] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.262 [2024-10-07 11:28:59.582063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.262 [2024-10-07 11:28:59.582110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.262 [2024-10-07 11:28:59.587316] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.262 [2024-10-07 11:28:59.587518] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.262 [2024-10-07 11:28:59.587555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.262 [2024-10-07 11:28:59.587574] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.262 [2024-10-07 11:28:59.587609] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.262 [2024-10-07 11:28:59.588553] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.262 [2024-10-07 11:28:59.588593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.262 [2024-10-07 11:28:59.588613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.262 [2024-10-07 11:28:59.588818] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.262 [2024-10-07 11:28:59.591823] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.262 [2024-10-07 11:28:59.592008] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.262 [2024-10-07 11:28:59.592053] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.262 [2024-10-07 11:28:59.592074] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.262 [2024-10-07 11:28:59.592110] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.262 [2024-10-07 11:28:59.593157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.262 [2024-10-07 11:28:59.593197] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.262 [2024-10-07 11:28:59.593217] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.262 [2024-10-07 11:28:59.593443] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.262 [2024-10-07 11:28:59.598389] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.262 [2024-10-07 11:28:59.598844] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.262 [2024-10-07 11:28:59.598893] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.262 [2024-10-07 11:28:59.598915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.262 [2024-10-07 11:28:59.598988] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.262 [2024-10-07 11:28:59.599050] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.262 [2024-10-07 11:28:59.599071] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.262 [2024-10-07 11:28:59.599087] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.262 [2024-10-07 11:28:59.599119] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.262 [2024-10-07 11:28:59.601971] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.262 [2024-10-07 11:28:59.602114] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.262 [2024-10-07 11:28:59.602150] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.262 [2024-10-07 11:28:59.602168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.262 [2024-10-07 11:28:59.602201] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.262 [2024-10-07 11:28:59.602232] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.262 [2024-10-07 11:28:59.602249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.262 [2024-10-07 11:28:59.602264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.262 [2024-10-07 11:28:59.602295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.262 [2024-10-07 11:28:59.609680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.262 [2024-10-07 11:28:59.609841] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.262 [2024-10-07 11:28:59.609878] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.262 [2024-10-07 11:28:59.609896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.262 [2024-10-07 11:28:59.609931] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.262 [2024-10-07 11:28:59.609995] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.262 [2024-10-07 11:28:59.610013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.262 [2024-10-07 11:28:59.610029] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.262 [2024-10-07 11:28:59.610060] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.262 [2024-10-07 11:28:59.612850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.262 [2024-10-07 11:28:59.613002] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.262 [2024-10-07 11:28:59.613046] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.262 [2024-10-07 11:28:59.613086] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.262 [2024-10-07 11:28:59.613123] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.262 [2024-10-07 11:28:59.613155] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.262 [2024-10-07 11:28:59.613171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.262 [2024-10-07 11:28:59.613186] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.262 [2024-10-07 11:28:59.613216] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.262 [2024-10-07 11:28:59.620105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.262 [2024-10-07 11:28:59.620257] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.262 [2024-10-07 11:28:59.620292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.262 [2024-10-07 11:28:59.620311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.262 [2024-10-07 11:28:59.621443] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.262 [2024-10-07 11:28:59.621692] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.262 [2024-10-07 11:28:59.621729] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.262 [2024-10-07 11:28:59.621748] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.262 [2024-10-07 11:28:59.622785] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.262 [2024-10-07 11:28:59.623082] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.262 [2024-10-07 11:28:59.623201] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.262 [2024-10-07 11:28:59.623242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.262 [2024-10-07 11:28:59.623262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.262 [2024-10-07 11:28:59.623294] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.262 [2024-10-07 11:28:59.623324] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.262 [2024-10-07 11:28:59.623340] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.262 [2024-10-07 11:28:59.623355] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.263 [2024-10-07 11:28:59.623426] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.263 [2024-10-07 11:28:59.630243] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.263 [2024-10-07 11:28:59.630414] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.263 [2024-10-07 11:28:59.630462] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.263 [2024-10-07 11:28:59.630484] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.263 [2024-10-07 11:28:59.630522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.263 [2024-10-07 11:28:59.630554] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.263 [2024-10-07 11:28:59.630571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.263 [2024-10-07 11:28:59.630585] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.263 [2024-10-07 11:28:59.630616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.263 [2024-10-07 11:28:59.633172] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.263 [2024-10-07 11:28:59.634071] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.263 [2024-10-07 11:28:59.634117] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.263 [2024-10-07 11:28:59.634138] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.263 [2024-10-07 11:28:59.634327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.263 [2024-10-07 11:28:59.634543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.263 [2024-10-07 11:28:59.634582] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.263 [2024-10-07 11:28:59.634601] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.263 [2024-10-07 11:28:59.634663] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.263 [2024-10-07 11:28:59.640355] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.263 [2024-10-07 11:28:59.640531] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.263 [2024-10-07 11:28:59.640566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.263 [2024-10-07 11:28:59.640584] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.263 [2024-10-07 11:28:59.640618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.263 [2024-10-07 11:28:59.640649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.263 [2024-10-07 11:28:59.640666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.263 [2024-10-07 11:28:59.640680] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.263 [2024-10-07 11:28:59.640711] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.263 [2024-10-07 11:28:59.645344] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.263 [2024-10-07 11:28:59.645488] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.263 [2024-10-07 11:28:59.645550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.263 [2024-10-07 11:28:59.645569] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.263 [2024-10-07 11:28:59.645603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.263 [2024-10-07 11:28:59.645634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.263 [2024-10-07 11:28:59.645650] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.263 [2024-10-07 11:28:59.645664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.263 [2024-10-07 11:28:59.645853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.263 [2024-10-07 11:28:59.650495] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.263 [2024-10-07 11:28:59.650625] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.263 [2024-10-07 11:28:59.650658] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.263 [2024-10-07 11:28:59.650676] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.263 [2024-10-07 11:28:59.650724] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.263 [2024-10-07 11:28:59.650757] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.263 [2024-10-07 11:28:59.650774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.263 [2024-10-07 11:28:59.650789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.263 [2024-10-07 11:28:59.650819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.263 [2024-10-07 11:28:59.655462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.263 [2024-10-07 11:28:59.655587] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.263 [2024-10-07 11:28:59.655618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.263 [2024-10-07 11:28:59.655636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.263 [2024-10-07 11:28:59.655667] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.263 [2024-10-07 11:28:59.655698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.263 [2024-10-07 11:28:59.655714] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.263 [2024-10-07 11:28:59.655729] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.263 [2024-10-07 11:28:59.655758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.263 [2024-10-07 11:28:59.660956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.263 [2024-10-07 11:28:59.661086] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.263 [2024-10-07 11:28:59.661125] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.263 [2024-10-07 11:28:59.661143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.263 [2024-10-07 11:28:59.661176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.263 [2024-10-07 11:28:59.661236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.263 [2024-10-07 11:28:59.661254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.263 [2024-10-07 11:28:59.661268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.263 [2024-10-07 11:28:59.661298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.263 [2024-10-07 11:28:59.665556] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.263 [2024-10-07 11:28:59.665677] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.263 [2024-10-07 11:28:59.665709] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.263 [2024-10-07 11:28:59.665726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.263 [2024-10-07 11:28:59.665757] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.263 [2024-10-07 11:28:59.665788] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.263 [2024-10-07 11:28:59.665804] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.263 [2024-10-07 11:28:59.665819] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.263 [2024-10-07 11:28:59.665848] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.263 [2024-10-07 11:28:59.671449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.263 [2024-10-07 11:28:59.671603] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.263 [2024-10-07 11:28:59.671636] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.263 [2024-10-07 11:28:59.671654] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.263 [2024-10-07 11:28:59.671686] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.263 [2024-10-07 11:28:59.671718] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.263 [2024-10-07 11:28:59.671735] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.263 [2024-10-07 11:28:59.671750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.263 [2024-10-07 11:28:59.671780] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.263 [2024-10-07 11:28:59.675674] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.263 [2024-10-07 11:28:59.675796] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.263 [2024-10-07 11:28:59.675827] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.263 [2024-10-07 11:28:59.675844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.263 [2024-10-07 11:28:59.675876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.263 [2024-10-07 11:28:59.675925] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.263 [2024-10-07 11:28:59.675944] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.263 [2024-10-07 11:28:59.675959] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.263 [2024-10-07 11:28:59.675989] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.263 [2024-10-07 11:28:59.682465] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.263 [2024-10-07 11:28:59.682597] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.263 [2024-10-07 11:28:59.682630] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.263 [2024-10-07 11:28:59.682649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.263 [2024-10-07 11:28:59.682681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.263 [2024-10-07 11:28:59.682711] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.263 [2024-10-07 11:28:59.682727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.263 [2024-10-07 11:28:59.682742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.263 [2024-10-07 11:28:59.682931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.263 [2024-10-07 11:28:59.685982] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.263 [2024-10-07 11:28:59.686108] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.263 [2024-10-07 11:28:59.686140] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.263 [2024-10-07 11:28:59.686157] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.263 [2024-10-07 11:28:59.686189] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.263 [2024-10-07 11:28:59.686220] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.263 [2024-10-07 11:28:59.686236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.263 [2024-10-07 11:28:59.686251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.263 [2024-10-07 11:28:59.686281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.263 [2024-10-07 11:28:59.693601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.263 [2024-10-07 11:28:59.693799] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.263 [2024-10-07 11:28:59.693840] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.263 [2024-10-07 11:28:59.693860] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.263 [2024-10-07 11:28:59.693894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.263 [2024-10-07 11:28:59.693925] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.263 [2024-10-07 11:28:59.693942] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.263 [2024-10-07 11:28:59.693957] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.263 [2024-10-07 11:28:59.693988] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.263 [2024-10-07 11:28:59.696073] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.263 [2024-10-07 11:28:59.696187] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.263 [2024-10-07 11:28:59.696228] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.263 [2024-10-07 11:28:59.696274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.263 [2024-10-07 11:28:59.696310] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.263 [2024-10-07 11:28:59.697289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.263 [2024-10-07 11:28:59.697327] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.263 [2024-10-07 11:28:59.697347] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.263 [2024-10-07 11:28:59.697563] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.263 [2024-10-07 11:28:59.705283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.263 [2024-10-07 11:28:59.705495] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.263 [2024-10-07 11:28:59.705539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.263 [2024-10-07 11:28:59.705561] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.263 [2024-10-07 11:28:59.705596] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.263 [2024-10-07 11:28:59.705628] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.263 [2024-10-07 11:28:59.705645] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.263 [2024-10-07 11:28:59.705660] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.263 [2024-10-07 11:28:59.705691] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.263 [2024-10-07 11:28:59.707421] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.263 [2024-10-07 11:28:59.707774] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.263 [2024-10-07 11:28:59.707816] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.263 [2024-10-07 11:28:59.707836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.263 [2024-10-07 11:28:59.707919] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.263 [2024-10-07 11:28:59.707956] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.263 [2024-10-07 11:28:59.707973] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.263 [2024-10-07 11:28:59.707987] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.263 [2024-10-07 11:28:59.708017] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.263 [2024-10-07 11:28:59.715424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.264 [2024-10-07 11:28:59.715583] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.264 [2024-10-07 11:28:59.715616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.264 [2024-10-07 11:28:59.715634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.264 [2024-10-07 11:28:59.715665] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.264 [2024-10-07 11:28:59.716683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.264 [2024-10-07 11:28:59.716748] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.264 [2024-10-07 11:28:59.716768] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.264 [2024-10-07 11:28:59.716968] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.264 [2024-10-07 11:28:59.719685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.264 [2024-10-07 11:28:59.719834] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.264 [2024-10-07 11:28:59.719876] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.264 [2024-10-07 11:28:59.719897] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.264 [2024-10-07 11:28:59.719930] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.264 [2024-10-07 11:28:59.719961] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.264 [2024-10-07 11:28:59.719977] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.264 [2024-10-07 11:28:59.719991] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.264 [2024-10-07 11:28:59.720021] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.264 [2024-10-07 11:28:59.725548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.264 [2024-10-07 11:28:59.726591] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.264 [2024-10-07 11:28:59.726638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.264 [2024-10-07 11:28:59.726660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.264 [2024-10-07 11:28:59.726873] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.264 [2024-10-07 11:28:59.728030] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.264 [2024-10-07 11:28:59.728067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.264 [2024-10-07 11:28:59.728086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.264 [2024-10-07 11:28:59.728292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.264 [2024-10-07 11:28:59.729781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.264 [2024-10-07 11:28:59.729895] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.264 [2024-10-07 11:28:59.729934] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.264 [2024-10-07 11:28:59.729953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.264 [2024-10-07 11:28:59.729985] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.264 [2024-10-07 11:28:59.730015] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.264 [2024-10-07 11:28:59.730032] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.264 [2024-10-07 11:28:59.730046] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.264 [2024-10-07 11:28:59.731057] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.264 [2024-10-07 11:28:59.736134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.264 [2024-10-07 11:28:59.736565] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.264 [2024-10-07 11:28:59.736613] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.264 [2024-10-07 11:28:59.736635] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.264 [2024-10-07 11:28:59.736709] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.264 [2024-10-07 11:28:59.736747] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.264 [2024-10-07 11:28:59.736764] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.264 [2024-10-07 11:28:59.736779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.264 [2024-10-07 11:28:59.736810] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.264 [2024-10-07 11:28:59.739872] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.264 [2024-10-07 11:28:59.740894] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.264 [2024-10-07 11:28:59.740939] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.264 [2024-10-07 11:28:59.740960] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.264 [2024-10-07 11:28:59.741179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.264 [2024-10-07 11:28:59.741276] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.264 [2024-10-07 11:28:59.741297] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.264 [2024-10-07 11:28:59.741313] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.264 [2024-10-07 11:28:59.742425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.264 [2024-10-07 11:28:59.748293] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.264 [2024-10-07 11:28:59.748468] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.264 [2024-10-07 11:28:59.748514] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.264 [2024-10-07 11:28:59.748534] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.264 [2024-10-07 11:28:59.748570] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.264 [2024-10-07 11:28:59.748601] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.264 [2024-10-07 11:28:59.748618] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.264 [2024-10-07 11:28:59.748633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.264 [2024-10-07 11:28:59.748663] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.264 [2024-10-07 11:28:59.750442] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.264 [2024-10-07 11:28:59.750785] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.264 [2024-10-07 11:28:59.750828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.264 [2024-10-07 11:28:59.750849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.264 [2024-10-07 11:28:59.750954] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.264 [2024-10-07 11:28:59.750991] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.264 [2024-10-07 11:28:59.751009] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.264 [2024-10-07 11:28:59.751023] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.264 [2024-10-07 11:28:59.751054] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.264 [2024-10-07 11:28:59.758431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.264 [2024-10-07 11:28:59.758586] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.264 [2024-10-07 11:28:59.758620] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.264 [2024-10-07 11:28:59.758637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.264 [2024-10-07 11:28:59.759671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.264 [2024-10-07 11:28:59.759889] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.264 [2024-10-07 11:28:59.759924] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.264 [2024-10-07 11:28:59.759942] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.264 [2024-10-07 11:28:59.760027] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.264 [2024-10-07 11:28:59.762629] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.264 [2024-10-07 11:28:59.762771] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.264 [2024-10-07 11:28:59.762813] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.264 [2024-10-07 11:28:59.762834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.264 [2024-10-07 11:28:59.762866] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.264 [2024-10-07 11:28:59.762897] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.264 [2024-10-07 11:28:59.762913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.264 [2024-10-07 11:28:59.762927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.264 [2024-10-07 11:28:59.762956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.264 [2024-10-07 11:28:59.769637] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.264 [2024-10-07 11:28:59.769839] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.264 [2024-10-07 11:28:59.769872] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.264 [2024-10-07 11:28:59.769890] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.264 [2024-10-07 11:28:59.770994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.264 [2024-10-07 11:28:59.771235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.264 [2024-10-07 11:28:59.771271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.264 [2024-10-07 11:28:59.771320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.264 [2024-10-07 11:28:59.772340] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.264 [2024-10-07 11:28:59.772727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.264 [2024-10-07 11:28:59.772841] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.264 [2024-10-07 11:28:59.772872] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.264 [2024-10-07 11:28:59.772890] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.264 [2024-10-07 11:28:59.772921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.264 [2024-10-07 11:28:59.772951] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.264 [2024-10-07 11:28:59.772968] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.264 [2024-10-07 11:28:59.772982] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.265 [2024-10-07 11:28:59.774014] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.265 [2024-10-07 11:28:59.779767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.265 [2024-10-07 11:28:59.779932] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.265 [2024-10-07 11:28:59.779968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.265 [2024-10-07 11:28:59.779986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.265 [2024-10-07 11:28:59.780021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.265 [2024-10-07 11:28:59.780052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.265 [2024-10-07 11:28:59.780070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.265 [2024-10-07 11:28:59.780084] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.265 [2024-10-07 11:28:59.780114] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.265 [2024-10-07 11:28:59.782814] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.265 [2024-10-07 11:28:59.782942] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.265 [2024-10-07 11:28:59.782974] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.265 [2024-10-07 11:28:59.782992] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.265 [2024-10-07 11:28:59.783935] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.265 [2024-10-07 11:28:59.784154] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.265 [2024-10-07 11:28:59.784189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.265 [2024-10-07 11:28:59.784207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.265 [2024-10-07 11:28:59.785363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.265 [2024-10-07 11:28:59.791349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.265 [2024-10-07 11:28:59.791629] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.265 [2024-10-07 11:28:59.791668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.265 [2024-10-07 11:28:59.791687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.265 [2024-10-07 11:28:59.791724] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.265 [2024-10-07 11:28:59.791756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.265 [2024-10-07 11:28:59.791773] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.265 [2024-10-07 11:28:59.791789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.265 [2024-10-07 11:28:59.791821] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.265 [2024-10-07 11:28:59.793505] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.265 [2024-10-07 11:28:59.793857] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.265 [2024-10-07 11:28:59.793901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.265 [2024-10-07 11:28:59.793920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.265 [2024-10-07 11:28:59.793991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.265 [2024-10-07 11:28:59.794028] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.265 [2024-10-07 11:28:59.794044] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.265 [2024-10-07 11:28:59.794058] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.265 [2024-10-07 11:28:59.794088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.265 [2024-10-07 11:28:59.801786] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.265 [2024-10-07 11:28:59.802036] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.265 [2024-10-07 11:28:59.802075] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.265 [2024-10-07 11:28:59.802094] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.265 [2024-10-07 11:28:59.803190] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.265 [2024-10-07 11:28:59.803435] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.265 [2024-10-07 11:28:59.803472] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.265 [2024-10-07 11:28:59.803491] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.265 [2024-10-07 11:28:59.804729] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.265 [2024-10-07 11:28:59.806186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.265 [2024-10-07 11:28:59.806345] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.265 [2024-10-07 11:28:59.806388] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.265 [2024-10-07 11:28:59.806424] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.265 [2024-10-07 11:28:59.806461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.265 [2024-10-07 11:28:59.806518] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.265 [2024-10-07 11:28:59.806536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.265 [2024-10-07 11:28:59.806551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.265 [2024-10-07 11:28:59.806581] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.265 [2024-10-07 11:28:59.811964] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.265 [2024-10-07 11:28:59.813072] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.265 [2024-10-07 11:28:59.813123] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.265 [2024-10-07 11:28:59.813145] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.265 [2024-10-07 11:28:59.813370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.265 [2024-10-07 11:28:59.813536] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.265 [2024-10-07 11:28:59.813570] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.265 [2024-10-07 11:28:59.813589] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.265 [2024-10-07 11:28:59.814696] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.265 [2024-10-07 11:28:59.816308] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.265 [2024-10-07 11:28:59.816509] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.265 [2024-10-07 11:28:59.816569] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.265 [2024-10-07 11:28:59.816594] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.265 [2024-10-07 11:28:59.817830] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.265 [2024-10-07 11:28:59.818193] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.265 [2024-10-07 11:28:59.818250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.265 [2024-10-07 11:28:59.818281] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.265 [2024-10-07 11:28:59.818466] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.265 [2024-10-07 11:28:59.823138] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.265 [2024-10-07 11:28:59.823353] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.265 [2024-10-07 11:28:59.823422] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.265 [2024-10-07 11:28:59.823448] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.265 [2024-10-07 11:28:59.823488] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.265 [2024-10-07 11:28:59.823521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.265 [2024-10-07 11:28:59.823539] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.265 [2024-10-07 11:28:59.823554] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.265 [2024-10-07 11:28:59.823621] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.265 [2024-10-07 11:28:59.826444] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.265 [2024-10-07 11:28:59.826586] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.265 [2024-10-07 11:28:59.826629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.265 [2024-10-07 11:28:59.826649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.265 [2024-10-07 11:28:59.827599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.265 [2024-10-07 11:28:59.827823] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.265 [2024-10-07 11:28:59.827859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.265 [2024-10-07 11:28:59.827878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.265 [2024-10-07 11:28:59.827957] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.265 [2024-10-07 11:28:59.836748] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.265 [2024-10-07 11:28:59.838092] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.265 [2024-10-07 11:28:59.838168] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.265 [2024-10-07 11:28:59.838203] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.265 [2024-10-07 11:28:59.838358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.265 [2024-10-07 11:28:59.838455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.265 [2024-10-07 11:28:59.838583] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.266 [2024-10-07 11:28:59.838638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.266 [2024-10-07 11:28:59.838670] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.266 [2024-10-07 11:28:59.838695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.266 [2024-10-07 11:28:59.838719] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.266 [2024-10-07 11:28:59.838746] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.266 [2024-10-07 11:28:59.838798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.266 [2024-10-07 11:28:59.838832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.266 [2024-10-07 11:28:59.838878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.266 [2024-10-07 11:28:59.838906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.266 [2024-10-07 11:28:59.838930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.266 [2024-10-07 11:28:59.838972] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.266 [2024-10-07 11:28:59.849807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.266 [2024-10-07 11:28:59.851212] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.266 [2024-10-07 11:28:59.851287] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.266 [2024-10-07 11:28:59.851361] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.266 [2024-10-07 11:28:59.852474] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.266 [2024-10-07 11:28:59.852560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.266 [2024-10-07 11:28:59.852779] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.266 [2024-10-07 11:28:59.852837] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.266 [2024-10-07 11:28:59.852870] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.266 [2024-10-07 11:28:59.852897] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.266 [2024-10-07 11:28:59.852921] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.266 [2024-10-07 11:28:59.852947] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.266 [2024-10-07 11:28:59.853001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.266 [2024-10-07 11:28:59.853035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.266 [2024-10-07 11:28:59.853098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.266 [2024-10-07 11:28:59.853129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.266 [2024-10-07 11:28:59.853154] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.266 [2024-10-07 11:28:59.853198] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.266 [2024-10-07 11:28:59.861425] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.266 [2024-10-07 11:28:59.863127] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.266 [2024-10-07 11:28:59.863205] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.266 [2024-10-07 11:28:59.863240] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.266 [2024-10-07 11:28:59.864732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.266 [2024-10-07 11:28:59.865965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.266 [2024-10-07 11:28:59.866052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.266 [2024-10-07 11:28:59.866086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.266 [2024-10-07 11:28:59.866114] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.266 [2024-10-07 11:28:59.867196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.266 [2024-10-07 11:28:59.867349] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.266 [2024-10-07 11:28:59.867424] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.266 [2024-10-07 11:28:59.867460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.266 [2024-10-07 11:28:59.867614] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.266 [2024-10-07 11:28:59.867727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.266 [2024-10-07 11:28:59.867762] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.266 [2024-10-07 11:28:59.867787] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.266 [2024-10-07 11:28:59.867838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.266 [2024-10-07 11:28:59.873930] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.266 [2024-10-07 11:28:59.875655] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.266 [2024-10-07 11:28:59.875736] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.266 [2024-10-07 11:28:59.875771] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.266 [2024-10-07 11:28:59.876067] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.266 [2024-10-07 11:28:59.876271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.266 [2024-10-07 11:28:59.876322] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.266 [2024-10-07 11:28:59.876354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.266 [2024-10-07 11:28:59.877883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.266 [2024-10-07 11:28:59.877953] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.266 [2024-10-07 11:28:59.879512] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.266 [2024-10-07 11:28:59.879580] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.266 [2024-10-07 11:28:59.879614] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.266 [2024-10-07 11:28:59.880751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.266 [2024-10-07 11:28:59.881871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.266 [2024-10-07 11:28:59.881929] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.266 [2024-10-07 11:28:59.881962] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.266 [2024-10-07 11:28:59.882166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.266 [2024-10-07 11:28:59.884118] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.266 [2024-10-07 11:28:59.885460] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.266 [2024-10-07 11:28:59.885525] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.266 [2024-10-07 11:28:59.885560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.266 [2024-10-07 11:28:59.885822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.266 [2024-10-07 11:28:59.886011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.266 [2024-10-07 11:28:59.886056] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.266 [2024-10-07 11:28:59.886086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.266 [2024-10-07 11:28:59.887449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.266 [2024-10-07 11:28:59.890508] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.266 [2024-10-07 11:28:59.892458] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.266 [2024-10-07 11:28:59.892526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.266 [2024-10-07 11:28:59.892560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.266 [2024-10-07 11:28:59.893983] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.266 [2024-10-07 11:28:59.895164] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.266 [2024-10-07 11:28:59.895221] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.266 [2024-10-07 11:28:59.895253] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.266 [2024-10-07 11:28:59.896364] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.266 [2024-10-07 11:28:59.896583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.266 [2024-10-07 11:28:59.896736] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.266 [2024-10-07 11:28:59.896793] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.266 [2024-10-07 11:28:59.896826] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.266 [2024-10-07 11:28:59.897858] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.266 [2024-10-07 11:28:59.898125] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.266 [2024-10-07 11:28:59.898175] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.266 [2024-10-07 11:28:59.898206] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.266 [2024-10-07 11:28:59.898446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.266 [2024-10-07 11:28:59.903013] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.266 [2024-10-07 11:28:59.904446] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.266 [2024-10-07 11:28:59.904512] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.266 [2024-10-07 11:28:59.904549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.266 [2024-10-07 11:28:59.906354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.267 [2024-10-07 11:28:59.907791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.267 [2024-10-07 11:28:59.907848] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.267 [2024-10-07 11:28:59.907880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.267 [2024-10-07 11:28:59.909091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.267 [2024-10-07 11:28:59.910207] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.267 [2024-10-07 11:28:59.910502] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.267 [2024-10-07 11:28:59.910565] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.267 [2024-10-07 11:28:59.910629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.267 [2024-10-07 11:28:59.910685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.267 [2024-10-07 11:28:59.910735] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.267 [2024-10-07 11:28:59.910764] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.267 [2024-10-07 11:28:59.910789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.267 [2024-10-07 11:28:59.910836] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.267 [2024-10-07 11:28:59.914351] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.267 [2024-10-07 11:28:59.915879] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.267 [2024-10-07 11:28:59.915947] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.267 [2024-10-07 11:28:59.915980] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.267 [2024-10-07 11:28:59.917880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.267 [2024-10-07 11:28:59.918506] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.267 [2024-10-07 11:28:59.918583] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.267 [2024-10-07 11:28:59.918621] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.267 [2024-10-07 11:28:59.920770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.267 [2024-10-07 11:28:59.925760] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.267 [2024-10-07 11:28:59.926861] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.267 [2024-10-07 11:28:59.926931] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.267 [2024-10-07 11:28:59.926955] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.267 [2024-10-07 11:28:59.928120] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.267 [2024-10-07 11:28:59.928182] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.267 [2024-10-07 11:28:59.928899] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.267 [2024-10-07 11:28:59.928946] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.267 [2024-10-07 11:28:59.928967] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.267 [2024-10-07 11:28:59.928984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.267 [2024-10-07 11:28:59.928998] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.267 [2024-10-07 11:28:59.929013] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.267 [2024-10-07 11:28:59.929844] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.267 [2024-10-07 11:28:59.929887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.267 [2024-10-07 11:28:59.930357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.267 [2024-10-07 11:28:59.930443] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.267 [2024-10-07 11:28:59.930462] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.267 [2024-10-07 11:28:59.931932] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.267 [2024-10-07 11:28:59.937527] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.267 [2024-10-07 11:28:59.937730] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.267 [2024-10-07 11:28:59.937768] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.267 [2024-10-07 11:28:59.937787] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.267 [2024-10-07 11:28:59.937823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.267 [2024-10-07 11:28:59.938455] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.267 [2024-10-07 11:28:59.938493] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.267 [2024-10-07 11:28:59.938513] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.267 [2024-10-07 11:28:59.939245] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.267 [2024-10-07 11:28:59.939553] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.267 [2024-10-07 11:28:59.939763] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.267 [2024-10-07 11:28:59.939802] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.267 [2024-10-07 11:28:59.939821] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.267 [2024-10-07 11:28:59.939875] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.267 [2024-10-07 11:28:59.939912] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.267 [2024-10-07 11:28:59.939930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.267 [2024-10-07 11:28:59.939944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.267 [2024-10-07 11:28:59.939975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.267 [2024-10-07 11:28:59.949605] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.267 [2024-10-07 11:28:59.950484] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.267 [2024-10-07 11:28:59.950536] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.267 [2024-10-07 11:28:59.950559] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.267 [2024-10-07 11:28:59.950706] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.267 [2024-10-07 11:28:59.950756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.267 [2024-10-07 11:28:59.950789] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.267 [2024-10-07 11:28:59.950806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.267 [2024-10-07 11:28:59.950821] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.267 [2024-10-07 11:28:59.950851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.267 [2024-10-07 11:28:59.950944] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.267 [2024-10-07 11:28:59.950973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.267 [2024-10-07 11:28:59.950989] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.267 [2024-10-07 11:28:59.951022] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.267 [2024-10-07 11:28:59.951053] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.267 [2024-10-07 11:28:59.951070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.267 [2024-10-07 11:28:59.951084] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.267 [2024-10-07 11:28:59.951113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.267 [2024-10-07 11:28:59.961920] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.267 [2024-10-07 11:28:59.962209] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.267 [2024-10-07 11:28:59.962340] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.267 [2024-10-07 11:28:59.962374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.267 [2024-10-07 11:28:59.962394] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.267 [2024-10-07 11:28:59.963384] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.267 [2024-10-07 11:28:59.963442] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.267 [2024-10-07 11:28:59.963462] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.267 [2024-10-07 11:28:59.963485] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.267 [2024-10-07 11:28:59.963704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.267 [2024-10-07 11:28:59.963743] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.267 [2024-10-07 11:28:59.963762] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.267 [2024-10-07 11:28:59.963778] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.267 [2024-10-07 11:28:59.964724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.267 [2024-10-07 11:28:59.964762] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.267 [2024-10-07 11:28:59.964779] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.268 [2024-10-07 11:28:59.964794] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.268 [2024-10-07 11:28:59.965505] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.268 [2024-10-07 11:28:59.972098] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.268 [2024-10-07 11:28:59.972364] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.268 [2024-10-07 11:28:59.972439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.268 [2024-10-07 11:28:59.972480] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.268 [2024-10-07 11:28:59.972604] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.268 [2024-10-07 11:28:59.972699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.268 [2024-10-07 11:28:59.972752] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.268 [2024-10-07 11:28:59.972786] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.268 [2024-10-07 11:28:59.973504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.268 [2024-10-07 11:28:59.973556] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.268 [2024-10-07 11:28:59.973800] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.268 [2024-10-07 11:28:59.973845] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.268 [2024-10-07 11:28:59.973866] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.268 [2024-10-07 11:28:59.974000] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.268 [2024-10-07 11:28:59.974048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.268 [2024-10-07 11:28:59.974067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.268 [2024-10-07 11:28:59.974081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.268 [2024-10-07 11:28:59.975423] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.268 [2024-10-07 11:28:59.982689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.268 [2024-10-07 11:28:59.982942] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.268 [2024-10-07 11:28:59.982981] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.268 [2024-10-07 11:28:59.983000] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.268 [2024-10-07 11:28:59.983037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.268 [2024-10-07 11:28:59.983069] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.268 [2024-10-07 11:28:59.983086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.268 [2024-10-07 11:28:59.983103] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.268 [2024-10-07 11:28:59.983134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.268 [2024-10-07 11:28:59.983619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.268 [2024-10-07 11:28:59.983720] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.268 [2024-10-07 11:28:59.983757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.268 [2024-10-07 11:28:59.983775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.268 [2024-10-07 11:28:59.984537] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.268 [2024-10-07 11:28:59.985193] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.268 [2024-10-07 11:28:59.985232] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.268 [2024-10-07 11:28:59.985280] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.268 [2024-10-07 11:28:59.985645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.268 [2024-10-07 11:28:59.994461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.268 [2024-10-07 11:28:59.994677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.268 [2024-10-07 11:28:59.994799] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.268 [2024-10-07 11:28:59.994842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.268 [2024-10-07 11:28:59.994863] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.268 [2024-10-07 11:28:59.994933] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.268 [2024-10-07 11:28:59.994961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.268 [2024-10-07 11:28:59.994977] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.268 [2024-10-07 11:28:59.994998] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.268 [2024-10-07 11:28:59.995031] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.268 [2024-10-07 11:28:59.995052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.268 [2024-10-07 11:28:59.995066] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.268 [2024-10-07 11:28:59.995081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.268 [2024-10-07 11:28:59.995111] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.268 [2024-10-07 11:28:59.995129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.268 [2024-10-07 11:28:59.995143] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.268 [2024-10-07 11:28:59.995157] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.268 [2024-10-07 11:28:59.995190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.268 [2024-10-07 11:29:00.006083] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.268 [2024-10-07 11:29:00.006185] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.268 [2024-10-07 11:29:00.007392] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.268 [2024-10-07 11:29:00.007468] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.268 [2024-10-07 11:29:00.007490] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.268 [2024-10-07 11:29:00.007549] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.268 [2024-10-07 11:29:00.007575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.268 [2024-10-07 11:29:00.007592] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.268 [2024-10-07 11:29:00.007818] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.268 [2024-10-07 11:29:00.007863] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.268 [2024-10-07 11:29:00.008833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.268 [2024-10-07 11:29:00.008873] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.268 [2024-10-07 11:29:00.008894] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.268 [2024-10-07 11:29:00.008917] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.268 [2024-10-07 11:29:00.008932] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.268 [2024-10-07 11:29:00.008945] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.268 [2024-10-07 11:29:00.009660] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.268 [2024-10-07 11:29:00.009700] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.268 [2024-10-07 11:29:00.016289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.268 [2024-10-07 11:29:00.016433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.268 [2024-10-07 11:29:00.016580] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.268 [2024-10-07 11:29:00.016621] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.268 [2024-10-07 11:29:00.016641] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.268 [2024-10-07 11:29:00.017338] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.268 [2024-10-07 11:29:00.017386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.268 [2024-10-07 11:29:00.017433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.268 [2024-10-07 11:29:00.017458] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.268 [2024-10-07 11:29:00.017639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.268 [2024-10-07 11:29:00.017668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.268 [2024-10-07 11:29:00.017684] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.268 [2024-10-07 11:29:00.017700] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.268 [2024-10-07 11:29:00.017816] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.269 [2024-10-07 11:29:00.017836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.269 [2024-10-07 11:29:00.017851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.269 [2024-10-07 11:29:00.017864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.269 [2024-10-07 11:29:00.017906] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.269 [2024-10-07 11:29:00.026891] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.269 [2024-10-07 11:29:00.026991] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.269 [2024-10-07 11:29:00.027129] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.269 [2024-10-07 11:29:00.027165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.269 [2024-10-07 11:29:00.027184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.269 [2024-10-07 11:29:00.027271] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.269 [2024-10-07 11:29:00.027297] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.269 [2024-10-07 11:29:00.027313] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.269 [2024-10-07 11:29:00.027348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.269 [2024-10-07 11:29:00.027372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.269 [2024-10-07 11:29:00.027414] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.269 [2024-10-07 11:29:00.027436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.269 [2024-10-07 11:29:00.027452] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.269 [2024-10-07 11:29:00.027469] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.269 [2024-10-07 11:29:00.027483] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.269 [2024-10-07 11:29:00.027496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.269 [2024-10-07 11:29:00.027527] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.269 [2024-10-07 11:29:00.027545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.269 [2024-10-07 11:29:00.038700] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.269 [2024-10-07 11:29:00.038797] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.269 [2024-10-07 11:29:00.038931] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.269 [2024-10-07 11:29:00.038967] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.269 [2024-10-07 11:29:00.038986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.269 [2024-10-07 11:29:00.039037] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.269 [2024-10-07 11:29:00.039061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.269 [2024-10-07 11:29:00.039076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.269 [2024-10-07 11:29:00.039112] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.269 [2024-10-07 11:29:00.039135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.269 [2024-10-07 11:29:00.039162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.269 [2024-10-07 11:29:00.039179] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.269 [2024-10-07 11:29:00.039195] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.269 [2024-10-07 11:29:00.039212] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.269 [2024-10-07 11:29:00.039227] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.269 [2024-10-07 11:29:00.039241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.269 [2024-10-07 11:29:00.039270] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.269 [2024-10-07 11:29:00.039310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.269 [2024-10-07 11:29:00.050174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.269 [2024-10-07 11:29:00.050268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.269 [2024-10-07 11:29:00.051520] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.269 [2024-10-07 11:29:00.051572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.269 [2024-10-07 11:29:00.051595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.269 [2024-10-07 11:29:00.051649] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.269 [2024-10-07 11:29:00.051674] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.269 [2024-10-07 11:29:00.051690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.269 [2024-10-07 11:29:00.051889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.269 [2024-10-07 11:29:00.051921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.269 [2024-10-07 11:29:00.053075] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.269 [2024-10-07 11:29:00.053123] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.269 [2024-10-07 11:29:00.053145] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.269 [2024-10-07 11:29:00.053166] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.269 [2024-10-07 11:29:00.053181] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.269 [2024-10-07 11:29:00.053195] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.269 [2024-10-07 11:29:00.053907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.269 [2024-10-07 11:29:00.053946] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.269 [2024-10-07 11:29:00.060368] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.269 [2024-10-07 11:29:00.060454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.269 [2024-10-07 11:29:00.060580] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.269 [2024-10-07 11:29:00.060615] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.269 [2024-10-07 11:29:00.060634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.269 [2024-10-07 11:29:00.060682] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.269 [2024-10-07 11:29:00.060706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.269 [2024-10-07 11:29:00.060721] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.269 [2024-10-07 11:29:00.060756] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.269 [2024-10-07 11:29:00.060780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.269 [2024-10-07 11:29:00.060807] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.269 [2024-10-07 11:29:00.060856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.269 [2024-10-07 11:29:00.060873] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.269 [2024-10-07 11:29:00.060890] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.269 [2024-10-07 11:29:00.060904] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.269 [2024-10-07 11:29:00.060917] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.269 [2024-10-07 11:29:00.061556] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.269 [2024-10-07 11:29:00.061585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.269 [2024-10-07 11:29:00.070544] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.269 [2024-10-07 11:29:00.070650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.269 [2024-10-07 11:29:00.070756] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.269 [2024-10-07 11:29:00.070788] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.269 [2024-10-07 11:29:00.070806] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.269 [2024-10-07 11:29:00.070872] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.269 [2024-10-07 11:29:00.070899] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.269 [2024-10-07 11:29:00.070915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.269 [2024-10-07 11:29:00.070935] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.269 [2024-10-07 11:29:00.070967] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.269 [2024-10-07 11:29:00.070987] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.269 [2024-10-07 11:29:00.071002] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.269 [2024-10-07 11:29:00.071016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.269 [2024-10-07 11:29:00.071046] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.269 [2024-10-07 11:29:00.071064] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.269 [2024-10-07 11:29:00.071077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.269 [2024-10-07 11:29:00.071090] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.269 [2024-10-07 11:29:00.071117] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.269 [2024-10-07 11:29:00.082047] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.269 [2024-10-07 11:29:00.082139] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.269 [2024-10-07 11:29:00.082269] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.270 [2024-10-07 11:29:00.082302] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.270 [2024-10-07 11:29:00.082320] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.270 [2024-10-07 11:29:00.082370] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.270 [2024-10-07 11:29:00.082438] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.270 [2024-10-07 11:29:00.082459] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.270 [2024-10-07 11:29:00.082496] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.270 [2024-10-07 11:29:00.082521] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.270 [2024-10-07 11:29:00.082547] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.270 [2024-10-07 11:29:00.082564] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.270 [2024-10-07 11:29:00.082580] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.270 [2024-10-07 11:29:00.082597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.270 [2024-10-07 11:29:00.082611] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.270 [2024-10-07 11:29:00.082624] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.270 [2024-10-07 11:29:00.082653] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.270 [2024-10-07 11:29:00.082671] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.270 [2024-10-07 11:29:00.093360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.270 [2024-10-07 11:29:00.093463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.270 [2024-10-07 11:29:00.093777] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.270 [2024-10-07 11:29:00.093813] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.270 [2024-10-07 11:29:00.093832] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.270 [2024-10-07 11:29:00.093881] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.270 [2024-10-07 11:29:00.093904] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.270 [2024-10-07 11:29:00.093920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.270 [2024-10-07 11:29:00.094869] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.270 [2024-10-07 11:29:00.094915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.270 [2024-10-07 11:29:00.095131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.270 [2024-10-07 11:29:00.095158] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.270 [2024-10-07 11:29:00.095175] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.270 [2024-10-07 11:29:00.095195] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.270 [2024-10-07 11:29:00.095209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.270 [2024-10-07 11:29:00.095223] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.270 [2024-10-07 11:29:00.096159] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.270 [2024-10-07 11:29:00.096195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.270 8412.12 IOPS, 32.86 MiB/s [2024-10-07T11:29:07.981Z] [2024-10-07 11:29:00.103565] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.270 [2024-10-07 11:29:00.103663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.270 [2024-10-07 11:29:00.103773] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.270 [2024-10-07 11:29:00.103806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.270 [2024-10-07 11:29:00.103824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.270 [2024-10-07 11:29:00.103889] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.270 [2024-10-07 11:29:00.103915] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.270 [2024-10-07 11:29:00.103931] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.270 [2024-10-07 11:29:00.103951] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.270 [2024-10-07 11:29:00.103983] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.270 [2024-10-07 11:29:00.104003] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.270 [2024-10-07 11:29:00.104017] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.270 [2024-10-07 11:29:00.104033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.270 [2024-10-07 11:29:00.104064] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.270 [2024-10-07 11:29:00.104081] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.270 [2024-10-07 11:29:00.104094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.270 [2024-10-07 11:29:00.104107] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.270 [2024-10-07 11:29:00.104722] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.270 [2024-10-07 11:29:00.113735] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.270 [2024-10-07 11:29:00.113853] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.270 [2024-10-07 11:29:00.113966] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.270 [2024-10-07 11:29:00.113998] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.270 [2024-10-07 11:29:00.114017] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.270 [2024-10-07 11:29:00.114082] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.270 [2024-10-07 11:29:00.114109] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.270 [2024-10-07 11:29:00.114125] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.270 [2024-10-07 11:29:00.114145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.270 [2024-10-07 11:29:00.114177] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.270 [2024-10-07 11:29:00.114197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.270 [2024-10-07 11:29:00.114211] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.270 [2024-10-07 11:29:00.114259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.270 [2024-10-07 11:29:00.114293] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.270 [2024-10-07 11:29:00.114311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.270 [2024-10-07 11:29:00.114324] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.270 [2024-10-07 11:29:00.114338] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.270 [2024-10-07 11:29:00.114364] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.270 [2024-10-07 11:29:00.125565] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.270 [2024-10-07 11:29:00.125660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.270 [2024-10-07 11:29:00.125794] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.270 [2024-10-07 11:29:00.125829] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.270 [2024-10-07 11:29:00.125847] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.270 [2024-10-07 11:29:00.125898] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.270 [2024-10-07 11:29:00.125921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.270 [2024-10-07 11:29:00.125936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.270 [2024-10-07 11:29:00.125971] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.270 [2024-10-07 11:29:00.125995] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.270 [2024-10-07 11:29:00.126021] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.270 [2024-10-07 11:29:00.126039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.270 [2024-10-07 11:29:00.126054] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.270 [2024-10-07 11:29:00.126071] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.270 [2024-10-07 11:29:00.126085] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.270 [2024-10-07 11:29:00.126098] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.270 [2024-10-07 11:29:00.126127] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.270 [2024-10-07 11:29:00.126144] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.270 [2024-10-07 11:29:00.137007] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.270 [2024-10-07 11:29:00.137121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.270 [2024-10-07 11:29:00.137250] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.270 [2024-10-07 11:29:00.137285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.270 [2024-10-07 11:29:00.137303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.270 [2024-10-07 11:29:00.137352] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.270 [2024-10-07 11:29:00.137375] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.270 [2024-10-07 11:29:00.137442] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.270 [2024-10-07 11:29:00.138383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.270 [2024-10-07 11:29:00.138442] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.271 [2024-10-07 11:29:00.138633] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.271 [2024-10-07 11:29:00.138668] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.271 [2024-10-07 11:29:00.138694] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.271 [2024-10-07 11:29:00.138712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.271 [2024-10-07 11:29:00.138727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.271 [2024-10-07 11:29:00.138740] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.271 [2024-10-07 11:29:00.139674] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.271 [2024-10-07 11:29:00.139713] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.271 [2024-10-07 11:29:00.147838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.271 [2024-10-07 11:29:00.147931] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.271 [2024-10-07 11:29:00.148060] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.271 [2024-10-07 11:29:00.148094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.271 [2024-10-07 11:29:00.148112] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.271 [2024-10-07 11:29:00.148162] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.271 [2024-10-07 11:29:00.148185] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.271 [2024-10-07 11:29:00.148201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.271 [2024-10-07 11:29:00.148235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.271 [2024-10-07 11:29:00.148258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.271 [2024-10-07 11:29:00.148285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.271 [2024-10-07 11:29:00.148302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.271 [2024-10-07 11:29:00.148317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.271 [2024-10-07 11:29:00.148334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.271 [2024-10-07 11:29:00.148348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.271 [2024-10-07 11:29:00.148372] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.271 [2024-10-07 11:29:00.148416] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.271 [2024-10-07 11:29:00.148437] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.271 [2024-10-07 11:29:00.159454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.271 [2024-10-07 11:29:00.159563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.271 [2024-10-07 11:29:00.159697] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.271 [2024-10-07 11:29:00.159731] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.271 [2024-10-07 11:29:00.159750] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.271 [2024-10-07 11:29:00.159799] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.271 [2024-10-07 11:29:00.159822] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.271 [2024-10-07 11:29:00.159838] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.271 [2024-10-07 11:29:00.160109] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.271 [2024-10-07 11:29:00.160152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.271 [2024-10-07 11:29:00.160225] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.271 [2024-10-07 11:29:00.160251] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.271 [2024-10-07 11:29:00.160267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.271 [2024-10-07 11:29:00.160285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.271 [2024-10-07 11:29:00.160299] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.271 [2024-10-07 11:29:00.160313] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.271 [2024-10-07 11:29:00.160343] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.271 [2024-10-07 11:29:00.160361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.271 [2024-10-07 11:29:00.170258] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.271 [2024-10-07 11:29:00.170337] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.271 [2024-10-07 11:29:00.170479] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.271 [2024-10-07 11:29:00.170514] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.271 [2024-10-07 11:29:00.170532] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.271 [2024-10-07 11:29:00.170582] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.271 [2024-10-07 11:29:00.170605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.271 [2024-10-07 11:29:00.170621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.271 [2024-10-07 11:29:00.171596] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.271 [2024-10-07 11:29:00.171642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.271 [2024-10-07 11:29:00.171837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.271 [2024-10-07 11:29:00.171862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.271 [2024-10-07 11:29:00.171878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.271 [2024-10-07 11:29:00.171919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.271 [2024-10-07 11:29:00.171936] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.271 [2024-10-07 11:29:00.171949] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.271 [2024-10-07 11:29:00.171989] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.271 [2024-10-07 11:29:00.172009] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.271 [2024-10-07 11:29:00.180457] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.271 [2024-10-07 11:29:00.180548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.271 [2024-10-07 11:29:00.180686] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.271 [2024-10-07 11:29:00.180721] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.271 [2024-10-07 11:29:00.180740] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.271 [2024-10-07 11:29:00.180790] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.271 [2024-10-07 11:29:00.180813] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.271 [2024-10-07 11:29:00.180828] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.271 [2024-10-07 11:29:00.181629] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.271 [2024-10-07 11:29:00.181677] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.271 [2024-10-07 11:29:00.182272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.271 [2024-10-07 11:29:00.182313] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.271 [2024-10-07 11:29:00.182333] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.271 [2024-10-07 11:29:00.182353] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.271 [2024-10-07 11:29:00.182367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.271 [2024-10-07 11:29:00.182381] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.271 [2024-10-07 11:29:00.182483] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.271 [2024-10-07 11:29:00.182508] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.271 [2024-10-07 11:29:00.190722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.271 [2024-10-07 11:29:00.190811] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.271 [2024-10-07 11:29:00.190941] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.271 [2024-10-07 11:29:00.190974] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.271 [2024-10-07 11:29:00.190992] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.271 [2024-10-07 11:29:00.191041] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.271 [2024-10-07 11:29:00.191064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.271 [2024-10-07 11:29:00.191123] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.271 [2024-10-07 11:29:00.191179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.271 [2024-10-07 11:29:00.191205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.271 [2024-10-07 11:29:00.191233] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.271 [2024-10-07 11:29:00.191249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.271 [2024-10-07 11:29:00.191264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.271 [2024-10-07 11:29:00.191282] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.271 [2024-10-07 11:29:00.191296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.271 [2024-10-07 11:29:00.191309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.271 [2024-10-07 11:29:00.192272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.272 [2024-10-07 11:29:00.192314] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.272 [2024-10-07 11:29:00.201218] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.272 [2024-10-07 11:29:00.201313] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.272 [2024-10-07 11:29:00.201464] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.272 [2024-10-07 11:29:00.201501] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.272 [2024-10-07 11:29:00.201520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.272 [2024-10-07 11:29:00.201573] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.272 [2024-10-07 11:29:00.201597] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.272 [2024-10-07 11:29:00.201613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.272 [2024-10-07 11:29:00.201934] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.272 [2024-10-07 11:29:00.201974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.272 [2024-10-07 11:29:00.202053] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.272 [2024-10-07 11:29:00.202079] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.272 [2024-10-07 11:29:00.202096] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.272 [2024-10-07 11:29:00.202114] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.272 [2024-10-07 11:29:00.202129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.272 [2024-10-07 11:29:00.202142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.272 [2024-10-07 11:29:00.202174] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.272 [2024-10-07 11:29:00.202192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.272 [2024-10-07 11:29:00.211423] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.272 [2024-10-07 11:29:00.212451] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.272 [2024-10-07 11:29:00.212620] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.272 [2024-10-07 11:29:00.212656] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.272 [2024-10-07 11:29:00.212675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.272 [2024-10-07 11:29:00.213454] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.272 [2024-10-07 11:29:00.213499] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.272 [2024-10-07 11:29:00.213519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.272 [2024-10-07 11:29:00.213541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.272 [2024-10-07 11:29:00.213642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.272 [2024-10-07 11:29:00.213670] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.272 [2024-10-07 11:29:00.213685] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.272 [2024-10-07 11:29:00.213700] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.272 [2024-10-07 11:29:00.213733] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.272 [2024-10-07 11:29:00.213752] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.272 [2024-10-07 11:29:00.213765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.272 [2024-10-07 11:29:00.213779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.272 [2024-10-07 11:29:00.213806] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.272 [2024-10-07 11:29:00.222183] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.272 [2024-10-07 11:29:00.222369] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.272 [2024-10-07 11:29:00.222418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.272 [2024-10-07 11:29:00.222440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.272 [2024-10-07 11:29:00.222475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.272 [2024-10-07 11:29:00.222507] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.272 [2024-10-07 11:29:00.222524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.272 [2024-10-07 11:29:00.222539] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.272 [2024-10-07 11:29:00.222569] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.272 [2024-10-07 11:29:00.222623] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.272 [2024-10-07 11:29:00.222709] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.272 [2024-10-07 11:29:00.222738] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.272 [2024-10-07 11:29:00.222754] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.272 [2024-10-07 11:29:00.222785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.272 [2024-10-07 11:29:00.222856] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.272 [2024-10-07 11:29:00.222875] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.272 [2024-10-07 11:29:00.222889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.272 [2024-10-07 11:29:00.222918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.272 [2024-10-07 11:29:00.232346] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.272 [2024-10-07 11:29:00.232567] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.272 [2024-10-07 11:29:00.232606] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.272 [2024-10-07 11:29:00.232625] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.272 [2024-10-07 11:29:00.232661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.272 [2024-10-07 11:29:00.232732] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.272 [2024-10-07 11:29:00.232756] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.272 [2024-10-07 11:29:00.232772] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.272 [2024-10-07 11:29:00.232804] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.272 [2024-10-07 11:29:00.232826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.272 [2024-10-07 11:29:00.232901] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.272 [2024-10-07 11:29:00.232929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.272 [2024-10-07 11:29:00.232945] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.272 [2024-10-07 11:29:00.232976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.272 [2024-10-07 11:29:00.233005] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.272 [2024-10-07 11:29:00.233022] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.272 [2024-10-07 11:29:00.233036] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.272 [2024-10-07 11:29:00.233080] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.272 [2024-10-07 11:29:00.243470] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.272 [2024-10-07 11:29:00.243571] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.272 [2024-10-07 11:29:00.243720] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.272 [2024-10-07 11:29:00.243756] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.272 [2024-10-07 11:29:00.243774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.272 [2024-10-07 11:29:00.243831] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.272 [2024-10-07 11:29:00.243855] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.272 [2024-10-07 11:29:00.243873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.272 [2024-10-07 11:29:00.243960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.272 [2024-10-07 11:29:00.243986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.272 [2024-10-07 11:29:00.244013] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.272 [2024-10-07 11:29:00.244030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.273 [2024-10-07 11:29:00.244045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.273 [2024-10-07 11:29:00.244063] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.273 [2024-10-07 11:29:00.244077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.273 [2024-10-07 11:29:00.244091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.273 [2024-10-07 11:29:00.245425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.273 [2024-10-07 11:29:00.245474] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.273 [2024-10-07 11:29:00.253937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.273 [2024-10-07 11:29:00.254043] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.273 [2024-10-07 11:29:00.254187] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.273 [2024-10-07 11:29:00.254223] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.273 [2024-10-07 11:29:00.254242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.273 [2024-10-07 11:29:00.254294] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.273 [2024-10-07 11:29:00.254318] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.273 [2024-10-07 11:29:00.254334] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.273 [2024-10-07 11:29:00.254630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.273 [2024-10-07 11:29:00.254664] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.273 [2024-10-07 11:29:00.254734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.273 [2024-10-07 11:29:00.254759] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.273 [2024-10-07 11:29:00.254775] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.273 [2024-10-07 11:29:00.254792] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.273 [2024-10-07 11:29:00.254807] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.273 [2024-10-07 11:29:00.254820] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.273 [2024-10-07 11:29:00.254851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.273 [2024-10-07 11:29:00.254868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.273 [2024-10-07 11:29:00.264250] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.273 [2024-10-07 11:29:00.264344] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.273 [2024-10-07 11:29:00.264493] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.273 [2024-10-07 11:29:00.264562] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.273 [2024-10-07 11:29:00.264583] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.273 [2024-10-07 11:29:00.264636] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.273 [2024-10-07 11:29:00.264661] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.273 [2024-10-07 11:29:00.264676] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.273 [2024-10-07 11:29:00.265645] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.273 [2024-10-07 11:29:00.265692] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.273 [2024-10-07 11:29:00.265887] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.273 [2024-10-07 11:29:00.265914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.273 [2024-10-07 11:29:00.265930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.273 [2024-10-07 11:29:00.265949] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.273 [2024-10-07 11:29:00.265963] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.273 [2024-10-07 11:29:00.265977] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.273 [2024-10-07 11:29:00.266016] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.273 [2024-10-07 11:29:00.266035] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.273 [2024-10-07 11:29:00.274455] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.273 [2024-10-07 11:29:00.275284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.273 [2024-10-07 11:29:00.275433] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.273 [2024-10-07 11:29:00.275467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.273 [2024-10-07 11:29:00.275485] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.273 [2024-10-07 11:29:00.276122] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.273 [2024-10-07 11:29:00.276165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.273 [2024-10-07 11:29:00.276186] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.273 [2024-10-07 11:29:00.276208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.273 [2024-10-07 11:29:00.276296] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.273 [2024-10-07 11:29:00.276323] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.273 [2024-10-07 11:29:00.276338] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.273 [2024-10-07 11:29:00.276353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.273 [2024-10-07 11:29:00.276638] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.273 [2024-10-07 11:29:00.276666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.273 [2024-10-07 11:29:00.276706] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.273 [2024-10-07 11:29:00.276722] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.273 [2024-10-07 11:29:00.276808] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.273 [2024-10-07 11:29:00.284615] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.273 [2024-10-07 11:29:00.284811] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.273 [2024-10-07 11:29:00.284846] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.273 [2024-10-07 11:29:00.284865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.273 [2024-10-07 11:29:00.284901] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.273 [2024-10-07 11:29:00.285870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.273 [2024-10-07 11:29:00.285912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.273 [2024-10-07 11:29:00.285933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.273 [2024-10-07 11:29:00.286143] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.273 [2024-10-07 11:29:00.286203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.273 [2024-10-07 11:29:00.287209] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.273 [2024-10-07 11:29:00.287253] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.273 [2024-10-07 11:29:00.287274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.273 [2024-10-07 11:29:00.287433] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.273 [2024-10-07 11:29:00.288036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.273 [2024-10-07 11:29:00.288073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.273 [2024-10-07 11:29:00.288091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.273 [2024-10-07 11:29:00.288192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.273 [2024-10-07 11:29:00.294772] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.273 [2024-10-07 11:29:00.294970] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.273 [2024-10-07 11:29:00.295007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.273 [2024-10-07 11:29:00.295026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.273 [2024-10-07 11:29:00.295063] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.273 [2024-10-07 11:29:00.295095] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.273 [2024-10-07 11:29:00.295113] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.273 [2024-10-07 11:29:00.295128] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.273 [2024-10-07 11:29:00.295159] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.273 [2024-10-07 11:29:00.296271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.273 [2024-10-07 11:29:00.296377] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.273 [2024-10-07 11:29:00.296423] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.273 [2024-10-07 11:29:00.296443] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.273 [2024-10-07 11:29:00.297227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.273 [2024-10-07 11:29:00.297365] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.273 [2024-10-07 11:29:00.297392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.273 [2024-10-07 11:29:00.297426] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.273 [2024-10-07 11:29:00.297461] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.273 [2024-10-07 11:29:00.306173] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.273 [2024-10-07 11:29:00.307305] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.274 [2024-10-07 11:29:00.307360] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.274 [2024-10-07 11:29:00.307383] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.274 [2024-10-07 11:29:00.307639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.274 [2024-10-07 11:29:00.308608] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.274 [2024-10-07 11:29:00.308662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.274 [2024-10-07 11:29:00.308682] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.274 [2024-10-07 11:29:00.308699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.274 [2024-10-07 11:29:00.309825] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.274 [2024-10-07 11:29:00.309920] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.274 [2024-10-07 11:29:00.309950] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.274 [2024-10-07 11:29:00.309967] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.274 [2024-10-07 11:29:00.310672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.274 [2024-10-07 11:29:00.310794] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.274 [2024-10-07 11:29:00.310821] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.274 [2024-10-07 11:29:00.310837] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.274 [2024-10-07 11:29:00.310870] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.274 [2024-10-07 11:29:00.316968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.274 [2024-10-07 11:29:00.317194] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.274 [2024-10-07 11:29:00.317231] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.274 [2024-10-07 11:29:00.317283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.274 [2024-10-07 11:29:00.317324] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.274 [2024-10-07 11:29:00.317358] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.274 [2024-10-07 11:29:00.317375] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.274 [2024-10-07 11:29:00.317391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.274 [2024-10-07 11:29:00.317440] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.274 [2024-10-07 11:29:00.318887] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.274 [2024-10-07 11:29:00.319008] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.274 [2024-10-07 11:29:00.319041] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.274 [2024-10-07 11:29:00.319059] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.274 [2024-10-07 11:29:00.319090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.274 [2024-10-07 11:29:00.319120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.274 [2024-10-07 11:29:00.319138] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.274 [2024-10-07 11:29:00.319152] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.274 [2024-10-07 11:29:00.319182] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.274 [2024-10-07 11:29:00.327744] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.274 [2024-10-07 11:29:00.327927] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.274 [2024-10-07 11:29:00.327963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.274 [2024-10-07 11:29:00.327982] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.274 [2024-10-07 11:29:00.328018] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.274 [2024-10-07 11:29:00.328050] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.274 [2024-10-07 11:29:00.328067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.274 [2024-10-07 11:29:00.328083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.274 [2024-10-07 11:29:00.328113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.274 [2024-10-07 11:29:00.330176] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.274 [2024-10-07 11:29:00.330577] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.274 [2024-10-07 11:29:00.330629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.274 [2024-10-07 11:29:00.330662] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.274 [2024-10-07 11:29:00.330769] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.274 [2024-10-07 11:29:00.330825] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.274 [2024-10-07 11:29:00.330858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.274 [2024-10-07 11:29:00.330920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.274 [2024-10-07 11:29:00.330973] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.274 [2024-10-07 11:29:00.339651] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.274 [2024-10-07 11:29:00.339986] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.274 [2024-10-07 11:29:00.340044] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.274 [2024-10-07 11:29:00.340080] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.274 [2024-10-07 11:29:00.340139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.274 [2024-10-07 11:29:00.340193] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.274 [2024-10-07 11:29:00.340224] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.274 [2024-10-07 11:29:00.340251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.274 [2024-10-07 11:29:00.340303] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.274 [2024-10-07 11:29:00.340384] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.274 [2024-10-07 11:29:00.340536] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.274 [2024-10-07 11:29:00.340580] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.274 [2024-10-07 11:29:00.340609] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.274 [2024-10-07 11:29:00.341592] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.274 [2024-10-07 11:29:00.342501] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.274 [2024-10-07 11:29:00.342545] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.274 [2024-10-07 11:29:00.342576] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.274 [2024-10-07 11:29:00.342752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.274 [2024-10-07 11:29:00.351568] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.274 [2024-10-07 11:29:00.352770] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.274 [2024-10-07 11:29:00.352907] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.274 [2024-10-07 11:29:00.352951] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.274 [2024-10-07 11:29:00.352973] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.274 [2024-10-07 11:29:00.353227] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.274 [2024-10-07 11:29:00.353276] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.274 [2024-10-07 11:29:00.353297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.274 [2024-10-07 11:29:00.353319] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.274 [2024-10-07 11:29:00.354306] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.274 [2024-10-07 11:29:00.354384] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.274 [2024-10-07 11:29:00.354426] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.274 [2024-10-07 11:29:00.354460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.274 [2024-10-07 11:29:00.355162] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.274 [2024-10-07 11:29:00.355204] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.274 [2024-10-07 11:29:00.355244] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.274 [2024-10-07 11:29:00.355266] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.274 [2024-10-07 11:29:00.356280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.274 [2024-10-07 11:29:00.361727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.274 [2024-10-07 11:29:00.361942] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.274 [2024-10-07 11:29:00.361979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.274 [2024-10-07 11:29:00.361998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.274 [2024-10-07 11:29:00.362036] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.274 [2024-10-07 11:29:00.362679] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.274 [2024-10-07 11:29:00.362720] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.274 [2024-10-07 11:29:00.362740] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.274 [2024-10-07 11:29:00.362922] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.275 [2024-10-07 11:29:00.363088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.275 [2024-10-07 11:29:00.363194] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.275 [2024-10-07 11:29:00.363242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.275 [2024-10-07 11:29:00.363265] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.275 [2024-10-07 11:29:00.363301] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.275 [2024-10-07 11:29:00.363332] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.275 [2024-10-07 11:29:00.363350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.275 [2024-10-07 11:29:00.363364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.275 [2024-10-07 11:29:00.363394] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.275 [2024-10-07 11:29:00.371883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.275 [2024-10-07 11:29:00.372078] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.275 [2024-10-07 11:29:00.372115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.275 [2024-10-07 11:29:00.372135] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.275 [2024-10-07 11:29:00.372202] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.275 [2024-10-07 11:29:00.372236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.275 [2024-10-07 11:29:00.372253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.275 [2024-10-07 11:29:00.372269] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.275 [2024-10-07 11:29:00.372300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.275 [2024-10-07 11:29:00.374223] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.275 [2024-10-07 11:29:00.374615] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.275 [2024-10-07 11:29:00.374661] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.275 [2024-10-07 11:29:00.374682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.275 [2024-10-07 11:29:00.374756] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.275 [2024-10-07 11:29:00.374795] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.275 [2024-10-07 11:29:00.374813] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.275 [2024-10-07 11:29:00.374827] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.275 [2024-10-07 11:29:00.374859] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.275 [2024-10-07 11:29:00.383611] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.275 [2024-10-07 11:29:00.383883] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.275 [2024-10-07 11:29:00.383933] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.275 [2024-10-07 11:29:00.383955] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.275 [2024-10-07 11:29:00.383993] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.275 [2024-10-07 11:29:00.384025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.275 [2024-10-07 11:29:00.384043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.275 [2024-10-07 11:29:00.384059] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.275 [2024-10-07 11:29:00.384091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.275 [2024-10-07 11:29:00.384319] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.275 [2024-10-07 11:29:00.384428] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.275 [2024-10-07 11:29:00.384459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.275 [2024-10-07 11:29:00.384476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.275 [2024-10-07 11:29:00.384508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.275 [2024-10-07 11:29:00.384560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.275 [2024-10-07 11:29:00.384581] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.275 [2024-10-07 11:29:00.384627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.275 [2024-10-07 11:29:00.385572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.275 [2024-10-07 11:29:00.395333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.275 [2024-10-07 11:29:00.395675] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.275 [2024-10-07 11:29:00.395805] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.275 [2024-10-07 11:29:00.395846] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.275 [2024-10-07 11:29:00.395867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.275 [2024-10-07 11:29:00.396907] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.275 [2024-10-07 11:29:00.396953] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.275 [2024-10-07 11:29:00.396973] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.275 [2024-10-07 11:29:00.396996] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.275 [2024-10-07 11:29:00.397226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.275 [2024-10-07 11:29:00.397284] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.275 [2024-10-07 11:29:00.397303] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.275 [2024-10-07 11:29:00.397318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.275 [2024-10-07 11:29:00.398314] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.275 [2024-10-07 11:29:00.398352] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.275 [2024-10-07 11:29:00.398370] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.275 [2024-10-07 11:29:00.398384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.275 [2024-10-07 11:29:00.399120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.275 [2024-10-07 11:29:00.405529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.275 [2024-10-07 11:29:00.405721] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.275 [2024-10-07 11:29:00.405758] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.275 [2024-10-07 11:29:00.405777] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.275 [2024-10-07 11:29:00.405814] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.275 [2024-10-07 11:29:00.405864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.275 [2024-10-07 11:29:00.405885] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.275 [2024-10-07 11:29:00.405902] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.275 [2024-10-07 11:29:00.405934] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.275 [2024-10-07 11:29:00.405956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.275 [2024-10-07 11:29:00.406029] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.275 [2024-10-07 11:29:00.406089] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.275 [2024-10-07 11:29:00.406109] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.275 [2024-10-07 11:29:00.406141] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.275 [2024-10-07 11:29:00.406172] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.275 [2024-10-07 11:29:00.406189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.275 [2024-10-07 11:29:00.406209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.275 [2024-10-07 11:29:00.406254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.275 [2024-10-07 11:29:00.416154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.275 [2024-10-07 11:29:00.416287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.275 [2024-10-07 11:29:00.416417] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.275 [2024-10-07 11:29:00.416451] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.275 [2024-10-07 11:29:00.416470] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.275 [2024-10-07 11:29:00.416545] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.275 [2024-10-07 11:29:00.416572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.275 [2024-10-07 11:29:00.416588] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.275 [2024-10-07 11:29:00.416609] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.275 [2024-10-07 11:29:00.416641] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.275 [2024-10-07 11:29:00.416662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.275 [2024-10-07 11:29:00.416676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.275 [2024-10-07 11:29:00.416692] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.275 [2024-10-07 11:29:00.416723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.275 [2024-10-07 11:29:00.416741] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.275 [2024-10-07 11:29:00.416754] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.276 [2024-10-07 11:29:00.416768] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.276 [2024-10-07 11:29:00.416795] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.276 [2024-10-07 11:29:00.427969] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.276 [2024-10-07 11:29:00.428191] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.276 [2024-10-07 11:29:00.428320] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.276 [2024-10-07 11:29:00.428367] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.276 [2024-10-07 11:29:00.428388] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.276 [2024-10-07 11:29:00.428511] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.276 [2024-10-07 11:29:00.428540] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.276 [2024-10-07 11:29:00.428557] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.276 [2024-10-07 11:29:00.428578] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.276 [2024-10-07 11:29:00.428612] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.276 [2024-10-07 11:29:00.428633] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.276 [2024-10-07 11:29:00.428647] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.276 [2024-10-07 11:29:00.428662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.276 [2024-10-07 11:29:00.428693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.276 [2024-10-07 11:29:00.428712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.276 [2024-10-07 11:29:00.428726] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.276 [2024-10-07 11:29:00.428739] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.276 [2024-10-07 11:29:00.428766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.276 [2024-10-07 11:29:00.439612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.276 [2024-10-07 11:29:00.439705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.276 [2024-10-07 11:29:00.440003] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.276 [2024-10-07 11:29:00.440052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.276 [2024-10-07 11:29:00.440074] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.276 [2024-10-07 11:29:00.440127] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.276 [2024-10-07 11:29:00.440152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.276 [2024-10-07 11:29:00.440168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.276 [2024-10-07 11:29:00.441123] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.276 [2024-10-07 11:29:00.441169] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.276 [2024-10-07 11:29:00.441384] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.276 [2024-10-07 11:29:00.441434] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.276 [2024-10-07 11:29:00.441454] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.276 [2024-10-07 11:29:00.441474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.276 [2024-10-07 11:29:00.441489] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.276 [2024-10-07 11:29:00.441502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.276 [2024-10-07 11:29:00.442458] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.276 [2024-10-07 11:29:00.442520] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.276 [2024-10-07 11:29:00.449802] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.276 [2024-10-07 11:29:00.449908] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.276 [2024-10-07 11:29:00.450018] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.276 [2024-10-07 11:29:00.450049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.276 [2024-10-07 11:29:00.450068] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.276 [2024-10-07 11:29:00.450133] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.276 [2024-10-07 11:29:00.450160] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.276 [2024-10-07 11:29:00.450177] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.276 [2024-10-07 11:29:00.450197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.276 [2024-10-07 11:29:00.450229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.276 [2024-10-07 11:29:00.450249] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.276 [2024-10-07 11:29:00.450263] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.276 [2024-10-07 11:29:00.450279] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.276 [2024-10-07 11:29:00.450309] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.276 [2024-10-07 11:29:00.450326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.276 [2024-10-07 11:29:00.450339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.276 [2024-10-07 11:29:00.450353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.276 [2024-10-07 11:29:00.450379] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.276 [2024-10-07 11:29:00.460227] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.276 [2024-10-07 11:29:00.460323] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.276 [2024-10-07 11:29:00.460467] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.276 [2024-10-07 11:29:00.460502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.276 [2024-10-07 11:29:00.460522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.276 [2024-10-07 11:29:00.460572] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.276 [2024-10-07 11:29:00.460596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.276 [2024-10-07 11:29:00.460612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.276 [2024-10-07 11:29:00.460647] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.276 [2024-10-07 11:29:00.460671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.276 [2024-10-07 11:29:00.460697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.276 [2024-10-07 11:29:00.460743] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.276 [2024-10-07 11:29:00.460760] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.276 [2024-10-07 11:29:00.460778] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.276 [2024-10-07 11:29:00.460792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.276 [2024-10-07 11:29:00.460805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.276 [2024-10-07 11:29:00.460835] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.276 [2024-10-07 11:29:00.460852] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.276 [2024-10-07 11:29:00.471883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.276 [2024-10-07 11:29:00.471970] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.276 [2024-10-07 11:29:00.472757] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.276 [2024-10-07 11:29:00.472805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.276 [2024-10-07 11:29:00.472827] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.276 [2024-10-07 11:29:00.472881] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.276 [2024-10-07 11:29:00.472905] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.276 [2024-10-07 11:29:00.472921] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.276 [2024-10-07 11:29:00.473020] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.276 [2024-10-07 11:29:00.473050] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.276 [2024-10-07 11:29:00.473095] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.276 [2024-10-07 11:29:00.473115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.276 [2024-10-07 11:29:00.473131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.277 [2024-10-07 11:29:00.473149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.277 [2024-10-07 11:29:00.473163] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.277 [2024-10-07 11:29:00.473176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.277 [2024-10-07 11:29:00.473207] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.277 [2024-10-07 11:29:00.473226] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.277 [2024-10-07 11:29:00.484100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.277 [2024-10-07 11:29:00.484186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.277 [2024-10-07 11:29:00.484521] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.277 [2024-10-07 11:29:00.484558] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.277 [2024-10-07 11:29:00.484577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.277 [2024-10-07 11:29:00.484627] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.277 [2024-10-07 11:29:00.484674] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.277 [2024-10-07 11:29:00.484692] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.277 [2024-10-07 11:29:00.485663] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.277 [2024-10-07 11:29:00.485715] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.277 [2024-10-07 11:29:00.485923] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.277 [2024-10-07 11:29:00.485950] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.277 [2024-10-07 11:29:00.485966] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.277 [2024-10-07 11:29:00.485984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.277 [2024-10-07 11:29:00.485999] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.277 [2024-10-07 11:29:00.486012] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.277 [2024-10-07 11:29:00.486952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.277 [2024-10-07 11:29:00.486991] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.277 [2024-10-07 11:29:00.494277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.277 [2024-10-07 11:29:00.494388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.277 [2024-10-07 11:29:00.494520] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.277 [2024-10-07 11:29:00.494553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.277 [2024-10-07 11:29:00.494570] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.277 [2024-10-07 11:29:00.494637] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.277 [2024-10-07 11:29:00.494664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.277 [2024-10-07 11:29:00.494679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.277 [2024-10-07 11:29:00.494700] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.277 [2024-10-07 11:29:00.494732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.277 [2024-10-07 11:29:00.494752] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.277 [2024-10-07 11:29:00.494766] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.277 [2024-10-07 11:29:00.494781] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.277 [2024-10-07 11:29:00.494812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.277 [2024-10-07 11:29:00.494829] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.277 [2024-10-07 11:29:00.494843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.277 [2024-10-07 11:29:00.494856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.277 [2024-10-07 11:29:00.495473] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.277 [2024-10-07 11:29:00.504441] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.277 [2024-10-07 11:29:00.504863] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.277 [2024-10-07 11:29:00.504911] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.277 [2024-10-07 11:29:00.504933] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.277 [2024-10-07 11:29:00.505026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.277 [2024-10-07 11:29:00.505111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.277 [2024-10-07 11:29:00.505155] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.277 [2024-10-07 11:29:00.505174] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.277 [2024-10-07 11:29:00.505189] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.277 [2024-10-07 11:29:00.505227] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.277 [2024-10-07 11:29:00.505302] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.277 [2024-10-07 11:29:00.505329] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.277 [2024-10-07 11:29:00.505346] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.277 [2024-10-07 11:29:00.505379] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.277 [2024-10-07 11:29:00.505427] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.277 [2024-10-07 11:29:00.505448] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.277 [2024-10-07 11:29:00.505462] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.277 [2024-10-07 11:29:00.505491] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.277 [2024-10-07 11:29:00.516665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.277 [2024-10-07 11:29:00.516761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.277 [2024-10-07 11:29:00.517611] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.277 [2024-10-07 11:29:00.517663] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.277 [2024-10-07 11:29:00.517687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.277 [2024-10-07 11:29:00.517742] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.277 [2024-10-07 11:29:00.517767] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.277 [2024-10-07 11:29:00.517783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.277 [2024-10-07 11:29:00.518754] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.277 [2024-10-07 11:29:00.518803] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.277 [2024-10-07 11:29:00.519697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.277 [2024-10-07 11:29:00.519758] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.277 [2024-10-07 11:29:00.519804] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.277 [2024-10-07 11:29:00.519828] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.277 [2024-10-07 11:29:00.519843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.277 [2024-10-07 11:29:00.519856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.277 [2024-10-07 11:29:00.519970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.277 [2024-10-07 11:29:00.519996] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.277 [2024-10-07 11:29:00.528137] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.277 [2024-10-07 11:29:00.528236] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.277 [2024-10-07 11:29:00.528593] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.277 [2024-10-07 11:29:00.528647] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.277 [2024-10-07 11:29:00.528668] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.277 [2024-10-07 11:29:00.528723] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.277 [2024-10-07 11:29:00.528747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.277 [2024-10-07 11:29:00.528763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.277 [2024-10-07 11:29:00.529743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.277 [2024-10-07 11:29:00.529790] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.277 [2024-10-07 11:29:00.529986] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.277 [2024-10-07 11:29:00.530028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.277 [2024-10-07 11:29:00.530048] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.277 [2024-10-07 11:29:00.530068] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.277 [2024-10-07 11:29:00.530083] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.277 [2024-10-07 11:29:00.530096] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.277 [2024-10-07 11:29:00.531037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.277 [2024-10-07 11:29:00.531073] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.277 [2024-10-07 11:29:00.538331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.277 [2024-10-07 11:29:00.538461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.278 [2024-10-07 11:29:00.538574] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.278 [2024-10-07 11:29:00.538607] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.278 [2024-10-07 11:29:00.538625] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.278 [2024-10-07 11:29:00.538691] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.278 [2024-10-07 11:29:00.538718] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.278 [2024-10-07 11:29:00.538768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.278 [2024-10-07 11:29:00.538791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.278 [2024-10-07 11:29:00.538825] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.278 [2024-10-07 11:29:00.538846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.278 [2024-10-07 11:29:00.538860] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.278 [2024-10-07 11:29:00.538875] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.278 [2024-10-07 11:29:00.538905] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.278 [2024-10-07 11:29:00.538923] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.278 [2024-10-07 11:29:00.538937] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.278 [2024-10-07 11:29:00.538950] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.278 [2024-10-07 11:29:00.538977] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.278 [2024-10-07 11:29:00.548694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.278 [2024-10-07 11:29:00.548785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.278 [2024-10-07 11:29:00.548918] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.278 [2024-10-07 11:29:00.548954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.278 [2024-10-07 11:29:00.548972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.278 [2024-10-07 11:29:00.549022] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.278 [2024-10-07 11:29:00.549045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.278 [2024-10-07 11:29:00.549079] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.278 [2024-10-07 11:29:00.549114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.278 [2024-10-07 11:29:00.549138] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.278 [2024-10-07 11:29:00.549164] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.278 [2024-10-07 11:29:00.549181] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.278 [2024-10-07 11:29:00.549196] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.278 [2024-10-07 11:29:00.549214] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.278 [2024-10-07 11:29:00.549228] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.278 [2024-10-07 11:29:00.549241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.278 [2024-10-07 11:29:00.549292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.278 [2024-10-07 11:29:00.549314] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.278 [2024-10-07 11:29:00.559973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.278 [2024-10-07 11:29:00.560101] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.278 [2024-10-07 11:29:00.560910] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.278 [2024-10-07 11:29:00.560961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.278 [2024-10-07 11:29:00.560984] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.278 [2024-10-07 11:29:00.561039] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.278 [2024-10-07 11:29:00.561079] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.278 [2024-10-07 11:29:00.561097] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.278 [2024-10-07 11:29:00.561200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.278 [2024-10-07 11:29:00.561231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.278 [2024-10-07 11:29:00.561260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.278 [2024-10-07 11:29:00.561278] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.278 [2024-10-07 11:29:00.561294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.278 [2024-10-07 11:29:00.561313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.278 [2024-10-07 11:29:00.561328] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.278 [2024-10-07 11:29:00.561341] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.278 [2024-10-07 11:29:00.561371] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.278 [2024-10-07 11:29:00.561389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.278 [2024-10-07 11:29:00.572490] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.278 [2024-10-07 11:29:00.572583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.278 [2024-10-07 11:29:00.572891] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.278 [2024-10-07 11:29:00.572929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.278 [2024-10-07 11:29:00.572949] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.278 [2024-10-07 11:29:00.572999] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.278 [2024-10-07 11:29:00.573022] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.278 [2024-10-07 11:29:00.573038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.278 [2024-10-07 11:29:00.574005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.278 [2024-10-07 11:29:00.574053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.278 [2024-10-07 11:29:00.574276] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.278 [2024-10-07 11:29:00.574312] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.278 [2024-10-07 11:29:00.574330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.278 [2024-10-07 11:29:00.574379] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.278 [2024-10-07 11:29:00.574396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.278 [2024-10-07 11:29:00.574428] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.278 [2024-10-07 11:29:00.575361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.278 [2024-10-07 11:29:00.575416] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.278 [2024-10-07 11:29:00.582681] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.278 [2024-10-07 11:29:00.582797] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.278 [2024-10-07 11:29:00.582910] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.278 [2024-10-07 11:29:00.582943] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.278 [2024-10-07 11:29:00.582961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.278 [2024-10-07 11:29:00.583028] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.278 [2024-10-07 11:29:00.583054] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.278 [2024-10-07 11:29:00.583070] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.278 [2024-10-07 11:29:00.583091] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.278 [2024-10-07 11:29:00.583123] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.278 [2024-10-07 11:29:00.583143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.278 [2024-10-07 11:29:00.583157] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.278 [2024-10-07 11:29:00.583172] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.278 [2024-10-07 11:29:00.583203] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.278 [2024-10-07 11:29:00.583220] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.278 [2024-10-07 11:29:00.583233] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.278 [2024-10-07 11:29:00.583247] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.278 [2024-10-07 11:29:00.583273] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.278 [2024-10-07 11:29:00.592985] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.278 [2024-10-07 11:29:00.593080] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.278 [2024-10-07 11:29:00.593215] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.278 [2024-10-07 11:29:00.593248] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.278 [2024-10-07 11:29:00.593267] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.278 [2024-10-07 11:29:00.593317] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.278 [2024-10-07 11:29:00.593350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.278 [2024-10-07 11:29:00.593366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.279 [2024-10-07 11:29:00.593450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.279 [2024-10-07 11:29:00.593476] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.279 [2024-10-07 11:29:00.593502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.279 [2024-10-07 11:29:00.593519] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.279 [2024-10-07 11:29:00.593535] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.279 [2024-10-07 11:29:00.593551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.279 [2024-10-07 11:29:00.593565] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.279 [2024-10-07 11:29:00.593578] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.279 [2024-10-07 11:29:00.593608] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.279 [2024-10-07 11:29:00.593625] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.279 [2024-10-07 11:29:00.604840] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.279 [2024-10-07 11:29:00.604937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.279 [2024-10-07 11:29:00.605144] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.279 [2024-10-07 11:29:00.605192] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.279 [2024-10-07 11:29:00.605222] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.279 [2024-10-07 11:29:00.605306] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.279 [2024-10-07 11:29:00.605344] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.279 [2024-10-07 11:29:00.605373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.279 [2024-10-07 11:29:00.605445] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.279 [2024-10-07 11:29:00.605489] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.279 [2024-10-07 11:29:00.605535] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.279 [2024-10-07 11:29:00.605565] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.279 [2024-10-07 11:29:00.605594] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.279 [2024-10-07 11:29:00.605623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.279 [2024-10-07 11:29:00.605650] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.279 [2024-10-07 11:29:00.605672] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.279 [2024-10-07 11:29:00.606659] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.279 [2024-10-07 11:29:00.606705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.279 [2024-10-07 11:29:00.616317] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.279 [2024-10-07 11:29:00.616434] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.279 [2024-10-07 11:29:00.617621] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.279 [2024-10-07 11:29:00.617681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.279 [2024-10-07 11:29:00.617716] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.279 [2024-10-07 11:29:00.617809] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.279 [2024-10-07 11:29:00.617848] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.279 [2024-10-07 11:29:00.617876] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.279 [2024-10-07 11:29:00.618135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.279 [2024-10-07 11:29:00.618187] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.279 [2024-10-07 11:29:00.619197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.279 [2024-10-07 11:29:00.619244] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.279 [2024-10-07 11:29:00.619278] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.279 [2024-10-07 11:29:00.619315] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.279 [2024-10-07 11:29:00.619341] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.279 [2024-10-07 11:29:00.619366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.279 [2024-10-07 11:29:00.620164] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.279 [2024-10-07 11:29:00.620213] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.279 [2024-10-07 11:29:00.626594] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.279 [2024-10-07 11:29:00.626719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.279 [2024-10-07 11:29:00.626877] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.279 [2024-10-07 11:29:00.626924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.279 [2024-10-07 11:29:00.626956] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.279 [2024-10-07 11:29:00.627675] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.279 [2024-10-07 11:29:00.627726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.279 [2024-10-07 11:29:00.627761] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.279 [2024-10-07 11:29:00.627797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.279 [2024-10-07 11:29:00.628025] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.279 [2024-10-07 11:29:00.628071] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.279 [2024-10-07 11:29:00.628101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.279 [2024-10-07 11:29:00.628129] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.279 [2024-10-07 11:29:00.628280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.279 [2024-10-07 11:29:00.628354] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.279 [2024-10-07 11:29:00.628385] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.279 [2024-10-07 11:29:00.628429] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.279 [2024-10-07 11:29:00.629809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.279 [2024-10-07 11:29:00.636755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.279 [2024-10-07 11:29:00.636976] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.279 [2024-10-07 11:29:00.637042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.279 [2024-10-07 11:29:00.637096] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.279 [2024-10-07 11:29:00.637178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.279 [2024-10-07 11:29:00.637272] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.279 [2024-10-07 11:29:00.637325] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.279 [2024-10-07 11:29:00.637358] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.279 [2024-10-07 11:29:00.637383] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.279 [2024-10-07 11:29:00.637446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.279 [2024-10-07 11:29:00.637541] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.279 [2024-10-07 11:29:00.637582] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.279 [2024-10-07 11:29:00.637612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.279 [2024-10-07 11:29:00.638455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.279 [2024-10-07 11:29:00.639337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.279 [2024-10-07 11:29:00.639381] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.279 [2024-10-07 11:29:00.639430] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.279 [2024-10-07 11:29:00.639585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.279 [2024-10-07 11:29:00.648284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.279 [2024-10-07 11:29:00.648382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.279 [2024-10-07 11:29:00.648581] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.279 [2024-10-07 11:29:00.648630] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.279 [2024-10-07 11:29:00.648662] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.279 [2024-10-07 11:29:00.648744] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.279 [2024-10-07 11:29:00.648781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.279 [2024-10-07 11:29:00.648810] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.279 [2024-10-07 11:29:00.648883] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.279 [2024-10-07 11:29:00.648972] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.279 [2024-10-07 11:29:00.649022] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.279 [2024-10-07 11:29:00.649069] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.279 [2024-10-07 11:29:00.649101] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.279 [2024-10-07 11:29:00.649130] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.279 [2024-10-07 11:29:00.649157] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.280 [2024-10-07 11:29:00.649178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.280 [2024-10-07 11:29:00.650176] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.280 [2024-10-07 11:29:00.650224] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.280 [2024-10-07 11:29:00.660054] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.280 [2024-10-07 11:29:00.660172] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.280 [2024-10-07 11:29:00.661526] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.280 [2024-10-07 11:29:00.661597] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.280 [2024-10-07 11:29:00.661631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.280 [2024-10-07 11:29:00.661717] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.280 [2024-10-07 11:29:00.661755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.280 [2024-10-07 11:29:00.661785] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.280 [2024-10-07 11:29:00.662048] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.280 [2024-10-07 11:29:00.662101] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.280 [2024-10-07 11:29:00.663101] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.280 [2024-10-07 11:29:00.663148] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.280 [2024-10-07 11:29:00.663181] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.280 [2024-10-07 11:29:00.663221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.280 [2024-10-07 11:29:00.663246] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.280 [2024-10-07 11:29:00.663269] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.280 [2024-10-07 11:29:00.664096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.280 [2024-10-07 11:29:00.664145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.280 [2024-10-07 11:29:00.670291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.280 [2024-10-07 11:29:00.670443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.280 [2024-10-07 11:29:00.670606] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.280 [2024-10-07 11:29:00.670688] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.280 [2024-10-07 11:29:00.670723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.280 [2024-10-07 11:29:00.671446] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.280 [2024-10-07 11:29:00.671498] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.280 [2024-10-07 11:29:00.671530] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.280 [2024-10-07 11:29:00.671566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.280 [2024-10-07 11:29:00.671801] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.280 [2024-10-07 11:29:00.671856] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.280 [2024-10-07 11:29:00.671886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.280 [2024-10-07 11:29:00.671915] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.280 [2024-10-07 11:29:00.672120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.280 [2024-10-07 11:29:00.672164] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.280 [2024-10-07 11:29:00.672193] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.280 [2024-10-07 11:29:00.672219] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.280 [2024-10-07 11:29:00.673579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.280 [2024-10-07 11:29:00.680779] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.280 [2024-10-07 11:29:00.680872] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.280 [2024-10-07 11:29:00.681074] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.280 [2024-10-07 11:29:00.681125] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.280 [2024-10-07 11:29:00.681156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.280 [2024-10-07 11:29:00.681241] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.280 [2024-10-07 11:29:00.681279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.280 [2024-10-07 11:29:00.681308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.280 [2024-10-07 11:29:00.681363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.280 [2024-10-07 11:29:00.681423] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.280 [2024-10-07 11:29:00.682231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.280 [2024-10-07 11:29:00.682277] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.280 [2024-10-07 11:29:00.682310] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.280 [2024-10-07 11:29:00.682341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.280 [2024-10-07 11:29:00.682366] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.280 [2024-10-07 11:29:00.682447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.280 [2024-10-07 11:29:00.683347] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.280 [2024-10-07 11:29:00.683392] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.280 [2024-10-07 11:29:00.693124] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.280 [2024-10-07 11:29:00.693254] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.280 [2024-10-07 11:29:00.694364] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.280 [2024-10-07 11:29:00.694440] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.280 [2024-10-07 11:29:00.694482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.280 [2024-10-07 11:29:00.694590] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.280 [2024-10-07 11:29:00.694629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x141d2e0 with addr=10.0.0.3, port=4420 00:18:26.280 [2024-10-07 11:29:00.694655] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x141d2e0 is same with the state(6) to be set 00:18:26.280 [2024-10-07 11:29:00.695661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.280 [2024-10-07 11:29:00.695728] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x141d2e0 (9): Bad file descriptor 00:18:26.280 [2024-10-07 11:29:00.696609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.280 [2024-10-07 11:29:00.696653] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.280 [2024-10-07 11:29:00.696675] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.280 [2024-10-07 11:29:00.696699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.280 [2024-10-07 11:29:00.696725] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.280 [2024-10-07 11:29:00.696738] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.280 [2024-10-07 11:29:00.696859] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.280 [2024-10-07 11:29:00.696884] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.280 [2024-10-07 11:29:00.705530] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.280 [2024-10-07 11:29:00.705644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.280 [2024-10-07 11:29:00.707255] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.280 [2024-10-07 11:29:00.707323] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.280 [2024-10-07 11:29:00.707356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.280 [2024-10-07 11:29:00.707670] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.280 [2024-10-07 11:29:00.708826] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.280 [2024-10-07 11:29:00.708887] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.280 [2024-10-07 11:29:00.708920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.280 [2024-10-07 11:29:00.709853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.281 [2024-10-07 11:29:00.715800] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.281 [2024-10-07 11:29:00.716100] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.281 [2024-10-07 11:29:00.716165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.281 [2024-10-07 11:29:00.716200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.281 [2024-10-07 11:29:00.716991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.281 [2024-10-07 11:29:00.717295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.281 [2024-10-07 11:29:00.717353] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.281 [2024-10-07 11:29:00.717384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.281 [2024-10-07 11:29:00.717579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.281 [2024-10-07 11:29:00.727159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.281 [2024-10-07 11:29:00.727498] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.281 [2024-10-07 11:29:00.727592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.281 [2024-10-07 11:29:00.727626] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.281 [2024-10-07 11:29:00.728589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.281 [2024-10-07 11:29:00.729661] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.281 [2024-10-07 11:29:00.729722] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.281 [2024-10-07 11:29:00.729752] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.281 [2024-10-07 11:29:00.729922] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.281 [2024-10-07 11:29:00.739165] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.281 [2024-10-07 11:29:00.739279] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:18:26.281 [2024-10-07 11:29:00.740377] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.281 [2024-10-07 11:29:00.740469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.281 [2024-10-07 11:29:00.740504] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.281 [2024-10-07 11:29:00.741773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.281 [2024-10-07 11:29:00.742908] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.281 [2024-10-07 11:29:00.742964] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.281 [2024-10-07 11:29:00.742994] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.281 [2024-10-07 11:29:00.744044] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.281 [2024-10-07 11:29:00.750846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.281 [2024-10-07 11:29:00.752210] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.281 [2024-10-07 11:29:00.752324] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.281 [2024-10-07 11:29:00.752360] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.281 [2024-10-07 11:29:00.752672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.281 [2024-10-07 11:29:00.752939] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.281 [2024-10-07 11:29:00.752991] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.281 [2024-10-07 11:29:00.753022] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.281 [2024-10-07 11:29:00.753138] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.281 [2024-10-07 11:29:00.762448] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.281 [2024-10-07 11:29:00.762724] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.281 [2024-10-07 11:29:00.762771] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.281 [2024-10-07 11:29:00.762798] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.281 [2024-10-07 11:29:00.763008] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.281 [2024-10-07 11:29:00.763294] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.281 [2024-10-07 11:29:00.763349] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.281 [2024-10-07 11:29:00.763380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.281 [2024-10-07 11:29:00.763491] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.281 [2024-10-07 11:29:00.773756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.281 [2024-10-07 11:29:00.774023] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.281 [2024-10-07 11:29:00.774075] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.281 [2024-10-07 11:29:00.774108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.281 [2024-10-07 11:29:00.774168] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.281 [2024-10-07 11:29:00.774225] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.281 [2024-10-07 11:29:00.774257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.281 [2024-10-07 11:29:00.774284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.281 [2024-10-07 11:29:00.774337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.281 [2024-10-07 11:29:00.785431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.281 [2024-10-07 11:29:00.785786] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.281 [2024-10-07 11:29:00.785851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.281 [2024-10-07 11:29:00.785884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.281 [2024-10-07 11:29:00.785941] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.281 [2024-10-07 11:29:00.786042] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.281 [2024-10-07 11:29:00.786071] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.281 [2024-10-07 11:29:00.786094] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.281 [2024-10-07 11:29:00.786140] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.281 [2024-10-07 11:29:00.797141] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.281 [2024-10-07 11:29:00.797427] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.281 [2024-10-07 11:29:00.797481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.281 [2024-10-07 11:29:00.797522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.281 [2024-10-07 11:29:00.797585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.281 [2024-10-07 11:29:00.797661] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.281 [2024-10-07 11:29:00.797693] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.281 [2024-10-07 11:29:00.797720] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.281 [2024-10-07 11:29:00.797776] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.281 [2024-10-07 11:29:00.807349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.281 [2024-10-07 11:29:00.807840] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.281 [2024-10-07 11:29:00.807908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.281 [2024-10-07 11:29:00.807946] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.281 [2024-10-07 11:29:00.808171] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.281 [2024-10-07 11:29:00.808288] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.281 [2024-10-07 11:29:00.808327] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.281 [2024-10-07 11:29:00.808352] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.281 [2024-10-07 11:29:00.808423] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.281 [2024-10-07 11:29:00.819174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.281 [2024-10-07 11:29:00.820622] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.281 [2024-10-07 11:29:00.820695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.281 [2024-10-07 11:29:00.820733] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.281 [2024-10-07 11:29:00.821041] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.281 [2024-10-07 11:29:00.821246] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.281 [2024-10-07 11:29:00.821299] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.281 [2024-10-07 11:29:00.821340] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.281 [2024-10-07 11:29:00.822856] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.281 [2024-10-07 11:29:00.830003] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.281 [2024-10-07 11:29:00.830297] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.281 [2024-10-07 11:29:00.830363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.281 [2024-10-07 11:29:00.830394] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.281 [2024-10-07 11:29:00.831539] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.281 [2024-10-07 11:29:00.831861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.282 [2024-10-07 11:29:00.831915] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.282 [2024-10-07 11:29:00.831946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.282 [2024-10-07 11:29:00.832091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.282 [2024-10-07 11:29:00.841924] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.282 [2024-10-07 11:29:00.842241] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.282 [2024-10-07 11:29:00.842292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.282 [2024-10-07 11:29:00.842323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.282 [2024-10-07 11:29:00.842380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.282 [2024-10-07 11:29:00.842460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.282 [2024-10-07 11:29:00.842490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.282 [2024-10-07 11:29:00.842515] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.282 [2024-10-07 11:29:00.842566] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.282 [2024-10-07 11:29:00.854242] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.282 [2024-10-07 11:29:00.854587] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.282 [2024-10-07 11:29:00.854660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.282 [2024-10-07 11:29:00.854694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.282 [2024-10-07 11:29:00.855552] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.282 [2024-10-07 11:29:00.856631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.282 [2024-10-07 11:29:00.856690] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.282 [2024-10-07 11:29:00.856722] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.282 [2024-10-07 11:29:00.856883] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.282 [2024-10-07 11:29:00.865750] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.282 [2024-10-07 11:29:00.867439] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.282 [2024-10-07 11:29:00.867515] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.282 [2024-10-07 11:29:00.867592] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.282 [2024-10-07 11:29:00.868973] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.282 [2024-10-07 11:29:00.870113] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.282 [2024-10-07 11:29:00.870172] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.282 [2024-10-07 11:29:00.870202] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.282 [2024-10-07 11:29:00.871297] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.282 [2024-10-07 11:29:00.878197] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.282 [2024-10-07 11:29:00.879926] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.282 [2024-10-07 11:29:00.879995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.282 [2024-10-07 11:29:00.880030] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.282 [2024-10-07 11:29:00.880303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.282 [2024-10-07 11:29:00.880512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.282 [2024-10-07 11:29:00.880561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.282 [2024-10-07 11:29:00.880590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.282 [2024-10-07 11:29:00.882048] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.282 [2024-10-07 11:29:00.888417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.282 [2024-10-07 11:29:00.888662] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.282 [2024-10-07 11:29:00.888711] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.282 [2024-10-07 11:29:00.888739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.282 [2024-10-07 11:29:00.889893] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.282 [2024-10-07 11:29:00.890224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.282 [2024-10-07 11:29:00.890285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.282 [2024-10-07 11:29:00.890321] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.282 [2024-10-07 11:29:00.890502] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.282 [2024-10-07 11:29:00.899864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.282 [2024-10-07 11:29:00.900138] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.282 [2024-10-07 11:29:00.900216] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.282 [2024-10-07 11:29:00.900249] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.282 [2024-10-07 11:29:00.900323] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.282 [2024-10-07 11:29:00.900377] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.282 [2024-10-07 11:29:00.900474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.282 [2024-10-07 11:29:00.900505] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.282 [2024-10-07 11:29:00.900589] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.282 [2024-10-07 11:29:00.912109] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.282 [2024-10-07 11:29:00.913287] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.282 [2024-10-07 11:29:00.913361] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.282 [2024-10-07 11:29:00.913420] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.282 [2024-10-07 11:29:00.914477] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.282 [2024-10-07 11:29:00.914693] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.282 [2024-10-07 11:29:00.914745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.282 [2024-10-07 11:29:00.914779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.282 [2024-10-07 11:29:00.914843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.282 [2024-10-07 11:29:00.923648] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.282 [2024-10-07 11:29:00.925279] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.282 [2024-10-07 11:29:00.925348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.282 [2024-10-07 11:29:00.925381] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.282 [2024-10-07 11:29:00.926742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.282 [2024-10-07 11:29:00.927065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.282 [2024-10-07 11:29:00.927121] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.282 [2024-10-07 11:29:00.927153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.282 [2024-10-07 11:29:00.927251] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.282 [2024-10-07 11:29:00.934058] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.282 [2024-10-07 11:29:00.934321] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.282 [2024-10-07 11:29:00.934390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.282 [2024-10-07 11:29:00.934444] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.282 [2024-10-07 11:29:00.934503] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.282 [2024-10-07 11:29:00.934557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.282 [2024-10-07 11:29:00.934585] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.282 [2024-10-07 11:29:00.934610] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.282 [2024-10-07 11:29:00.935712] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.282 [2024-10-07 11:29:00.945517] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.282 [2024-10-07 11:29:00.945966] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.282 [2024-10-07 11:29:00.946015] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.282 [2024-10-07 11:29:00.946037] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.282 [2024-10-07 11:29:00.946118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.282 [2024-10-07 11:29:00.946162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.282 [2024-10-07 11:29:00.946180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.282 [2024-10-07 11:29:00.946198] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.282 [2024-10-07 11:29:00.946234] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.282 [2024-10-07 11:29:00.958017] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.282 [2024-10-07 11:29:00.958321] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.282 [2024-10-07 11:29:00.958390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.282 [2024-10-07 11:29:00.958450] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.283 [2024-10-07 11:29:00.958520] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.283 [2024-10-07 11:29:00.958582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.283 [2024-10-07 11:29:00.958614] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.283 [2024-10-07 11:29:00.958640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.283 [2024-10-07 11:29:00.959542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.283 [2024-10-07 11:29:00.968211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.283 [2024-10-07 11:29:00.968433] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.283 [2024-10-07 11:29:00.968480] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.283 [2024-10-07 11:29:00.968506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.283 [2024-10-07 11:29:00.969583] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.283 [2024-10-07 11:29:00.969819] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.283 [2024-10-07 11:29:00.969856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.283 [2024-10-07 11:29:00.969875] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.283 [2024-10-07 11:29:00.969952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.283 [2024-10-07 11:29:00.978386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.283 [2024-10-07 11:29:00.979533] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.283 [2024-10-07 11:29:00.979583] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.283 [2024-10-07 11:29:00.979605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.283 [2024-10-07 11:29:00.979871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.283 [2024-10-07 11:29:00.980011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.283 [2024-10-07 11:29:00.980041] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.283 [2024-10-07 11:29:00.980060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.283 [2024-10-07 11:29:00.981196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.283 [2024-10-07 11:29:00.989276] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.283 [2024-10-07 11:29:00.989743] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.283 [2024-10-07 11:29:00.989782] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.283 [2024-10-07 11:29:00.989801] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.283 [2024-10-07 11:29:00.989880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.283 [2024-10-07 11:29:00.989924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.283 [2024-10-07 11:29:00.989941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.283 [2024-10-07 11:29:00.989957] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.283 [2024-10-07 11:29:00.989994] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.283 [2024-10-07 11:29:01.001775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.283 [2024-10-07 11:29:01.002000] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.283 [2024-10-07 11:29:01.002039] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.283 [2024-10-07 11:29:01.002057] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.283 [2024-10-07 11:29:01.002098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.283 [2024-10-07 11:29:01.002134] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.283 [2024-10-07 11:29:01.002152] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.283 [2024-10-07 11:29:01.002167] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.283 [2024-10-07 11:29:01.002203] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.283 [2024-10-07 11:29:01.011936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.283 [2024-10-07 11:29:01.012133] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.283 [2024-10-07 11:29:01.012170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.283 [2024-10-07 11:29:01.012188] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.283 [2024-10-07 11:29:01.013251] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.283 [2024-10-07 11:29:01.013520] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.283 [2024-10-07 11:29:01.013566] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.283 [2024-10-07 11:29:01.013619] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.283 [2024-10-07 11:29:01.013745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.283 [2024-10-07 11:29:01.022086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.283 [2024-10-07 11:29:01.022279] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.283 [2024-10-07 11:29:01.022315] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.283 [2024-10-07 11:29:01.022333] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.283 [2024-10-07 11:29:01.023283] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.283 [2024-10-07 11:29:01.023556] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.283 [2024-10-07 11:29:01.023595] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.283 [2024-10-07 11:29:01.023615] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.283 [2024-10-07 11:29:01.023735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.283 [2024-10-07 11:29:01.032943] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.283 [2024-10-07 11:29:01.033416] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.283 [2024-10-07 11:29:01.033470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.283 [2024-10-07 11:29:01.033505] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.283 [2024-10-07 11:29:01.033603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.283 [2024-10-07 11:29:01.033648] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.283 [2024-10-07 11:29:01.033667] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.283 [2024-10-07 11:29:01.033683] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.283 [2024-10-07 11:29:01.033720] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.283 [2024-10-07 11:29:01.045227] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.283 [2024-10-07 11:29:01.045574] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.283 [2024-10-07 11:29:01.045625] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.283 [2024-10-07 11:29:01.045647] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.283 [2024-10-07 11:29:01.045713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.283 [2024-10-07 11:29:01.045755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.283 [2024-10-07 11:29:01.045774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.283 [2024-10-07 11:29:01.045791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.283 [2024-10-07 11:29:01.045827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.283 [2024-10-07 11:29:01.055675] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.283 [2024-10-07 11:29:01.055988] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.283 [2024-10-07 11:29:01.056028] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.283 [2024-10-07 11:29:01.056048] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.283 [2024-10-07 11:29:01.056090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.283 [2024-10-07 11:29:01.057184] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.283 [2024-10-07 11:29:01.057231] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.283 [2024-10-07 11:29:01.057253] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.283 [2024-10-07 11:29:01.057529] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.283 [2024-10-07 11:29:01.066064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.283 [2024-10-07 11:29:01.066265] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.283 [2024-10-07 11:29:01.066303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.283 [2024-10-07 11:29:01.066322] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.283 [2024-10-07 11:29:01.066376] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.283 [2024-10-07 11:29:01.066430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.283 [2024-10-07 11:29:01.066451] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.283 [2024-10-07 11:29:01.066468] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.283 [2024-10-07 11:29:01.066503] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.283 [2024-10-07 11:29:01.076240] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.283 [2024-10-07 11:29:01.076458] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.283 [2024-10-07 11:29:01.076497] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.284 [2024-10-07 11:29:01.076517] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.284 [2024-10-07 11:29:01.076558] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.284 [2024-10-07 11:29:01.076594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.284 [2024-10-07 11:29:01.076611] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.284 [2024-10-07 11:29:01.076626] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.284 [2024-10-07 11:29:01.076661] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.284 [2024-10-07 11:29:01.087243] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.284 [2024-10-07 11:29:01.087521] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.284 [2024-10-07 11:29:01.087577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.284 [2024-10-07 11:29:01.087602] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.284 [2024-10-07 11:29:01.087692] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.284 [2024-10-07 11:29:01.088828] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.284 [2024-10-07 11:29:01.088873] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.284 [2024-10-07 11:29:01.088894] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.284 [2024-10-07 11:29:01.089124] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.284 [2024-10-07 11:29:01.098014] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.284 [2024-10-07 11:29:01.098237] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.284 [2024-10-07 11:29:01.098276] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.284 [2024-10-07 11:29:01.098296] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.284 [2024-10-07 11:29:01.098337] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.284 [2024-10-07 11:29:01.098374] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.284 [2024-10-07 11:29:01.098391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.284 [2024-10-07 11:29:01.098424] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.284 [2024-10-07 11:29:01.098463] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.284 8377.78 IOPS, 32.73 MiB/s [2024-10-07T11:29:07.995Z] [2024-10-07 11:29:01.109320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.284 [2024-10-07 11:29:01.109763] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.284 [2024-10-07 11:29:01.109813] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.284 [2024-10-07 11:29:01.109835] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.284 [2024-10-07 11:29:01.109915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.284 [2024-10-07 11:29:01.109958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.284 [2024-10-07 11:29:01.109977] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.284 [2024-10-07 11:29:01.109993] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.284 [2024-10-07 11:29:01.110029] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.284 [2024-10-07 11:29:01.120154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.284 [2024-10-07 11:29:01.120355] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.284 [2024-10-07 11:29:01.120393] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.284 [2024-10-07 11:29:01.120433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.284 [2024-10-07 11:29:01.120475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.284 [2024-10-07 11:29:01.120512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.284 [2024-10-07 11:29:01.120529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.284 [2024-10-07 11:29:01.120585] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.284 [2024-10-07 11:29:01.120623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.284 [2024-10-07 11:29:01.130317] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.284 [2024-10-07 11:29:01.130528] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.284 [2024-10-07 11:29:01.130566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.284 [2024-10-07 11:29:01.130585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.284 [2024-10-07 11:29:01.130624] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.284 [2024-10-07 11:29:01.130660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.284 [2024-10-07 11:29:01.130677] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.284 [2024-10-07 11:29:01.130693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.284 [2024-10-07 11:29:01.130728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.284 [2024-10-07 11:29:01.143266] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.284 [2024-10-07 11:29:01.143737] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.284 [2024-10-07 11:29:01.143803] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.284 [2024-10-07 11:29:01.143869] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.284 [2024-10-07 11:29:01.143974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.284 [2024-10-07 11:29:01.144072] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.284 [2024-10-07 11:29:01.144109] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.284 [2024-10-07 11:29:01.144133] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.284 [2024-10-07 11:29:01.144185] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.284 [2024-10-07 11:29:01.153546] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.284 [2024-10-07 11:29:01.153816] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.284 [2024-10-07 11:29:01.153865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.284 [2024-10-07 11:29:01.153896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.284 [2024-10-07 11:29:01.153954] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.284 [2024-10-07 11:29:01.155320] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.284 [2024-10-07 11:29:01.155376] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.284 [2024-10-07 11:29:01.155426] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.284 [2024-10-07 11:29:01.155742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.284 [2024-10-07 11:29:01.164366] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.284 [2024-10-07 11:29:01.164651] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.284 [2024-10-07 11:29:01.164764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.284 [2024-10-07 11:29:01.164811] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.284 [2024-10-07 11:29:01.164871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.284 [2024-10-07 11:29:01.164925] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.284 [2024-10-07 11:29:01.164953] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.284 [2024-10-07 11:29:01.164978] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.284 [2024-10-07 11:29:01.165030] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.284 [2024-10-07 11:29:01.177283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.284 [2024-10-07 11:29:01.177589] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.284 [2024-10-07 11:29:01.177651] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.284 [2024-10-07 11:29:01.177696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.284 [2024-10-07 11:29:01.178608] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.284 [2024-10-07 11:29:01.179756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.284 [2024-10-07 11:29:01.179812] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.284 [2024-10-07 11:29:01.179844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.284 [2024-10-07 11:29:01.180023] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.284 [2024-10-07 11:29:01.187904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.284 [2024-10-07 11:29:01.188147] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.284 [2024-10-07 11:29:01.188194] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.284 [2024-10-07 11:29:01.188225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.284 [2024-10-07 11:29:01.189535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.284 [2024-10-07 11:29:01.189822] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.284 [2024-10-07 11:29:01.189871] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.284 [2024-10-07 11:29:01.189904] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.284 [2024-10-07 11:29:01.190078] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.285 [2024-10-07 11:29:01.198468] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.285 [2024-10-07 11:29:01.198729] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.285 [2024-10-07 11:29:01.198789] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.285 [2024-10-07 11:29:01.198823] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.285 [2024-10-07 11:29:01.199835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.285 [2024-10-07 11:29:01.200128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.285 [2024-10-07 11:29:01.200167] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.285 [2024-10-07 11:29:01.200188] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.285 [2024-10-07 11:29:01.200274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.285 [2024-10-07 11:29:01.208683] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.285 [2024-10-07 11:29:01.208947] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.285 [2024-10-07 11:29:01.208997] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.285 [2024-10-07 11:29:01.209026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.285 [2024-10-07 11:29:01.209952] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.285 [2024-10-07 11:29:01.211076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.285 [2024-10-07 11:29:01.211132] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.285 [2024-10-07 11:29:01.211164] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.285 [2024-10-07 11:29:01.211319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.285 [2024-10-07 11:29:01.218989] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.285 [2024-10-07 11:29:01.220477] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.285 [2024-10-07 11:29:01.220549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.285 [2024-10-07 11:29:01.220582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.285 [2024-10-07 11:29:01.220864] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.285 [2024-10-07 11:29:01.221036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.285 [2024-10-07 11:29:01.221102] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.285 [2024-10-07 11:29:01.221134] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.285 [2024-10-07 11:29:01.222632] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.285 [2024-10-07 11:29:01.229210] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.285 [2024-10-07 11:29:01.229473] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.285 [2024-10-07 11:29:01.229530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.285 [2024-10-07 11:29:01.229561] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.285 [2024-10-07 11:29:01.230734] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.285 [2024-10-07 11:29:01.231082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.285 [2024-10-07 11:29:01.231134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.285 [2024-10-07 11:29:01.231166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.285 [2024-10-07 11:29:01.231363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.285 [2024-10-07 11:29:01.239427] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.285 [2024-10-07 11:29:01.239679] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.285 [2024-10-07 11:29:01.239741] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.285 [2024-10-07 11:29:01.239775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.285 [2024-10-07 11:29:01.239834] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.285 [2024-10-07 11:29:01.239924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.285 [2024-10-07 11:29:01.239968] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.285 [2024-10-07 11:29:01.239999] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.285 [2024-10-07 11:29:01.240911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.285 [2024-10-07 11:29:01.250264] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.285 [2024-10-07 11:29:01.251776] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.285 [2024-10-07 11:29:01.251845] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.285 [2024-10-07 11:29:01.251878] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.285 [2024-10-07 11:29:01.252168] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.285 [2024-10-07 11:29:01.252341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.285 [2024-10-07 11:29:01.252383] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.285 [2024-10-07 11:29:01.252434] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.285 [2024-10-07 11:29:01.253965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.285 [2024-10-07 11:29:01.260470] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.285 [2024-10-07 11:29:01.261623] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.285 [2024-10-07 11:29:01.261676] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.285 [2024-10-07 11:29:01.261699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.285 [2024-10-07 11:29:01.261909] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.285 [2024-10-07 11:29:01.263096] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.285 [2024-10-07 11:29:01.263140] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.285 [2024-10-07 11:29:01.263161] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.285 [2024-10-07 11:29:01.263424] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.285 [2024-10-07 11:29:01.271331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.285 [2024-10-07 11:29:01.271527] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.285 [2024-10-07 11:29:01.271566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.285 [2024-10-07 11:29:01.271618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.285 [2024-10-07 11:29:01.271905] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.285 [2024-10-07 11:29:01.272028] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.285 [2024-10-07 11:29:01.272065] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.285 [2024-10-07 11:29:01.272084] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.285 [2024-10-07 11:29:01.272133] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.285 [2024-10-07 11:29:01.283842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.285 [2024-10-07 11:29:01.284061] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.285 [2024-10-07 11:29:01.284099] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.285 [2024-10-07 11:29:01.284119] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.285 [2024-10-07 11:29:01.284160] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.285 [2024-10-07 11:29:01.284196] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.285 [2024-10-07 11:29:01.284214] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.285 [2024-10-07 11:29:01.284230] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.285 [2024-10-07 11:29:01.284265] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.285 [2024-10-07 11:29:01.294004] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.285 [2024-10-07 11:29:01.294192] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.285 [2024-10-07 11:29:01.294229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.285 [2024-10-07 11:29:01.294247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.285 [2024-10-07 11:29:01.294286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.286 [2024-10-07 11:29:01.294322] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.286 [2024-10-07 11:29:01.294339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.286 [2024-10-07 11:29:01.294354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.286 [2024-10-07 11:29:01.294389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.286 [2024-10-07 11:29:01.304187] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.286 [2024-10-07 11:29:01.304421] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.286 [2024-10-07 11:29:01.304464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.286 [2024-10-07 11:29:01.304484] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.286 [2024-10-07 11:29:01.304529] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.286 [2024-10-07 11:29:01.304566] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.286 [2024-10-07 11:29:01.304615] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.286 [2024-10-07 11:29:01.304632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.286 [2024-10-07 11:29:01.304669] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.286 [2024-10-07 11:29:01.314344] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.286 [2024-10-07 11:29:01.314584] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.286 [2024-10-07 11:29:01.314634] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.286 [2024-10-07 11:29:01.314656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.286 [2024-10-07 11:29:01.314697] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.286 [2024-10-07 11:29:01.314752] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.286 [2024-10-07 11:29:01.314772] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.286 [2024-10-07 11:29:01.314789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.286 [2024-10-07 11:29:01.314824] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.286 [2024-10-07 11:29:01.324627] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.286 [2024-10-07 11:29:01.325992] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.286 [2024-10-07 11:29:01.326065] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.286 [2024-10-07 11:29:01.326103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.286 [2024-10-07 11:29:01.326358] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.286 [2024-10-07 11:29:01.326464] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.286 [2024-10-07 11:29:01.326494] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.286 [2024-10-07 11:29:01.326512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.286 [2024-10-07 11:29:01.326553] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.286 [2024-10-07 11:29:01.334845] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.286 [2024-10-07 11:29:01.335072] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.286 [2024-10-07 11:29:01.335110] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.286 [2024-10-07 11:29:01.335129] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.286 [2024-10-07 11:29:01.335169] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.286 [2024-10-07 11:29:01.335206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.286 [2024-10-07 11:29:01.335223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.286 [2024-10-07 11:29:01.335239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.286 [2024-10-07 11:29:01.335274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.286 [2024-10-07 11:29:01.346777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.286 [2024-10-07 11:29:01.347127] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.286 [2024-10-07 11:29:01.347179] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.286 [2024-10-07 11:29:01.347202] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.286 [2024-10-07 11:29:01.347267] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.286 [2024-10-07 11:29:01.347311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.286 [2024-10-07 11:29:01.347330] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.286 [2024-10-07 11:29:01.347346] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.286 [2024-10-07 11:29:01.347383] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.286 [2024-10-07 11:29:01.356980] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.286 [2024-10-07 11:29:01.358177] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.286 [2024-10-07 11:29:01.358228] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.286 [2024-10-07 11:29:01.358251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.286 [2024-10-07 11:29:01.358495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.286 [2024-10-07 11:29:01.358581] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.286 [2024-10-07 11:29:01.358604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.286 [2024-10-07 11:29:01.358622] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.286 [2024-10-07 11:29:01.358660] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.286 [2024-10-07 11:29:01.367154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.286 [2024-10-07 11:29:01.367355] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.286 [2024-10-07 11:29:01.367416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.286 [2024-10-07 11:29:01.367440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.286 [2024-10-07 11:29:01.367485] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.286 [2024-10-07 11:29:01.367521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.286 [2024-10-07 11:29:01.367540] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.286 [2024-10-07 11:29:01.367566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.286 [2024-10-07 11:29:01.367623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.286 [2024-10-07 11:29:01.378717] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.286 [2024-10-07 11:29:01.378946] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.286 [2024-10-07 11:29:01.378985] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.286 [2024-10-07 11:29:01.379006] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.286 [2024-10-07 11:29:01.379083] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.286 [2024-10-07 11:29:01.379120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.286 [2024-10-07 11:29:01.379137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.286 [2024-10-07 11:29:01.379153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.286 [2024-10-07 11:29:01.379189] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.286 [2024-10-07 11:29:01.388896] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.286 [2024-10-07 11:29:01.389135] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.286 [2024-10-07 11:29:01.389175] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.286 [2024-10-07 11:29:01.389195] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.286 [2024-10-07 11:29:01.389236] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.286 [2024-10-07 11:29:01.389273] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.286 [2024-10-07 11:29:01.389291] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.286 [2024-10-07 11:29:01.389307] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.286 [2024-10-07 11:29:01.389344] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.286 [2024-10-07 11:29:01.399084] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.286 [2024-10-07 11:29:01.399290] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.286 [2024-10-07 11:29:01.399328] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.286 [2024-10-07 11:29:01.399348] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.286 [2024-10-07 11:29:01.399388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.286 [2024-10-07 11:29:01.399444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.286 [2024-10-07 11:29:01.399463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.286 [2024-10-07 11:29:01.399479] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.286 [2024-10-07 11:29:01.399515] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.286 [2024-10-07 11:29:01.410522] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.286 [2024-10-07 11:29:01.410966] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.286 [2024-10-07 11:29:01.411016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.287 [2024-10-07 11:29:01.411038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.287 [2024-10-07 11:29:01.411143] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.287 [2024-10-07 11:29:01.411189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.287 [2024-10-07 11:29:01.411208] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.287 [2024-10-07 11:29:01.411270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.287 [2024-10-07 11:29:01.411348] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.287 [2024-10-07 11:29:01.422984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.287 [2024-10-07 11:29:01.423214] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.287 [2024-10-07 11:29:01.423254] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.287 [2024-10-07 11:29:01.423274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.287 [2024-10-07 11:29:01.423314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.287 [2024-10-07 11:29:01.423351] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.287 [2024-10-07 11:29:01.423369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.287 [2024-10-07 11:29:01.423384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.287 [2024-10-07 11:29:01.423437] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.287 [2024-10-07 11:29:01.433190] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.287 [2024-10-07 11:29:01.433514] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.287 [2024-10-07 11:29:01.433570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.287 [2024-10-07 11:29:01.433604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.287 [2024-10-07 11:29:01.434685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.287 [2024-10-07 11:29:01.434936] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.287 [2024-10-07 11:29:01.434974] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.287 [2024-10-07 11:29:01.434994] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.287 [2024-10-07 11:29:01.436246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.287 [2024-10-07 11:29:01.443423] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.287 [2024-10-07 11:29:01.443627] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.287 [2024-10-07 11:29:01.443665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.287 [2024-10-07 11:29:01.443684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.287 [2024-10-07 11:29:01.443723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.287 [2024-10-07 11:29:01.444698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.287 [2024-10-07 11:29:01.444740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.287 [2024-10-07 11:29:01.444760] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.287 [2024-10-07 11:29:01.444993] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.287 [2024-10-07 11:29:01.454603] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.287 [2024-10-07 11:29:01.455173] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.287 [2024-10-07 11:29:01.455227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.287 [2024-10-07 11:29:01.455251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.287 [2024-10-07 11:29:01.455376] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.287 [2024-10-07 11:29:01.455442] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.287 [2024-10-07 11:29:01.455463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.287 [2024-10-07 11:29:01.455479] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.287 [2024-10-07 11:29:01.455516] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.287 [2024-10-07 11:29:01.465196] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.287 [2024-10-07 11:29:01.465395] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.287 [2024-10-07 11:29:01.465450] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.287 [2024-10-07 11:29:01.465493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.287 [2024-10-07 11:29:01.465563] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.287 [2024-10-07 11:29:01.465602] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.287 [2024-10-07 11:29:01.465620] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.287 [2024-10-07 11:29:01.465635] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.287 [2024-10-07 11:29:01.465689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.287 [2024-10-07 11:29:01.475366] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.287 [2024-10-07 11:29:01.475587] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.287 [2024-10-07 11:29:01.475625] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.287 [2024-10-07 11:29:01.475645] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.287 [2024-10-07 11:29:01.475685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.287 [2024-10-07 11:29:01.475721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.287 [2024-10-07 11:29:01.475740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.287 [2024-10-07 11:29:01.475755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.287 [2024-10-07 11:29:01.475791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.287 [2024-10-07 11:29:01.485563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.287 [2024-10-07 11:29:01.485772] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.287 [2024-10-07 11:29:01.485809] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.287 [2024-10-07 11:29:01.485828] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.287 [2024-10-07 11:29:01.485903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.287 [2024-10-07 11:29:01.485942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.287 [2024-10-07 11:29:01.485960] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.287 [2024-10-07 11:29:01.485975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.287 [2024-10-07 11:29:01.486010] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.287 [2024-10-07 11:29:01.496849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.287 [2024-10-07 11:29:01.497068] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.287 [2024-10-07 11:29:01.497110] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.287 [2024-10-07 11:29:01.497130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.287 [2024-10-07 11:29:01.497171] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.287 [2024-10-07 11:29:01.497208] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.287 [2024-10-07 11:29:01.497226] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.287 [2024-10-07 11:29:01.497241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.287 [2024-10-07 11:29:01.497277] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.287 [2024-10-07 11:29:01.507022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.287 [2024-10-07 11:29:01.507246] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.287 [2024-10-07 11:29:01.507285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.287 [2024-10-07 11:29:01.507304] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.287 [2024-10-07 11:29:01.507344] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.287 [2024-10-07 11:29:01.507381] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.287 [2024-10-07 11:29:01.507413] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.287 [2024-10-07 11:29:01.507434] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.287 [2024-10-07 11:29:01.507470] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.287 [2024-10-07 11:29:01.517204] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.287 [2024-10-07 11:29:01.517459] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.287 [2024-10-07 11:29:01.517514] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.287 [2024-10-07 11:29:01.517546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.287 [2024-10-07 11:29:01.517594] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.287 [2024-10-07 11:29:01.517631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.287 [2024-10-07 11:29:01.517650] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.287 [2024-10-07 11:29:01.517705] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.287 [2024-10-07 11:29:01.517745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.287 [2024-10-07 11:29:01.529502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.288 [2024-10-07 11:29:01.529886] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.288 [2024-10-07 11:29:01.529938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.288 [2024-10-07 11:29:01.529961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.288 [2024-10-07 11:29:01.530035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.288 [2024-10-07 11:29:01.530103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.288 [2024-10-07 11:29:01.530125] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.288 [2024-10-07 11:29:01.530141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.288 [2024-10-07 11:29:01.530177] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.288 [2024-10-07 11:29:01.539681] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.288 [2024-10-07 11:29:01.539931] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.288 [2024-10-07 11:29:01.539970] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.288 [2024-10-07 11:29:01.539990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.288 [2024-10-07 11:29:01.540030] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.288 [2024-10-07 11:29:01.540066] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.288 [2024-10-07 11:29:01.540084] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.288 [2024-10-07 11:29:01.540100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.288 [2024-10-07 11:29:01.540135] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.288 [2024-10-07 11:29:01.550639] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.288 [2024-10-07 11:29:01.550863] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.288 [2024-10-07 11:29:01.550901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.288 [2024-10-07 11:29:01.550920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.288 [2024-10-07 11:29:01.550961] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.288 [2024-10-07 11:29:01.550999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.288 [2024-10-07 11:29:01.551016] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.288 [2024-10-07 11:29:01.551033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.288 [2024-10-07 11:29:01.551069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.288 [2024-10-07 11:29:01.560825] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.288 [2024-10-07 11:29:01.561039] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.288 [2024-10-07 11:29:01.561130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.288 [2024-10-07 11:29:01.561153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.288 [2024-10-07 11:29:01.561194] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.288 [2024-10-07 11:29:01.561231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.288 [2024-10-07 11:29:01.561249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.288 [2024-10-07 11:29:01.561264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.288 [2024-10-07 11:29:01.561299] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.288 [2024-10-07 11:29:01.571004] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.288 [2024-10-07 11:29:01.571228] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.288 [2024-10-07 11:29:01.571265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.288 [2024-10-07 11:29:01.571284] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.288 [2024-10-07 11:29:01.571324] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.288 [2024-10-07 11:29:01.571360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.288 [2024-10-07 11:29:01.571378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.288 [2024-10-07 11:29:01.571394] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.288 [2024-10-07 11:29:01.571447] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.288 [2024-10-07 11:29:01.582199] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.288 [2024-10-07 11:29:01.582429] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.288 [2024-10-07 11:29:01.582469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.288 [2024-10-07 11:29:01.582489] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.288 [2024-10-07 11:29:01.582530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.288 [2024-10-07 11:29:01.582567] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.288 [2024-10-07 11:29:01.582585] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.288 [2024-10-07 11:29:01.582601] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.288 [2024-10-07 11:29:01.582636] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.288 [2024-10-07 11:29:01.592543] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.288 [2024-10-07 11:29:01.592755] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.288 [2024-10-07 11:29:01.592794] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.288 [2024-10-07 11:29:01.592813] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.288 [2024-10-07 11:29:01.592854] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.288 [2024-10-07 11:29:01.592919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.288 [2024-10-07 11:29:01.592938] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.288 [2024-10-07 11:29:01.592954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.288 [2024-10-07 11:29:01.592989] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.288 [2024-10-07 11:29:01.603872] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.288 [2024-10-07 11:29:01.604081] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.288 [2024-10-07 11:29:01.604119] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.288 [2024-10-07 11:29:01.604138] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.288 [2024-10-07 11:29:01.604177] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.288 [2024-10-07 11:29:01.604224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.288 [2024-10-07 11:29:01.604242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.288 [2024-10-07 11:29:01.604258] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.288 [2024-10-07 11:29:01.604293] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.288 [2024-10-07 11:29:01.614378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.288 [2024-10-07 11:29:01.614660] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.288 [2024-10-07 11:29:01.614711] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.288 [2024-10-07 11:29:01.614734] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.288 [2024-10-07 11:29:01.614783] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.288 [2024-10-07 11:29:01.614839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.288 [2024-10-07 11:29:01.614872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.288 [2024-10-07 11:29:01.614891] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.288 [2024-10-07 11:29:01.614930] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.288 [2024-10-07 11:29:01.625773] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.288 [2024-10-07 11:29:01.625975] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.288 [2024-10-07 11:29:01.626012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.288 [2024-10-07 11:29:01.626031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.288 [2024-10-07 11:29:01.626070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.288 [2024-10-07 11:29:01.626106] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.288 [2024-10-07 11:29:01.626124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.288 [2024-10-07 11:29:01.626140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.288 [2024-10-07 11:29:01.626201] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.288 [2024-10-07 11:29:01.635939] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.288 [2024-10-07 11:29:01.636155] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.288 [2024-10-07 11:29:01.636192] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.288 [2024-10-07 11:29:01.636210] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.288 [2024-10-07 11:29:01.636250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.289 [2024-10-07 11:29:01.636287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.289 [2024-10-07 11:29:01.636305] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.289 [2024-10-07 11:29:01.636320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.289 [2024-10-07 11:29:01.636356] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.289 [2024-10-07 11:29:01.646120] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.289 [2024-10-07 11:29:01.646340] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.289 [2024-10-07 11:29:01.646378] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.289 [2024-10-07 11:29:01.646397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.289 [2024-10-07 11:29:01.646460] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.289 [2024-10-07 11:29:01.646498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.289 [2024-10-07 11:29:01.646516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.289 [2024-10-07 11:29:01.646531] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.289 [2024-10-07 11:29:01.646567] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.289 [2024-10-07 11:29:01.657185] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.289 [2024-10-07 11:29:01.658135] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.289 [2024-10-07 11:29:01.658186] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.289 [2024-10-07 11:29:01.658207] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.289 [2024-10-07 11:29:01.658507] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.289 [2024-10-07 11:29:01.658609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.289 [2024-10-07 11:29:01.658639] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.289 [2024-10-07 11:29:01.658658] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.289 [2024-10-07 11:29:01.658696] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.289 [2024-10-07 11:29:01.667378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.289 [2024-10-07 11:29:01.667619] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.289 [2024-10-07 11:29:01.667657] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.289 [2024-10-07 11:29:01.667712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.289 [2024-10-07 11:29:01.667758] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.289 [2024-10-07 11:29:01.667795] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.289 [2024-10-07 11:29:01.667813] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.289 [2024-10-07 11:29:01.667829] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.289 [2024-10-07 11:29:01.667865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.289 [2024-10-07 11:29:01.677572] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.289 [2024-10-07 11:29:01.677802] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.289 [2024-10-07 11:29:01.677844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.289 [2024-10-07 11:29:01.677863] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.289 [2024-10-07 11:29:01.677906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.289 [2024-10-07 11:29:01.677958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.289 [2024-10-07 11:29:01.677981] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.289 [2024-10-07 11:29:01.677997] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.289 [2024-10-07 11:29:01.678032] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.289 [2024-10-07 11:29:01.687746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.289 [2024-10-07 11:29:01.687952] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.289 [2024-10-07 11:29:01.687989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.289 [2024-10-07 11:29:01.688007] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.289 [2024-10-07 11:29:01.688048] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.289 [2024-10-07 11:29:01.688084] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.289 [2024-10-07 11:29:01.688101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.289 [2024-10-07 11:29:01.688118] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.289 [2024-10-07 11:29:01.688167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.289 [2024-10-07 11:29:01.698705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.289 [2024-10-07 11:29:01.699088] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.289 [2024-10-07 11:29:01.699136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.289 [2024-10-07 11:29:01.699158] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.289 [2024-10-07 11:29:01.699312] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.289 [2024-10-07 11:29:01.699395] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.289 [2024-10-07 11:29:01.699474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.289 [2024-10-07 11:29:01.699494] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.289 [2024-10-07 11:29:01.699534] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.289 [2024-10-07 11:29:01.708877] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.289 [2024-10-07 11:29:01.709094] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.289 [2024-10-07 11:29:01.709132] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.289 [2024-10-07 11:29:01.709151] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.289 [2024-10-07 11:29:01.709192] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.289 [2024-10-07 11:29:01.709228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.289 [2024-10-07 11:29:01.709246] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.289 [2024-10-07 11:29:01.709263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.289 [2024-10-07 11:29:01.709299] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.289 [2024-10-07 11:29:01.719037] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.289 [2024-10-07 11:29:01.719252] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.289 [2024-10-07 11:29:01.719288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.289 [2024-10-07 11:29:01.719307] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.289 [2024-10-07 11:29:01.719346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.289 [2024-10-07 11:29:01.719382] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.289 [2024-10-07 11:29:01.719413] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.289 [2024-10-07 11:29:01.719432] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.289 [2024-10-07 11:29:01.719469] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.289 [2024-10-07 11:29:01.729209] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.289 [2024-10-07 11:29:01.729428] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.289 [2024-10-07 11:29:01.729464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.289 [2024-10-07 11:29:01.729483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.289 [2024-10-07 11:29:01.729525] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.289 [2024-10-07 11:29:01.729560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.290 [2024-10-07 11:29:01.729578] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.290 [2024-10-07 11:29:01.729593] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.290 [2024-10-07 11:29:01.729628] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.290 [2024-10-07 11:29:01.739831] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.290 [2024-10-07 11:29:01.740020] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.290 [2024-10-07 11:29:01.740058] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.290 [2024-10-07 11:29:01.740077] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.290 [2024-10-07 11:29:01.740117] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.290 [2024-10-07 11:29:01.740154] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.290 [2024-10-07 11:29:01.740171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.290 [2024-10-07 11:29:01.740188] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.290 [2024-10-07 11:29:01.740231] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.290 [2024-10-07 11:29:01.749987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.290 [2024-10-07 11:29:01.750174] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.290 [2024-10-07 11:29:01.750211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.290 [2024-10-07 11:29:01.750230] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.290 [2024-10-07 11:29:01.750269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.290 [2024-10-07 11:29:01.750316] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.290 [2024-10-07 11:29:01.750334] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.290 [2024-10-07 11:29:01.750349] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.290 [2024-10-07 11:29:01.750385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.290 [2024-10-07 11:29:01.760139] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.290 [2024-10-07 11:29:01.760337] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.290 [2024-10-07 11:29:01.760374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.290 [2024-10-07 11:29:01.760393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.290 [2024-10-07 11:29:01.760450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.290 [2024-10-07 11:29:01.760509] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.290 [2024-10-07 11:29:01.760531] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.290 [2024-10-07 11:29:01.760547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.290 [2024-10-07 11:29:01.760583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.290 [2024-10-07 11:29:01.771720] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.290 [2024-10-07 11:29:01.771988] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.290 [2024-10-07 11:29:01.772037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.290 [2024-10-07 11:29:01.772060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.290 [2024-10-07 11:29:01.772303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.290 [2024-10-07 11:29:01.772380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.290 [2024-10-07 11:29:01.772418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.290 [2024-10-07 11:29:01.772437] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.290 [2024-10-07 11:29:01.772478] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.290 [2024-10-07 11:29:01.781886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.290 [2024-10-07 11:29:01.782097] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.290 [2024-10-07 11:29:01.782135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.290 [2024-10-07 11:29:01.782155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.290 [2024-10-07 11:29:01.782195] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.290 [2024-10-07 11:29:01.782232] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.290 [2024-10-07 11:29:01.782249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.290 [2024-10-07 11:29:01.782265] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.290 [2024-10-07 11:29:01.782300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.290 [2024-10-07 11:29:01.793260] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.290 [2024-10-07 11:29:01.793480] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.290 [2024-10-07 11:29:01.793519] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.290 [2024-10-07 11:29:01.793538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.290 [2024-10-07 11:29:01.793579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.290 [2024-10-07 11:29:01.793615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.290 [2024-10-07 11:29:01.793633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.290 [2024-10-07 11:29:01.793649] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.290 [2024-10-07 11:29:01.793684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.290 [2024-10-07 11:29:01.803449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.290 [2024-10-07 11:29:01.803667] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.290 [2024-10-07 11:29:01.803706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.290 [2024-10-07 11:29:01.803726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.290 [2024-10-07 11:29:01.803766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.290 [2024-10-07 11:29:01.803802] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.290 [2024-10-07 11:29:01.803820] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.290 [2024-10-07 11:29:01.803862] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.290 [2024-10-07 11:29:01.803900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.290 [2024-10-07 11:29:01.814280] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.290 [2024-10-07 11:29:01.814498] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.290 [2024-10-07 11:29:01.814537] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.290 [2024-10-07 11:29:01.814556] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.290 [2024-10-07 11:29:01.814597] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.290 [2024-10-07 11:29:01.814648] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.290 [2024-10-07 11:29:01.814668] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.290 [2024-10-07 11:29:01.814684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.290 [2024-10-07 11:29:01.814720] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.290 [2024-10-07 11:29:01.824472] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.290 [2024-10-07 11:29:01.824699] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.290 [2024-10-07 11:29:01.824738] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.290 [2024-10-07 11:29:01.824757] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.290 [2024-10-07 11:29:01.824811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.290 [2024-10-07 11:29:01.824849] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.290 [2024-10-07 11:29:01.824867] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.290 [2024-10-07 11:29:01.824883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.290 [2024-10-07 11:29:01.824918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.290 [2024-10-07 11:29:01.835882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.290 [2024-10-07 11:29:01.836446] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.290 [2024-10-07 11:29:01.836503] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.290 [2024-10-07 11:29:01.836525] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.290 [2024-10-07 11:29:01.836635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.290 [2024-10-07 11:29:01.836694] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.290 [2024-10-07 11:29:01.836728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.290 [2024-10-07 11:29:01.836756] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.290 [2024-10-07 11:29:01.836800] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.290 [2024-10-07 11:29:01.848297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.290 [2024-10-07 11:29:01.848748] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.290 [2024-10-07 11:29:01.848797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.290 [2024-10-07 11:29:01.848817] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.291 [2024-10-07 11:29:01.848883] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.291 [2024-10-07 11:29:01.848927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.291 [2024-10-07 11:29:01.848945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.291 [2024-10-07 11:29:01.848962] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.291 [2024-10-07 11:29:01.849002] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.291 [2024-10-07 11:29:01.858706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.291 [2024-10-07 11:29:01.858937] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.291 [2024-10-07 11:29:01.858974] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.291 [2024-10-07 11:29:01.858994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.291 [2024-10-07 11:29:01.859035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.291 [2024-10-07 11:29:01.859073] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.291 [2024-10-07 11:29:01.859090] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.291 [2024-10-07 11:29:01.859106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.291 [2024-10-07 11:29:01.859142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.291 [2024-10-07 11:29:01.868898] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.291 [2024-10-07 11:29:01.869119] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.291 [2024-10-07 11:29:01.869156] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.291 [2024-10-07 11:29:01.869175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.291 [2024-10-07 11:29:01.869216] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.291 [2024-10-07 11:29:01.869252] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.291 [2024-10-07 11:29:01.869270] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.291 [2024-10-07 11:29:01.869285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.291 [2024-10-07 11:29:01.869323] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.291 [2024-10-07 11:29:01.880213] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.291 [2024-10-07 11:29:01.880741] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.291 [2024-10-07 11:29:01.880800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.291 [2024-10-07 11:29:01.880825] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.291 [2024-10-07 11:29:01.880970] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.291 [2024-10-07 11:29:01.881089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.291 [2024-10-07 11:29:01.881112] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.291 [2024-10-07 11:29:01.881131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.291 [2024-10-07 11:29:01.881178] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.291 [2024-10-07 11:29:01.890425] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.291 [2024-10-07 11:29:01.891837] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.291 [2024-10-07 11:29:01.891897] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.291 [2024-10-07 11:29:01.891920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.291 [2024-10-07 11:29:01.893132] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.291 [2024-10-07 11:29:01.893387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.291 [2024-10-07 11:29:01.893441] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.291 [2024-10-07 11:29:01.893461] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.291 [2024-10-07 11:29:01.893561] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.291 [2024-10-07 11:29:01.901880] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.291 [2024-10-07 11:29:01.903057] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.291 [2024-10-07 11:29:01.903115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.291 [2024-10-07 11:29:01.903137] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.291 [2024-10-07 11:29:01.903370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.291 [2024-10-07 11:29:01.903465] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.291 [2024-10-07 11:29:01.903489] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.291 [2024-10-07 11:29:01.903505] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.291 [2024-10-07 11:29:01.903555] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.291 [2024-10-07 11:29:01.913066] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.291 [2024-10-07 11:29:01.913265] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.291 [2024-10-07 11:29:01.913301] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.291 [2024-10-07 11:29:01.913320] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.291 [2024-10-07 11:29:01.913359] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.291 [2024-10-07 11:29:01.913396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.291 [2024-10-07 11:29:01.913435] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.291 [2024-10-07 11:29:01.913452] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.291 [2024-10-07 11:29:01.913519] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.291 [2024-10-07 11:29:01.923905] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.291 [2024-10-07 11:29:01.924777] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.291 [2024-10-07 11:29:01.924842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.291 [2024-10-07 11:29:01.924865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.291 [2024-10-07 11:29:01.925223] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.291 [2024-10-07 11:29:01.925346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.291 [2024-10-07 11:29:01.925383] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.291 [2024-10-07 11:29:01.925418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.291 [2024-10-07 11:29:01.925467] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.291 [2024-10-07 11:29:01.934624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.291 [2024-10-07 11:29:01.936028] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.291 [2024-10-07 11:29:01.936081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.291 [2024-10-07 11:29:01.936104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.291 [2024-10-07 11:29:01.937310] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.291 [2024-10-07 11:29:01.937574] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.291 [2024-10-07 11:29:01.937612] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.291 [2024-10-07 11:29:01.937632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.291 [2024-10-07 11:29:01.937699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.291 [2024-10-07 11:29:01.946461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.291 [2024-10-07 11:29:01.948210] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.291 [2024-10-07 11:29:01.948301] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.291 [2024-10-07 11:29:01.948340] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.291 [2024-10-07 11:29:01.948706] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.291 [2024-10-07 11:29:01.949837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.291 [2024-10-07 11:29:01.949884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.291 [2024-10-07 11:29:01.949905] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.291 [2024-10-07 11:29:01.951708] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.291 [2024-10-07 11:29:01.956663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.291 [2024-10-07 11:29:01.956888] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.291 [2024-10-07 11:29:01.956929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.291 [2024-10-07 11:29:01.956976] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.291 [2024-10-07 11:29:01.957020] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.291 [2024-10-07 11:29:01.957078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.291 [2024-10-07 11:29:01.957101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.291 [2024-10-07 11:29:01.957118] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.291 [2024-10-07 11:29:01.957157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.291 [2024-10-07 11:29:01.967851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.291 [2024-10-07 11:29:01.968041] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.292 [2024-10-07 11:29:01.968078] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.292 [2024-10-07 11:29:01.968097] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.292 [2024-10-07 11:29:01.968137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.292 [2024-10-07 11:29:01.968173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.292 [2024-10-07 11:29:01.968190] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.292 [2024-10-07 11:29:01.968207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.292 [2024-10-07 11:29:01.968255] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.292 [2024-10-07 11:29:01.978001] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.292 [2024-10-07 11:29:01.979183] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.292 [2024-10-07 11:29:01.979240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.292 [2024-10-07 11:29:01.979263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.292 [2024-10-07 11:29:01.979521] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.292 [2024-10-07 11:29:01.979661] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.292 [2024-10-07 11:29:01.979691] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.292 [2024-10-07 11:29:01.979710] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.292 [2024-10-07 11:29:01.980930] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.292 [2024-10-07 11:29:01.989453] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.292 [2024-10-07 11:29:01.991033] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.292 [2024-10-07 11:29:01.991095] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.292 [2024-10-07 11:29:01.991119] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.292 [2024-10-07 11:29:01.991344] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.292 [2024-10-07 11:29:01.992447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.292 [2024-10-07 11:29:01.992497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.292 [2024-10-07 11:29:01.992518] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.292 [2024-10-07 11:29:01.993764] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.292 [2024-10-07 11:29:01.999626] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.292 [2024-10-07 11:29:01.999794] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.292 [2024-10-07 11:29:01.999831] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.292 [2024-10-07 11:29:01.999849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.292 [2024-10-07 11:29:01.999887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.292 [2024-10-07 11:29:01.999923] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.292 [2024-10-07 11:29:01.999940] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.292 [2024-10-07 11:29:01.999956] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.292 [2024-10-07 11:29:01.999991] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.292 [2024-10-07 11:29:02.011113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.292 [2024-10-07 11:29:02.011316] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.292 [2024-10-07 11:29:02.011354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.292 [2024-10-07 11:29:02.011373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.292 [2024-10-07 11:29:02.011429] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.292 [2024-10-07 11:29:02.011470] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.292 [2024-10-07 11:29:02.011488] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.292 [2024-10-07 11:29:02.011504] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.292 [2024-10-07 11:29:02.011540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.292 [2024-10-07 11:29:02.021276] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.292 [2024-10-07 11:29:02.021491] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.292 [2024-10-07 11:29:02.021530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.292 [2024-10-07 11:29:02.021550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.292 [2024-10-07 11:29:02.021592] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.292 [2024-10-07 11:29:02.021629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.292 [2024-10-07 11:29:02.021646] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.292 [2024-10-07 11:29:02.021662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.292 [2024-10-07 11:29:02.021698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.292 [2024-10-07 11:29:02.031464] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.292 [2024-10-07 11:29:02.031649] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.292 [2024-10-07 11:29:02.031686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.292 [2024-10-07 11:29:02.031704] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.292 [2024-10-07 11:29:02.032674] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.292 [2024-10-07 11:29:02.032915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.292 [2024-10-07 11:29:02.032954] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.292 [2024-10-07 11:29:02.032973] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.292 [2024-10-07 11:29:02.033074] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.292 [2024-10-07 11:29:02.042739] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.292 [2024-10-07 11:29:02.043143] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.292 [2024-10-07 11:29:02.043192] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.292 [2024-10-07 11:29:02.043221] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.292 [2024-10-07 11:29:02.043318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.292 [2024-10-07 11:29:02.043363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.292 [2024-10-07 11:29:02.043382] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.292 [2024-10-07 11:29:02.043413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.292 [2024-10-07 11:29:02.043481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.292 [2024-10-07 11:29:02.052878] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.292 [2024-10-07 11:29:02.053078] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.292 [2024-10-07 11:29:02.053117] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.292 [2024-10-07 11:29:02.053136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.292 [2024-10-07 11:29:02.054349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.292 [2024-10-07 11:29:02.055587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.292 [2024-10-07 11:29:02.055629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.292 [2024-10-07 11:29:02.055650] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.292 [2024-10-07 11:29:02.055878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.292 [2024-10-07 11:29:02.063177] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.292 [2024-10-07 11:29:02.063355] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.292 [2024-10-07 11:29:02.063392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.292 [2024-10-07 11:29:02.063459] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.292 [2024-10-07 11:29:02.063502] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.292 [2024-10-07 11:29:02.064629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.292 [2024-10-07 11:29:02.064662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.292 [2024-10-07 11:29:02.064679] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.292 [2024-10-07 11:29:02.064900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.292 [2024-10-07 11:29:02.073323] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.292 [2024-10-07 11:29:02.073747] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.292 [2024-10-07 11:29:02.073797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.292 [2024-10-07 11:29:02.073819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.292 [2024-10-07 11:29:02.073897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.292 [2024-10-07 11:29:02.073940] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.292 [2024-10-07 11:29:02.073958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.292 [2024-10-07 11:29:02.073975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.292 [2024-10-07 11:29:02.074011] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.293 [2024-10-07 11:29:02.085638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.293 [2024-10-07 11:29:02.085878] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.293 [2024-10-07 11:29:02.085921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.293 [2024-10-07 11:29:02.085941] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.293 [2024-10-07 11:29:02.085981] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.293 [2024-10-07 11:29:02.086018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.293 [2024-10-07 11:29:02.086036] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.293 [2024-10-07 11:29:02.086052] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.293 [2024-10-07 11:29:02.086090] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.293 [2024-10-07 11:29:02.095812] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.293 [2024-10-07 11:29:02.096005] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.293 [2024-10-07 11:29:02.096042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.293 [2024-10-07 11:29:02.096061] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.293 [2024-10-07 11:29:02.096100] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.293 [2024-10-07 11:29:02.096136] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.293 [2024-10-07 11:29:02.096185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.293 [2024-10-07 11:29:02.096202] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.293 [2024-10-07 11:29:02.097254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.293 8252.80 IOPS, 32.24 MiB/s [2024-10-07T11:29:08.004Z] [2024-10-07 11:29:02.105965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.293 [2024-10-07 11:29:02.106144] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.293 [2024-10-07 11:29:02.106181] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.293 [2024-10-07 11:29:02.106199] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.293 [2024-10-07 11:29:02.107156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.293 [2024-10-07 11:29:02.107388] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.293 [2024-10-07 11:29:02.107450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.293 [2024-10-07 11:29:02.107472] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.293 [2024-10-07 11:29:02.108637] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.293 [2024-10-07 11:29:02.116965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.293 [2024-10-07 11:29:02.117420] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.293 [2024-10-07 11:29:02.117470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.293 [2024-10-07 11:29:02.117493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.293 [2024-10-07 11:29:02.117574] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.293 [2024-10-07 11:29:02.117639] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.293 [2024-10-07 11:29:02.117670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.293 [2024-10-07 11:29:02.117689] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.293 [2024-10-07 11:29:02.117727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.293 [2024-10-07 11:29:02.129602] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.293 [2024-10-07 11:29:02.129856] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.293 [2024-10-07 11:29:02.129907] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.293 [2024-10-07 11:29:02.129929] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.293 [2024-10-07 11:29:02.129971] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.293 [2024-10-07 11:29:02.130009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.293 [2024-10-07 11:29:02.130026] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.293 [2024-10-07 11:29:02.130041] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.293 [2024-10-07 11:29:02.130077] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.293 [2024-10-07 11:29:02.139804] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.293 [2024-10-07 11:29:02.139979] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.293 [2024-10-07 11:29:02.140016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.293 [2024-10-07 11:29:02.140035] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.293 [2024-10-07 11:29:02.140073] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.293 [2024-10-07 11:29:02.140109] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.293 [2024-10-07 11:29:02.140127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.293 [2024-10-07 11:29:02.140143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.293 [2024-10-07 11:29:02.140177] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.293 [2024-10-07 11:29:02.144076] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1471a00 was disconnected and freed. reset controller. 00:18:26.293 [2024-10-07 11:29:02.144466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.293 [2024-10-07 11:29:02.144578] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.293 [2024-10-07 11:29:02.145188] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.293 [2024-10-07 11:29:02.145243] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.293 [2024-10-07 11:29:02.145265] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.293 [2024-10-07 11:29:02.145291] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.293 [2024-10-07 11:29:02.145324] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.293 [2024-10-07 11:29:02.150533] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.293 [2024-10-07 11:29:02.150740] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.293 [2024-10-07 11:29:02.150778] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.293 [2024-10-07 11:29:02.150797] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.293 [2024-10-07 11:29:02.150833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.293 [2024-10-07 11:29:02.150865] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.293 [2024-10-07 11:29:02.150882] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.293 [2024-10-07 11:29:02.150898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.293 [2024-10-07 11:29:02.150931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.293 [2024-10-07 11:29:02.155219] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.293 [2024-10-07 11:29:02.155382] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.293 [2024-10-07 11:29:02.155434] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.293 [2024-10-07 11:29:02.155454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.293 [2024-10-07 11:29:02.155490] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.293 [2024-10-07 11:29:02.155557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.293 [2024-10-07 11:29:02.155576] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.293 [2024-10-07 11:29:02.155592] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.293 [2024-10-07 11:29:02.156616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.293 [2024-10-07 11:29:02.161778] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.293 [2024-10-07 11:29:02.162178] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.293 [2024-10-07 11:29:02.162226] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.293 [2024-10-07 11:29:02.162249] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.293 [2024-10-07 11:29:02.162324] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.294 [2024-10-07 11:29:02.162363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.294 [2024-10-07 11:29:02.162380] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.294 [2024-10-07 11:29:02.162396] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.294 [2024-10-07 11:29:02.162447] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.294 [2024-10-07 11:29:02.165346] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.294 [2024-10-07 11:29:02.165490] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.294 [2024-10-07 11:29:02.165524] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.294 [2024-10-07 11:29:02.165542] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.294 [2024-10-07 11:29:02.165576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.294 [2024-10-07 11:29:02.166517] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.294 [2024-10-07 11:29:02.166555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.294 [2024-10-07 11:29:02.166575] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.294 [2024-10-07 11:29:02.166777] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.294 [2024-10-07 11:29:02.173981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.294 [2024-10-07 11:29:02.174253] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.294 [2024-10-07 11:29:02.174299] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.294 [2024-10-07 11:29:02.174321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.294 [2024-10-07 11:29:02.174380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.294 [2024-10-07 11:29:02.174437] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.294 [2024-10-07 11:29:02.174457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.294 [2024-10-07 11:29:02.174472] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.294 [2024-10-07 11:29:02.174542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.294 [2024-10-07 11:29:02.176220] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.294 [2024-10-07 11:29:02.176587] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.294 [2024-10-07 11:29:02.176630] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.294 [2024-10-07 11:29:02.176651] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.294 [2024-10-07 11:29:02.176724] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.294 [2024-10-07 11:29:02.176762] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.294 [2024-10-07 11:29:02.176781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.294 [2024-10-07 11:29:02.176796] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.294 [2024-10-07 11:29:02.176827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.294 [2024-10-07 11:29:02.184105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.294 [2024-10-07 11:29:02.184252] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.294 [2024-10-07 11:29:02.184285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.294 [2024-10-07 11:29:02.184302] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.294 [2024-10-07 11:29:02.184336] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.294 [2024-10-07 11:29:02.184366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.294 [2024-10-07 11:29:02.184383] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.294 [2024-10-07 11:29:02.184413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.294 [2024-10-07 11:29:02.184449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.294 [2024-10-07 11:29:02.188450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.294 [2024-10-07 11:29:02.188705] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.294 [2024-10-07 11:29:02.188751] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.294 [2024-10-07 11:29:02.188772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.294 [2024-10-07 11:29:02.188831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.294 [2024-10-07 11:29:02.188868] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.294 [2024-10-07 11:29:02.188886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.294 [2024-10-07 11:29:02.188902] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.294 [2024-10-07 11:29:02.188933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.294 [2024-10-07 11:29:02.195092] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.294 [2024-10-07 11:29:02.195286] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.294 [2024-10-07 11:29:02.195363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.294 [2024-10-07 11:29:02.195386] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.294 [2024-10-07 11:29:02.195439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.294 [2024-10-07 11:29:02.195474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.294 [2024-10-07 11:29:02.195491] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.294 [2024-10-07 11:29:02.195507] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.294 [2024-10-07 11:29:02.195538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.294 [2024-10-07 11:29:02.198742] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.294 [2024-10-07 11:29:02.198877] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.294 [2024-10-07 11:29:02.198909] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.294 [2024-10-07 11:29:02.198926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.294 [2024-10-07 11:29:02.199950] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.294 [2024-10-07 11:29:02.200190] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.294 [2024-10-07 11:29:02.200227] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.294 [2024-10-07 11:29:02.200246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.294 [2024-10-07 11:29:02.200308] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.294 [2024-10-07 11:29:02.205209] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.294 [2024-10-07 11:29:02.205371] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.294 [2024-10-07 11:29:02.205421] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.294 [2024-10-07 11:29:02.205450] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.294 [2024-10-07 11:29:02.205495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.294 [2024-10-07 11:29:02.205528] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.294 [2024-10-07 11:29:02.205546] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.294 [2024-10-07 11:29:02.205562] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.294 [2024-10-07 11:29:02.205594] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.294 [2024-10-07 11:29:02.208846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.294 [2024-10-07 11:29:02.208984] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.294 [2024-10-07 11:29:02.209018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.294 [2024-10-07 11:29:02.209036] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.294 [2024-10-07 11:29:02.209087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.294 [2024-10-07 11:29:02.209149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.294 [2024-10-07 11:29:02.209168] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.294 [2024-10-07 11:29:02.209183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.294 [2024-10-07 11:29:02.209215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.294 [2024-10-07 11:29:02.215332] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.294 [2024-10-07 11:29:02.215540] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.294 [2024-10-07 11:29:02.215578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.294 [2024-10-07 11:29:02.215607] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.294 [2024-10-07 11:29:02.215642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.294 [2024-10-07 11:29:02.216684] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.294 [2024-10-07 11:29:02.216724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.294 [2024-10-07 11:29:02.216744] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.294 [2024-10-07 11:29:02.217005] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.294 [2024-10-07 11:29:02.219714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.294 [2024-10-07 11:29:02.219857] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.294 [2024-10-07 11:29:02.219893] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.295 [2024-10-07 11:29:02.219911] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.295 [2024-10-07 11:29:02.219947] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.295 [2024-10-07 11:29:02.219978] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.295 [2024-10-07 11:29:02.219996] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.295 [2024-10-07 11:29:02.220012] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.295 [2024-10-07 11:29:02.220043] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.295 [2024-10-07 11:29:02.225487] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.295 [2024-10-07 11:29:02.225639] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.295 [2024-10-07 11:29:02.225673] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.295 [2024-10-07 11:29:02.225691] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.295 [2024-10-07 11:29:02.225725] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.295 [2024-10-07 11:29:02.226699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.295 [2024-10-07 11:29:02.226743] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.295 [2024-10-07 11:29:02.226764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.295 [2024-10-07 11:29:02.226987] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.295 [2024-10-07 11:29:02.229869] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.295 [2024-10-07 11:29:02.230012] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.295 [2024-10-07 11:29:02.230046] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.295 [2024-10-07 11:29:02.230064] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.295 [2024-10-07 11:29:02.230099] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.295 [2024-10-07 11:29:02.230130] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.295 [2024-10-07 11:29:02.230147] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.295 [2024-10-07 11:29:02.230163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.295 [2024-10-07 11:29:02.230193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.295 [2024-10-07 11:29:02.236777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.295 [2024-10-07 11:29:02.237215] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.295 [2024-10-07 11:29:02.237263] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.295 [2024-10-07 11:29:02.237294] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.295 [2024-10-07 11:29:02.237370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.295 [2024-10-07 11:29:02.237434] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.295 [2024-10-07 11:29:02.237458] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.295 [2024-10-07 11:29:02.237474] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.295 [2024-10-07 11:29:02.237507] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.295 [2024-10-07 11:29:02.240001] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.295 [2024-10-07 11:29:02.240126] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.295 [2024-10-07 11:29:02.240160] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.295 [2024-10-07 11:29:02.240178] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.295 [2024-10-07 11:29:02.240211] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.295 [2024-10-07 11:29:02.240242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.295 [2024-10-07 11:29:02.240259] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.295 [2024-10-07 11:29:02.240274] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.295 [2024-10-07 11:29:02.240304] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.295 [2024-10-07 11:29:02.249194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.295 [2024-10-07 11:29:02.249429] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.295 [2024-10-07 11:29:02.249468] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.295 [2024-10-07 11:29:02.249513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.295 [2024-10-07 11:29:02.249554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.295 [2024-10-07 11:29:02.249587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.295 [2024-10-07 11:29:02.249603] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.295 [2024-10-07 11:29:02.249619] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.295 [2024-10-07 11:29:02.249651] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.295 [2024-10-07 11:29:02.251263] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.295 [2024-10-07 11:29:02.251636] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.295 [2024-10-07 11:29:02.251681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.295 [2024-10-07 11:29:02.251702] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.295 [2024-10-07 11:29:02.251775] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.295 [2024-10-07 11:29:02.251835] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.295 [2024-10-07 11:29:02.251857] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.295 [2024-10-07 11:29:02.251872] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.295 [2024-10-07 11:29:02.251903] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.295 [2024-10-07 11:29:02.259349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.295 [2024-10-07 11:29:02.259519] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.295 [2024-10-07 11:29:02.259555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.295 [2024-10-07 11:29:02.259573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.295 [2024-10-07 11:29:02.260593] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.295 [2024-10-07 11:29:02.260835] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.295 [2024-10-07 11:29:02.260871] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.295 [2024-10-07 11:29:02.260890] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.295 [2024-10-07 11:29:02.262134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.295 [2024-10-07 11:29:02.263541] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.295 [2024-10-07 11:29:02.263689] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.295 [2024-10-07 11:29:02.263728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.295 [2024-10-07 11:29:02.263748] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.295 [2024-10-07 11:29:02.263781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.295 [2024-10-07 11:29:02.263813] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.295 [2024-10-07 11:29:02.263860] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.295 [2024-10-07 11:29:02.263876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.295 [2024-10-07 11:29:02.263909] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.295 [2024-10-07 11:29:02.270569] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.295 [2024-10-07 11:29:02.270720] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.295 [2024-10-07 11:29:02.270754] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.295 [2024-10-07 11:29:02.270773] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.295 [2024-10-07 11:29:02.271896] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.295 [2024-10-07 11:29:02.272136] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.295 [2024-10-07 11:29:02.272174] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.295 [2024-10-07 11:29:02.272193] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.295 [2024-10-07 11:29:02.273298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.295 [2024-10-07 11:29:02.273646] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.295 [2024-10-07 11:29:02.273779] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.295 [2024-10-07 11:29:02.273813] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.295 [2024-10-07 11:29:02.273832] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.295 [2024-10-07 11:29:02.273865] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.295 [2024-10-07 11:29:02.273896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.295 [2024-10-07 11:29:02.273914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.295 [2024-10-07 11:29:02.273929] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.295 [2024-10-07 11:29:02.274957] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.295 [2024-10-07 11:29:02.280697] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.296 [2024-10-07 11:29:02.280913] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.296 [2024-10-07 11:29:02.280951] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.296 [2024-10-07 11:29:02.280970] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.296 [2024-10-07 11:29:02.281007] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.296 [2024-10-07 11:29:02.281039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.296 [2024-10-07 11:29:02.281073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.296 [2024-10-07 11:29:02.281091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.296 [2024-10-07 11:29:02.281124] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.296 [2024-10-07 11:29:02.283748] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.296 [2024-10-07 11:29:02.283931] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.296 [2024-10-07 11:29:02.283966] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.296 [2024-10-07 11:29:02.283985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.296 [2024-10-07 11:29:02.284940] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.296 [2024-10-07 11:29:02.285194] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.296 [2024-10-07 11:29:02.285230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.296 [2024-10-07 11:29:02.285249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.296 [2024-10-07 11:29:02.285332] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.296 [2024-10-07 11:29:02.292562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.296 [2024-10-07 11:29:02.292809] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.296 [2024-10-07 11:29:02.292848] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.296 [2024-10-07 11:29:02.292867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.296 [2024-10-07 11:29:02.292904] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.296 [2024-10-07 11:29:02.292937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.296 [2024-10-07 11:29:02.292955] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.296 [2024-10-07 11:29:02.292971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.296 [2024-10-07 11:29:02.293001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.296 [2024-10-07 11:29:02.294671] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.296 [2024-10-07 11:29:02.295028] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.296 [2024-10-07 11:29:02.295062] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.296 [2024-10-07 11:29:02.295079] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.296 [2024-10-07 11:29:02.295149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.296 [2024-10-07 11:29:02.295208] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.296 [2024-10-07 11:29:02.295230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.296 [2024-10-07 11:29:02.295244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.296 [2024-10-07 11:29:02.295276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.296 [2024-10-07 11:29:02.302735] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.296 [2024-10-07 11:29:02.302927] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.296 [2024-10-07 11:29:02.302963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.296 [2024-10-07 11:29:02.302981] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.296 [2024-10-07 11:29:02.304049] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.296 [2024-10-07 11:29:02.304302] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.296 [2024-10-07 11:29:02.304340] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.296 [2024-10-07 11:29:02.304360] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.296 [2024-10-07 11:29:02.304509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.296 [2024-10-07 11:29:02.307070] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.296 [2024-10-07 11:29:02.307263] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.296 [2024-10-07 11:29:02.307303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.296 [2024-10-07 11:29:02.307322] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.296 [2024-10-07 11:29:02.307358] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.296 [2024-10-07 11:29:02.307390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.296 [2024-10-07 11:29:02.307425] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.296 [2024-10-07 11:29:02.307442] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.296 [2024-10-07 11:29:02.307476] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.296 [2024-10-07 11:29:02.312885] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.296 [2024-10-07 11:29:02.314011] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.296 [2024-10-07 11:29:02.314060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.296 [2024-10-07 11:29:02.314082] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.296 [2024-10-07 11:29:02.314285] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.296 [2024-10-07 11:29:02.315451] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.296 [2024-10-07 11:29:02.315488] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.296 [2024-10-07 11:29:02.315508] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.296 [2024-10-07 11:29:02.315725] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.296 [2024-10-07 11:29:02.317187] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.296 [2024-10-07 11:29:02.317317] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.296 [2024-10-07 11:29:02.317349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.296 [2024-10-07 11:29:02.317367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.296 [2024-10-07 11:29:02.317415] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.296 [2024-10-07 11:29:02.317451] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.296 [2024-10-07 11:29:02.317468] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.296 [2024-10-07 11:29:02.317507] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.296 [2024-10-07 11:29:02.318529] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.296 [2024-10-07 11:29:02.323636] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.296 [2024-10-07 11:29:02.324022] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.296 [2024-10-07 11:29:02.324068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.296 [2024-10-07 11:29:02.324089] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.296 [2024-10-07 11:29:02.324163] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.296 [2024-10-07 11:29:02.324202] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.296 [2024-10-07 11:29:02.324219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.296 [2024-10-07 11:29:02.324235] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.296 [2024-10-07 11:29:02.324266] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.296 [2024-10-07 11:29:02.327280] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.296 [2024-10-07 11:29:02.327415] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.296 [2024-10-07 11:29:02.327449] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.296 [2024-10-07 11:29:02.327466] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.296 [2024-10-07 11:29:02.328391] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.296 [2024-10-07 11:29:02.328627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.296 [2024-10-07 11:29:02.328662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.296 [2024-10-07 11:29:02.328680] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.296 [2024-10-07 11:29:02.328761] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.296 [2024-10-07 11:29:02.335908] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.296 [2024-10-07 11:29:02.336109] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.296 [2024-10-07 11:29:02.336143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.296 [2024-10-07 11:29:02.336162] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.296 [2024-10-07 11:29:02.336198] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.297 [2024-10-07 11:29:02.336230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.297 [2024-10-07 11:29:02.336248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.297 [2024-10-07 11:29:02.336263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.297 [2024-10-07 11:29:02.336293] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.297 [2024-10-07 11:29:02.338018] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.297 [2024-10-07 11:29:02.338390] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.297 [2024-10-07 11:29:02.338448] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.297 [2024-10-07 11:29:02.338469] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.297 [2024-10-07 11:29:02.338543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.297 [2024-10-07 11:29:02.338600] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.297 [2024-10-07 11:29:02.338622] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.297 [2024-10-07 11:29:02.338636] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.297 [2024-10-07 11:29:02.338667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.297 [2024-10-07 11:29:02.346047] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.297 [2024-10-07 11:29:02.346193] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.297 [2024-10-07 11:29:02.346225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.297 [2024-10-07 11:29:02.346243] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.297 [2024-10-07 11:29:02.346277] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.297 [2024-10-07 11:29:02.347297] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.297 [2024-10-07 11:29:02.347336] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.297 [2024-10-07 11:29:02.347355] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.297 [2024-10-07 11:29:02.347603] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.297 [2024-10-07 11:29:02.350256] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.297 [2024-10-07 11:29:02.350423] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.297 [2024-10-07 11:29:02.350457] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.297 [2024-10-07 11:29:02.350476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.297 [2024-10-07 11:29:02.350510] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.297 [2024-10-07 11:29:02.350542] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.297 [2024-10-07 11:29:02.350559] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.297 [2024-10-07 11:29:02.350574] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.297 [2024-10-07 11:29:02.350604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.297 [2024-10-07 11:29:02.356165] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.297 [2024-10-07 11:29:02.357241] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.297 [2024-10-07 11:29:02.357291] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.297 [2024-10-07 11:29:02.357312] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.297 [2024-10-07 11:29:02.357526] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.297 [2024-10-07 11:29:02.357654] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.297 [2024-10-07 11:29:02.357677] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.297 [2024-10-07 11:29:02.357693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.297 [2024-10-07 11:29:02.357726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.297 [2024-10-07 11:29:02.360371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.297 [2024-10-07 11:29:02.360503] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.297 [2024-10-07 11:29:02.360535] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.297 [2024-10-07 11:29:02.360553] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.297 [2024-10-07 11:29:02.360585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.297 [2024-10-07 11:29:02.360616] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.297 [2024-10-07 11:29:02.360634] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.297 [2024-10-07 11:29:02.360648] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.297 [2024-10-07 11:29:02.360678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.297 [2024-10-07 11:29:02.367100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.297 [2024-10-07 11:29:02.367504] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.297 [2024-10-07 11:29:02.367549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.297 [2024-10-07 11:29:02.367571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.297 [2024-10-07 11:29:02.367646] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.297 [2024-10-07 11:29:02.367685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.297 [2024-10-07 11:29:02.367703] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.297 [2024-10-07 11:29:02.367718] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.297 [2024-10-07 11:29:02.367749] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.297 [2024-10-07 11:29:02.370480] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.297 [2024-10-07 11:29:02.370600] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.297 [2024-10-07 11:29:02.370632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.297 [2024-10-07 11:29:02.370650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.297 [2024-10-07 11:29:02.370682] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.297 [2024-10-07 11:29:02.370713] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.297 [2024-10-07 11:29:02.370730] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.297 [2024-10-07 11:29:02.370745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.297 [2024-10-07 11:29:02.370803] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.297 [2024-10-07 11:29:02.379418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.297 [2024-10-07 11:29:02.379669] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.297 [2024-10-07 11:29:02.379708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.297 [2024-10-07 11:29:02.379727] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.297 [2024-10-07 11:29:02.379765] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.297 [2024-10-07 11:29:02.379798] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.297 [2024-10-07 11:29:02.379816] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.297 [2024-10-07 11:29:02.379832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.297 [2024-10-07 11:29:02.379872] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.297 [2024-10-07 11:29:02.381851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.297 [2024-10-07 11:29:02.382225] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.297 [2024-10-07 11:29:02.382272] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.297 [2024-10-07 11:29:02.382295] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.297 [2024-10-07 11:29:02.382388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.297 [2024-10-07 11:29:02.382468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.297 [2024-10-07 11:29:02.382497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.297 [2024-10-07 11:29:02.382513] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.297 [2024-10-07 11:29:02.382546] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.297 [2024-10-07 11:29:02.389733] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.297 [2024-10-07 11:29:02.389893] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.297 [2024-10-07 11:29:02.389928] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.297 [2024-10-07 11:29:02.389947] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.297 [2024-10-07 11:29:02.389982] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.297 [2024-10-07 11:29:02.390013] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.297 [2024-10-07 11:29:02.390030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.297 [2024-10-07 11:29:02.390045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.297 [2024-10-07 11:29:02.390076] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.298 [2024-10-07 11:29:02.394005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.298 [2024-10-07 11:29:02.394243] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.298 [2024-10-07 11:29:02.394287] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.298 [2024-10-07 11:29:02.394332] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.298 [2024-10-07 11:29:02.394393] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.298 [2024-10-07 11:29:02.394450] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.298 [2024-10-07 11:29:02.394470] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.298 [2024-10-07 11:29:02.394484] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.298 [2024-10-07 11:29:02.394515] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.298 [2024-10-07 11:29:02.399860] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.298 [2024-10-07 11:29:02.399991] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.298 [2024-10-07 11:29:02.400023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.298 [2024-10-07 11:29:02.400040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.298 [2024-10-07 11:29:02.400073] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.298 [2024-10-07 11:29:02.400104] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.298 [2024-10-07 11:29:02.400121] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.298 [2024-10-07 11:29:02.400136] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.298 [2024-10-07 11:29:02.400167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.298 [2024-10-07 11:29:02.404177] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.298 [2024-10-07 11:29:02.404301] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.298 [2024-10-07 11:29:02.404334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.298 [2024-10-07 11:29:02.404351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.298 [2024-10-07 11:29:02.404383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.298 [2024-10-07 11:29:02.404431] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.298 [2024-10-07 11:29:02.404452] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.298 [2024-10-07 11:29:02.404467] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.298 [2024-10-07 11:29:02.404497] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.298 [2024-10-07 11:29:02.410832] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.298 [2024-10-07 11:29:02.411213] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.298 [2024-10-07 11:29:02.411258] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.298 [2024-10-07 11:29:02.411279] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.298 [2024-10-07 11:29:02.411352] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.298 [2024-10-07 11:29:02.411422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.298 [2024-10-07 11:29:02.411475] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.298 [2024-10-07 11:29:02.411492] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.298 [2024-10-07 11:29:02.411525] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.298 [2024-10-07 11:29:02.414277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.298 [2024-10-07 11:29:02.414394] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.298 [2024-10-07 11:29:02.414439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.298 [2024-10-07 11:29:02.414458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.298 [2024-10-07 11:29:02.414491] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.298 [2024-10-07 11:29:02.414522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.298 [2024-10-07 11:29:02.414540] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.298 [2024-10-07 11:29:02.414554] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.298 [2024-10-07 11:29:02.414585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.298 [2024-10-07 11:29:02.423179] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.298 [2024-10-07 11:29:02.423564] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.298 [2024-10-07 11:29:02.423622] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.298 [2024-10-07 11:29:02.423650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.298 [2024-10-07 11:29:02.423724] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.298 [2024-10-07 11:29:02.423791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.298 [2024-10-07 11:29:02.423818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.298 [2024-10-07 11:29:02.423841] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.298 [2024-10-07 11:29:02.423881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.298 [2024-10-07 11:29:02.425951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.298 [2024-10-07 11:29:02.426164] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.298 [2024-10-07 11:29:02.426216] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.298 [2024-10-07 11:29:02.426242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.298 [2024-10-07 11:29:02.426285] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.298 [2024-10-07 11:29:02.426324] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.298 [2024-10-07 11:29:02.426348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.298 [2024-10-07 11:29:02.426368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.298 [2024-10-07 11:29:02.426423] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.298 [2024-10-07 11:29:02.433861] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.298 [2024-10-07 11:29:02.434056] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.298 [2024-10-07 11:29:02.434093] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.298 [2024-10-07 11:29:02.434112] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.298 [2024-10-07 11:29:02.434149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.298 [2024-10-07 11:29:02.434181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.298 [2024-10-07 11:29:02.434198] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.298 [2024-10-07 11:29:02.434213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.298 [2024-10-07 11:29:02.434245] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.298 [2024-10-07 11:29:02.438491] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.298 [2024-10-07 11:29:02.438707] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.298 [2024-10-07 11:29:02.438767] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.298 [2024-10-07 11:29:02.438801] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.298 [2024-10-07 11:29:02.438857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.298 [2024-10-07 11:29:02.438909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.298 [2024-10-07 11:29:02.438940] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.298 [2024-10-07 11:29:02.438969] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.298 [2024-10-07 11:29:02.439018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.298 [2024-10-07 11:29:02.444030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.299 [2024-10-07 11:29:02.444177] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.299 [2024-10-07 11:29:02.444212] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.299 [2024-10-07 11:29:02.444231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.299 [2024-10-07 11:29:02.444265] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.299 [2024-10-07 11:29:02.444297] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.299 [2024-10-07 11:29:02.444315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.299 [2024-10-07 11:29:02.444330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.299 [2024-10-07 11:29:02.444361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.299 [2024-10-07 11:29:02.448618] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.299 [2024-10-07 11:29:02.448756] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.299 [2024-10-07 11:29:02.448789] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.299 [2024-10-07 11:29:02.448842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.299 [2024-10-07 11:29:02.448880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.299 [2024-10-07 11:29:02.448913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.299 [2024-10-07 11:29:02.448930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.299 [2024-10-07 11:29:02.448944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.299 [2024-10-07 11:29:02.448975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.299 [2024-10-07 11:29:02.455453] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.299 [2024-10-07 11:29:02.455904] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.299 [2024-10-07 11:29:02.455954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.299 [2024-10-07 11:29:02.455976] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.299 [2024-10-07 11:29:02.456052] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.299 [2024-10-07 11:29:02.456092] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.299 [2024-10-07 11:29:02.456110] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.299 [2024-10-07 11:29:02.456125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.299 [2024-10-07 11:29:02.456156] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.299 [2024-10-07 11:29:02.458775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.299 [2024-10-07 11:29:02.458944] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.299 [2024-10-07 11:29:02.458990] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.299 [2024-10-07 11:29:02.459011] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.299 [2024-10-07 11:29:02.459048] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.299 [2024-10-07 11:29:02.459080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.299 [2024-10-07 11:29:02.459098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.299 [2024-10-07 11:29:02.459113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.299 [2024-10-07 11:29:02.459143] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.299 [2024-10-07 11:29:02.468286] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.299 [2024-10-07 11:29:02.468523] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.299 [2024-10-07 11:29:02.468561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.299 [2024-10-07 11:29:02.468580] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.299 [2024-10-07 11:29:02.468616] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.299 [2024-10-07 11:29:02.468649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.299 [2024-10-07 11:29:02.468701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.299 [2024-10-07 11:29:02.468718] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.299 [2024-10-07 11:29:02.468752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.299 [2024-10-07 11:29:02.470264] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.299 [2024-10-07 11:29:02.470636] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.299 [2024-10-07 11:29:02.470681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.299 [2024-10-07 11:29:02.470701] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.299 [2024-10-07 11:29:02.470773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.299 [2024-10-07 11:29:02.470833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.299 [2024-10-07 11:29:02.470854] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.299 [2024-10-07 11:29:02.470868] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.299 [2024-10-07 11:29:02.470900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.299 [2024-10-07 11:29:02.478551] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.299 [2024-10-07 11:29:02.478744] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.299 [2024-10-07 11:29:02.478780] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.299 [2024-10-07 11:29:02.478799] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.299 [2024-10-07 11:29:02.478834] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.299 [2024-10-07 11:29:02.478867] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.299 [2024-10-07 11:29:02.478884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.299 [2024-10-07 11:29:02.478899] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.299 [2024-10-07 11:29:02.478933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.299 [2024-10-07 11:29:02.480371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.299 [2024-10-07 11:29:02.480519] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.299 [2024-10-07 11:29:02.480577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.299 [2024-10-07 11:29:02.480610] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.299 [2024-10-07 11:29:02.481960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.299 [2024-10-07 11:29:02.483196] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.299 [2024-10-07 11:29:02.483239] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.299 [2024-10-07 11:29:02.483259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.299 [2024-10-07 11:29:02.483500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.299 [2024-10-07 11:29:02.488715] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.299 [2024-10-07 11:29:02.488975] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.299 [2024-10-07 11:29:02.489024] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.299 [2024-10-07 11:29:02.489045] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.299 [2024-10-07 11:29:02.489113] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.299 [2024-10-07 11:29:02.489148] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.299 [2024-10-07 11:29:02.489166] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.299 [2024-10-07 11:29:02.489182] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.299 [2024-10-07 11:29:02.489214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.299 [2024-10-07 11:29:02.490673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.299 [2024-10-07 11:29:02.490816] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.299 [2024-10-07 11:29:02.490850] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.299 [2024-10-07 11:29:02.490868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.299 [2024-10-07 11:29:02.490903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.299 [2024-10-07 11:29:02.490934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.299 [2024-10-07 11:29:02.490951] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.299 [2024-10-07 11:29:02.490966] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.299 [2024-10-07 11:29:02.491001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.299 [2024-10-07 11:29:02.499444] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.300 [2024-10-07 11:29:02.499866] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.300 [2024-10-07 11:29:02.499926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.300 [2024-10-07 11:29:02.499954] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.300 [2024-10-07 11:29:02.500145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.300 [2024-10-07 11:29:02.500229] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.300 [2024-10-07 11:29:02.500259] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.300 [2024-10-07 11:29:02.500281] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.300 [2024-10-07 11:29:02.500322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.300 [2024-10-07 11:29:02.500798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.300 [2024-10-07 11:29:02.500947] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.300 [2024-10-07 11:29:02.501003] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.300 [2024-10-07 11:29:02.501036] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.300 [2024-10-07 11:29:02.501147] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.300 [2024-10-07 11:29:02.501200] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.300 [2024-10-07 11:29:02.501229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.300 [2024-10-07 11:29:02.501256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.300 [2024-10-07 11:29:02.502105] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.300 [2024-10-07 11:29:02.511088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.300 [2024-10-07 11:29:02.511367] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.300 [2024-10-07 11:29:02.511428] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.300 [2024-10-07 11:29:02.511457] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.300 [2024-10-07 11:29:02.512540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.300 [2024-10-07 11:29:02.512608] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.300 [2024-10-07 11:29:02.512868] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.300 [2024-10-07 11:29:02.512912] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.300 [2024-10-07 11:29:02.512932] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.300 [2024-10-07 11:29:02.512948] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.300 [2024-10-07 11:29:02.512962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.300 [2024-10-07 11:29:02.512978] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.300 [2024-10-07 11:29:02.513119] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.300 [2024-10-07 11:29:02.513147] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.300 [2024-10-07 11:29:02.514380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.300 [2024-10-07 11:29:02.514439] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.300 [2024-10-07 11:29:02.514459] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.300 [2024-10-07 11:29:02.515753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.300 [2024-10-07 11:29:02.521300] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.300 [2024-10-07 11:29:02.521519] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.300 [2024-10-07 11:29:02.521558] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.300 [2024-10-07 11:29:02.521579] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.300 [2024-10-07 11:29:02.521615] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.300 [2024-10-07 11:29:02.521648] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.300 [2024-10-07 11:29:02.521665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.300 [2024-10-07 11:29:02.521715] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.300 [2024-10-07 11:29:02.522728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.300 [2024-10-07 11:29:02.523107] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.300 [2024-10-07 11:29:02.524419] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.300 [2024-10-07 11:29:02.524473] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.300 [2024-10-07 11:29:02.524500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.300 [2024-10-07 11:29:02.524769] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.300 [2024-10-07 11:29:02.525953] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.300 [2024-10-07 11:29:02.526008] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.300 [2024-10-07 11:29:02.526036] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.300 [2024-10-07 11:29:02.527510] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.300 [2024-10-07 11:29:02.531500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.300 [2024-10-07 11:29:02.531680] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.300 [2024-10-07 11:29:02.531718] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.300 [2024-10-07 11:29:02.531737] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.300 [2024-10-07 11:29:02.532599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.300 [2024-10-07 11:29:02.533508] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.300 [2024-10-07 11:29:02.533573] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.300 [2024-10-07 11:29:02.533613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.300 [2024-10-07 11:29:02.534079] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.300 [2024-10-07 11:29:02.534224] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.300 [2024-10-07 11:29:02.534417] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.300 [2024-10-07 11:29:02.534491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.300 [2024-10-07 11:29:02.534531] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.300 [2024-10-07 11:29:02.534594] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.300 [2024-10-07 11:29:02.534650] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.300 [2024-10-07 11:29:02.534685] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.300 [2024-10-07 11:29:02.534711] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.300 [2024-10-07 11:29:02.534769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.300 [2024-10-07 11:29:02.542174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.300 [2024-10-07 11:29:02.542463] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.300 [2024-10-07 11:29:02.542556] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.300 [2024-10-07 11:29:02.542596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.300 [2024-10-07 11:29:02.543783] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.300 [2024-10-07 11:29:02.544060] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.300 [2024-10-07 11:29:02.544106] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.300 [2024-10-07 11:29:02.544131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.300 [2024-10-07 11:29:02.544266] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.300 [2024-10-07 11:29:02.547461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.300 [2024-10-07 11:29:02.548428] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.300 [2024-10-07 11:29:02.548478] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.300 [2024-10-07 11:29:02.548501] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.300 [2024-10-07 11:29:02.549443] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.300 [2024-10-07 11:29:02.549587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.300 [2024-10-07 11:29:02.549614] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.300 [2024-10-07 11:29:02.549631] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.300 [2024-10-07 11:29:02.549666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.300 [2024-10-07 11:29:02.552573] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.300 [2024-10-07 11:29:02.552728] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.300 [2024-10-07 11:29:02.552769] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.300 [2024-10-07 11:29:02.552793] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.301 [2024-10-07 11:29:02.552835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.301 [2024-10-07 11:29:02.552874] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.301 [2024-10-07 11:29:02.552898] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.301 [2024-10-07 11:29:02.552919] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.301 [2024-10-07 11:29:02.552959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.301 [2024-10-07 11:29:02.557745] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.301 [2024-10-07 11:29:02.557971] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.301 [2024-10-07 11:29:02.558015] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.301 [2024-10-07 11:29:02.558035] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.301 [2024-10-07 11:29:02.558072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.301 [2024-10-07 11:29:02.558133] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.301 [2024-10-07 11:29:02.558152] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.301 [2024-10-07 11:29:02.558167] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.301 [2024-10-07 11:29:02.559204] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.301 [2024-10-07 11:29:02.562698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.301 [2024-10-07 11:29:02.562927] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.301 [2024-10-07 11:29:02.562977] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.301 [2024-10-07 11:29:02.563008] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.301 [2024-10-07 11:29:02.563064] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.301 [2024-10-07 11:29:02.563106] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.301 [2024-10-07 11:29:02.563134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.301 [2024-10-07 11:29:02.563163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.301 [2024-10-07 11:29:02.563213] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.301 [2024-10-07 11:29:02.568226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.301 [2024-10-07 11:29:02.568476] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.301 [2024-10-07 11:29:02.568537] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.301 [2024-10-07 11:29:02.568561] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.301 [2024-10-07 11:29:02.568601] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.301 [2024-10-07 11:29:02.568635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.301 [2024-10-07 11:29:02.568653] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.301 [2024-10-07 11:29:02.568669] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.301 [2024-10-07 11:29:02.568702] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.301 [2024-10-07 11:29:02.573224] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.301 [2024-10-07 11:29:02.573387] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.301 [2024-10-07 11:29:02.573441] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.301 [2024-10-07 11:29:02.573468] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.301 [2024-10-07 11:29:02.573518] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.301 [2024-10-07 11:29:02.573552] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.301 [2024-10-07 11:29:02.573570] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.301 [2024-10-07 11:29:02.573585] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.301 [2024-10-07 11:29:02.573647] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.301 [2024-10-07 11:29:02.578421] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.301 [2024-10-07 11:29:02.578793] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.301 [2024-10-07 11:29:02.578852] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.301 [2024-10-07 11:29:02.578894] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.301 [2024-10-07 11:29:02.579054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.301 [2024-10-07 11:29:02.579156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.301 [2024-10-07 11:29:02.579192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.301 [2024-10-07 11:29:02.579211] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.301 [2024-10-07 11:29:02.579246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.301 [2024-10-07 11:29:02.583361] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.301 [2024-10-07 11:29:02.583600] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.301 [2024-10-07 11:29:02.583665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.301 [2024-10-07 11:29:02.583699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.301 [2024-10-07 11:29:02.583754] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.301 [2024-10-07 11:29:02.583803] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.301 [2024-10-07 11:29:02.583822] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.301 [2024-10-07 11:29:02.583838] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.301 [2024-10-07 11:29:02.583871] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.301 [2024-10-07 11:29:02.588586] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.301 [2024-10-07 11:29:02.589752] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.301 [2024-10-07 11:29:02.589803] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.301 [2024-10-07 11:29:02.589826] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.301 [2024-10-07 11:29:02.590029] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.301 [2024-10-07 11:29:02.590109] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.301 [2024-10-07 11:29:02.590134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.301 [2024-10-07 11:29:02.590150] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.301 [2024-10-07 11:29:02.590184] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.301 [2024-10-07 11:29:02.594479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.301 [2024-10-07 11:29:02.594645] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.301 [2024-10-07 11:29:02.594681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.301 [2024-10-07 11:29:02.594733] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.301 [2024-10-07 11:29:02.594772] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.301 [2024-10-07 11:29:02.594804] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.301 [2024-10-07 11:29:02.594822] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.301 [2024-10-07 11:29:02.594837] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.301 [2024-10-07 11:29:02.594869] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.301 [2024-10-07 11:29:02.598701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.302 [2024-10-07 11:29:02.599748] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.302 [2024-10-07 11:29:02.599810] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.302 [2024-10-07 11:29:02.599834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.302 [2024-10-07 11:29:02.600039] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.302 [2024-10-07 11:29:02.600223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.302 [2024-10-07 11:29:02.600263] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.302 [2024-10-07 11:29:02.600283] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.302 [2024-10-07 11:29:02.600349] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.302 [2024-10-07 11:29:02.605287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.302 [2024-10-07 11:29:02.605486] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.302 [2024-10-07 11:29:02.605524] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.302 [2024-10-07 11:29:02.605544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.302 [2024-10-07 11:29:02.605582] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.302 [2024-10-07 11:29:02.605615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.302 [2024-10-07 11:29:02.605632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.302 [2024-10-07 11:29:02.605648] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.302 [2024-10-07 11:29:02.605679] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.302 [2024-10-07 11:29:02.609779] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.302 [2024-10-07 11:29:02.609930] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.302 [2024-10-07 11:29:02.609964] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.302 [2024-10-07 11:29:02.609983] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.302 [2024-10-07 11:29:02.610017] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.302 [2024-10-07 11:29:02.610047] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.302 [2024-10-07 11:29:02.610094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.302 [2024-10-07 11:29:02.610110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.302 [2024-10-07 11:29:02.610142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.302 [2024-10-07 11:29:02.615751] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.302 [2024-10-07 11:29:02.615925] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.302 [2024-10-07 11:29:02.615961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.302 [2024-10-07 11:29:02.615979] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.302 [2024-10-07 11:29:02.616015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.302 [2024-10-07 11:29:02.616046] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.302 [2024-10-07 11:29:02.616064] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.302 [2024-10-07 11:29:02.616079] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.302 [2024-10-07 11:29:02.616109] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.302 [2024-10-07 11:29:02.620124] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.302 [2024-10-07 11:29:02.620283] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.302 [2024-10-07 11:29:02.620317] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.302 [2024-10-07 11:29:02.620337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.302 [2024-10-07 11:29:02.620372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.302 [2024-10-07 11:29:02.620421] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.302 [2024-10-07 11:29:02.620443] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.302 [2024-10-07 11:29:02.620460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.302 [2024-10-07 11:29:02.620528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.302 [2024-10-07 11:29:02.628829] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.302 [2024-10-07 11:29:02.630258] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.302 [2024-10-07 11:29:02.630335] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.302 [2024-10-07 11:29:02.630372] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.302 [2024-10-07 11:29:02.630585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.302 [2024-10-07 11:29:02.630676] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.302 [2024-10-07 11:29:02.630710] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.302 [2024-10-07 11:29:02.630736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.302 [2024-10-07 11:29:02.630788] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.302 [2024-10-07 11:29:02.630865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.302 [2024-10-07 11:29:02.630994] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.302 [2024-10-07 11:29:02.631051] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.302 [2024-10-07 11:29:02.631081] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.302 [2024-10-07 11:29:02.631132] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.302 [2024-10-07 11:29:02.631188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.302 [2024-10-07 11:29:02.631222] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.302 [2024-10-07 11:29:02.631250] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.302 [2024-10-07 11:29:02.631302] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.302 [2024-10-07 11:29:02.640095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.302 [2024-10-07 11:29:02.641796] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.302 [2024-10-07 11:29:02.641870] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.302 [2024-10-07 11:29:02.641908] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.302 [2024-10-07 11:29:02.643451] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.302 [2024-10-07 11:29:02.643807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.302 [2024-10-07 11:29:02.643882] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.302 [2024-10-07 11:29:02.643912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.302 [2024-10-07 11:29:02.643938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.302 [2024-10-07 11:29:02.644042] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.302 [2024-10-07 11:29:02.644134] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.302 [2024-10-07 11:29:02.644170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.302 [2024-10-07 11:29:02.644196] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.302 [2024-10-07 11:29:02.644244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.302 [2024-10-07 11:29:02.644289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.302 [2024-10-07 11:29:02.644315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.302 [2024-10-07 11:29:02.644337] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.302 [2024-10-07 11:29:02.644378] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.302 [2024-10-07 11:29:02.652581] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.302 [2024-10-07 11:29:02.653101] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.302 [2024-10-07 11:29:02.653166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.303 [2024-10-07 11:29:02.653199] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.303 [2024-10-07 11:29:02.654513] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.303 [2024-10-07 11:29:02.656096] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.303 [2024-10-07 11:29:02.656161] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.303 [2024-10-07 11:29:02.656192] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.303 [2024-10-07 11:29:02.656500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.303 [2024-10-07 11:29:02.656555] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.303 [2024-10-07 11:29:02.656783] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.303 [2024-10-07 11:29:02.656838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.303 [2024-10-07 11:29:02.656870] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.303 [2024-10-07 11:29:02.658421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.303 [2024-10-07 11:29:02.660048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.303 [2024-10-07 11:29:02.660119] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.303 [2024-10-07 11:29:02.660151] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.303 [2024-10-07 11:29:02.661289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.303 [2024-10-07 11:29:02.663987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.303 [2024-10-07 11:29:02.664194] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.303 [2024-10-07 11:29:02.664262] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.303 [2024-10-07 11:29:02.664298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.303 [2024-10-07 11:29:02.665559] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.303 [2024-10-07 11:29:02.665913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.303 [2024-10-07 11:29:02.665960] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.303 [2024-10-07 11:29:02.665980] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.303 [2024-10-07 11:29:02.666100] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.303 [2024-10-07 11:29:02.668747] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.303 [2024-10-07 11:29:02.670277] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.303 [2024-10-07 11:29:02.670354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.303 [2024-10-07 11:29:02.670395] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.303 [2024-10-07 11:29:02.672340] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.303 [2024-10-07 11:29:02.673945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.303 [2024-10-07 11:29:02.674023] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.303 [2024-10-07 11:29:02.674103] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.303 [2024-10-07 11:29:02.675321] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.303 [2024-10-07 11:29:02.676503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.303 [2024-10-07 11:29:02.676669] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.303 [2024-10-07 11:29:02.676715] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.303 [2024-10-07 11:29:02.676737] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.303 [2024-10-07 11:29:02.676773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.303 [2024-10-07 11:29:02.676806] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.303 [2024-10-07 11:29:02.676822] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.303 [2024-10-07 11:29:02.676837] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.303 [2024-10-07 11:29:02.676868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.303 [2024-10-07 11:29:02.678902] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.303 [2024-10-07 11:29:02.679029] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.303 [2024-10-07 11:29:02.679061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.303 [2024-10-07 11:29:02.679088] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.303 [2024-10-07 11:29:02.679120] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.303 [2024-10-07 11:29:02.679152] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.303 [2024-10-07 11:29:02.679169] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.303 [2024-10-07 11:29:02.679183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.303 [2024-10-07 11:29:02.679214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.303 [2024-10-07 11:29:02.689519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.303 [2024-10-07 11:29:02.690637] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.303 [2024-10-07 11:29:02.690690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.303 [2024-10-07 11:29:02.690713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.303 [2024-10-07 11:29:02.690829] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.303 [2024-10-07 11:29:02.690874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.303 [2024-10-07 11:29:02.690952] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.303 [2024-10-07 11:29:02.690981] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.303 [2024-10-07 11:29:02.690998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.303 [2024-10-07 11:29:02.691013] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.303 [2024-10-07 11:29:02.691060] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.303 [2024-10-07 11:29:02.691076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.303 [2024-10-07 11:29:02.691112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.303 [2024-10-07 11:29:02.691134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.303 [2024-10-07 11:29:02.691162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.303 [2024-10-07 11:29:02.691178] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.303 [2024-10-07 11:29:02.691192] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.303 [2024-10-07 11:29:02.691220] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.303 [2024-10-07 11:29:02.700076] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.303 [2024-10-07 11:29:02.700283] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.303 [2024-10-07 11:29:02.700321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.303 [2024-10-07 11:29:02.700340] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.303 [2024-10-07 11:29:02.701627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.303 [2024-10-07 11:29:02.703126] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.303 [2024-10-07 11:29:02.703205] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.303 [2024-10-07 11:29:02.703240] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.303 [2024-10-07 11:29:02.704481] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.303 [2024-10-07 11:29:02.704552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.303 [2024-10-07 11:29:02.705660] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.303 [2024-10-07 11:29:02.705729] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.303 [2024-10-07 11:29:02.705765] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.303 [2024-10-07 11:29:02.705927] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.303 [2024-10-07 11:29:02.706012] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.303 [2024-10-07 11:29:02.706059] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.303 [2024-10-07 11:29:02.706091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.303 [2024-10-07 11:29:02.706146] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.303 [2024-10-07 11:29:02.713016] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.304 [2024-10-07 11:29:02.713584] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.304 [2024-10-07 11:29:02.713651] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.304 [2024-10-07 11:29:02.713686] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.304 [2024-10-07 11:29:02.714979] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.304 [2024-10-07 11:29:02.716832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.304 [2024-10-07 11:29:02.716897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.304 [2024-10-07 11:29:02.716930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.304 [2024-10-07 11:29:02.718371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.304 [2024-10-07 11:29:02.718458] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.304 [2024-10-07 11:29:02.719725] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.304 [2024-10-07 11:29:02.719791] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.304 [2024-10-07 11:29:02.719826] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.304 [2024-10-07 11:29:02.720916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.304 [2024-10-07 11:29:02.721142] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.304 [2024-10-07 11:29:02.721195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.304 [2024-10-07 11:29:02.721236] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.304 [2024-10-07 11:29:02.721293] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.304 [2024-10-07 11:29:02.723232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.304 [2024-10-07 11:29:02.723428] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.304 [2024-10-07 11:29:02.723477] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.304 [2024-10-07 11:29:02.723506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.304 [2024-10-07 11:29:02.724639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.304 [2024-10-07 11:29:02.724958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.304 [2024-10-07 11:29:02.725010] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.304 [2024-10-07 11:29:02.725040] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.304 [2024-10-07 11:29:02.725215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.304 [2024-10-07 11:29:02.732581] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.304 [2024-10-07 11:29:02.733953] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.304 [2024-10-07 11:29:02.734020] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.304 [2024-10-07 11:29:02.734055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.304 [2024-10-07 11:29:02.735148] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.304 [2024-10-07 11:29:02.735329] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.304 [2024-10-07 11:29:02.735414] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.304 [2024-10-07 11:29:02.735491] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.304 [2024-10-07 11:29:02.735520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.304 [2024-10-07 11:29:02.735571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.304 [2024-10-07 11:29:02.735661] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.304 [2024-10-07 11:29:02.735700] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.304 [2024-10-07 11:29:02.735726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.304 [2024-10-07 11:29:02.735774] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.304 [2024-10-07 11:29:02.735820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.304 [2024-10-07 11:29:02.735847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.304 [2024-10-07 11:29:02.735870] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.304 [2024-10-07 11:29:02.735914] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.304 [2024-10-07 11:29:02.743938] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.304 [2024-10-07 11:29:02.745612] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.304 [2024-10-07 11:29:02.745679] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.304 [2024-10-07 11:29:02.745713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.304 [2024-10-07 11:29:02.747109] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.304 [2024-10-07 11:29:02.748286] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.304 [2024-10-07 11:29:02.748366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.304 [2024-10-07 11:29:02.748419] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.304 [2024-10-07 11:29:02.748451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.304 [2024-10-07 11:29:02.749533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.304 [2024-10-07 11:29:02.749662] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.304 [2024-10-07 11:29:02.749704] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.304 [2024-10-07 11:29:02.749732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.304 [2024-10-07 11:29:02.749888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.304 [2024-10-07 11:29:02.749958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.304 [2024-10-07 11:29:02.749989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.304 [2024-10-07 11:29:02.750015] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.304 [2024-10-07 11:29:02.750061] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.304 [2024-10-07 11:29:02.754357] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.304 [2024-10-07 11:29:02.754575] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.304 [2024-10-07 11:29:02.754658] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.304 [2024-10-07 11:29:02.754689] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.304 [2024-10-07 11:29:02.756029] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.304 [2024-10-07 11:29:02.756358] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.304 [2024-10-07 11:29:02.756430] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.304 [2024-10-07 11:29:02.756464] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.304 [2024-10-07 11:29:02.757709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.304 [2024-10-07 11:29:02.759578] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.304 [2024-10-07 11:29:02.761182] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.304 [2024-10-07 11:29:02.761248] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.304 [2024-10-07 11:29:02.761282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.304 [2024-10-07 11:29:02.762764] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.304 [2024-10-07 11:29:02.763125] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.304 [2024-10-07 11:29:02.763179] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.304 [2024-10-07 11:29:02.763210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.304 [2024-10-07 11:29:02.763295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.304 [2024-10-07 11:29:02.765475] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.304 [2024-10-07 11:29:02.765640] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.304 [2024-10-07 11:29:02.765698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.304 [2024-10-07 11:29:02.765730] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.304 [2024-10-07 11:29:02.765781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.304 [2024-10-07 11:29:02.765827] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.304 [2024-10-07 11:29:02.765855] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.304 [2024-10-07 11:29:02.765879] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.304 [2024-10-07 11:29:02.765923] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.304 [2024-10-07 11:29:02.770710] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.304 [2024-10-07 11:29:02.772198] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.304 [2024-10-07 11:29:02.772263] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.304 [2024-10-07 11:29:02.772295] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.304 [2024-10-07 11:29:02.773777] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.304 [2024-10-07 11:29:02.774140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.304 [2024-10-07 11:29:02.774194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.304 [2024-10-07 11:29:02.774225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.304 [2024-10-07 11:29:02.775472] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.304 [2024-10-07 11:29:02.779951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.304 [2024-10-07 11:29:02.781309] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.305 [2024-10-07 11:29:02.781380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.305 [2024-10-07 11:29:02.781433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.305 [2024-10-07 11:29:02.781611] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.305 [2024-10-07 11:29:02.781692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.305 [2024-10-07 11:29:02.781746] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.305 [2024-10-07 11:29:02.781773] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.305 [2024-10-07 11:29:02.781798] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.305 [2024-10-07 11:29:02.782864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.305 [2024-10-07 11:29:02.783012] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.305 [2024-10-07 11:29:02.783062] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.305 [2024-10-07 11:29:02.783099] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.305 [2024-10-07 11:29:02.783371] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.305 [2024-10-07 11:29:02.784712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.305 [2024-10-07 11:29:02.784770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.305 [2024-10-07 11:29:02.784799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.305 [2024-10-07 11:29:02.785169] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.305 [2024-10-07 11:29:02.794723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.305 [2024-10-07 11:29:02.794857] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.305 [2024-10-07 11:29:02.796357] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.305 [2024-10-07 11:29:02.796466] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.305 [2024-10-07 11:29:02.796509] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.305 [2024-10-07 11:29:02.796614] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.305 [2024-10-07 11:29:02.796660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.305 [2024-10-07 11:29:02.796694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.305 [2024-10-07 11:29:02.798021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.305 [2024-10-07 11:29:02.798107] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.305 [2024-10-07 11:29:02.798432] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.305 [2024-10-07 11:29:02.798495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.305 [2024-10-07 11:29:02.798534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.305 [2024-10-07 11:29:02.798581] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.305 [2024-10-07 11:29:02.798614] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.305 [2024-10-07 11:29:02.798642] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.305 [2024-10-07 11:29:02.800083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.305 [2024-10-07 11:29:02.800156] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.305 [2024-10-07 11:29:02.806112] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.305 [2024-10-07 11:29:02.806219] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.305 [2024-10-07 11:29:02.808219] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.305 [2024-10-07 11:29:02.808291] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.305 [2024-10-07 11:29:02.808326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.305 [2024-10-07 11:29:02.808438] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.305 [2024-10-07 11:29:02.808481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.305 [2024-10-07 11:29:02.808509] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.305 [2024-10-07 11:29:02.810214] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.305 [2024-10-07 11:29:02.810299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.305 [2024-10-07 11:29:02.811623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.305 [2024-10-07 11:29:02.811704] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.305 [2024-10-07 11:29:02.811744] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.305 [2024-10-07 11:29:02.811787] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.305 [2024-10-07 11:29:02.811818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.305 [2024-10-07 11:29:02.811847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.305 [2024-10-07 11:29:02.813112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.305 [2024-10-07 11:29:02.813175] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.305 [2024-10-07 11:29:02.818296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.305 [2024-10-07 11:29:02.818443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.305 [2024-10-07 11:29:02.820332] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.305 [2024-10-07 11:29:02.820500] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.305 [2024-10-07 11:29:02.820547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.305 [2024-10-07 11:29:02.820651] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.305 [2024-10-07 11:29:02.820698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.305 [2024-10-07 11:29:02.820732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.305 [2024-10-07 11:29:02.821120] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.305 [2024-10-07 11:29:02.821196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.305 [2024-10-07 11:29:02.822675] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.305 [2024-10-07 11:29:02.822750] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.305 [2024-10-07 11:29:02.822792] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.305 [2024-10-07 11:29:02.822839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.305 [2024-10-07 11:29:02.822872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.305 [2024-10-07 11:29:02.822899] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.305 [2024-10-07 11:29:02.825123] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.305 [2024-10-07 11:29:02.825197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.305 [2024-10-07 11:29:02.831245] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.305 [2024-10-07 11:29:02.831360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.305 [2024-10-07 11:29:02.832314] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.305 [2024-10-07 11:29:02.832419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.305 [2024-10-07 11:29:02.832462] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.305 [2024-10-07 11:29:02.832558] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.305 [2024-10-07 11:29:02.832608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.305 [2024-10-07 11:29:02.832641] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.305 [2024-10-07 11:29:02.833776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.305 [2024-10-07 11:29:02.833852] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.305 [2024-10-07 11:29:02.834831] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.305 [2024-10-07 11:29:02.834902] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.305 [2024-10-07 11:29:02.834941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.305 [2024-10-07 11:29:02.834981] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.305 [2024-10-07 11:29:02.835013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.305 [2024-10-07 11:29:02.835083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.305 [2024-10-07 11:29:02.835417] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.305 [2024-10-07 11:29:02.835469] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.305 [2024-10-07 11:29:02.843452] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.305 [2024-10-07 11:29:02.843620] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.305 [2024-10-07 11:29:02.845012] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.305 [2024-10-07 11:29:02.845115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.305 [2024-10-07 11:29:02.845160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.306 [2024-10-07 11:29:02.845263] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.306 [2024-10-07 11:29:02.845309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.306 [2024-10-07 11:29:02.845343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.306 [2024-10-07 11:29:02.846694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.306 [2024-10-07 11:29:02.846772] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.306 [2024-10-07 11:29:02.848024] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.306 [2024-10-07 11:29:02.848099] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.306 [2024-10-07 11:29:02.848140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.306 [2024-10-07 11:29:02.848188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.306 [2024-10-07 11:29:02.848219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.306 [2024-10-07 11:29:02.848248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.306 [2024-10-07 11:29:02.849197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.306 [2024-10-07 11:29:02.849257] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.306 [2024-10-07 11:29:02.856510] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.306 [2024-10-07 11:29:02.856660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.306 [2024-10-07 11:29:02.857328] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.306 [2024-10-07 11:29:02.857436] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.306 [2024-10-07 11:29:02.857482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.306 [2024-10-07 11:29:02.857585] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.306 [2024-10-07 11:29:02.857630] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.306 [2024-10-07 11:29:02.857662] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.306 [2024-10-07 11:29:02.858576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.306 [2024-10-07 11:29:02.858688] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.306 [2024-10-07 11:29:02.859840] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.306 [2024-10-07 11:29:02.859911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.306 [2024-10-07 11:29:02.859951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.306 [2024-10-07 11:29:02.859993] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.306 [2024-10-07 11:29:02.860023] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.306 [2024-10-07 11:29:02.860052] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.306 [2024-10-07 11:29:02.860952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.306 [2024-10-07 11:29:02.861012] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.306 [2024-10-07 11:29:02.868722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.306 [2024-10-07 11:29:02.868868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.306 [2024-10-07 11:29:02.869989] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.306 [2024-10-07 11:29:02.870068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.306 [2024-10-07 11:29:02.870123] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.306 [2024-10-07 11:29:02.870221] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.306 [2024-10-07 11:29:02.870266] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.306 [2024-10-07 11:29:02.870298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.306 [2024-10-07 11:29:02.870711] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.306 [2024-10-07 11:29:02.870791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.306 [2024-10-07 11:29:02.872189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.306 [2024-10-07 11:29:02.872257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.306 [2024-10-07 11:29:02.872298] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.306 [2024-10-07 11:29:02.872335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.306 [2024-10-07 11:29:02.872366] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.306 [2024-10-07 11:29:02.872395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.306 [2024-10-07 11:29:02.873368] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.306 [2024-10-07 11:29:02.873460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.306 [2024-10-07 11:29:02.881635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.306 [2024-10-07 11:29:02.881785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.306 [2024-10-07 11:29:02.883359] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.306 [2024-10-07 11:29:02.883449] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.306 [2024-10-07 11:29:02.883535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.306 [2024-10-07 11:29:02.883638] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.306 [2024-10-07 11:29:02.883682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.306 [2024-10-07 11:29:02.883715] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.306 [2024-10-07 11:29:02.884901] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.306 [2024-10-07 11:29:02.884971] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.306 [2024-10-07 11:29:02.885926] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.306 [2024-10-07 11:29:02.886000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.306 [2024-10-07 11:29:02.886040] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.306 [2024-10-07 11:29:02.886082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.306 [2024-10-07 11:29:02.886114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.306 [2024-10-07 11:29:02.886149] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.306 [2024-10-07 11:29:02.887281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.306 [2024-10-07 11:29:02.887346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.306 [2024-10-07 11:29:02.895065] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.306 [2024-10-07 11:29:02.895218] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.306 [2024-10-07 11:29:02.895741] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.306 [2024-10-07 11:29:02.895811] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.306 [2024-10-07 11:29:02.895850] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.306 [2024-10-07 11:29:02.895937] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.306 [2024-10-07 11:29:02.895975] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.306 [2024-10-07 11:29:02.896003] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.306 [2024-10-07 11:29:02.897845] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.306 [2024-10-07 11:29:02.897935] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.306 [2024-10-07 11:29:02.899027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.306 [2024-10-07 11:29:02.899091] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.306 [2024-10-07 11:29:02.899126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.306 [2024-10-07 11:29:02.899171] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.306 [2024-10-07 11:29:02.899200] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.306 [2024-10-07 11:29:02.899270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.306 [2024-10-07 11:29:02.900737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.306 [2024-10-07 11:29:02.900805] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.306 [2024-10-07 11:29:02.907774] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.306 [2024-10-07 11:29:02.907898] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.306 [2024-10-07 11:29:02.910270] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.306 [2024-10-07 11:29:02.910345] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.306 [2024-10-07 11:29:02.910381] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.306 [2024-10-07 11:29:02.910500] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.306 [2024-10-07 11:29:02.910539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.306 [2024-10-07 11:29:02.910568] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.306 [2024-10-07 11:29:02.911886] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.306 [2024-10-07 11:29:02.911973] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.307 [2024-10-07 11:29:02.913048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.307 [2024-10-07 11:29:02.913121] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.307 [2024-10-07 11:29:02.913166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.307 [2024-10-07 11:29:02.913201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.307 [2024-10-07 11:29:02.913228] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.307 [2024-10-07 11:29:02.913248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.307 [2024-10-07 11:29:02.913484] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.307 [2024-10-07 11:29:02.913523] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.307 [2024-10-07 11:29:02.919867] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.307 [2024-10-07 11:29:02.919983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.307 [2024-10-07 11:29:02.921801] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.307 [2024-10-07 11:29:02.921886] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.307 [2024-10-07 11:29:02.921927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.307 [2024-10-07 11:29:02.922025] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.307 [2024-10-07 11:29:02.922071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.307 [2024-10-07 11:29:02.922099] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.307 [2024-10-07 11:29:02.923693] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.307 [2024-10-07 11:29:02.923778] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.307 [2024-10-07 11:29:02.924228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.307 [2024-10-07 11:29:02.924296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.307 [2024-10-07 11:29:02.924335] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.307 [2024-10-07 11:29:02.924376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.307 [2024-10-07 11:29:02.924431] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.307 [2024-10-07 11:29:02.924464] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.307 [2024-10-07 11:29:02.925792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.307 [2024-10-07 11:29:02.925864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.307 [2024-10-07 11:29:02.932217] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.307 [2024-10-07 11:29:02.932338] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.307 [2024-10-07 11:29:02.933746] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.307 [2024-10-07 11:29:02.933819] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.307 [2024-10-07 11:29:02.933862] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.307 [2024-10-07 11:29:02.933969] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.307 [2024-10-07 11:29:02.934015] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.307 [2024-10-07 11:29:02.934047] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.307 [2024-10-07 11:29:02.935330] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.307 [2024-10-07 11:29:02.935460] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.307 [2024-10-07 11:29:02.936635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.307 [2024-10-07 11:29:02.936708] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.307 [2024-10-07 11:29:02.936749] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.307 [2024-10-07 11:29:02.936793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.307 [2024-10-07 11:29:02.936825] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.307 [2024-10-07 11:29:02.936854] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.307 [2024-10-07 11:29:02.937961] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.307 [2024-10-07 11:29:02.938029] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.307 [2024-10-07 11:29:02.944673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.307 [2024-10-07 11:29:02.944780] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.307 [2024-10-07 11:29:02.945221] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.307 [2024-10-07 11:29:02.945300] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.307 [2024-10-07 11:29:02.945342] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.307 [2024-10-07 11:29:02.945520] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.307 [2024-10-07 11:29:02.945582] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.307 [2024-10-07 11:29:02.945619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.307 [2024-10-07 11:29:02.947065] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.307 [2024-10-07 11:29:02.947140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.307 [2024-10-07 11:29:02.948133] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.307 [2024-10-07 11:29:02.948207] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.307 [2024-10-07 11:29:02.948246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.307 [2024-10-07 11:29:02.948287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.307 [2024-10-07 11:29:02.948318] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.307 [2024-10-07 11:29:02.948348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.307 [2024-10-07 11:29:02.948861] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.307 [2024-10-07 11:29:02.948942] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.307 [2024-10-07 11:29:02.957154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.307 [2024-10-07 11:29:02.957298] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.307 [2024-10-07 11:29:02.957770] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.307 [2024-10-07 11:29:02.957841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.307 [2024-10-07 11:29:02.957878] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.307 [2024-10-07 11:29:02.957961] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.307 [2024-10-07 11:29:02.957999] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.307 [2024-10-07 11:29:02.958032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.307 [2024-10-07 11:29:02.959499] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.307 [2024-10-07 11:29:02.959577] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.307 [2024-10-07 11:29:02.959904] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.307 [2024-10-07 11:29:02.959966] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.307 [2024-10-07 11:29:02.960000] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.307 [2024-10-07 11:29:02.960032] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.307 [2024-10-07 11:29:02.960061] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.307 [2024-10-07 11:29:02.960085] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.307 [2024-10-07 11:29:02.961596] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.307 [2024-10-07 11:29:02.961666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.307 [2024-10-07 11:29:02.970272] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.307 [2024-10-07 11:29:02.970428] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.307 [2024-10-07 11:29:02.971785] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.307 [2024-10-07 11:29:02.971871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.307 [2024-10-07 11:29:02.971915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.307 [2024-10-07 11:29:02.972014] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.307 [2024-10-07 11:29:02.972064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.307 [2024-10-07 11:29:02.972097] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.307 [2024-10-07 11:29:02.973138] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.307 [2024-10-07 11:29:02.973226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.307 [2024-10-07 11:29:02.974204] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.307 [2024-10-07 11:29:02.974277] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.307 [2024-10-07 11:29:02.974317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.307 [2024-10-07 11:29:02.974359] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.307 [2024-10-07 11:29:02.974391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.307 [2024-10-07 11:29:02.974448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.307 [2024-10-07 11:29:02.975459] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.307 [2024-10-07 11:29:02.975521] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.307 [2024-10-07 11:29:02.982890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.307 [2024-10-07 11:29:02.983009] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.308 [2024-10-07 11:29:02.983980] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.308 [2024-10-07 11:29:02.984049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.308 [2024-10-07 11:29:02.984084] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.308 [2024-10-07 11:29:02.984164] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.308 [2024-10-07 11:29:02.984201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.308 [2024-10-07 11:29:02.984227] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.308 [2024-10-07 11:29:02.985262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.308 [2024-10-07 11:29:02.985329] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.308 [2024-10-07 11:29:02.986383] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.308 [2024-10-07 11:29:02.986502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.308 [2024-10-07 11:29:02.986535] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.308 [2024-10-07 11:29:02.986567] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.308 [2024-10-07 11:29:02.986592] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.308 [2024-10-07 11:29:02.986615] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.308 [2024-10-07 11:29:02.987649] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.308 [2024-10-07 11:29:02.987703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.308 [2024-10-07 11:29:02.996169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.308 [2024-10-07 11:29:02.996303] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.308 [2024-10-07 11:29:02.996832] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.308 [2024-10-07 11:29:02.996914] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.308 [2024-10-07 11:29:02.996955] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.308 [2024-10-07 11:29:02.997052] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.308 [2024-10-07 11:29:02.997114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.308 [2024-10-07 11:29:02.997150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.308 [2024-10-07 11:29:02.998549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.308 [2024-10-07 11:29:02.998621] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.308 [2024-10-07 11:29:02.999682] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.308 [2024-10-07 11:29:02.999751] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.308 [2024-10-07 11:29:02.999791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.308 [2024-10-07 11:29:02.999833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.308 [2024-10-07 11:29:02.999866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.308 [2024-10-07 11:29:02.999895] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.308 [2024-10-07 11:29:03.001170] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.308 [2024-10-07 11:29:03.001241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.308 [2024-10-07 11:29:03.007997] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.308 [2024-10-07 11:29:03.008117] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.308 [2024-10-07 11:29:03.009752] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.308 [2024-10-07 11:29:03.009826] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.308 [2024-10-07 11:29:03.009867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.308 [2024-10-07 11:29:03.010002] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.308 [2024-10-07 11:29:03.010042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.308 [2024-10-07 11:29:03.010072] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.308 [2024-10-07 11:29:03.011148] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.308 [2024-10-07 11:29:03.011234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.308 [2024-10-07 11:29:03.011564] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.308 [2024-10-07 11:29:03.011628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.308 [2024-10-07 11:29:03.011667] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.308 [2024-10-07 11:29:03.011706] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.308 [2024-10-07 11:29:03.011738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.308 [2024-10-07 11:29:03.011766] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.308 [2024-10-07 11:29:03.013077] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.308 [2024-10-07 11:29:03.013146] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.308 [2024-10-07 11:29:03.020741] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.308 [2024-10-07 11:29:03.020885] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.308 [2024-10-07 11:29:03.022223] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.308 [2024-10-07 11:29:03.022309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.308 [2024-10-07 11:29:03.022350] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.308 [2024-10-07 11:29:03.022473] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.308 [2024-10-07 11:29:03.022530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.308 [2024-10-07 11:29:03.022565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.308 [2024-10-07 11:29:03.023820] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.308 [2024-10-07 11:29:03.023892] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.308 [2024-10-07 11:29:03.024954] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.308 [2024-10-07 11:29:03.025026] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.308 [2024-10-07 11:29:03.025082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.308 [2024-10-07 11:29:03.025127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.308 [2024-10-07 11:29:03.025160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.308 [2024-10-07 11:29:03.025189] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.308 [2024-10-07 11:29:03.026174] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.308 [2024-10-07 11:29:03.026266] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.308 [2024-10-07 11:29:03.032469] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.308 [2024-10-07 11:29:03.032587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.308 [2024-10-07 11:29:03.034086] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.308 [2024-10-07 11:29:03.034171] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.308 [2024-10-07 11:29:03.034214] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.308 [2024-10-07 11:29:03.034313] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.308 [2024-10-07 11:29:03.034357] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.308 [2024-10-07 11:29:03.034390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.308 [2024-10-07 11:29:03.035516] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.308 [2024-10-07 11:29:03.035588] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.308 [2024-10-07 11:29:03.036809] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.308 [2024-10-07 11:29:03.036880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.308 [2024-10-07 11:29:03.036919] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.308 [2024-10-07 11:29:03.036959] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.308 [2024-10-07 11:29:03.036990] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.308 [2024-10-07 11:29:03.037019] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.308 [2024-10-07 11:29:03.038245] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.308 [2024-10-07 11:29:03.038315] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.308 [2024-10-07 11:29:03.044763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.308 [2024-10-07 11:29:03.044881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.308 [2024-10-07 11:29:03.046264] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.308 [2024-10-07 11:29:03.046348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.308 [2024-10-07 11:29:03.046390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.308 [2024-10-07 11:29:03.046525] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.308 [2024-10-07 11:29:03.046572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.308 [2024-10-07 11:29:03.046606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.308 [2024-10-07 11:29:03.047093] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.308 [2024-10-07 11:29:03.047166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.308 [2024-10-07 11:29:03.048430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.308 [2024-10-07 11:29:03.048505] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.308 [2024-10-07 11:29:03.048595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.308 [2024-10-07 11:29:03.048638] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.308 [2024-10-07 11:29:03.048670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.308 [2024-10-07 11:29:03.048699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.308 [2024-10-07 11:29:03.049676] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.308 [2024-10-07 11:29:03.049735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.308 [2024-10-07 11:29:03.057950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.308 [2024-10-07 11:29:03.058083] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.308 [2024-10-07 11:29:03.059458] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.308 [2024-10-07 11:29:03.059543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.308 [2024-10-07 11:29:03.059595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.308 [2024-10-07 11:29:03.059697] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.308 [2024-10-07 11:29:03.059742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.308 [2024-10-07 11:29:03.059775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.308 [2024-10-07 11:29:03.060769] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.308 [2024-10-07 11:29:03.060851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.308 [2024-10-07 11:29:03.061978] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.308 [2024-10-07 11:29:03.062050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.308 [2024-10-07 11:29:03.062089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.308 [2024-10-07 11:29:03.062135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.308 [2024-10-07 11:29:03.062165] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.308 [2024-10-07 11:29:03.062196] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.308 [2024-10-07 11:29:03.062543] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.308 [2024-10-07 11:29:03.062587] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.308 [2024-10-07 11:29:03.072087] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.308 [2024-10-07 11:29:03.072250] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.308 [2024-10-07 11:29:03.073761] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.308 [2024-10-07 11:29:03.073837] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.309 [2024-10-07 11:29:03.073884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.309 [2024-10-07 11:29:03.073970] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.309 [2024-10-07 11:29:03.074058] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.309 [2024-10-07 11:29:03.074092] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.309 [2024-10-07 11:29:03.074421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.309 [2024-10-07 11:29:03.074498] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.309 [2024-10-07 11:29:03.076050] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.309 [2024-10-07 11:29:03.076112] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.309 [2024-10-07 11:29:03.076147] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.309 [2024-10-07 11:29:03.076181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.309 [2024-10-07 11:29:03.076208] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.309 [2024-10-07 11:29:03.076234] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.309 [2024-10-07 11:29:03.077558] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.309 [2024-10-07 11:29:03.077629] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.309 [2024-10-07 11:29:03.084436] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.309 [2024-10-07 11:29:03.084583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.309 [2024-10-07 11:29:03.085685] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.309 [2024-10-07 11:29:03.085762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.309 [2024-10-07 11:29:03.085802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.309 [2024-10-07 11:29:03.085906] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.309 [2024-10-07 11:29:03.085959] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.309 [2024-10-07 11:29:03.085995] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.309 [2024-10-07 11:29:03.087621] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.309 [2024-10-07 11:29:03.087696] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.309 [2024-10-07 11:29:03.088118] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.309 [2024-10-07 11:29:03.088187] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.309 [2024-10-07 11:29:03.088228] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.309 [2024-10-07 11:29:03.088272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.309 [2024-10-07 11:29:03.088304] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.309 [2024-10-07 11:29:03.088331] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.309 [2024-10-07 11:29:03.089808] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.309 [2024-10-07 11:29:03.089873] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.309 [2024-10-07 11:29:03.095935] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.309 [2024-10-07 11:29:03.096076] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.309 [2024-10-07 11:29:03.096484] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.309 [2024-10-07 11:29:03.096555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.309 [2024-10-07 11:29:03.096590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.309 [2024-10-07 11:29:03.096679] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.309 [2024-10-07 11:29:03.096722] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.309 [2024-10-07 11:29:03.096756] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.309 [2024-10-07 11:29:03.097185] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.309 [2024-10-07 11:29:03.097255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.309 [2024-10-07 11:29:03.099089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.309 [2024-10-07 11:29:03.099157] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.309 [2024-10-07 11:29:03.099192] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.309 [2024-10-07 11:29:03.099229] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.309 [2024-10-07 11:29:03.099255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.309 [2024-10-07 11:29:03.099279] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.309 [2024-10-07 11:29:03.100804] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.309 [2024-10-07 11:29:03.100882] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.309 8251.18 IOPS, 32.23 MiB/s [2024-10-07T11:29:08.020Z] [2024-10-07 11:29:03.107089] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.309 [2024-10-07 11:29:03.107218] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.309 [2024-10-07 11:29:03.109080] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.309 [2024-10-07 11:29:03.109177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.309 [2024-10-07 11:29:03.109221] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.309 [2024-10-07 11:29:03.109321] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.309 [2024-10-07 11:29:03.109366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.309 [2024-10-07 11:29:03.109421] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.309 [2024-10-07 11:29:03.110508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.309 [2024-10-07 11:29:03.110590] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.309 [2024-10-07 11:29:03.112046] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.309 [2024-10-07 11:29:03.112107] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.309 [2024-10-07 11:29:03.112181] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.309 [2024-10-07 11:29:03.112224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.309 [2024-10-07 11:29:03.112255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.309 [2024-10-07 11:29:03.112280] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.309 [2024-10-07 11:29:03.113467] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.309 [2024-10-07 11:29:03.113536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.309 [2024-10-07 11:29:03.119494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.309 [2024-10-07 11:29:03.119652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.309 [2024-10-07 11:29:03.121207] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.309 [2024-10-07 11:29:03.121286] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.309 [2024-10-07 11:29:03.121327] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.309 [2024-10-07 11:29:03.121443] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.309 [2024-10-07 11:29:03.121492] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.309 [2024-10-07 11:29:03.121525] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.309 [2024-10-07 11:29:03.122593] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.309 [2024-10-07 11:29:03.122673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.309 [2024-10-07 11:29:03.123012] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.309 [2024-10-07 11:29:03.123073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.309 [2024-10-07 11:29:03.123105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.309 [2024-10-07 11:29:03.123137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.309 [2024-10-07 11:29:03.123164] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.309 [2024-10-07 11:29:03.123190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.309 [2024-10-07 11:29:03.123446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.309 [2024-10-07 11:29:03.123499] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.309 [2024-10-07 11:29:03.133147] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.309 [2024-10-07 11:29:03.133305] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.309 [2024-10-07 11:29:03.133748] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.309 [2024-10-07 11:29:03.133820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.309 [2024-10-07 11:29:03.133856] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.309 [2024-10-07 11:29:03.133940] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.309 [2024-10-07 11:29:03.133990] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.309 [2024-10-07 11:29:03.134057] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.309 [2024-10-07 11:29:03.134224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.309 [2024-10-07 11:29:03.134291] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.309 [2024-10-07 11:29:03.134732] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.309 [2024-10-07 11:29:03.134794] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.309 [2024-10-07 11:29:03.134833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.309 [2024-10-07 11:29:03.134869] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.309 [2024-10-07 11:29:03.134900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.309 [2024-10-07 11:29:03.134926] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.309 [2024-10-07 11:29:03.136789] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.309 [2024-10-07 11:29:03.136863] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.309 [2024-10-07 11:29:03.146424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.309 [2024-10-07 11:29:03.146565] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.309 [2024-10-07 11:29:03.147002] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.309 [2024-10-07 11:29:03.147071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.309 [2024-10-07 11:29:03.147107] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.309 [2024-10-07 11:29:03.147189] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.309 [2024-10-07 11:29:03.147227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.309 [2024-10-07 11:29:03.147258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.310 [2024-10-07 11:29:03.149327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.310 [2024-10-07 11:29:03.149427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.310 [2024-10-07 11:29:03.150328] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.310 [2024-10-07 11:29:03.150395] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.310 [2024-10-07 11:29:03.150465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.310 [2024-10-07 11:29:03.150511] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.310 [2024-10-07 11:29:03.150543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.310 [2024-10-07 11:29:03.150572] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.310 [2024-10-07 11:29:03.151588] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.310 [2024-10-07 11:29:03.151654] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.310 [2024-10-07 11:29:03.157183] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.310 [2024-10-07 11:29:03.157357] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.310 [2024-10-07 11:29:03.157725] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.310 [2024-10-07 11:29:03.157791] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.310 [2024-10-07 11:29:03.157826] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.310 [2024-10-07 11:29:03.157918] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.310 [2024-10-07 11:29:03.157957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.310 [2024-10-07 11:29:03.157985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.310 [2024-10-07 11:29:03.161152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.310 [2024-10-07 11:29:03.161261] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.310 [2024-10-07 11:29:03.163316] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.310 [2024-10-07 11:29:03.163418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.310 [2024-10-07 11:29:03.163462] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.310 [2024-10-07 11:29:03.163510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.310 [2024-10-07 11:29:03.163542] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.310 [2024-10-07 11:29:03.163570] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.310 [2024-10-07 11:29:03.164428] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.310 [2024-10-07 11:29:03.164500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.310 [2024-10-07 11:29:03.169273] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.310 [2024-10-07 11:29:03.169433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.310 [2024-10-07 11:29:03.169793] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.310 [2024-10-07 11:29:03.169871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.310 [2024-10-07 11:29:03.169912] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.310 [2024-10-07 11:29:03.170014] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.310 [2024-10-07 11:29:03.170070] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.310 [2024-10-07 11:29:03.170102] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.310 [2024-10-07 11:29:03.170259] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.310 [2024-10-07 11:29:03.170319] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.310 [2024-10-07 11:29:03.172178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.310 [2024-10-07 11:29:03.172247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.310 [2024-10-07 11:29:03.172282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.310 [2024-10-07 11:29:03.172354] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.310 [2024-10-07 11:29:03.172383] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.310 [2024-10-07 11:29:03.172430] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.310 [2024-10-07 11:29:03.174747] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.310 [2024-10-07 11:29:03.174835] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.310 [2024-10-07 11:29:03.181647] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.310 [2024-10-07 11:29:03.181774] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.310 [2024-10-07 11:29:03.182300] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.310 [2024-10-07 11:29:03.182373] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.310 [2024-10-07 11:29:03.182439] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.310 [2024-10-07 11:29:03.182539] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.310 [2024-10-07 11:29:03.182584] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.310 [2024-10-07 11:29:03.182617] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.310 [2024-10-07 11:29:03.185023] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.310 [2024-10-07 11:29:03.185157] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.310 [2024-10-07 11:29:03.186575] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.310 [2024-10-07 11:29:03.186646] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.310 [2024-10-07 11:29:03.186687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.310 [2024-10-07 11:29:03.186734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.310 [2024-10-07 11:29:03.186765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.310 [2024-10-07 11:29:03.186793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.310 [2024-10-07 11:29:03.187700] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.310 [2024-10-07 11:29:03.187771] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.310 [2024-10-07 11:29:03.194913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.310 [2024-10-07 11:29:03.195064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.310 [2024-10-07 11:29:03.195578] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.310 [2024-10-07 11:29:03.195655] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.310 [2024-10-07 11:29:03.195691] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.310 [2024-10-07 11:29:03.195777] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.310 [2024-10-07 11:29:03.195816] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.310 [2024-10-07 11:29:03.195845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.310 [2024-10-07 11:29:03.197293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.310 [2024-10-07 11:29:03.197378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.310 [2024-10-07 11:29:03.198598] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.310 [2024-10-07 11:29:03.198671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.310 [2024-10-07 11:29:03.198712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.310 [2024-10-07 11:29:03.198756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.310 [2024-10-07 11:29:03.198788] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.310 [2024-10-07 11:29:03.198817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.310 [2024-10-07 11:29:03.200244] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.310 [2024-10-07 11:29:03.200307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.310 [2024-10-07 11:29:03.206925] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.310 [2024-10-07 11:29:03.207062] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.310 [2024-10-07 11:29:03.209044] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.310 [2024-10-07 11:29:03.209143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.310 [2024-10-07 11:29:03.209187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.310 [2024-10-07 11:29:03.209287] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.310 [2024-10-07 11:29:03.209331] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.310 [2024-10-07 11:29:03.209364] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.310 [2024-10-07 11:29:03.210570] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.310 [2024-10-07 11:29:03.210639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.310 [2024-10-07 11:29:03.212178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.310 [2024-10-07 11:29:03.212252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.310 [2024-10-07 11:29:03.212294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.310 [2024-10-07 11:29:03.212340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.310 [2024-10-07 11:29:03.212372] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.310 [2024-10-07 11:29:03.212418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.310 [2024-10-07 11:29:03.212758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.310 [2024-10-07 11:29:03.212821] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.310 [2024-10-07 11:29:03.220659] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.310 [2024-10-07 11:29:03.220796] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.310 [2024-10-07 11:29:03.222043] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.310 [2024-10-07 11:29:03.222117] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.310 [2024-10-07 11:29:03.222154] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.310 [2024-10-07 11:29:03.222248] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.311 [2024-10-07 11:29:03.222286] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.311 [2024-10-07 11:29:03.222314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.311 [2024-10-07 11:29:03.222585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.311 [2024-10-07 11:29:03.222661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.311 [2024-10-07 11:29:03.224099] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.311 [2024-10-07 11:29:03.224159] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.311 [2024-10-07 11:29:03.224190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.311 [2024-10-07 11:29:03.224233] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.311 [2024-10-07 11:29:03.224256] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.311 [2024-10-07 11:29:03.224276] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.311 [2024-10-07 11:29:03.226113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.311 [2024-10-07 11:29:03.226185] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.311 [2024-10-07 11:29:03.234475] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.311 [2024-10-07 11:29:03.234617] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.311 [2024-10-07 11:29:03.236004] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.311 [2024-10-07 11:29:03.236089] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.311 [2024-10-07 11:29:03.236132] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.311 [2024-10-07 11:29:03.236231] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.311 [2024-10-07 11:29:03.236285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.311 [2024-10-07 11:29:03.236333] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.311 [2024-10-07 11:29:03.237636] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.311 [2024-10-07 11:29:03.237712] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.311 [2024-10-07 11:29:03.238719] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.311 [2024-10-07 11:29:03.238789] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.311 [2024-10-07 11:29:03.238828] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.311 [2024-10-07 11:29:03.238873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.311 [2024-10-07 11:29:03.238958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.311 [2024-10-07 11:29:03.238989] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.311 [2024-10-07 11:29:03.239295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.311 [2024-10-07 11:29:03.239354] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.311 [2024-10-07 11:29:03.246801] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.311 [2024-10-07 11:29:03.246955] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.311 [2024-10-07 11:29:03.248417] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.311 [2024-10-07 11:29:03.248495] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.311 [2024-10-07 11:29:03.248532] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.311 [2024-10-07 11:29:03.248621] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.311 [2024-10-07 11:29:03.248660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.311 [2024-10-07 11:29:03.248688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.311 [2024-10-07 11:29:03.249964] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.311 [2024-10-07 11:29:03.250048] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.311 [2024-10-07 11:29:03.251670] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.311 [2024-10-07 11:29:03.251743] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.311 [2024-10-07 11:29:03.251786] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.311 [2024-10-07 11:29:03.251832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.311 [2024-10-07 11:29:03.251864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.311 [2024-10-07 11:29:03.251892] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.311 [2024-10-07 11:29:03.253148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.311 [2024-10-07 11:29:03.253210] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.311 [2024-10-07 11:29:03.259472] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.311 [2024-10-07 11:29:03.259602] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.311 [2024-10-07 11:29:03.260862] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.311 [2024-10-07 11:29:03.260945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.311 [2024-10-07 11:29:03.260986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.311 [2024-10-07 11:29:03.261092] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.311 [2024-10-07 11:29:03.261131] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.311 [2024-10-07 11:29:03.261158] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.311 [2024-10-07 11:29:03.261445] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.311 [2024-10-07 11:29:03.261540] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.311 [2024-10-07 11:29:03.262933] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.311 [2024-10-07 11:29:03.263005] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.311 [2024-10-07 11:29:03.263044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.311 [2024-10-07 11:29:03.263085] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.311 [2024-10-07 11:29:03.263117] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.311 [2024-10-07 11:29:03.263144] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.311 [2024-10-07 11:29:03.263461] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.311 [2024-10-07 11:29:03.263509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.311 [2024-10-07 11:29:03.271895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.311 [2024-10-07 11:29:03.272010] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.311 [2024-10-07 11:29:03.273571] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.311 [2024-10-07 11:29:03.273654] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.311 [2024-10-07 11:29:03.273697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.311 [2024-10-07 11:29:03.273796] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.311 [2024-10-07 11:29:03.273840] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.311 [2024-10-07 11:29:03.273874] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.311 [2024-10-07 11:29:03.274267] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.311 [2024-10-07 11:29:03.274337] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.311 [2024-10-07 11:29:03.274541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.311 [2024-10-07 11:29:03.274594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.311 [2024-10-07 11:29:03.274628] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.311 [2024-10-07 11:29:03.274665] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.311 [2024-10-07 11:29:03.274692] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.311 [2024-10-07 11:29:03.274715] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.311 [2024-10-07 11:29:03.276726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.311 [2024-10-07 11:29:03.276791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.311 [2024-10-07 11:29:03.284458] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.311 [2024-10-07 11:29:03.284593] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.311 [2024-10-07 11:29:03.285193] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.311 [2024-10-07 11:29:03.285302] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.311 [2024-10-07 11:29:03.285341] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.311 [2024-10-07 11:29:03.285454] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.311 [2024-10-07 11:29:03.285497] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.311 [2024-10-07 11:29:03.285530] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.311 [2024-10-07 11:29:03.286977] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.311 [2024-10-07 11:29:03.287051] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.311 [2024-10-07 11:29:03.288314] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.311 [2024-10-07 11:29:03.288384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.311 [2024-10-07 11:29:03.288447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.311 [2024-10-07 11:29:03.288490] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.311 [2024-10-07 11:29:03.288518] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.311 [2024-10-07 11:29:03.288549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.311 [2024-10-07 11:29:03.289730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.311 [2024-10-07 11:29:03.289802] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.311 [2024-10-07 11:29:03.296921] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.311 [2024-10-07 11:29:03.297049] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.311 [2024-10-07 11:29:03.298854] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.311 [2024-10-07 11:29:03.298938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.311 [2024-10-07 11:29:03.298982] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.311 [2024-10-07 11:29:03.299082] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.311 [2024-10-07 11:29:03.299126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.311 [2024-10-07 11:29:03.299160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.311 [2024-10-07 11:29:03.300576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.311 [2024-10-07 11:29:03.300663] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.311 [2024-10-07 11:29:03.302263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.311 [2024-10-07 11:29:03.302338] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.311 [2024-10-07 11:29:03.302379] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.311 [2024-10-07 11:29:03.302449] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.311 [2024-10-07 11:29:03.302485] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.311 [2024-10-07 11:29:03.302553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.311 [2024-10-07 11:29:03.302880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.311 [2024-10-07 11:29:03.302939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.311 [2024-10-07 11:29:03.309069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.311 [2024-10-07 11:29:03.309180] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.311 [2024-10-07 11:29:03.310506] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.311 [2024-10-07 11:29:03.310588] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.311 [2024-10-07 11:29:03.310630] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.311 [2024-10-07 11:29:03.310725] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.311 [2024-10-07 11:29:03.310769] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.311 [2024-10-07 11:29:03.310802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.312 [2024-10-07 11:29:03.312070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.312 [2024-10-07 11:29:03.312145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.312 [2024-10-07 11:29:03.313158] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.312 [2024-10-07 11:29:03.313226] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.312 [2024-10-07 11:29:03.313266] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.312 [2024-10-07 11:29:03.313306] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.312 [2024-10-07 11:29:03.313339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.312 [2024-10-07 11:29:03.313366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.312 [2024-10-07 11:29:03.313682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.312 [2024-10-07 11:29:03.313746] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.312 [2024-10-07 11:29:03.321529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.312 [2024-10-07 11:29:03.321685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.312 [2024-10-07 11:29:03.323136] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.312 [2024-10-07 11:29:03.323214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.312 [2024-10-07 11:29:03.323253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.312 [2024-10-07 11:29:03.323351] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.312 [2024-10-07 11:29:03.323396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.312 [2024-10-07 11:29:03.323454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.312 [2024-10-07 11:29:03.324662] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.312 [2024-10-07 11:29:03.324771] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.312 [2024-10-07 11:29:03.325216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.312 [2024-10-07 11:29:03.325278] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.312 [2024-10-07 11:29:03.325318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.312 [2024-10-07 11:29:03.325363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.312 [2024-10-07 11:29:03.325394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.312 [2024-10-07 11:29:03.325450] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.312 [2024-10-07 11:29:03.325673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.312 [2024-10-07 11:29:03.325732] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.312 [2024-10-07 11:29:03.333501] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.312 [2024-10-07 11:29:03.333651] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.312 [2024-10-07 11:29:03.335159] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.312 [2024-10-07 11:29:03.335235] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.312 [2024-10-07 11:29:03.335273] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.312 [2024-10-07 11:29:03.335367] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.312 [2024-10-07 11:29:03.335433] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.312 [2024-10-07 11:29:03.335471] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.312 [2024-10-07 11:29:03.336564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.312 [2024-10-07 11:29:03.336646] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.312 [2024-10-07 11:29:03.336942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.312 [2024-10-07 11:29:03.337001] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.312 [2024-10-07 11:29:03.337035] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.312 [2024-10-07 11:29:03.337082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.312 [2024-10-07 11:29:03.337112] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.312 [2024-10-07 11:29:03.337135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.312 [2024-10-07 11:29:03.338586] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.312 [2024-10-07 11:29:03.338653] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.312 [2024-10-07 11:29:03.347205] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.312 [2024-10-07 11:29:03.347364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.312 [2024-10-07 11:29:03.348330] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.312 [2024-10-07 11:29:03.348432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.312 [2024-10-07 11:29:03.348529] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.312 [2024-10-07 11:29:03.348640] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.312 [2024-10-07 11:29:03.348697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.312 [2024-10-07 11:29:03.348732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.312 [2024-10-07 11:29:03.349241] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.312 [2024-10-07 11:29:03.349320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.312 [2024-10-07 11:29:03.350527] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.312 [2024-10-07 11:29:03.350605] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.312 [2024-10-07 11:29:03.350646] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.312 [2024-10-07 11:29:03.350689] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.312 [2024-10-07 11:29:03.350721] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.312 [2024-10-07 11:29:03.350749] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.312 [2024-10-07 11:29:03.351807] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.312 [2024-10-07 11:29:03.351868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.312 [2024-10-07 11:29:03.359877] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.312 [2024-10-07 11:29:03.360033] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.312 [2024-10-07 11:29:03.360514] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.312 [2024-10-07 11:29:03.360592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.312 [2024-10-07 11:29:03.360633] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.312 [2024-10-07 11:29:03.360718] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.312 [2024-10-07 11:29:03.360755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.312 [2024-10-07 11:29:03.360786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.312 [2024-10-07 11:29:03.361009] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.312 [2024-10-07 11:29:03.361089] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.312 [2024-10-07 11:29:03.362801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.312 [2024-10-07 11:29:03.362866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.312 [2024-10-07 11:29:03.362901] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.312 [2024-10-07 11:29:03.362934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.312 [2024-10-07 11:29:03.362962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.312 [2024-10-07 11:29:03.362986] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.312 [2024-10-07 11:29:03.364467] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.312 [2024-10-07 11:29:03.364531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.312 [2024-10-07 11:29:03.372235] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.312 [2024-10-07 11:29:03.372382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.312 [2024-10-07 11:29:03.373653] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.312 [2024-10-07 11:29:03.373741] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.312 [2024-10-07 11:29:03.373781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.312 [2024-10-07 11:29:03.373877] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.312 [2024-10-07 11:29:03.373918] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.312 [2024-10-07 11:29:03.373950] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.312 [2024-10-07 11:29:03.375294] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.312 [2024-10-07 11:29:03.375383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.312 [2024-10-07 11:29:03.376360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.312 [2024-10-07 11:29:03.376441] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.312 [2024-10-07 11:29:03.376484] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.312 [2024-10-07 11:29:03.376529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.312 [2024-10-07 11:29:03.376562] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.312 [2024-10-07 11:29:03.376589] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.312 [2024-10-07 11:29:03.376896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.312 [2024-10-07 11:29:03.376955] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.312 [2024-10-07 11:29:03.386675] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.332 [2024-10-07 11:29:03.386826] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.332 [2024-10-07 11:29:03.387433] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.332 [2024-10-07 11:29:03.387509] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.332 [2024-10-07 11:29:03.387549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.332 [2024-10-07 11:29:03.387647] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.332 [2024-10-07 11:29:03.387690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.332 [2024-10-07 11:29:03.387721] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.332 [2024-10-07 11:29:03.387926] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.332 [2024-10-07 11:29:03.387994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.332 [2024-10-07 11:29:03.389814] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.332 [2024-10-07 11:29:03.389888] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.332 [2024-10-07 11:29:03.389929] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.332 [2024-10-07 11:29:03.389977] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.332 [2024-10-07 11:29:03.390007] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.332 [2024-10-07 11:29:03.390035] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.332 [2024-10-07 11:29:03.392101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.332 [2024-10-07 11:29:03.392180] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.332 [2024-10-07 11:29:03.398513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.332 [2024-10-07 11:29:03.398653] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.332 [2024-10-07 11:29:03.400304] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.332 [2024-10-07 11:29:03.400377] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.332 [2024-10-07 11:29:03.400432] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.332 [2024-10-07 11:29:03.400521] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.332 [2024-10-07 11:29:03.400561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.332 [2024-10-07 11:29:03.400589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.332 [2024-10-07 11:29:03.402226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.332 [2024-10-07 11:29:03.402305] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.332 [2024-10-07 11:29:03.403181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.332 [2024-10-07 11:29:03.403242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.332 [2024-10-07 11:29:03.403275] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.332 [2024-10-07 11:29:03.403313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.332 [2024-10-07 11:29:03.403338] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.332 [2024-10-07 11:29:03.403361] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.332 [2024-10-07 11:29:03.403615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.332 [2024-10-07 11:29:03.403653] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.332 [2024-10-07 11:29:03.412625] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.332 [2024-10-07 11:29:03.412763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.332 [2024-10-07 11:29:03.413135] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.332 [2024-10-07 11:29:03.413206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.332 [2024-10-07 11:29:03.413241] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.332 [2024-10-07 11:29:03.413374] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.332 [2024-10-07 11:29:03.413433] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.332 [2024-10-07 11:29:03.413465] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.332 [2024-10-07 11:29:03.415118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.332 [2024-10-07 11:29:03.415197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.332 [2024-10-07 11:29:03.416569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.332 [2024-10-07 11:29:03.416629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.332 [2024-10-07 11:29:03.416657] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.332 [2024-10-07 11:29:03.416696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.332 [2024-10-07 11:29:03.416721] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.332 [2024-10-07 11:29:03.416743] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.332 [2024-10-07 11:29:03.417760] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.332 [2024-10-07 11:29:03.417822] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.332 [2024-10-07 11:29:03.427525] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.332 [2024-10-07 11:29:03.427699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.332 [2024-10-07 11:29:03.428105] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.332 [2024-10-07 11:29:03.428176] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.332 [2024-10-07 11:29:03.428212] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.332 [2024-10-07 11:29:03.428296] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.332 [2024-10-07 11:29:03.428332] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.332 [2024-10-07 11:29:03.428360] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.332 [2024-10-07 11:29:03.430016] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.332 [2024-10-07 11:29:03.430100] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.332 [2024-10-07 11:29:03.431492] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.332 [2024-10-07 11:29:03.431579] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.332 [2024-10-07 11:29:03.431612] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.332 [2024-10-07 11:29:03.431653] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.333 [2024-10-07 11:29:03.431677] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.333 [2024-10-07 11:29:03.431697] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.333 [2024-10-07 11:29:03.432685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.333 [2024-10-07 11:29:03.432779] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.333 [2024-10-07 11:29:03.441577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.333 [2024-10-07 11:29:03.441740] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.333 [2024-10-07 11:29:03.443169] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.333 [2024-10-07 11:29:03.443250] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.333 [2024-10-07 11:29:03.443287] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.333 [2024-10-07 11:29:03.443372] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.333 [2024-10-07 11:29:03.443428] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.333 [2024-10-07 11:29:03.443458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.333 [2024-10-07 11:29:03.443744] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.333 [2024-10-07 11:29:03.443810] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.333 [2024-10-07 11:29:03.444994] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.333 [2024-10-07 11:29:03.445071] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.333 [2024-10-07 11:29:03.445106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.333 [2024-10-07 11:29:03.445146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.333 [2024-10-07 11:29:03.445176] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.333 [2024-10-07 11:29:03.445202] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.333 [2024-10-07 11:29:03.446589] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.333 [2024-10-07 11:29:03.446661] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.333 [2024-10-07 11:29:03.452717] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.333 [2024-10-07 11:29:03.452845] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.333 [2024-10-07 11:29:03.454553] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.333 [2024-10-07 11:29:03.454630] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.333 [2024-10-07 11:29:03.454666] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.333 [2024-10-07 11:29:03.454746] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.333 [2024-10-07 11:29:03.454785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.333 [2024-10-07 11:29:03.454813] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.333 [2024-10-07 11:29:03.456524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.333 [2024-10-07 11:29:03.456601] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.333 [2024-10-07 11:29:03.457913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.333 [2024-10-07 11:29:03.458026] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.333 [2024-10-07 11:29:03.458062] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.333 [2024-10-07 11:29:03.458105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.333 [2024-10-07 11:29:03.458137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.333 [2024-10-07 11:29:03.458163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.333 [2024-10-07 11:29:03.459651] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.333 [2024-10-07 11:29:03.459716] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.333 [2024-10-07 11:29:03.466335] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.333 [2024-10-07 11:29:03.466460] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.333 [2024-10-07 11:29:03.468257] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.333 [2024-10-07 11:29:03.468332] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.333 [2024-10-07 11:29:03.468369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.333 [2024-10-07 11:29:03.468475] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.333 [2024-10-07 11:29:03.468516] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.333 [2024-10-07 11:29:03.468543] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.333 [2024-10-07 11:29:03.468811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.333 [2024-10-07 11:29:03.468874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.333 [2024-10-07 11:29:03.470177] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.333 [2024-10-07 11:29:03.470249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.333 [2024-10-07 11:29:03.470285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.333 [2024-10-07 11:29:03.470331] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.333 [2024-10-07 11:29:03.470361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.333 [2024-10-07 11:29:03.470387] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.333 [2024-10-07 11:29:03.471744] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.333 [2024-10-07 11:29:03.471810] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.333 [2024-10-07 11:29:03.476606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.333 [2024-10-07 11:29:03.477974] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.333 [2024-10-07 11:29:03.478212] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.333 [2024-10-07 11:29:03.478279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.333 [2024-10-07 11:29:03.478313] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.333 [2024-10-07 11:29:03.478682] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.333 [2024-10-07 11:29:03.478785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.333 [2024-10-07 11:29:03.478821] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.333 [2024-10-07 11:29:03.478857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.333 [2024-10-07 11:29:03.479053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.333 [2024-10-07 11:29:03.479110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.333 [2024-10-07 11:29:03.479140] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.333 [2024-10-07 11:29:03.479168] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.333 [2024-10-07 11:29:03.480739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.333 [2024-10-07 11:29:03.480802] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.333 [2024-10-07 11:29:03.480833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.333 [2024-10-07 11:29:03.480861] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.333 [2024-10-07 11:29:03.481993] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.333 [2024-10-07 11:29:03.489608] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.333 [2024-10-07 11:29:03.490692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.333 [2024-10-07 11:29:03.490910] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.333 [2024-10-07 11:29:03.490963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.333 [2024-10-07 11:29:03.490994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.333 [2024-10-07 11:29:03.491296] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.333 [2024-10-07 11:29:03.491358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.333 [2024-10-07 11:29:03.491392] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.334 [2024-10-07 11:29:03.491450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.334 [2024-10-07 11:29:03.492663] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.334 [2024-10-07 11:29:03.492731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.334 [2024-10-07 11:29:03.492762] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.334 [2024-10-07 11:29:03.492790] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.334 [2024-10-07 11:29:03.494730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.334 [2024-10-07 11:29:03.494793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.334 [2024-10-07 11:29:03.494825] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.334 [2024-10-07 11:29:03.494852] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.334 [2024-10-07 11:29:03.495968] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.334 [2024-10-07 11:29:03.502172] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.334 [2024-10-07 11:29:03.503571] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.334 [2024-10-07 11:29:03.503823] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.334 [2024-10-07 11:29:03.503876] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.334 [2024-10-07 11:29:03.503909] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.334 [2024-10-07 11:29:03.504201] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.334 [2024-10-07 11:29:03.504264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.334 [2024-10-07 11:29:03.504297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.334 [2024-10-07 11:29:03.504333] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.334 [2024-10-07 11:29:03.505294] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.334 [2024-10-07 11:29:03.505362] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.334 [2024-10-07 11:29:03.505394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.334 [2024-10-07 11:29:03.505444] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.334 [2024-10-07 11:29:03.505703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.334 [2024-10-07 11:29:03.505744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.334 [2024-10-07 11:29:03.505769] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.334 [2024-10-07 11:29:03.505794] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.334 [2024-10-07 11:29:03.505898] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.334 [2024-10-07 11:29:03.514980] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.334 [2024-10-07 11:29:03.515363] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.334 [2024-10-07 11:29:03.515568] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.334 [2024-10-07 11:29:03.515631] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.334 [2024-10-07 11:29:03.515670] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.334 [2024-10-07 11:29:03.516968] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.334 [2024-10-07 11:29:03.517045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.334 [2024-10-07 11:29:03.517100] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.334 [2024-10-07 11:29:03.517140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.334 [2024-10-07 11:29:03.518396] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.334 [2024-10-07 11:29:03.518479] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.334 [2024-10-07 11:29:03.518508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.334 [2024-10-07 11:29:03.518576] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.334 [2024-10-07 11:29:03.518837] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.334 [2024-10-07 11:29:03.518886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.334 [2024-10-07 11:29:03.518914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.334 [2024-10-07 11:29:03.518940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.334 [2024-10-07 11:29:03.519942] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.334 [2024-10-07 11:29:03.526528] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.334 [2024-10-07 11:29:03.526991] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.334 [2024-10-07 11:29:03.527055] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.334 [2024-10-07 11:29:03.527087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.334 [2024-10-07 11:29:03.528372] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.334 [2024-10-07 11:29:03.528477] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.334 [2024-10-07 11:29:03.529744] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.334 [2024-10-07 11:29:03.529809] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.334 [2024-10-07 11:29:03.529842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.334 [2024-10-07 11:29:03.529868] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.334 [2024-10-07 11:29:03.529891] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.334 [2024-10-07 11:29:03.529914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.334 [2024-10-07 11:29:03.530150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.334 [2024-10-07 11:29:03.530207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.334 [2024-10-07 11:29:03.531355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.334 [2024-10-07 11:29:03.531427] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.334 [2024-10-07 11:29:03.531458] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.334 [2024-10-07 11:29:03.532573] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.334 [2024-10-07 11:29:03.536706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.334 [2024-10-07 11:29:03.538338] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.334 [2024-10-07 11:29:03.538422] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.334 [2024-10-07 11:29:03.538456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.334 [2024-10-07 11:29:03.539495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.334 [2024-10-07 11:29:03.539896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.334 [2024-10-07 11:29:03.539993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.334 [2024-10-07 11:29:03.540027] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.334 [2024-10-07 11:29:03.541424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.334 [2024-10-07 11:29:03.541488] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.334 [2024-10-07 11:29:03.541888] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.334 [2024-10-07 11:29:03.541949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.334 [2024-10-07 11:29:03.541981] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.334 [2024-10-07 11:29:03.543267] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.334 [2024-10-07 11:29:03.544446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.334 [2024-10-07 11:29:03.544502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.334 [2024-10-07 11:29:03.544533] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.334 [2024-10-07 11:29:03.544778] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.334 [2024-10-07 11:29:03.547299] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.334 [2024-10-07 11:29:03.547498] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.334 [2024-10-07 11:29:03.547546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.334 [2024-10-07 11:29:03.547576] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.334 [2024-10-07 11:29:03.547627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.334 [2024-10-07 11:29:03.547674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.334 [2024-10-07 11:29:03.547701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.334 [2024-10-07 11:29:03.547727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.334 [2024-10-07 11:29:03.547772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.334 [2024-10-07 11:29:03.552986] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.334 [2024-10-07 11:29:03.553183] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.334 [2024-10-07 11:29:03.553228] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.334 [2024-10-07 11:29:03.553255] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.334 [2024-10-07 11:29:03.554135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.334 [2024-10-07 11:29:03.554428] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.335 [2024-10-07 11:29:03.554490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.335 [2024-10-07 11:29:03.554520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.335 [2024-10-07 11:29:03.554657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.335 [2024-10-07 11:29:03.558662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.335 [2024-10-07 11:29:03.559029] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.335 [2024-10-07 11:29:03.559090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.335 [2024-10-07 11:29:03.559121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.335 [2024-10-07 11:29:03.559279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.335 [2024-10-07 11:29:03.560372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.335 [2024-10-07 11:29:03.560450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.335 [2024-10-07 11:29:03.560480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.335 [2024-10-07 11:29:03.561363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.335 [2024-10-07 11:29:03.563922] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.335 [2024-10-07 11:29:03.564137] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.335 [2024-10-07 11:29:03.564185] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.335 [2024-10-07 11:29:03.564214] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.335 [2024-10-07 11:29:03.564261] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.335 [2024-10-07 11:29:03.564307] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.335 [2024-10-07 11:29:03.564334] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.335 [2024-10-07 11:29:03.564357] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.335 [2024-10-07 11:29:03.564423] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.335 [2024-10-07 11:29:03.568948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.335 [2024-10-07 11:29:03.569144] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.335 [2024-10-07 11:29:03.569181] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.335 [2024-10-07 11:29:03.569200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.335 [2024-10-07 11:29:03.570411] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.335 [2024-10-07 11:29:03.570644] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.335 [2024-10-07 11:29:03.570680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.335 [2024-10-07 11:29:03.570699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.335 [2024-10-07 11:29:03.571826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.335 [2024-10-07 11:29:03.575635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.335 [2024-10-07 11:29:03.575771] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.335 [2024-10-07 11:29:03.575805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.335 [2024-10-07 11:29:03.575823] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.335 [2024-10-07 11:29:03.576075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.335 [2024-10-07 11:29:03.576223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.335 [2024-10-07 11:29:03.576262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.335 [2024-10-07 11:29:03.576281] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.335 [2024-10-07 11:29:03.576335] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.335 [2024-10-07 11:29:03.579065] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.335 [2024-10-07 11:29:03.579186] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.335 [2024-10-07 11:29:03.579218] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.335 [2024-10-07 11:29:03.579235] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.335 [2024-10-07 11:29:03.580172] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.335 [2024-10-07 11:29:03.580438] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.335 [2024-10-07 11:29:03.580475] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.335 [2024-10-07 11:29:03.580494] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.335 [2024-10-07 11:29:03.580574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.335 [2024-10-07 11:29:03.587176] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.335 [2024-10-07 11:29:03.587349] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.335 [2024-10-07 11:29:03.587384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.335 [2024-10-07 11:29:03.587416] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.335 [2024-10-07 11:29:03.587457] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.335 [2024-10-07 11:29:03.587489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.335 [2024-10-07 11:29:03.587507] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.335 [2024-10-07 11:29:03.587522] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.335 [2024-10-07 11:29:03.587554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.335 [2024-10-07 11:29:03.590307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.335 [2024-10-07 11:29:03.590464] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.335 [2024-10-07 11:29:03.590498] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.335 [2024-10-07 11:29:03.590516] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.335 [2024-10-07 11:29:03.590748] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.335 [2024-10-07 11:29:03.590868] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.335 [2024-10-07 11:29:03.590906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.335 [2024-10-07 11:29:03.590949] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.335 [2024-10-07 11:29:03.591007] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.335 [2024-10-07 11:29:03.598202] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.335 [2024-10-07 11:29:03.598387] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.335 [2024-10-07 11:29:03.598437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.335 [2024-10-07 11:29:03.598458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.335 [2024-10-07 11:29:03.598493] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.335 [2024-10-07 11:29:03.598526] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.335 [2024-10-07 11:29:03.598543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.335 [2024-10-07 11:29:03.598561] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.335 [2024-10-07 11:29:03.598592] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.335 [2024-10-07 11:29:03.602079] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.335 [2024-10-07 11:29:03.602229] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.335 [2024-10-07 11:29:03.602264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.335 [2024-10-07 11:29:03.602282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.335 [2024-10-07 11:29:03.602316] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.335 [2024-10-07 11:29:03.602347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.335 [2024-10-07 11:29:03.602365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.335 [2024-10-07 11:29:03.602380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.335 [2024-10-07 11:29:03.602596] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.335 [2024-10-07 11:29:03.608341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.335 [2024-10-07 11:29:03.608512] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.335 [2024-10-07 11:29:03.608548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.335 [2024-10-07 11:29:03.608567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.335 [2024-10-07 11:29:03.608601] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.335 [2024-10-07 11:29:03.608633] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.335 [2024-10-07 11:29:03.608650] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.335 [2024-10-07 11:29:03.608665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.335 [2024-10-07 11:29:03.609615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.335 [2024-10-07 11:29:03.612791] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.335 [2024-10-07 11:29:03.612918] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.335 [2024-10-07 11:29:03.612976] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.335 [2024-10-07 11:29:03.612996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.335 [2024-10-07 11:29:03.613031] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.335 [2024-10-07 11:29:03.613076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.335 [2024-10-07 11:29:03.613096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.335 [2024-10-07 11:29:03.613111] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.335 [2024-10-07 11:29:03.613142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.335 [2024-10-07 11:29:03.619668] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.335 [2024-10-07 11:29:03.619820] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.335 [2024-10-07 11:29:03.619854] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.335 [2024-10-07 11:29:03.619872] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.335 [2024-10-07 11:29:03.620102] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.335 [2024-10-07 11:29:03.620223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.335 [2024-10-07 11:29:03.620250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.335 [2024-10-07 11:29:03.620267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.335 [2024-10-07 11:29:03.620319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.335 [2024-10-07 11:29:03.622884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.335 [2024-10-07 11:29:03.623018] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.336 [2024-10-07 11:29:03.623051] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.336 [2024-10-07 11:29:03.623068] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.336 [2024-10-07 11:29:03.623102] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.336 [2024-10-07 11:29:03.623133] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.336 [2024-10-07 11:29:03.623150] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.336 [2024-10-07 11:29:03.623165] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.336 [2024-10-07 11:29:03.623195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.336 [2024-10-07 11:29:03.631186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.336 [2024-10-07 11:29:03.631374] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.336 [2024-10-07 11:29:03.631422] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.336 [2024-10-07 11:29:03.631444] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.336 [2024-10-07 11:29:03.631480] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.336 [2024-10-07 11:29:03.631539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.336 [2024-10-07 11:29:03.631558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.336 [2024-10-07 11:29:03.631573] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.336 [2024-10-07 11:29:03.631785] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.336 [2024-10-07 11:29:03.634275] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.336 [2024-10-07 11:29:03.634423] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.336 [2024-10-07 11:29:03.634463] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.336 [2024-10-07 11:29:03.634482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.336 [2024-10-07 11:29:03.634713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.336 [2024-10-07 11:29:03.634833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.336 [2024-10-07 11:29:03.634866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.336 [2024-10-07 11:29:03.634884] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.336 [2024-10-07 11:29:03.634939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.336 [2024-10-07 11:29:03.642039] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.336 [2024-10-07 11:29:03.642221] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.336 [2024-10-07 11:29:03.642256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.336 [2024-10-07 11:29:03.642274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.336 [2024-10-07 11:29:03.642310] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.336 [2024-10-07 11:29:03.642341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.336 [2024-10-07 11:29:03.642359] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.336 [2024-10-07 11:29:03.642374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.336 [2024-10-07 11:29:03.642421] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.336 [2024-10-07 11:29:03.645923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.336 [2024-10-07 11:29:03.646060] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.336 [2024-10-07 11:29:03.646093] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.336 [2024-10-07 11:29:03.646111] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.336 [2024-10-07 11:29:03.646144] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.336 [2024-10-07 11:29:03.646177] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.336 [2024-10-07 11:29:03.646194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.336 [2024-10-07 11:29:03.646209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.336 [2024-10-07 11:29:03.646265] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.336 [2024-10-07 11:29:03.652203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.336 [2024-10-07 11:29:03.652360] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.336 [2024-10-07 11:29:03.652394] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.336 [2024-10-07 11:29:03.652430] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.336 [2024-10-07 11:29:03.652467] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.336 [2024-10-07 11:29:03.652499] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.336 [2024-10-07 11:29:03.652516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.336 [2024-10-07 11:29:03.652531] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.336 [2024-10-07 11:29:03.652562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.336 [2024-10-07 11:29:03.656849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.336 [2024-10-07 11:29:03.656979] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.336 [2024-10-07 11:29:03.657012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.336 [2024-10-07 11:29:03.657031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.336 [2024-10-07 11:29:03.657077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.336 [2024-10-07 11:29:03.657111] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.336 [2024-10-07 11:29:03.657129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.336 [2024-10-07 11:29:03.657144] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.336 [2024-10-07 11:29:03.657175] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.336 [2024-10-07 11:29:03.663670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.336 [2024-10-07 11:29:03.663817] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.336 [2024-10-07 11:29:03.663851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.336 [2024-10-07 11:29:03.663869] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.336 [2024-10-07 11:29:03.663917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.336 [2024-10-07 11:29:03.664149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.336 [2024-10-07 11:29:03.664185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.336 [2024-10-07 11:29:03.664205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.336 [2024-10-07 11:29:03.664319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.336 [2024-10-07 11:29:03.666948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.336 [2024-10-07 11:29:03.667069] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.336 [2024-10-07 11:29:03.667101] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.336 [2024-10-07 11:29:03.667147] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.336 [2024-10-07 11:29:03.667183] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.336 [2024-10-07 11:29:03.667222] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.336 [2024-10-07 11:29:03.667241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.336 [2024-10-07 11:29:03.667256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.336 [2024-10-07 11:29:03.668196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.336 [2024-10-07 11:29:03.675370] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.336 [2024-10-07 11:29:03.675540] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.336 [2024-10-07 11:29:03.675574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.336 [2024-10-07 11:29:03.675591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.336 [2024-10-07 11:29:03.675625] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.336 [2024-10-07 11:29:03.675657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.336 [2024-10-07 11:29:03.675675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.336 [2024-10-07 11:29:03.675690] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.336 [2024-10-07 11:29:03.675721] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.336 [2024-10-07 11:29:03.678447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.336 [2024-10-07 11:29:03.678572] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.336 [2024-10-07 11:29:03.678604] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.336 [2024-10-07 11:29:03.678623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.336 [2024-10-07 11:29:03.678850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.336 [2024-10-07 11:29:03.679003] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.336 [2024-10-07 11:29:03.679042] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.336 [2024-10-07 11:29:03.679083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.336 [2024-10-07 11:29:03.679170] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.336 [2024-10-07 11:29:03.686244] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.336 [2024-10-07 11:29:03.686412] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.336 [2024-10-07 11:29:03.686448] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.336 [2024-10-07 11:29:03.686467] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.336 [2024-10-07 11:29:03.686503] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.336 [2024-10-07 11:29:03.686535] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.336 [2024-10-07 11:29:03.686578] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.336 [2024-10-07 11:29:03.686594] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.336 [2024-10-07 11:29:03.686626] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.336 [2024-10-07 11:29:03.690095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.336 [2024-10-07 11:29:03.690217] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.336 [2024-10-07 11:29:03.690249] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.336 [2024-10-07 11:29:03.690267] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.336 [2024-10-07 11:29:03.690300] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.336 [2024-10-07 11:29:03.690331] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.336 [2024-10-07 11:29:03.690348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.337 [2024-10-07 11:29:03.690362] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.337 [2024-10-07 11:29:03.690392] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.337 [2024-10-07 11:29:03.696364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.337 [2024-10-07 11:29:03.696515] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.337 [2024-10-07 11:29:03.696549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.337 [2024-10-07 11:29:03.696567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.337 [2024-10-07 11:29:03.696601] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.337 [2024-10-07 11:29:03.696632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.337 [2024-10-07 11:29:03.696650] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.337 [2024-10-07 11:29:03.696664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.337 [2024-10-07 11:29:03.697615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.337 [2024-10-07 11:29:03.700781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.337 [2024-10-07 11:29:03.700904] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.337 [2024-10-07 11:29:03.700936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.337 [2024-10-07 11:29:03.700954] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.337 [2024-10-07 11:29:03.700987] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.337 [2024-10-07 11:29:03.701018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.337 [2024-10-07 11:29:03.701035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.337 [2024-10-07 11:29:03.701049] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.337 [2024-10-07 11:29:03.701095] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.337 [2024-10-07 11:29:03.707687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.337 [2024-10-07 11:29:03.707850] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.337 [2024-10-07 11:29:03.707885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.337 [2024-10-07 11:29:03.707903] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.337 [2024-10-07 11:29:03.708137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.337 [2024-10-07 11:29:03.708258] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.337 [2024-10-07 11:29:03.708296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.337 [2024-10-07 11:29:03.708316] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.337 [2024-10-07 11:29:03.708370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.337 [2024-10-07 11:29:03.710894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.337 [2024-10-07 11:29:03.711007] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.337 [2024-10-07 11:29:03.711038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.337 [2024-10-07 11:29:03.711056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.337 [2024-10-07 11:29:03.711090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.337 [2024-10-07 11:29:03.711120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.337 [2024-10-07 11:29:03.711137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.337 [2024-10-07 11:29:03.711151] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.337 [2024-10-07 11:29:03.711180] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.337 [2024-10-07 11:29:03.719180] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.337 [2024-10-07 11:29:03.719380] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.337 [2024-10-07 11:29:03.719431] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.337 [2024-10-07 11:29:03.719451] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.337 [2024-10-07 11:29:03.719489] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.337 [2024-10-07 11:29:03.719521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.337 [2024-10-07 11:29:03.719541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.337 [2024-10-07 11:29:03.719556] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.337 [2024-10-07 11:29:03.719753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.337 [2024-10-07 11:29:03.722226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.337 [2024-10-07 11:29:03.722345] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.337 [2024-10-07 11:29:03.722376] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.337 [2024-10-07 11:29:03.722434] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.337 [2024-10-07 11:29:03.722670] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.337 [2024-10-07 11:29:03.722791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.337 [2024-10-07 11:29:03.722818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.337 [2024-10-07 11:29:03.722834] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.337 [2024-10-07 11:29:03.722885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.337 [2024-10-07 11:29:03.729968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.337 [2024-10-07 11:29:03.730142] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.337 [2024-10-07 11:29:03.730177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.337 [2024-10-07 11:29:03.730195] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.337 [2024-10-07 11:29:03.730229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.337 [2024-10-07 11:29:03.730261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.337 [2024-10-07 11:29:03.730279] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.337 [2024-10-07 11:29:03.730294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.337 [2024-10-07 11:29:03.730324] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.337 [2024-10-07 11:29:03.733798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.337 [2024-10-07 11:29:03.733936] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.337 [2024-10-07 11:29:03.733969] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.337 [2024-10-07 11:29:03.733987] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.337 [2024-10-07 11:29:03.734021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.337 [2024-10-07 11:29:03.734052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.337 [2024-10-07 11:29:03.734068] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.337 [2024-10-07 11:29:03.734083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.337 [2024-10-07 11:29:03.734288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.337 [2024-10-07 11:29:03.740099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.337 [2024-10-07 11:29:03.740257] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.337 [2024-10-07 11:29:03.740291] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.337 [2024-10-07 11:29:03.740309] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.337 [2024-10-07 11:29:03.740343] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.337 [2024-10-07 11:29:03.740375] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.337 [2024-10-07 11:29:03.740418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.337 [2024-10-07 11:29:03.740450] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.337 [2024-10-07 11:29:03.741394] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.337 [2024-10-07 11:29:03.744746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.337 [2024-10-07 11:29:03.744897] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.337 [2024-10-07 11:29:03.744932] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.337 [2024-10-07 11:29:03.744951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.337 [2024-10-07 11:29:03.744986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.337 [2024-10-07 11:29:03.745019] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.337 [2024-10-07 11:29:03.745036] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.337 [2024-10-07 11:29:03.745051] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.337 [2024-10-07 11:29:03.746337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.337 [2024-10-07 11:29:03.751680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.337 [2024-10-07 11:29:03.751851] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.337 [2024-10-07 11:29:03.751885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.337 [2024-10-07 11:29:03.751904] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.337 [2024-10-07 11:29:03.752137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.338 [2024-10-07 11:29:03.752268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.338 [2024-10-07 11:29:03.752305] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.338 [2024-10-07 11:29:03.752325] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.338 [2024-10-07 11:29:03.752380] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.338 [2024-10-07 11:29:03.754849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.338 [2024-10-07 11:29:03.754974] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.338 [2024-10-07 11:29:03.755008] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.338 [2024-10-07 11:29:03.755026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.338 [2024-10-07 11:29:03.755059] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.338 [2024-10-07 11:29:03.755090] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.338 [2024-10-07 11:29:03.755108] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.338 [2024-10-07 11:29:03.755122] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.338 [2024-10-07 11:29:03.755152] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.338 [2024-10-07 11:29:03.763212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.338 [2024-10-07 11:29:03.763422] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.338 [2024-10-07 11:29:03.763457] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.338 [2024-10-07 11:29:03.763476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.338 [2024-10-07 11:29:03.763512] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.338 [2024-10-07 11:29:03.763544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.338 [2024-10-07 11:29:03.763562] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.338 [2024-10-07 11:29:03.763577] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.338 [2024-10-07 11:29:03.763771] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.338 [2024-10-07 11:29:03.766250] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.338 [2024-10-07 11:29:03.766364] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.338 [2024-10-07 11:29:03.766419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.338 [2024-10-07 11:29:03.766440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.338 [2024-10-07 11:29:03.766667] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.338 [2024-10-07 11:29:03.766809] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.338 [2024-10-07 11:29:03.766846] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.338 [2024-10-07 11:29:03.766865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.338 [2024-10-07 11:29:03.766918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.338 [2024-10-07 11:29:03.774068] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.338 [2024-10-07 11:29:03.774236] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.338 [2024-10-07 11:29:03.774271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.338 [2024-10-07 11:29:03.774289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.338 [2024-10-07 11:29:03.774324] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.338 [2024-10-07 11:29:03.774356] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.338 [2024-10-07 11:29:03.774373] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.338 [2024-10-07 11:29:03.774389] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.338 [2024-10-07 11:29:03.775666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.338 [2024-10-07 11:29:03.778046] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.338 [2024-10-07 11:29:03.778164] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.338 [2024-10-07 11:29:03.778206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.338 [2024-10-07 11:29:03.778227] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.338 [2024-10-07 11:29:03.778480] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.338 [2024-10-07 11:29:03.778663] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.338 [2024-10-07 11:29:03.778698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.338 [2024-10-07 11:29:03.778730] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.338 [2024-10-07 11:29:03.778855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.338 [2024-10-07 11:29:03.784197] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.338 [2024-10-07 11:29:03.784342] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.338 [2024-10-07 11:29:03.784376] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.338 [2024-10-07 11:29:03.784393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.338 [2024-10-07 11:29:03.785352] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.338 [2024-10-07 11:29:03.785588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.338 [2024-10-07 11:29:03.785624] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.338 [2024-10-07 11:29:03.785643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.338 [2024-10-07 11:29:03.785723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.338 [2024-10-07 11:29:03.788631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.338 [2024-10-07 11:29:03.788751] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.338 [2024-10-07 11:29:03.788784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.338 [2024-10-07 11:29:03.788801] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.338 [2024-10-07 11:29:03.788834] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.338 [2024-10-07 11:29:03.788864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.338 [2024-10-07 11:29:03.788882] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.338 [2024-10-07 11:29:03.788896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.338 [2024-10-07 11:29:03.788936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.338 [2024-10-07 11:29:03.795556] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.338 [2024-10-07 11:29:03.795703] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.338 [2024-10-07 11:29:03.795737] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.338 [2024-10-07 11:29:03.795755] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.338 [2024-10-07 11:29:03.796009] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.338 [2024-10-07 11:29:03.796141] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.338 [2024-10-07 11:29:03.796178] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.338 [2024-10-07 11:29:03.796223] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.338 [2024-10-07 11:29:03.796287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.338 [2024-10-07 11:29:03.798723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.338 [2024-10-07 11:29:03.798840] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.338 [2024-10-07 11:29:03.798872] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.338 [2024-10-07 11:29:03.798889] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.338 [2024-10-07 11:29:03.798921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.338 [2024-10-07 11:29:03.798952] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.338 [2024-10-07 11:29:03.798969] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.338 [2024-10-07 11:29:03.798983] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.338 [2024-10-07 11:29:03.799014] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.338 [2024-10-07 11:29:03.807276] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.338 [2024-10-07 11:29:03.807481] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.338 [2024-10-07 11:29:03.807518] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.338 [2024-10-07 11:29:03.807536] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.338 [2024-10-07 11:29:03.807572] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.338 [2024-10-07 11:29:03.807605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.338 [2024-10-07 11:29:03.807623] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.338 [2024-10-07 11:29:03.807638] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.338 [2024-10-07 11:29:03.807848] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.338 [2024-10-07 11:29:03.810369] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.338 [2024-10-07 11:29:03.810494] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.338 [2024-10-07 11:29:03.810526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.338 [2024-10-07 11:29:03.810544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.338 [2024-10-07 11:29:03.810773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.338 [2024-10-07 11:29:03.810904] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.338 [2024-10-07 11:29:03.810941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.338 [2024-10-07 11:29:03.810959] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.338 [2024-10-07 11:29:03.811013] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.338 [2024-10-07 11:29:03.818123] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.338 [2024-10-07 11:29:03.818292] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.338 [2024-10-07 11:29:03.818351] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.338 [2024-10-07 11:29:03.818371] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.339 [2024-10-07 11:29:03.818423] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.339 [2024-10-07 11:29:03.818460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.339 [2024-10-07 11:29:03.818478] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.339 [2024-10-07 11:29:03.818493] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.339 [2024-10-07 11:29:03.819678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.339 [2024-10-07 11:29:03.821959] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.339 [2024-10-07 11:29:03.822082] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.339 [2024-10-07 11:29:03.822114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.339 [2024-10-07 11:29:03.822132] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.339 [2024-10-07 11:29:03.822165] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.339 [2024-10-07 11:29:03.822197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.339 [2024-10-07 11:29:03.822214] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.339 [2024-10-07 11:29:03.822228] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.339 [2024-10-07 11:29:03.822436] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.339 [2024-10-07 11:29:03.828262] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.339 [2024-10-07 11:29:03.828439] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.339 [2024-10-07 11:29:03.828475] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.339 [2024-10-07 11:29:03.828493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.339 [2024-10-07 11:29:03.828529] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.339 [2024-10-07 11:29:03.829498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.339 [2024-10-07 11:29:03.829538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.339 [2024-10-07 11:29:03.829557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.339 [2024-10-07 11:29:03.829776] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.339 [2024-10-07 11:29:03.832699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.339 [2024-10-07 11:29:03.832842] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.339 [2024-10-07 11:29:03.832876] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.339 [2024-10-07 11:29:03.832893] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.339 [2024-10-07 11:29:03.832927] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.339 [2024-10-07 11:29:03.832987] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.339 [2024-10-07 11:29:03.833006] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.339 [2024-10-07 11:29:03.833020] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.339 [2024-10-07 11:29:03.833051] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.339 [2024-10-07 11:29:03.840124] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.339 [2024-10-07 11:29:03.840423] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.339 [2024-10-07 11:29:03.840474] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.339 [2024-10-07 11:29:03.840494] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.339 [2024-10-07 11:29:03.840552] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.339 [2024-10-07 11:29:03.840592] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.339 [2024-10-07 11:29:03.840611] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.339 [2024-10-07 11:29:03.840627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.339 [2024-10-07 11:29:03.840659] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.339 [2024-10-07 11:29:03.842813] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.339 [2024-10-07 11:29:03.842953] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.339 [2024-10-07 11:29:03.842988] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.339 [2024-10-07 11:29:03.843007] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.339 [2024-10-07 11:29:03.843041] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.339 [2024-10-07 11:29:03.843094] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.339 [2024-10-07 11:29:03.843114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.339 [2024-10-07 11:29:03.843129] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.339 [2024-10-07 11:29:03.843161] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.339 [2024-10-07 11:29:03.851677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.339 [2024-10-07 11:29:03.851909] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.339 [2024-10-07 11:29:03.851947] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.339 [2024-10-07 11:29:03.851966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.339 [2024-10-07 11:29:03.852167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.339 [2024-10-07 11:29:03.852315] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.339 [2024-10-07 11:29:03.852340] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.339 [2024-10-07 11:29:03.852356] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.339 [2024-10-07 11:29:03.852535] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.339 [2024-10-07 11:29:03.854734] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.339 [2024-10-07 11:29:03.854854] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.339 [2024-10-07 11:29:03.854886] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.339 [2024-10-07 11:29:03.854924] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.339 [2024-10-07 11:29:03.855156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.339 [2024-10-07 11:29:03.855275] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.339 [2024-10-07 11:29:03.855312] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.339 [2024-10-07 11:29:03.855330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.339 [2024-10-07 11:29:03.855384] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.339 [2024-10-07 11:29:03.862387] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.339 [2024-10-07 11:29:03.862576] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.339 [2024-10-07 11:29:03.862612] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.339 [2024-10-07 11:29:03.862630] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.339 [2024-10-07 11:29:03.862665] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.339 [2024-10-07 11:29:03.862697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.339 [2024-10-07 11:29:03.862715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.339 [2024-10-07 11:29:03.862730] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.339 [2024-10-07 11:29:03.862761] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.339 [2024-10-07 11:29:03.866240] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.339 [2024-10-07 11:29:03.866373] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.339 [2024-10-07 11:29:03.866420] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.339 [2024-10-07 11:29:03.866441] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.339 [2024-10-07 11:29:03.866475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.339 [2024-10-07 11:29:03.866506] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.339 [2024-10-07 11:29:03.866523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.339 [2024-10-07 11:29:03.866538] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.339 [2024-10-07 11:29:03.866568] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.339 [2024-10-07 11:29:03.872532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.339 [2024-10-07 11:29:03.872688] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.339 [2024-10-07 11:29:03.872724] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.339 [2024-10-07 11:29:03.872777] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.339 [2024-10-07 11:29:03.872815] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.339 [2024-10-07 11:29:03.872847] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.339 [2024-10-07 11:29:03.872864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.339 [2024-10-07 11:29:03.872880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.339 [2024-10-07 11:29:03.873848] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.339 [2024-10-07 11:29:03.877072] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.339 [2024-10-07 11:29:03.877206] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.339 [2024-10-07 11:29:03.877248] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.339 [2024-10-07 11:29:03.877269] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.339 [2024-10-07 11:29:03.877303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.339 [2024-10-07 11:29:03.877335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.339 [2024-10-07 11:29:03.877352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.339 [2024-10-07 11:29:03.877366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.339 [2024-10-07 11:29:03.877396] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.339 [2024-10-07 11:29:03.883888] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.339 [2024-10-07 11:29:03.884055] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.339 [2024-10-07 11:29:03.884090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.339 [2024-10-07 11:29:03.884108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.339 [2024-10-07 11:29:03.884342] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.339 [2024-10-07 11:29:03.884480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.339 [2024-10-07 11:29:03.884509] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.339 [2024-10-07 11:29:03.884525] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.340 [2024-10-07 11:29:03.884578] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.340 [2024-10-07 11:29:03.887170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.340 [2024-10-07 11:29:03.887293] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.340 [2024-10-07 11:29:03.887325] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.340 [2024-10-07 11:29:03.887342] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.340 [2024-10-07 11:29:03.887374] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.340 [2024-10-07 11:29:03.887421] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.340 [2024-10-07 11:29:03.887468] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.340 [2024-10-07 11:29:03.887484] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.340 [2024-10-07 11:29:03.888433] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.340 [2024-10-07 11:29:03.895607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.340 [2024-10-07 11:29:03.895822] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.340 [2024-10-07 11:29:03.895860] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.340 [2024-10-07 11:29:03.895879] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.340 [2024-10-07 11:29:03.895914] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.340 [2024-10-07 11:29:03.896137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.340 [2024-10-07 11:29:03.896175] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.340 [2024-10-07 11:29:03.896195] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.340 [2024-10-07 11:29:03.896338] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.340 [2024-10-07 11:29:03.898723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.340 [2024-10-07 11:29:03.898868] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.340 [2024-10-07 11:29:03.898901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.340 [2024-10-07 11:29:03.898919] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.340 [2024-10-07 11:29:03.899152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.340 [2024-10-07 11:29:03.899293] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.340 [2024-10-07 11:29:03.899330] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.340 [2024-10-07 11:29:03.899349] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.340 [2024-10-07 11:29:03.899420] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.340 [2024-10-07 11:29:03.906592] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.340 [2024-10-07 11:29:03.906824] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.340 [2024-10-07 11:29:03.906862] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.340 [2024-10-07 11:29:03.906881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.340 [2024-10-07 11:29:03.906917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.340 [2024-10-07 11:29:03.908112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.340 [2024-10-07 11:29:03.908151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.340 [2024-10-07 11:29:03.908172] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.340 [2024-10-07 11:29:03.908433] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.340 [2024-10-07 11:29:03.910587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.340 [2024-10-07 11:29:03.910724] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.340 [2024-10-07 11:29:03.910758] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.340 [2024-10-07 11:29:03.910776] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.340 [2024-10-07 11:29:03.910985] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.340 [2024-10-07 11:29:03.911143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.340 [2024-10-07 11:29:03.911177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.340 [2024-10-07 11:29:03.911196] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.340 [2024-10-07 11:29:03.911317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.340 [2024-10-07 11:29:03.916781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.340 [2024-10-07 11:29:03.916979] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.340 [2024-10-07 11:29:03.917014] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.340 [2024-10-07 11:29:03.917032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.340 [2024-10-07 11:29:03.917100] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.340 [2024-10-07 11:29:03.918056] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.340 [2024-10-07 11:29:03.918096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.340 [2024-10-07 11:29:03.918117] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.340 [2024-10-07 11:29:03.918320] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.340 [2024-10-07 11:29:03.921310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.340 [2024-10-07 11:29:03.921452] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.340 [2024-10-07 11:29:03.921486] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.340 [2024-10-07 11:29:03.921504] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.340 [2024-10-07 11:29:03.921542] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.340 [2024-10-07 11:29:03.921573] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.340 [2024-10-07 11:29:03.921590] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.340 [2024-10-07 11:29:03.921605] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.340 [2024-10-07 11:29:03.921635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.340 [2024-10-07 11:29:03.928232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.340 [2024-10-07 11:29:03.928448] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.340 [2024-10-07 11:29:03.928486] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.340 [2024-10-07 11:29:03.928506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.340 [2024-10-07 11:29:03.928784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.340 [2024-10-07 11:29:03.928919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.340 [2024-10-07 11:29:03.928965] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.340 [2024-10-07 11:29:03.928985] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.340 [2024-10-07 11:29:03.929041] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.340 [2024-10-07 11:29:03.931446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.340 [2024-10-07 11:29:03.931583] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.340 [2024-10-07 11:29:03.931616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.340 [2024-10-07 11:29:03.931634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.340 [2024-10-07 11:29:03.931667] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.340 [2024-10-07 11:29:03.931698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.340 [2024-10-07 11:29:03.931714] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.340 [2024-10-07 11:29:03.931729] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.340 [2024-10-07 11:29:03.931760] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.340 [2024-10-07 11:29:03.939946] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.340 [2024-10-07 11:29:03.940135] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.340 [2024-10-07 11:29:03.940171] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.340 [2024-10-07 11:29:03.940190] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.340 [2024-10-07 11:29:03.940225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.340 [2024-10-07 11:29:03.940257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.340 [2024-10-07 11:29:03.940275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.340 [2024-10-07 11:29:03.940290] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.340 [2024-10-07 11:29:03.940508] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.340 [2024-10-07 11:29:03.942967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.340 [2024-10-07 11:29:03.943092] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.340 [2024-10-07 11:29:03.943124] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.340 [2024-10-07 11:29:03.943141] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.340 [2024-10-07 11:29:03.943371] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.340 [2024-10-07 11:29:03.943509] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.340 [2024-10-07 11:29:03.943547] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.340 [2024-10-07 11:29:03.943597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.340 [2024-10-07 11:29:03.943656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.340 [2024-10-07 11:29:03.950708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.340 [2024-10-07 11:29:03.950909] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.340 [2024-10-07 11:29:03.950946] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.340 [2024-10-07 11:29:03.950965] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.340 [2024-10-07 11:29:03.951000] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.340 [2024-10-07 11:29:03.951032] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.341 [2024-10-07 11:29:03.951050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.341 [2024-10-07 11:29:03.951065] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.341 [2024-10-07 11:29:03.951095] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.341 [2024-10-07 11:29:03.954577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.341 [2024-10-07 11:29:03.954736] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.341 [2024-10-07 11:29:03.954770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.341 [2024-10-07 11:29:03.954789] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.341 [2024-10-07 11:29:03.954823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.341 [2024-10-07 11:29:03.954855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.341 [2024-10-07 11:29:03.954873] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.341 [2024-10-07 11:29:03.954888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.341 [2024-10-07 11:29:03.954919] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.341 [2024-10-07 11:29:03.960855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.341 [2024-10-07 11:29:03.961024] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.341 [2024-10-07 11:29:03.961069] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.341 [2024-10-07 11:29:03.961090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.341 [2024-10-07 11:29:03.961125] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.341 [2024-10-07 11:29:03.961157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.341 [2024-10-07 11:29:03.961175] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.341 [2024-10-07 11:29:03.961190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.341 [2024-10-07 11:29:03.962134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.341 [2024-10-07 11:29:03.965359] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.341 [2024-10-07 11:29:03.965533] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.341 [2024-10-07 11:29:03.965566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.341 [2024-10-07 11:29:03.965584] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.341 [2024-10-07 11:29:03.965618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.341 [2024-10-07 11:29:03.965648] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.341 [2024-10-07 11:29:03.965665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.341 [2024-10-07 11:29:03.965680] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.341 [2024-10-07 11:29:03.965710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.341 [2024-10-07 11:29:03.972169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.341 [2024-10-07 11:29:03.972340] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.341 [2024-10-07 11:29:03.972375] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.341 [2024-10-07 11:29:03.972394] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.341 [2024-10-07 11:29:03.972647] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.341 [2024-10-07 11:29:03.972766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.341 [2024-10-07 11:29:03.972794] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.341 [2024-10-07 11:29:03.972810] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.341 [2024-10-07 11:29:03.972863] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.341 [2024-10-07 11:29:03.975504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.341 [2024-10-07 11:29:03.975625] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.341 [2024-10-07 11:29:03.975657] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.341 [2024-10-07 11:29:03.975675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.341 [2024-10-07 11:29:03.975707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.341 [2024-10-07 11:29:03.975737] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.341 [2024-10-07 11:29:03.975754] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.341 [2024-10-07 11:29:03.975768] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.341 [2024-10-07 11:29:03.976705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.341 [2024-10-07 11:29:03.983714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.341 [2024-10-07 11:29:03.983859] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.341 [2024-10-07 11:29:03.983892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.341 [2024-10-07 11:29:03.983910] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.341 [2024-10-07 11:29:03.983978] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.341 [2024-10-07 11:29:03.984012] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.341 [2024-10-07 11:29:03.984029] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.341 [2024-10-07 11:29:03.984044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.341 [2024-10-07 11:29:03.984075] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.341 [2024-10-07 11:29:03.986770] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.341 [2024-10-07 11:29:03.986887] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.341 [2024-10-07 11:29:03.986918] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.341 [2024-10-07 11:29:03.986936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.341 [2024-10-07 11:29:03.987160] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.341 [2024-10-07 11:29:03.987278] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.341 [2024-10-07 11:29:03.987305] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.341 [2024-10-07 11:29:03.987321] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.341 [2024-10-07 11:29:03.987373] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.341 [2024-10-07 11:29:03.994411] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.341 [2024-10-07 11:29:03.994538] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.341 [2024-10-07 11:29:03.994572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.341 [2024-10-07 11:29:03.994590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.341 [2024-10-07 11:29:03.994623] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.341 [2024-10-07 11:29:03.994653] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.341 [2024-10-07 11:29:03.994671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.341 [2024-10-07 11:29:03.994685] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.341 [2024-10-07 11:29:03.994714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.341 [2024-10-07 11:29:03.998210] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.341 [2024-10-07 11:29:03.998352] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.341 [2024-10-07 11:29:03.998384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.341 [2024-10-07 11:29:03.998415] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.341 [2024-10-07 11:29:03.998451] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.341 [2024-10-07 11:29:03.998482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.341 [2024-10-07 11:29:03.998499] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.341 [2024-10-07 11:29:03.998543] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.341 [2024-10-07 11:29:03.998737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.341 [2024-10-07 11:29:04.004513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.341 [2024-10-07 11:29:04.004636] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.341 [2024-10-07 11:29:04.004668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.341 [2024-10-07 11:29:04.004685] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.341 [2024-10-07 11:29:04.005643] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.341 [2024-10-07 11:29:04.005864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.341 [2024-10-07 11:29:04.005897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.341 [2024-10-07 11:29:04.005914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.342 [2024-10-07 11:29:04.005992] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.342 [2024-10-07 11:29:04.008845] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.342 [2024-10-07 11:29:04.008964] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.342 [2024-10-07 11:29:04.008995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.342 [2024-10-07 11:29:04.009013] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.342 [2024-10-07 11:29:04.009045] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.342 [2024-10-07 11:29:04.009097] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.342 [2024-10-07 11:29:04.009115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.342 [2024-10-07 11:29:04.009130] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.342 [2024-10-07 11:29:04.009160] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.342 [2024-10-07 11:29:04.015659] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.342 [2024-10-07 11:29:04.015802] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.342 [2024-10-07 11:29:04.015835] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.342 [2024-10-07 11:29:04.015853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.342 [2024-10-07 11:29:04.016082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.342 [2024-10-07 11:29:04.016221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.342 [2024-10-07 11:29:04.016260] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.342 [2024-10-07 11:29:04.016280] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.342 [2024-10-07 11:29:04.016334] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.342 [2024-10-07 11:29:04.018937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.342 [2024-10-07 11:29:04.019050] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.342 [2024-10-07 11:29:04.019106] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.342 [2024-10-07 11:29:04.019125] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.342 [2024-10-07 11:29:04.019158] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.342 [2024-10-07 11:29:04.019189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.342 [2024-10-07 11:29:04.019206] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.342 [2024-10-07 11:29:04.019220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.342 [2024-10-07 11:29:04.019249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.342 [2024-10-07 11:29:04.027284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.342 [2024-10-07 11:29:04.027470] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.342 [2024-10-07 11:29:04.027512] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.342 [2024-10-07 11:29:04.027531] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.342 [2024-10-07 11:29:04.027568] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.342 [2024-10-07 11:29:04.027600] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.342 [2024-10-07 11:29:04.027617] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.342 [2024-10-07 11:29:04.027633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.342 [2024-10-07 11:29:04.027663] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.342 [2024-10-07 11:29:04.030373] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.342 [2024-10-07 11:29:04.030510] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.342 [2024-10-07 11:29:04.030542] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.342 [2024-10-07 11:29:04.030560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.342 [2024-10-07 11:29:04.030791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.342 [2024-10-07 11:29:04.030910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.342 [2024-10-07 11:29:04.030937] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.342 [2024-10-07 11:29:04.030952] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.342 [2024-10-07 11:29:04.031003] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.342 [2024-10-07 11:29:04.038161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.342 [2024-10-07 11:29:04.038327] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.342 [2024-10-07 11:29:04.038361] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.342 [2024-10-07 11:29:04.038379] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.342 [2024-10-07 11:29:04.038429] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.342 [2024-10-07 11:29:04.038491] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.342 [2024-10-07 11:29:04.038509] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.342 [2024-10-07 11:29:04.038524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.342 [2024-10-07 11:29:04.038554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.342 [2024-10-07 11:29:04.042011] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.342 [2024-10-07 11:29:04.042153] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.342 [2024-10-07 11:29:04.042185] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.342 [2024-10-07 11:29:04.042203] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.342 [2024-10-07 11:29:04.042237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.342 [2024-10-07 11:29:04.042268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.342 [2024-10-07 11:29:04.042285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.342 [2024-10-07 11:29:04.042299] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.342 [2024-10-07 11:29:04.042505] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.342 [2024-10-07 11:29:04.048292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.342 [2024-10-07 11:29:04.048469] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.342 [2024-10-07 11:29:04.048503] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.342 [2024-10-07 11:29:04.048521] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.342 [2024-10-07 11:29:04.048557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.342 [2024-10-07 11:29:04.049522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.342 [2024-10-07 11:29:04.049562] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.342 [2024-10-07 11:29:04.049581] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.342 [2024-10-07 11:29:04.049782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.342 [2024-10-07 11:29:04.052758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.342 [2024-10-07 11:29:04.052891] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.342 [2024-10-07 11:29:04.052924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.342 [2024-10-07 11:29:04.052942] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.342 [2024-10-07 11:29:04.052977] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.342 [2024-10-07 11:29:04.053008] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.342 [2024-10-07 11:29:04.053025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.342 [2024-10-07 11:29:04.053040] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.342 [2024-10-07 11:29:04.053118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.342 [2024-10-07 11:29:04.059683] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.342 [2024-10-07 11:29:04.059873] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.342 [2024-10-07 11:29:04.059908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.342 [2024-10-07 11:29:04.059926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.342 [2024-10-07 11:29:04.060160] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.342 [2024-10-07 11:29:04.060292] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.342 [2024-10-07 11:29:04.060330] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.342 [2024-10-07 11:29:04.060350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.342 [2024-10-07 11:29:04.060419] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.342 [2024-10-07 11:29:04.062872] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.342 [2024-10-07 11:29:04.062991] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.342 [2024-10-07 11:29:04.063023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.342 [2024-10-07 11:29:04.063040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.342 [2024-10-07 11:29:04.063072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.342 [2024-10-07 11:29:04.063103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.342 [2024-10-07 11:29:04.063120] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.343 [2024-10-07 11:29:04.063135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.343 [2024-10-07 11:29:04.063164] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.343 [2024-10-07 11:29:04.071265] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.343 [2024-10-07 11:29:04.071458] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.343 [2024-10-07 11:29:04.071494] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.343 [2024-10-07 11:29:04.071513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.343 [2024-10-07 11:29:04.071552] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.343 [2024-10-07 11:29:04.071584] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.343 [2024-10-07 11:29:04.071602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.343 [2024-10-07 11:29:04.071617] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.343 [2024-10-07 11:29:04.071815] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.343 [2024-10-07 11:29:04.074310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.343 [2024-10-07 11:29:04.074457] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.343 [2024-10-07 11:29:04.074505] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.343 [2024-10-07 11:29:04.074558] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.343 [2024-10-07 11:29:04.074801] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.343 [2024-10-07 11:29:04.074937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.343 [2024-10-07 11:29:04.074973] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.343 [2024-10-07 11:29:04.074992] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.343 [2024-10-07 11:29:04.075046] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.343 [2024-10-07 11:29:04.082150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.343 [2024-10-07 11:29:04.082527] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.343 [2024-10-07 11:29:04.082578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.343 [2024-10-07 11:29:04.082601] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.343 [2024-10-07 11:29:04.082707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.343 [2024-10-07 11:29:04.082758] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.343 [2024-10-07 11:29:04.082779] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.343 [2024-10-07 11:29:04.082796] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.343 [2024-10-07 11:29:04.082828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.343 [2024-10-07 11:29:04.084426] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.343 [2024-10-07 11:29:04.085659] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.343 [2024-10-07 11:29:04.085705] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.343 [2024-10-07 11:29:04.085727] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.343 [2024-10-07 11:29:04.086580] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.343 [2024-10-07 11:29:04.086716] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.343 [2024-10-07 11:29:04.086751] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.343 [2024-10-07 11:29:04.086769] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.343 [2024-10-07 11:29:04.086805] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.343 [2024-10-07 11:29:04.092532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.343 [2024-10-07 11:29:04.092730] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.343 [2024-10-07 11:29:04.092766] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.343 [2024-10-07 11:29:04.092785] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.343 [2024-10-07 11:29:04.092821] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.343 [2024-10-07 11:29:04.092866] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.343 [2024-10-07 11:29:04.092919] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.343 [2024-10-07 11:29:04.092936] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.343 [2024-10-07 11:29:04.092969] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.343 [2024-10-07 11:29:04.094685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.343 [2024-10-07 11:29:04.094804] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.343 [2024-10-07 11:29:04.094837] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.343 [2024-10-07 11:29:04.094855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.343 [2024-10-07 11:29:04.094888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.343 [2024-10-07 11:29:04.094919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.343 [2024-10-07 11:29:04.094936] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.343 [2024-10-07 11:29:04.094950] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.343 [2024-10-07 11:29:04.096193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.343 8266.83 IOPS, 32.29 MiB/s [2024-10-07T11:29:08.054Z] [2024-10-07 11:29:04.104651] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.343 [2024-10-07 11:29:04.105746] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.343 [2024-10-07 11:29:04.105797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.343 [2024-10-07 11:29:04.105820] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.343 [2024-10-07 11:29:04.106006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.343 [2024-10-07 11:29:04.106089] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.343 [2024-10-07 11:29:04.106129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.343 [2024-10-07 11:29:04.106146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.343 [2024-10-07 11:29:04.106162] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.343 [2024-10-07 11:29:04.106192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.343 [2024-10-07 11:29:04.106254] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.343 [2024-10-07 11:29:04.106281] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.343 [2024-10-07 11:29:04.106298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.343 [2024-10-07 11:29:04.106330] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.343 [2024-10-07 11:29:04.106361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.343 [2024-10-07 11:29:04.106377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.343 [2024-10-07 11:29:04.106391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.343 [2024-10-07 11:29:04.106452] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.343 [2024-10-07 11:29:04.116607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.343 [2024-10-07 11:29:04.116733] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.343 [2024-10-07 11:29:04.116843] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.343 [2024-10-07 11:29:04.116876] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.343 [2024-10-07 11:29:04.116895] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.343 [2024-10-07 11:29:04.116962] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.343 [2024-10-07 11:29:04.116989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.343 [2024-10-07 11:29:04.117006] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.343 [2024-10-07 11:29:04.117027] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.343 [2024-10-07 11:29:04.117251] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.343 [2024-10-07 11:29:04.117282] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.343 [2024-10-07 11:29:04.117298] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.343 [2024-10-07 11:29:04.117314] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.343 [2024-10-07 11:29:04.117471] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.343 [2024-10-07 11:29:04.117497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.343 [2024-10-07 11:29:04.117511] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.343 [2024-10-07 11:29:04.117525] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.343 [2024-10-07 11:29:04.117645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.343 [2024-10-07 11:29:04.127690] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.343 [2024-10-07 11:29:04.127790] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.343 [2024-10-07 11:29:04.127924] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.343 [2024-10-07 11:29:04.127960] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.343 [2024-10-07 11:29:04.127979] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.343 [2024-10-07 11:29:04.128028] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.343 [2024-10-07 11:29:04.128052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.343 [2024-10-07 11:29:04.128068] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.343 [2024-10-07 11:29:04.129291] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.343 [2024-10-07 11:29:04.129340] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.343 [2024-10-07 11:29:04.129588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.343 [2024-10-07 11:29:04.129626] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.343 [2024-10-07 11:29:04.129671] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.344 [2024-10-07 11:29:04.129692] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.344 [2024-10-07 11:29:04.129707] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.344 [2024-10-07 11:29:04.129720] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.344 [2024-10-07 11:29:04.130878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.344 [2024-10-07 11:29:04.130920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.344 [2024-10-07 11:29:04.137890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.344 [2024-10-07 11:29:04.138013] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.344 [2024-10-07 11:29:04.138130] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.344 [2024-10-07 11:29:04.138163] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.344 [2024-10-07 11:29:04.138182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.344 [2024-10-07 11:29:04.138269] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.344 [2024-10-07 11:29:04.138298] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.344 [2024-10-07 11:29:04.138314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.344 [2024-10-07 11:29:04.138335] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.344 [2024-10-07 11:29:04.138368] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.344 [2024-10-07 11:29:04.138388] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.344 [2024-10-07 11:29:04.138425] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.344 [2024-10-07 11:29:04.138455] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.344 [2024-10-07 11:29:04.138503] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.344 [2024-10-07 11:29:04.138523] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.344 [2024-10-07 11:29:04.138538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.344 [2024-10-07 11:29:04.138552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.344 [2024-10-07 11:29:04.138579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.344 [2024-10-07 11:29:04.148053] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.344 [2024-10-07 11:29:04.148264] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.344 [2024-10-07 11:29:04.148301] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.344 [2024-10-07 11:29:04.148320] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.344 [2024-10-07 11:29:04.149298] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.344 [2024-10-07 11:29:04.149358] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.344 [2024-10-07 11:29:04.150175] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.344 [2024-10-07 11:29:04.150245] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.344 [2024-10-07 11:29:04.150268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.344 [2024-10-07 11:29:04.150285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.344 [2024-10-07 11:29:04.150298] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.344 [2024-10-07 11:29:04.150313] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.344 [2024-10-07 11:29:04.150658] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.344 [2024-10-07 11:29:04.150706] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.344 [2024-10-07 11:29:04.150824] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.344 [2024-10-07 11:29:04.150863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.344 [2024-10-07 11:29:04.150881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.344 [2024-10-07 11:29:04.150963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.344 [2024-10-07 11:29:04.158256] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.344 [2024-10-07 11:29:04.158496] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.344 [2024-10-07 11:29:04.158537] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.344 [2024-10-07 11:29:04.158556] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.344 [2024-10-07 11:29:04.158597] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.344 [2024-10-07 11:29:04.158629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.344 [2024-10-07 11:29:04.158647] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.344 [2024-10-07 11:29:04.158663] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.344 [2024-10-07 11:29:04.159882] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.344 [2024-10-07 11:29:04.160232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.344 [2024-10-07 11:29:04.161498] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.344 [2024-10-07 11:29:04.161548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.344 [2024-10-07 11:29:04.161569] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.344 [2024-10-07 11:29:04.162393] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.344 [2024-10-07 11:29:04.162535] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.344 [2024-10-07 11:29:04.162569] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.344 [2024-10-07 11:29:04.162588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.344 [2024-10-07 11:29:04.162626] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.344 [2024-10-07 11:29:04.168448] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.344 [2024-10-07 11:29:04.168681] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.344 [2024-10-07 11:29:04.168720] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.344 [2024-10-07 11:29:04.168739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.344 [2024-10-07 11:29:04.168775] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.344 [2024-10-07 11:29:04.168829] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.344 [2024-10-07 11:29:04.168850] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.344 [2024-10-07 11:29:04.168866] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.344 [2024-10-07 11:29:04.168899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.344 [2024-10-07 11:29:04.170537] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.344 [2024-10-07 11:29:04.170658] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.344 [2024-10-07 11:29:04.170692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.344 [2024-10-07 11:29:04.170709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.344 [2024-10-07 11:29:04.170742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.344 [2024-10-07 11:29:04.170774] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.344 [2024-10-07 11:29:04.170792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.344 [2024-10-07 11:29:04.170806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.344 [2024-10-07 11:29:04.170835] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.344 [2024-10-07 11:29:04.178632] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.344 [2024-10-07 11:29:04.178827] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.344 [2024-10-07 11:29:04.178864] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.344 [2024-10-07 11:29:04.178882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.344 [2024-10-07 11:29:04.179849] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.344 [2024-10-07 11:29:04.180645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.344 [2024-10-07 11:29:04.180685] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.344 [2024-10-07 11:29:04.180705] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.344 [2024-10-07 11:29:04.180829] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.344 [2024-10-07 11:29:04.180870] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.344 [2024-10-07 11:29:04.180964] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.344 [2024-10-07 11:29:04.180995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.344 [2024-10-07 11:29:04.181012] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.344 [2024-10-07 11:29:04.181289] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.344 [2024-10-07 11:29:04.181440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.344 [2024-10-07 11:29:04.181477] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.344 [2024-10-07 11:29:04.181495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.344 [2024-10-07 11:29:04.181550] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.344 [2024-10-07 11:29:04.188931] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.344 [2024-10-07 11:29:04.189157] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.344 [2024-10-07 11:29:04.189196] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.344 [2024-10-07 11:29:04.189216] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.344 [2024-10-07 11:29:04.189254] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.344 [2024-10-07 11:29:04.189288] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.344 [2024-10-07 11:29:04.189305] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.344 [2024-10-07 11:29:04.189320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.344 [2024-10-07 11:29:04.189351] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.344 [2024-10-07 11:29:04.192054] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.344 [2024-10-07 11:29:04.193030] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.344 [2024-10-07 11:29:04.193097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.344 [2024-10-07 11:29:04.193121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.344 [2024-10-07 11:29:04.193232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.344 [2024-10-07 11:29:04.193272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.344 [2024-10-07 11:29:04.193291] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.345 [2024-10-07 11:29:04.193306] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.345 [2024-10-07 11:29:04.193340] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.345 [2024-10-07 11:29:04.199091] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.345 [2024-10-07 11:29:04.199274] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.345 [2024-10-07 11:29:04.199309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.345 [2024-10-07 11:29:04.199328] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.345 [2024-10-07 11:29:04.199364] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.345 [2024-10-07 11:29:04.199441] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.345 [2024-10-07 11:29:04.199476] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.345 [2024-10-07 11:29:04.199524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.345 [2024-10-07 11:29:04.199561] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.345 [2024-10-07 11:29:04.202747] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.345 [2024-10-07 11:29:04.202884] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.345 [2024-10-07 11:29:04.202917] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.345 [2024-10-07 11:29:04.202935] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.345 [2024-10-07 11:29:04.202969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.345 [2024-10-07 11:29:04.203000] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.345 [2024-10-07 11:29:04.203017] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.345 [2024-10-07 11:29:04.203032] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.345 [2024-10-07 11:29:04.203061] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.345 [2024-10-07 11:29:04.209240] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.345 [2024-10-07 11:29:04.210340] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.345 [2024-10-07 11:29:04.210390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.345 [2024-10-07 11:29:04.210426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.345 [2024-10-07 11:29:04.211176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.345 [2024-10-07 11:29:04.211300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.345 [2024-10-07 11:29:04.211331] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.345 [2024-10-07 11:29:04.211348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.345 [2024-10-07 11:29:04.211382] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.345 [2024-10-07 11:29:04.212854] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.345 [2024-10-07 11:29:04.212976] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.345 [2024-10-07 11:29:04.213008] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.345 [2024-10-07 11:29:04.213026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.345 [2024-10-07 11:29:04.213075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.345 [2024-10-07 11:29:04.213112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.345 [2024-10-07 11:29:04.213130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.345 [2024-10-07 11:29:04.213144] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.345 [2024-10-07 11:29:04.213174] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.345 [2024-10-07 11:29:04.219392] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.345 [2024-10-07 11:29:04.219618] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.345 [2024-10-07 11:29:04.219690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.345 [2024-10-07 11:29:04.219711] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.345 [2024-10-07 11:29:04.220916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.345 [2024-10-07 11:29:04.221206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.345 [2024-10-07 11:29:04.221255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.345 [2024-10-07 11:29:04.221274] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.345 [2024-10-07 11:29:04.222412] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.345 [2024-10-07 11:29:04.223363] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.345 [2024-10-07 11:29:04.223516] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.345 [2024-10-07 11:29:04.223562] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.345 [2024-10-07 11:29:04.223583] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.345 [2024-10-07 11:29:04.223618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.345 [2024-10-07 11:29:04.223650] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.345 [2024-10-07 11:29:04.223667] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.345 [2024-10-07 11:29:04.223681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.345 [2024-10-07 11:29:04.223876] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.345 [2024-10-07 11:29:04.229563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.345 [2024-10-07 11:29:04.229698] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.345 [2024-10-07 11:29:04.229732] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.345 [2024-10-07 11:29:04.229751] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.345 [2024-10-07 11:29:04.229815] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.345 [2024-10-07 11:29:04.229851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.345 [2024-10-07 11:29:04.229869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.345 [2024-10-07 11:29:04.229883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.345 [2024-10-07 11:29:04.229914] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.345 [2024-10-07 11:29:04.234356] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.345 [2024-10-07 11:29:04.234496] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.345 [2024-10-07 11:29:04.234530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.345 [2024-10-07 11:29:04.234548] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.345 [2024-10-07 11:29:04.234581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.345 [2024-10-07 11:29:04.234642] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.345 [2024-10-07 11:29:04.234661] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.345 [2024-10-07 11:29:04.234676] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.345 [2024-10-07 11:29:04.234706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.345 [2024-10-07 11:29:04.239677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.345 [2024-10-07 11:29:04.240758] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.345 [2024-10-07 11:29:04.240823] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.345 [2024-10-07 11:29:04.240853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.345 [2024-10-07 11:29:04.241649] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.345 [2024-10-07 11:29:04.241782] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.345 [2024-10-07 11:29:04.241828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.345 [2024-10-07 11:29:04.241858] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.345 [2024-10-07 11:29:04.241918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.345 [2024-10-07 11:29:04.244611] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.345 [2024-10-07 11:29:04.244743] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.345 [2024-10-07 11:29:04.244777] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.345 [2024-10-07 11:29:04.244795] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.346 [2024-10-07 11:29:04.244828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.346 [2024-10-07 11:29:04.244860] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.346 [2024-10-07 11:29:04.244877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.346 [2024-10-07 11:29:04.244892] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.346 [2024-10-07 11:29:04.244922] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.346 [2024-10-07 11:29:04.249794] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.346 [2024-10-07 11:29:04.249939] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.346 [2024-10-07 11:29:04.249974] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.346 [2024-10-07 11:29:04.249992] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.346 [2024-10-07 11:29:04.250027] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.346 [2024-10-07 11:29:04.251232] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.346 [2024-10-07 11:29:04.251274] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.346 [2024-10-07 11:29:04.251293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.346 [2024-10-07 11:29:04.251583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.346 [2024-10-07 11:29:04.254719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.346 [2024-10-07 11:29:04.254865] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.346 [2024-10-07 11:29:04.254916] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.346 [2024-10-07 11:29:04.254938] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.346 [2024-10-07 11:29:04.254973] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.346 [2024-10-07 11:29:04.255006] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.346 [2024-10-07 11:29:04.255023] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.346 [2024-10-07 11:29:04.255037] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.346 [2024-10-07 11:29:04.255986] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.346 [2024-10-07 11:29:04.259907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.346 [2024-10-07 11:29:04.260055] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.346 [2024-10-07 11:29:04.260089] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.346 [2024-10-07 11:29:04.260108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.346 [2024-10-07 11:29:04.260159] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.346 [2024-10-07 11:29:04.260194] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.346 [2024-10-07 11:29:04.260211] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.346 [2024-10-07 11:29:04.260226] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.346 [2024-10-07 11:29:04.260256] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.346 [2024-10-07 11:29:04.264864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.346 [2024-10-07 11:29:04.265008] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.346 [2024-10-07 11:29:04.265042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.346 [2024-10-07 11:29:04.265076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.346 [2024-10-07 11:29:04.265115] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.346 [2024-10-07 11:29:04.265147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.346 [2024-10-07 11:29:04.265164] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.346 [2024-10-07 11:29:04.265179] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.346 [2024-10-07 11:29:04.265209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.346 [2024-10-07 11:29:04.270022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.346 [2024-10-07 11:29:04.271085] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.346 [2024-10-07 11:29:04.271134] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.346 [2024-10-07 11:29:04.271181] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.346 [2024-10-07 11:29:04.271953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.346 [2024-10-07 11:29:04.272081] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.346 [2024-10-07 11:29:04.272115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.346 [2024-10-07 11:29:04.272134] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.346 [2024-10-07 11:29:04.272362] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.346 [2024-10-07 11:29:04.274972] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.346 [2024-10-07 11:29:04.275095] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.346 [2024-10-07 11:29:04.275128] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.346 [2024-10-07 11:29:04.275146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.346 [2024-10-07 11:29:04.275178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.346 [2024-10-07 11:29:04.275210] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.346 [2024-10-07 11:29:04.275227] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.346 [2024-10-07 11:29:04.275242] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.346 [2024-10-07 11:29:04.275271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.346 [2024-10-07 11:29:04.280134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.346 [2024-10-07 11:29:04.280275] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.346 [2024-10-07 11:29:04.280308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.346 [2024-10-07 11:29:04.280326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.346 [2024-10-07 11:29:04.281542] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.346 [2024-10-07 11:29:04.281795] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.346 [2024-10-07 11:29:04.281833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.346 [2024-10-07 11:29:04.281853] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.346 [2024-10-07 11:29:04.282972] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.346 [2024-10-07 11:29:04.285083] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.346 [2024-10-07 11:29:04.285212] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.346 [2024-10-07 11:29:04.285247] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.346 [2024-10-07 11:29:04.285266] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.346 [2024-10-07 11:29:04.285299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.346 [2024-10-07 11:29:04.286242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.346 [2024-10-07 11:29:04.286303] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.346 [2024-10-07 11:29:04.286323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.346 [2024-10-07 11:29:04.287109] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.346 [2024-10-07 11:29:04.290244] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.346 [2024-10-07 11:29:04.290395] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.346 [2024-10-07 11:29:04.290451] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.346 [2024-10-07 11:29:04.290472] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.346 [2024-10-07 11:29:04.290507] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.346 [2024-10-07 11:29:04.290539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.346 [2024-10-07 11:29:04.290556] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.346 [2024-10-07 11:29:04.290571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.346 [2024-10-07 11:29:04.290601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.346 [2024-10-07 11:29:04.295184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.346 [2024-10-07 11:29:04.295320] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.346 [2024-10-07 11:29:04.295353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.346 [2024-10-07 11:29:04.295371] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.346 [2024-10-07 11:29:04.295419] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.346 [2024-10-07 11:29:04.295455] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.346 [2024-10-07 11:29:04.295473] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.346 [2024-10-07 11:29:04.295488] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.346 [2024-10-07 11:29:04.296671] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.346 [2024-10-07 11:29:04.301251] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.346 [2024-10-07 11:29:04.302120] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.346 [2024-10-07 11:29:04.302167] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.346 [2024-10-07 11:29:04.302189] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.346 [2024-10-07 11:29:04.302293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.346 [2024-10-07 11:29:04.302331] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.346 [2024-10-07 11:29:04.302349] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.346 [2024-10-07 11:29:04.302364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.346 [2024-10-07 11:29:04.302397] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.346 [2024-10-07 11:29:04.305291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.346 [2024-10-07 11:29:04.305428] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.346 [2024-10-07 11:29:04.305466] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.346 [2024-10-07 11:29:04.305486] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.346 [2024-10-07 11:29:04.305520] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.346 [2024-10-07 11:29:04.305552] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.347 [2024-10-07 11:29:04.305569] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.347 [2024-10-07 11:29:04.305583] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.347 [2024-10-07 11:29:04.305613] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.347 [2024-10-07 11:29:04.312055] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.347 [2024-10-07 11:29:04.313300] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.347 [2024-10-07 11:29:04.313348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.347 [2024-10-07 11:29:04.313369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.347 [2024-10-07 11:29:04.314205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.347 [2024-10-07 11:29:04.314334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.347 [2024-10-07 11:29:04.314368] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.347 [2024-10-07 11:29:04.314387] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.347 [2024-10-07 11:29:04.314436] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.347 [2024-10-07 11:29:04.315383] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.347 [2024-10-07 11:29:04.315506] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.347 [2024-10-07 11:29:04.315543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.347 [2024-10-07 11:29:04.315562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.347 [2024-10-07 11:29:04.315594] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.347 [2024-10-07 11:29:04.316531] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.347 [2024-10-07 11:29:04.316568] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.347 [2024-10-07 11:29:04.316586] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.347 [2024-10-07 11:29:04.317364] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.347 [2024-10-07 11:29:04.322286] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.347 [2024-10-07 11:29:04.322463] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.347 [2024-10-07 11:29:04.322499] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.347 [2024-10-07 11:29:04.322518] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.347 [2024-10-07 11:29:04.322581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.347 [2024-10-07 11:29:04.323830] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.347 [2024-10-07 11:29:04.323868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.347 [2024-10-07 11:29:04.323888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.347 [2024-10-07 11:29:04.324076] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.347 [2024-10-07 11:29:04.325485] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.347 [2024-10-07 11:29:04.325600] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.347 [2024-10-07 11:29:04.325632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.347 [2024-10-07 11:29:04.325649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.347 [2024-10-07 11:29:04.325681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.347 [2024-10-07 11:29:04.325712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.347 [2024-10-07 11:29:04.325729] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.347 [2024-10-07 11:29:04.325743] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.347 [2024-10-07 11:29:04.325772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.347 [2024-10-07 11:29:04.332488] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.347 [2024-10-07 11:29:04.332665] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.347 [2024-10-07 11:29:04.332699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.347 [2024-10-07 11:29:04.332718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.347 [2024-10-07 11:29:04.332952] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.347 [2024-10-07 11:29:04.333098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.347 [2024-10-07 11:29:04.333135] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.347 [2024-10-07 11:29:04.333155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.347 [2024-10-07 11:29:04.333209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.347 [2024-10-07 11:29:04.335575] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.347 [2024-10-07 11:29:04.335691] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.347 [2024-10-07 11:29:04.335722] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.347 [2024-10-07 11:29:04.335740] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.347 [2024-10-07 11:29:04.335773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.347 [2024-10-07 11:29:04.335804] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.347 [2024-10-07 11:29:04.335821] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.347 [2024-10-07 11:29:04.335860] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.347 [2024-10-07 11:29:04.335892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.347 [2024-10-07 11:29:04.344348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.347 [2024-10-07 11:29:04.344539] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.347 [2024-10-07 11:29:04.344575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.347 [2024-10-07 11:29:04.344594] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.347 [2024-10-07 11:29:04.344630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.347 [2024-10-07 11:29:04.344663] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.347 [2024-10-07 11:29:04.344680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.347 [2024-10-07 11:29:04.344695] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.347 [2024-10-07 11:29:04.344725] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.347 [2024-10-07 11:29:04.345665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.347 [2024-10-07 11:29:04.345772] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.347 [2024-10-07 11:29:04.345803] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.347 [2024-10-07 11:29:04.345820] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.347 [2024-10-07 11:29:04.345852] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.347 [2024-10-07 11:29:04.346789] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.347 [2024-10-07 11:29:04.346828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.347 [2024-10-07 11:29:04.346847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.347 [2024-10-07 11:29:04.347627] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.347 [2024-10-07 11:29:04.355419] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.347 [2024-10-07 11:29:04.355749] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.347 [2024-10-07 11:29:04.355810] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.347 [2024-10-07 11:29:04.355842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.347 [2024-10-07 11:29:04.355893] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.347 [2024-10-07 11:29:04.357249] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.347 [2024-10-07 11:29:04.357296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.347 [2024-10-07 11:29:04.357318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.347 [2024-10-07 11:29:04.357566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.347 [2024-10-07 11:29:04.357610] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.347 [2024-10-07 11:29:04.358831] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.347 [2024-10-07 11:29:04.358879] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.347 [2024-10-07 11:29:04.358901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.347 [2024-10-07 11:29:04.359757] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.347 [2024-10-07 11:29:04.359911] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.347 [2024-10-07 11:29:04.359948] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.347 [2024-10-07 11:29:04.359966] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.347 [2024-10-07 11:29:04.360001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.347 [2024-10-07 11:29:04.365584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.347 [2024-10-07 11:29:04.365736] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.347 [2024-10-07 11:29:04.365770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.347 [2024-10-07 11:29:04.365789] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.347 [2024-10-07 11:29:04.365822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.347 [2024-10-07 11:29:04.365855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.347 [2024-10-07 11:29:04.365872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.347 [2024-10-07 11:29:04.365888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.347 [2024-10-07 11:29:04.365918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.347 [2024-10-07 11:29:04.367701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.348 [2024-10-07 11:29:04.367842] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.348 [2024-10-07 11:29:04.367876] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.348 [2024-10-07 11:29:04.367894] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.348 [2024-10-07 11:29:04.369179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.348 [2024-10-07 11:29:04.369394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.348 [2024-10-07 11:29:04.369457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.348 [2024-10-07 11:29:04.369477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.348 [2024-10-07 11:29:04.369515] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.348 [2024-10-07 11:29:04.375710] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.348 [2024-10-07 11:29:04.375874] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.348 [2024-10-07 11:29:04.375910] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.348 [2024-10-07 11:29:04.375928] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.348 [2024-10-07 11:29:04.376903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.348 [2024-10-07 11:29:04.377727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.348 [2024-10-07 11:29:04.377768] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.348 [2024-10-07 11:29:04.377788] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.348 [2024-10-07 11:29:04.377895] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.348 [2024-10-07 11:29:04.377956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.348 [2024-10-07 11:29:04.378242] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.348 [2024-10-07 11:29:04.378285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.348 [2024-10-07 11:29:04.378306] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.348 [2024-10-07 11:29:04.378439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.348 [2024-10-07 11:29:04.378502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.348 [2024-10-07 11:29:04.378527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.348 [2024-10-07 11:29:04.378541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.348 [2024-10-07 11:29:04.378572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.348 [2024-10-07 11:29:04.385837] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.348 [2024-10-07 11:29:04.386001] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.348 [2024-10-07 11:29:04.386036] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.348 [2024-10-07 11:29:04.386055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.348 [2024-10-07 11:29:04.386090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.348 [2024-10-07 11:29:04.386121] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.348 [2024-10-07 11:29:04.386138] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.348 [2024-10-07 11:29:04.386152] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.348 [2024-10-07 11:29:04.387351] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.348 [2024-10-07 11:29:04.389752] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.348 [2024-10-07 11:29:04.389868] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.348 [2024-10-07 11:29:04.389899] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.348 [2024-10-07 11:29:04.389917] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.348 [2024-10-07 11:29:04.389949] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.348 [2024-10-07 11:29:04.389980] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.348 [2024-10-07 11:29:04.389997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.348 [2024-10-07 11:29:04.390011] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.348 [2024-10-07 11:29:04.390067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.348 [2024-10-07 11:29:04.395965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.348 [2024-10-07 11:29:04.396101] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.348 [2024-10-07 11:29:04.396134] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.348 [2024-10-07 11:29:04.396153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.348 [2024-10-07 11:29:04.396187] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.348 [2024-10-07 11:29:04.396218] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.348 [2024-10-07 11:29:04.396234] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.348 [2024-10-07 11:29:04.396249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.348 [2024-10-07 11:29:04.396279] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.348 [2024-10-07 11:29:04.400722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.348 [2024-10-07 11:29:04.400921] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.348 [2024-10-07 11:29:04.400955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.348 [2024-10-07 11:29:04.400974] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.348 [2024-10-07 11:29:04.401026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.348 [2024-10-07 11:29:04.401072] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.348 [2024-10-07 11:29:04.401093] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.348 [2024-10-07 11:29:04.401108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.348 [2024-10-07 11:29:04.401139] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.348 [2024-10-07 11:29:04.406078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.348 [2024-10-07 11:29:04.407120] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.348 [2024-10-07 11:29:04.407166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.348 [2024-10-07 11:29:04.407188] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.348 [2024-10-07 11:29:04.407960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.348 [2024-10-07 11:29:04.408084] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.348 [2024-10-07 11:29:04.408117] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.348 [2024-10-07 11:29:04.408136] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.348 [2024-10-07 11:29:04.408184] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.348 [2024-10-07 11:29:04.410830] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.348 [2024-10-07 11:29:04.410954] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.348 [2024-10-07 11:29:04.411008] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.348 [2024-10-07 11:29:04.411027] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.348 [2024-10-07 11:29:04.411073] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.348 [2024-10-07 11:29:04.411123] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.348 [2024-10-07 11:29:04.411143] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.348 [2024-10-07 11:29:04.411157] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.348 [2024-10-07 11:29:04.411188] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.348 [2024-10-07 11:29:04.416194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.348 [2024-10-07 11:29:04.416335] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.348 [2024-10-07 11:29:04.416367] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.348 [2024-10-07 11:29:04.416385] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.348 [2024-10-07 11:29:04.417605] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.348 [2024-10-07 11:29:04.417835] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.348 [2024-10-07 11:29:04.417871] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.348 [2024-10-07 11:29:04.417889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.348 [2024-10-07 11:29:04.419007] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.348 [2024-10-07 11:29:04.420942] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.348 [2024-10-07 11:29:04.421079] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.348 [2024-10-07 11:29:04.421112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.348 [2024-10-07 11:29:04.421130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.348 [2024-10-07 11:29:04.421164] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.348 [2024-10-07 11:29:04.421196] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.348 [2024-10-07 11:29:04.421213] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.348 [2024-10-07 11:29:04.421227] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.348 [2024-10-07 11:29:04.421258] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.348 [2024-10-07 11:29:04.426312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.348 [2024-10-07 11:29:04.426486] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.348 [2024-10-07 11:29:04.426522] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.348 [2024-10-07 11:29:04.426541] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.348 [2024-10-07 11:29:04.426575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.348 [2024-10-07 11:29:04.426635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.348 [2024-10-07 11:29:04.426654] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.348 [2024-10-07 11:29:04.426668] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.348 [2024-10-07 11:29:04.426699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.348 [2024-10-07 11:29:04.431058] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.348 [2024-10-07 11:29:04.431192] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.348 [2024-10-07 11:29:04.431225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.348 [2024-10-07 11:29:04.431243] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.348 [2024-10-07 11:29:04.431276] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.348 [2024-10-07 11:29:04.431308] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.348 [2024-10-07 11:29:04.431325] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.348 [2024-10-07 11:29:04.431340] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.348 [2024-10-07 11:29:04.431370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.348 [2024-10-07 11:29:04.438065] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.348 [2024-10-07 11:29:04.438224] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.348 [2024-10-07 11:29:04.438258] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.349 [2024-10-07 11:29:04.438276] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.349 [2024-10-07 11:29:04.438530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.349 [2024-10-07 11:29:04.438664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.349 [2024-10-07 11:29:04.438701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.349 [2024-10-07 11:29:04.438720] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.349 [2024-10-07 11:29:04.438774] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.349 [2024-10-07 11:29:04.441159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.349 [2024-10-07 11:29:04.441271] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.349 [2024-10-07 11:29:04.441303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.349 [2024-10-07 11:29:04.441320] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.349 [2024-10-07 11:29:04.441370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.349 [2024-10-07 11:29:04.441428] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.349 [2024-10-07 11:29:04.441450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.349 [2024-10-07 11:29:04.441465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.349 [2024-10-07 11:29:04.441496] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.349 [2024-10-07 11:29:04.449942] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.349 [2024-10-07 11:29:04.450169] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.349 [2024-10-07 11:29:04.450205] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.349 [2024-10-07 11:29:04.450223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.349 [2024-10-07 11:29:04.450258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.349 [2024-10-07 11:29:04.450290] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.349 [2024-10-07 11:29:04.450308] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.349 [2024-10-07 11:29:04.450323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.349 [2024-10-07 11:29:04.450354] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.349 [2024-10-07 11:29:04.451245] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.349 [2024-10-07 11:29:04.451354] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.349 [2024-10-07 11:29:04.451390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.349 [2024-10-07 11:29:04.451425] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.349 [2024-10-07 11:29:04.452351] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.349 [2024-10-07 11:29:04.453143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.349 [2024-10-07 11:29:04.453182] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.349 [2024-10-07 11:29:04.453201] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.349 [2024-10-07 11:29:04.453303] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.349 [2024-10-07 11:29:04.461042] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.349 [2024-10-07 11:29:04.461253] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.349 [2024-10-07 11:29:04.461289] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.349 [2024-10-07 11:29:04.461308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.349 [2024-10-07 11:29:04.461342] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.349 [2024-10-07 11:29:04.461390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.349 [2024-10-07 11:29:04.461428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.349 [2024-10-07 11:29:04.461445] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.349 [2024-10-07 11:29:04.461480] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.349 [2024-10-07 11:29:04.461504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.349 [2024-10-07 11:29:04.462741] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.349 [2024-10-07 11:29:04.462785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.349 [2024-10-07 11:29:04.462829] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.349 [2024-10-07 11:29:04.463059] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.349 [2024-10-07 11:29:04.464202] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.349 [2024-10-07 11:29:04.464241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.349 [2024-10-07 11:29:04.464259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.349 [2024-10-07 11:29:04.465104] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.349 [2024-10-07 11:29:04.471199] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.349 [2024-10-07 11:29:04.471375] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.349 [2024-10-07 11:29:04.471426] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.349 [2024-10-07 11:29:04.471449] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.349 [2024-10-07 11:29:04.471484] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.349 [2024-10-07 11:29:04.471538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.349 [2024-10-07 11:29:04.471559] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.349 [2024-10-07 11:29:04.471575] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.349 [2024-10-07 11:29:04.471616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.349 [2024-10-07 11:29:04.471650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.349 [2024-10-07 11:29:04.471730] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.349 [2024-10-07 11:29:04.471758] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.349 [2024-10-07 11:29:04.471775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.349 [2024-10-07 11:29:04.471805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.349 [2024-10-07 11:29:04.471836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.349 [2024-10-07 11:29:04.471853] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.349 [2024-10-07 11:29:04.471867] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.349 [2024-10-07 11:29:04.471896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.349 [2024-10-07 11:29:04.481336] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.349 [2024-10-07 11:29:04.482461] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.349 [2024-10-07 11:29:04.482510] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.349 [2024-10-07 11:29:04.482533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.349 [2024-10-07 11:29:04.483302] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.349 [2024-10-07 11:29:04.483445] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.349 [2024-10-07 11:29:04.483522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.349 [2024-10-07 11:29:04.483543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.349 [2024-10-07 11:29:04.483560] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.349 [2024-10-07 11:29:04.483791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.349 [2024-10-07 11:29:04.483873] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.349 [2024-10-07 11:29:04.483901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.349 [2024-10-07 11:29:04.483919] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.349 [2024-10-07 11:29:04.484033] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.349 [2024-10-07 11:29:04.484096] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.349 [2024-10-07 11:29:04.484119] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.349 [2024-10-07 11:29:04.484134] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.349 [2024-10-07 11:29:04.484186] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.349 [2024-10-07 11:29:04.491499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.349 [2024-10-07 11:29:04.491675] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.349 [2024-10-07 11:29:04.491712] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.349 [2024-10-07 11:29:04.491731] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.349 [2024-10-07 11:29:04.492922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.349 [2024-10-07 11:29:04.493192] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.349 [2024-10-07 11:29:04.493229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.349 [2024-10-07 11:29:04.493249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.349 [2024-10-07 11:29:04.494380] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.349 [2024-10-07 11:29:04.495321] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.349 [2024-10-07 11:29:04.495454] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.349 [2024-10-07 11:29:04.495486] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.349 [2024-10-07 11:29:04.495504] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.349 [2024-10-07 11:29:04.495539] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.349 [2024-10-07 11:29:04.495570] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.349 [2024-10-07 11:29:04.495588] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.349 [2024-10-07 11:29:04.495602] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.349 [2024-10-07 11:29:04.495632] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.349 [2024-10-07 11:29:04.501639] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.350 [2024-10-07 11:29:04.501831] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.350 [2024-10-07 11:29:04.501867] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.350 [2024-10-07 11:29:04.501885] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.350 [2024-10-07 11:29:04.501937] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.350 [2024-10-07 11:29:04.501972] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.350 [2024-10-07 11:29:04.501990] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.350 [2024-10-07 11:29:04.502005] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.350 [2024-10-07 11:29:04.502037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.350 [2024-10-07 11:29:04.506390] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.350 [2024-10-07 11:29:04.506558] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.350 [2024-10-07 11:29:04.506593] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.350 [2024-10-07 11:29:04.506611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.350 [2024-10-07 11:29:04.506645] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.350 [2024-10-07 11:29:04.506677] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.350 [2024-10-07 11:29:04.506694] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.350 [2024-10-07 11:29:04.506718] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.350 [2024-10-07 11:29:04.506749] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.350 [2024-10-07 11:29:04.513429] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.350 [2024-10-07 11:29:04.513617] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.350 [2024-10-07 11:29:04.513653] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.350 [2024-10-07 11:29:04.513671] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.350 [2024-10-07 11:29:04.513907] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.350 [2024-10-07 11:29:04.514040] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.350 [2024-10-07 11:29:04.514077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.350 [2024-10-07 11:29:04.514097] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.350 [2024-10-07 11:29:04.514152] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.350 [2024-10-07 11:29:04.516521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.350 [2024-10-07 11:29:04.516638] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.350 [2024-10-07 11:29:04.516676] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.350 [2024-10-07 11:29:04.516694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.350 [2024-10-07 11:29:04.516753] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.350 [2024-10-07 11:29:04.516785] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.350 [2024-10-07 11:29:04.516802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.350 [2024-10-07 11:29:04.516817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.350 [2024-10-07 11:29:04.516846] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.350 [2024-10-07 11:29:04.525392] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.350 [2024-10-07 11:29:04.525596] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.350 [2024-10-07 11:29:04.525632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.350 [2024-10-07 11:29:04.525651] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.350 [2024-10-07 11:29:04.525686] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.350 [2024-10-07 11:29:04.525718] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.350 [2024-10-07 11:29:04.525735] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.350 [2024-10-07 11:29:04.525751] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.350 [2024-10-07 11:29:04.525782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.350 [2024-10-07 11:29:04.526616] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.350 [2024-10-07 11:29:04.526722] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.350 [2024-10-07 11:29:04.526754] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.350 [2024-10-07 11:29:04.526771] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.350 [2024-10-07 11:29:04.526802] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.350 [2024-10-07 11:29:04.526833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.350 [2024-10-07 11:29:04.526851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.350 [2024-10-07 11:29:04.526865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.350 [2024-10-07 11:29:04.527809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.350 [2024-10-07 11:29:04.536515] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.350 [2024-10-07 11:29:04.536713] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.350 [2024-10-07 11:29:04.536749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.350 [2024-10-07 11:29:04.536768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.350 [2024-10-07 11:29:04.536806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.350 [2024-10-07 11:29:04.536855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.350 [2024-10-07 11:29:04.536876] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.350 [2024-10-07 11:29:04.536918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.350 [2024-10-07 11:29:04.538137] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.350 [2024-10-07 11:29:04.538181] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.350 [2024-10-07 11:29:04.538469] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.350 [2024-10-07 11:29:04.538510] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.350 [2024-10-07 11:29:04.538531] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.350 [2024-10-07 11:29:04.539657] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.350 [2024-10-07 11:29:04.540504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.350 [2024-10-07 11:29:04.540543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.350 [2024-10-07 11:29:04.540562] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.350 [2024-10-07 11:29:04.540699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.350 [2024-10-07 11:29:04.546666] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.350 [2024-10-07 11:29:04.546843] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.350 [2024-10-07 11:29:04.546879] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.350 [2024-10-07 11:29:04.546897] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.350 [2024-10-07 11:29:04.546933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.350 [2024-10-07 11:29:04.546969] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.350 [2024-10-07 11:29:04.546987] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.350 [2024-10-07 11:29:04.547003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.350 [2024-10-07 11:29:04.547034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.350 [2024-10-07 11:29:04.548564] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.350 [2024-10-07 11:29:04.548693] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.350 [2024-10-07 11:29:04.548740] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.350 [2024-10-07 11:29:04.548760] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.350 [2024-10-07 11:29:04.548793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.350 [2024-10-07 11:29:04.548824] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.350 [2024-10-07 11:29:04.548841] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.350 [2024-10-07 11:29:04.548855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.350 [2024-10-07 11:29:04.548885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.350 [2024-10-07 11:29:04.556804] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.350 [2024-10-07 11:29:04.557946] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.350 [2024-10-07 11:29:04.557994] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.350 [2024-10-07 11:29:04.558015] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.350 [2024-10-07 11:29:04.558809] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.350 [2024-10-07 11:29:04.559144] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.350 [2024-10-07 11:29:04.559184] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.350 [2024-10-07 11:29:04.559204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.350 [2024-10-07 11:29:04.559323] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.350 [2024-10-07 11:29:04.559354] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.350 [2024-10-07 11:29:04.559471] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.350 [2024-10-07 11:29:04.559508] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.350 [2024-10-07 11:29:04.559526] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.350 [2024-10-07 11:29:04.559559] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.350 [2024-10-07 11:29:04.559590] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.350 [2024-10-07 11:29:04.559608] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.350 [2024-10-07 11:29:04.559622] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.350 [2024-10-07 11:29:04.559652] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.350 [2024-10-07 11:29:04.566972] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.350 [2024-10-07 11:29:04.568310] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.350 [2024-10-07 11:29:04.568359] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.350 [2024-10-07 11:29:04.568381] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.350 [2024-10-07 11:29:04.568606] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.350 [2024-10-07 11:29:04.569767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.350 [2024-10-07 11:29:04.569806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.350 [2024-10-07 11:29:04.569826] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.350 [2024-10-07 11:29:04.570688] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.350 [2024-10-07 11:29:04.570842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.350 [2024-10-07 11:29:04.570952] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.350 [2024-10-07 11:29:04.570995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.350 [2024-10-07 11:29:04.571015] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.351 [2024-10-07 11:29:04.571208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.351 [2024-10-07 11:29:04.571389] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.351 [2024-10-07 11:29:04.571438] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.351 [2024-10-07 11:29:04.571456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.351 [2024-10-07 11:29:04.571577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.351 [2024-10-07 11:29:04.577118] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.351 [2024-10-07 11:29:04.577277] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.351 [2024-10-07 11:29:04.577311] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.351 [2024-10-07 11:29:04.577329] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.351 [2024-10-07 11:29:04.577363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.351 [2024-10-07 11:29:04.577396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.351 [2024-10-07 11:29:04.577433] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.351 [2024-10-07 11:29:04.577450] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.351 [2024-10-07 11:29:04.577482] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.351 [2024-10-07 11:29:04.581811] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.351 [2024-10-07 11:29:04.581966] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.351 [2024-10-07 11:29:04.582002] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.351 [2024-10-07 11:29:04.582020] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.351 [2024-10-07 11:29:04.582056] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.351 [2024-10-07 11:29:04.582088] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.351 [2024-10-07 11:29:04.582106] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.351 [2024-10-07 11:29:04.582121] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.351 [2024-10-07 11:29:04.582151] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.351 [2024-10-07 11:29:04.588877] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.351 [2024-10-07 11:29:04.589052] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.351 [2024-10-07 11:29:04.589118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.351 [2024-10-07 11:29:04.589154] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.351 [2024-10-07 11:29:04.589432] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.351 [2024-10-07 11:29:04.589580] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.351 [2024-10-07 11:29:04.589619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.351 [2024-10-07 11:29:04.589640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.351 [2024-10-07 11:29:04.589721] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.351 [2024-10-07 11:29:04.591985] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.351 [2024-10-07 11:29:04.592103] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.351 [2024-10-07 11:29:04.592134] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.351 [2024-10-07 11:29:04.592152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.351 [2024-10-07 11:29:04.592201] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.351 [2024-10-07 11:29:04.592237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.351 [2024-10-07 11:29:04.592254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.351 [2024-10-07 11:29:04.592268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.351 [2024-10-07 11:29:04.592298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.351 [2024-10-07 11:29:04.600769] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.351 [2024-10-07 11:29:04.600940] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.351 [2024-10-07 11:29:04.600980] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.351 [2024-10-07 11:29:04.601000] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.351 [2024-10-07 11:29:04.601034] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.351 [2024-10-07 11:29:04.601078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.351 [2024-10-07 11:29:04.601098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.351 [2024-10-07 11:29:04.601114] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.351 [2024-10-07 11:29:04.601145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.351 [2024-10-07 11:29:04.602078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.351 [2024-10-07 11:29:04.602186] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.351 [2024-10-07 11:29:04.602217] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.351 [2024-10-07 11:29:04.602234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.351 [2024-10-07 11:29:04.602265] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.351 [2024-10-07 11:29:04.602296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.351 [2024-10-07 11:29:04.602314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.351 [2024-10-07 11:29:04.602328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.351 [2024-10-07 11:29:04.603310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.351 [2024-10-07 11:29:04.611796] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.351 [2024-10-07 11:29:04.612049] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.351 [2024-10-07 11:29:04.612096] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.351 [2024-10-07 11:29:04.612142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.351 [2024-10-07 11:29:04.612181] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.351 [2024-10-07 11:29:04.612241] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.351 [2024-10-07 11:29:04.612270] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.351 [2024-10-07 11:29:04.612287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.351 [2024-10-07 11:29:04.612322] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.351 [2024-10-07 11:29:04.612345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.351 [2024-10-07 11:29:04.612436] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.351 [2024-10-07 11:29:04.612468] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.351 [2024-10-07 11:29:04.612484] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.351 [2024-10-07 11:29:04.613715] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.351 [2024-10-07 11:29:04.613975] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.351 [2024-10-07 11:29:04.614013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.351 [2024-10-07 11:29:04.614032] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.351 [2024-10-07 11:29:04.615167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.351 [2024-10-07 11:29:04.622037] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.351 [2024-10-07 11:29:04.622185] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.351 [2024-10-07 11:29:04.622219] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.351 [2024-10-07 11:29:04.622238] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.351 [2024-10-07 11:29:04.622272] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.351 [2024-10-07 11:29:04.622307] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.351 [2024-10-07 11:29:04.622324] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.351 [2024-10-07 11:29:04.622339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.351 [2024-10-07 11:29:04.622371] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.351 [2024-10-07 11:29:04.622455] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.351 [2024-10-07 11:29:04.622546] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.351 [2024-10-07 11:29:04.622575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.351 [2024-10-07 11:29:04.622591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.351 [2024-10-07 11:29:04.622623] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.351 [2024-10-07 11:29:04.622679] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.351 [2024-10-07 11:29:04.622698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.351 [2024-10-07 11:29:04.622713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.351 [2024-10-07 11:29:04.622742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.351 [2024-10-07 11:29:04.632148] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.351 [2024-10-07 11:29:04.632325] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.351 [2024-10-07 11:29:04.632360] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.351 [2024-10-07 11:29:04.632379] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.351 [2024-10-07 11:29:04.633332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.351 [2024-10-07 11:29:04.634154] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.351 [2024-10-07 11:29:04.634200] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.351 [2024-10-07 11:29:04.634220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.351 [2024-10-07 11:29:04.634329] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.351 [2024-10-07 11:29:04.634359] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.351 [2024-10-07 11:29:04.634460] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.351 [2024-10-07 11:29:04.634492] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.351 [2024-10-07 11:29:04.634510] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.351 [2024-10-07 11:29:04.634543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.351 [2024-10-07 11:29:04.634574] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.351 [2024-10-07 11:29:04.634591] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.351 [2024-10-07 11:29:04.634606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.351 [2024-10-07 11:29:04.634831] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.351 [2024-10-07 11:29:04.642289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.351 [2024-10-07 11:29:04.642493] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.351 [2024-10-07 11:29:04.642529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.351 [2024-10-07 11:29:04.642548] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.351 [2024-10-07 11:29:04.642584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.351 [2024-10-07 11:29:04.643775] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.351 [2024-10-07 11:29:04.643814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.351 [2024-10-07 11:29:04.643834] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.351 [2024-10-07 11:29:04.644068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.351 [2024-10-07 11:29:04.646226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.352 [2024-10-07 11:29:04.646348] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.352 [2024-10-07 11:29:04.646380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.352 [2024-10-07 11:29:04.646414] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.352 [2024-10-07 11:29:04.646453] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.352 [2024-10-07 11:29:04.646484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.352 [2024-10-07 11:29:04.646503] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.352 [2024-10-07 11:29:04.646517] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.352 [2024-10-07 11:29:04.646547] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.352 [2024-10-07 11:29:04.652446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.352 [2024-10-07 11:29:04.652577] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.352 [2024-10-07 11:29:04.652610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.352 [2024-10-07 11:29:04.652628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.352 [2024-10-07 11:29:04.652661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.352 [2024-10-07 11:29:04.652710] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.352 [2024-10-07 11:29:04.652730] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.352 [2024-10-07 11:29:04.652746] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.352 [2024-10-07 11:29:04.652777] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.352 [2024-10-07 11:29:04.657231] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.352 [2024-10-07 11:29:04.657351] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.352 [2024-10-07 11:29:04.657383] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.352 [2024-10-07 11:29:04.657416] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.352 [2024-10-07 11:29:04.657455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.352 [2024-10-07 11:29:04.657507] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.352 [2024-10-07 11:29:04.657532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.352 [2024-10-07 11:29:04.657547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.352 [2024-10-07 11:29:04.657579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.352 [2024-10-07 11:29:04.664180] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.352 [2024-10-07 11:29:04.664343] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.352 [2024-10-07 11:29:04.664377] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.352 [2024-10-07 11:29:04.664436] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.352 [2024-10-07 11:29:04.664674] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.352 [2024-10-07 11:29:04.664808] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.352 [2024-10-07 11:29:04.664845] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.352 [2024-10-07 11:29:04.664865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.352 [2024-10-07 11:29:04.664920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.352 [2024-10-07 11:29:04.667325] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.352 [2024-10-07 11:29:04.667459] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.352 [2024-10-07 11:29:04.667493] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.352 [2024-10-07 11:29:04.667510] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.352 [2024-10-07 11:29:04.667544] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.352 [2024-10-07 11:29:04.667575] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.352 [2024-10-07 11:29:04.667593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.352 [2024-10-07 11:29:04.667607] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.352 [2024-10-07 11:29:04.667637] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.352 [2024-10-07 11:29:04.676054] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.352 [2024-10-07 11:29:04.676226] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.352 [2024-10-07 11:29:04.676260] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.352 [2024-10-07 11:29:04.676280] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.352 [2024-10-07 11:29:04.676314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.352 [2024-10-07 11:29:04.676346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.352 [2024-10-07 11:29:04.676363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.352 [2024-10-07 11:29:04.676379] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.352 [2024-10-07 11:29:04.676427] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.352 [2024-10-07 11:29:04.677433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.352 [2024-10-07 11:29:04.677562] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.352 [2024-10-07 11:29:04.677610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.352 [2024-10-07 11:29:04.677629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.352 [2024-10-07 11:29:04.678573] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.352 [2024-10-07 11:29:04.679357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.352 [2024-10-07 11:29:04.679431] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.352 [2024-10-07 11:29:04.679467] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.352 [2024-10-07 11:29:04.679583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.352 [2024-10-07 11:29:04.686927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.352 [2024-10-07 11:29:04.687258] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.352 [2024-10-07 11:29:04.687304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.352 [2024-10-07 11:29:04.687326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.352 [2024-10-07 11:29:04.687443] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.352 [2024-10-07 11:29:04.687485] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.352 [2024-10-07 11:29:04.687505] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.352 [2024-10-07 11:29:04.687521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.352 [2024-10-07 11:29:04.687554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.352 [2024-10-07 11:29:04.687606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.352 [2024-10-07 11:29:04.687691] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.352 [2024-10-07 11:29:04.687720] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.352 [2024-10-07 11:29:04.687737] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.352 [2024-10-07 11:29:04.688917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.352 [2024-10-07 11:29:04.689161] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.352 [2024-10-07 11:29:04.689199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.352 [2024-10-07 11:29:04.689218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.352 [2024-10-07 11:29:04.690357] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.352 [2024-10-07 11:29:04.697161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.352 [2024-10-07 11:29:04.697321] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.352 [2024-10-07 11:29:04.697356] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.352 [2024-10-07 11:29:04.697375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.352 [2024-10-07 11:29:04.697424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.352 [2024-10-07 11:29:04.697464] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.352 [2024-10-07 11:29:04.697495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.352 [2024-10-07 11:29:04.697521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.352 [2024-10-07 11:29:04.697557] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.352 [2024-10-07 11:29:04.697673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.352 [2024-10-07 11:29:04.697787] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.352 [2024-10-07 11:29:04.697817] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.352 [2024-10-07 11:29:04.697835] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.352 [2024-10-07 11:29:04.697866] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.352 [2024-10-07 11:29:04.697896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.352 [2024-10-07 11:29:04.697913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.352 [2024-10-07 11:29:04.697927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.352 [2024-10-07 11:29:04.697956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.352 [2024-10-07 11:29:04.707282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.352 [2024-10-07 11:29:04.707467] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.352 [2024-10-07 11:29:04.707504] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.352 [2024-10-07 11:29:04.707522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.352 [2024-10-07 11:29:04.708461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.352 [2024-10-07 11:29:04.709280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.352 [2024-10-07 11:29:04.709322] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.352 [2024-10-07 11:29:04.709342] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.352 [2024-10-07 11:29:04.709461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.352 [2024-10-07 11:29:04.709506] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.352 [2024-10-07 11:29:04.709601] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.352 [2024-10-07 11:29:04.709632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.352 [2024-10-07 11:29:04.709649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.352 [2024-10-07 11:29:04.709880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.352 [2024-10-07 11:29:04.710013] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.353 [2024-10-07 11:29:04.710050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.353 [2024-10-07 11:29:04.710069] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.353 [2024-10-07 11:29:04.710121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.353 [2024-10-07 11:29:04.717430] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.353 [2024-10-07 11:29:04.717577] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.353 [2024-10-07 11:29:04.717618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.353 [2024-10-07 11:29:04.717639] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.353 [2024-10-07 11:29:04.718844] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.353 [2024-10-07 11:29:04.719077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.353 [2024-10-07 11:29:04.719114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.353 [2024-10-07 11:29:04.719133] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.353 [2024-10-07 11:29:04.720253] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.353 [2024-10-07 11:29:04.721241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.353 [2024-10-07 11:29:04.721357] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.353 [2024-10-07 11:29:04.721389] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.353 [2024-10-07 11:29:04.721422] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.353 [2024-10-07 11:29:04.721459] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.353 [2024-10-07 11:29:04.721512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.353 [2024-10-07 11:29:04.721534] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.353 [2024-10-07 11:29:04.721549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.353 [2024-10-07 11:29:04.721580] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.353 [2024-10-07 11:29:04.727552] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.353 [2024-10-07 11:29:04.727698] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.353 [2024-10-07 11:29:04.727732] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.353 [2024-10-07 11:29:04.727750] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.353 [2024-10-07 11:29:04.727784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.353 [2024-10-07 11:29:04.727815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.353 [2024-10-07 11:29:04.727832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.353 [2024-10-07 11:29:04.727847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.353 [2024-10-07 11:29:04.727877] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.353 [2024-10-07 11:29:04.732246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.353 [2024-10-07 11:29:04.732378] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.353 [2024-10-07 11:29:04.732425] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.353 [2024-10-07 11:29:04.732456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.353 [2024-10-07 11:29:04.732504] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.353 [2024-10-07 11:29:04.732538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.353 [2024-10-07 11:29:04.732555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.353 [2024-10-07 11:29:04.732594] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.353 [2024-10-07 11:29:04.732627] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.353 [2024-10-07 11:29:04.739282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.353 [2024-10-07 11:29:04.739456] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.353 [2024-10-07 11:29:04.739490] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.353 [2024-10-07 11:29:04.739508] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.353 [2024-10-07 11:29:04.739544] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.353 [2024-10-07 11:29:04.739576] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.353 [2024-10-07 11:29:04.739592] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.353 [2024-10-07 11:29:04.739607] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.353 [2024-10-07 11:29:04.739840] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.353 [2024-10-07 11:29:04.742500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.353 [2024-10-07 11:29:04.742618] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.353 [2024-10-07 11:29:04.742650] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.353 [2024-10-07 11:29:04.742668] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.353 [2024-10-07 11:29:04.742701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.353 [2024-10-07 11:29:04.742732] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.353 [2024-10-07 11:29:04.742750] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.353 [2024-10-07 11:29:04.742764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.353 [2024-10-07 11:29:04.742793] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.353 [2024-10-07 11:29:04.751719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.353 [2024-10-07 11:29:04.751973] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.353 [2024-10-07 11:29:04.752020] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.353 [2024-10-07 11:29:04.752041] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.353 [2024-10-07 11:29:04.752244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.353 [2024-10-07 11:29:04.752421] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.353 [2024-10-07 11:29:04.752454] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.353 [2024-10-07 11:29:04.752472] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.353 [2024-10-07 11:29:04.752614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.353 [2024-10-07 11:29:04.752704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.353 [2024-10-07 11:29:04.752805] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.353 [2024-10-07 11:29:04.752875] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.353 [2024-10-07 11:29:04.752898] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.353 [2024-10-07 11:29:04.752931] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.353 [2024-10-07 11:29:04.752962] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.353 [2024-10-07 11:29:04.752979] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.353 [2024-10-07 11:29:04.752993] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.353 [2024-10-07 11:29:04.753023] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.353 [2024-10-07 11:29:04.762732] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.353 [2024-10-07 11:29:04.762928] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.353 [2024-10-07 11:29:04.762965] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.353 [2024-10-07 11:29:04.762983] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.353 [2024-10-07 11:29:04.763034] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.353 [2024-10-07 11:29:04.763074] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.353 [2024-10-07 11:29:04.763107] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.353 [2024-10-07 11:29:04.763124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.353 [2024-10-07 11:29:04.763139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.353 [2024-10-07 11:29:04.764327] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.353 [2024-10-07 11:29:04.764426] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.353 [2024-10-07 11:29:04.764456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.353 [2024-10-07 11:29:04.764474] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.353 [2024-10-07 11:29:04.764703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.353 [2024-10-07 11:29:04.765856] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.353 [2024-10-07 11:29:04.765896] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.353 [2024-10-07 11:29:04.765914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.353 [2024-10-07 11:29:04.766744] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.353 [2024-10-07 11:29:04.772881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.353 [2024-10-07 11:29:04.773027] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.353 [2024-10-07 11:29:04.773074] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.353 [2024-10-07 11:29:04.773094] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.353 [2024-10-07 11:29:04.773130] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.353 [2024-10-07 11:29:04.773222] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.353 [2024-10-07 11:29:04.773247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.353 [2024-10-07 11:29:04.773263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.353 [2024-10-07 11:29:04.773295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.353 [2024-10-07 11:29:04.773318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.353 [2024-10-07 11:29:04.773393] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.353 [2024-10-07 11:29:04.773437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.353 [2024-10-07 11:29:04.773456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.353 [2024-10-07 11:29:04.773487] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.353 [2024-10-07 11:29:04.773519] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.354 [2024-10-07 11:29:04.773536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.354 [2024-10-07 11:29:04.773550] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.354 [2024-10-07 11:29:04.773579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.354 [2024-10-07 11:29:04.783000] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.354 [2024-10-07 11:29:04.784241] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.354 [2024-10-07 11:29:04.784312] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.354 [2024-10-07 11:29:04.784351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.354 [2024-10-07 11:29:04.785298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.354 [2024-10-07 11:29:04.785653] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.354 [2024-10-07 11:29:04.785711] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.354 [2024-10-07 11:29:04.785734] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.354 [2024-10-07 11:29:04.785751] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.354 [2024-10-07 11:29:04.785867] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.354 [2024-10-07 11:29:04.785944] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.354 [2024-10-07 11:29:04.785973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.354 [2024-10-07 11:29:04.785991] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.354 [2024-10-07 11:29:04.786063] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.354 [2024-10-07 11:29:04.786103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.354 [2024-10-07 11:29:04.786121] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.354 [2024-10-07 11:29:04.786135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.354 [2024-10-07 11:29:04.786192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.354 [2024-10-07 11:29:04.793291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.354 [2024-10-07 11:29:04.794693] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.354 [2024-10-07 11:29:04.794746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.354 [2024-10-07 11:29:04.794769] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.354 [2024-10-07 11:29:04.795006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.354 [2024-10-07 11:29:04.796157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.354 [2024-10-07 11:29:04.796199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.354 [2024-10-07 11:29:04.796230] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.354 [2024-10-07 11:29:04.797114] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.354 [2024-10-07 11:29:04.797253] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.354 [2024-10-07 11:29:04.797368] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.354 [2024-10-07 11:29:04.797420] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.354 [2024-10-07 11:29:04.797443] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.354 [2024-10-07 11:29:04.797477] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.354 [2024-10-07 11:29:04.797671] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.354 [2024-10-07 11:29:04.797706] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.354 [2024-10-07 11:29:04.797725] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.354 [2024-10-07 11:29:04.797864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.354 [2024-10-07 11:29:04.803467] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.354 [2024-10-07 11:29:04.803650] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.354 [2024-10-07 11:29:04.803686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.354 [2024-10-07 11:29:04.803705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.354 [2024-10-07 11:29:04.803741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.354 [2024-10-07 11:29:04.803772] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.354 [2024-10-07 11:29:04.803789] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.354 [2024-10-07 11:29:04.803805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.354 [2024-10-07 11:29:04.803836] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.354 [2024-10-07 11:29:04.808189] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.354 [2024-10-07 11:29:04.808350] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.354 [2024-10-07 11:29:04.808384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.354 [2024-10-07 11:29:04.808446] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.354 [2024-10-07 11:29:04.808486] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.354 [2024-10-07 11:29:04.808518] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.354 [2024-10-07 11:29:04.808536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.354 [2024-10-07 11:29:04.808551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.354 [2024-10-07 11:29:04.808582] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.354 [2024-10-07 11:29:04.815196] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.354 [2024-10-07 11:29:04.815393] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.354 [2024-10-07 11:29:04.815443] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.354 [2024-10-07 11:29:04.815464] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.354 [2024-10-07 11:29:04.815700] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.354 [2024-10-07 11:29:04.815832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.354 [2024-10-07 11:29:04.815869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.354 [2024-10-07 11:29:04.815888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.354 [2024-10-07 11:29:04.815944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.354 [2024-10-07 11:29:04.818311] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.354 [2024-10-07 11:29:04.818452] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.354 [2024-10-07 11:29:04.818485] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.354 [2024-10-07 11:29:04.818504] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.354 [2024-10-07 11:29:04.818538] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.354 [2024-10-07 11:29:04.818569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.354 [2024-10-07 11:29:04.818587] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.354 [2024-10-07 11:29:04.818601] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.354 [2024-10-07 11:29:04.818631] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.354 [2024-10-07 11:29:04.827145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.354 [2024-10-07 11:29:04.827327] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.354 [2024-10-07 11:29:04.827362] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.354 [2024-10-07 11:29:04.827381] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.354 [2024-10-07 11:29:04.827434] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.354 [2024-10-07 11:29:04.827470] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.354 [2024-10-07 11:29:04.827513] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.354 [2024-10-07 11:29:04.827529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.354 [2024-10-07 11:29:04.827727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.354 [2024-10-07 11:29:04.828423] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.354 [2024-10-07 11:29:04.828530] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.354 [2024-10-07 11:29:04.828566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.354 [2024-10-07 11:29:04.828586] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.354 [2024-10-07 11:29:04.829576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.354 [2024-10-07 11:29:04.830367] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.354 [2024-10-07 11:29:04.830419] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.354 [2024-10-07 11:29:04.830440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.354 [2024-10-07 11:29:04.830545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.354 [2024-10-07 11:29:04.838198] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.354 [2024-10-07 11:29:04.838462] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.354 [2024-10-07 11:29:04.838500] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.354 [2024-10-07 11:29:04.838520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.354 [2024-10-07 11:29:04.838558] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.354 [2024-10-07 11:29:04.838607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.354 [2024-10-07 11:29:04.838629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.354 [2024-10-07 11:29:04.838645] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.354 [2024-10-07 11:29:04.838677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.354 [2024-10-07 11:29:04.838699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.354 [2024-10-07 11:29:04.839934] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.354 [2024-10-07 11:29:04.839978] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.354 [2024-10-07 11:29:04.839998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.354 [2024-10-07 11:29:04.840206] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.354 [2024-10-07 11:29:04.840274] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.354 [2024-10-07 11:29:04.840296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.354 [2024-10-07 11:29:04.840310] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.354 [2024-10-07 11:29:04.841448] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.354 [2024-10-07 11:29:04.848339] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.354 [2024-10-07 11:29:04.848516] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.354 [2024-10-07 11:29:04.848552] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.354 [2024-10-07 11:29:04.848571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.354 [2024-10-07 11:29:04.848604] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.354 [2024-10-07 11:29:04.848641] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.354 [2024-10-07 11:29:04.848659] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.354 [2024-10-07 11:29:04.848675] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.354 [2024-10-07 11:29:04.848705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.354 [2024-10-07 11:29:04.848763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.354 [2024-10-07 11:29:04.848843] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.354 [2024-10-07 11:29:04.848871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.354 [2024-10-07 11:29:04.848887] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.354 [2024-10-07 11:29:04.848917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.354 [2024-10-07 11:29:04.848947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.355 [2024-10-07 11:29:04.848964] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.355 [2024-10-07 11:29:04.848978] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.355 [2024-10-07 11:29:04.849007] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.355 [2024-10-07 11:29:04.858480] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.355 [2024-10-07 11:29:04.859562] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.355 [2024-10-07 11:29:04.859610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.355 [2024-10-07 11:29:04.859632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.355 [2024-10-07 11:29:04.860426] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.355 [2024-10-07 11:29:04.860556] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.355 [2024-10-07 11:29:04.860603] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.355 [2024-10-07 11:29:04.860624] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.355 [2024-10-07 11:29:04.860649] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.355 [2024-10-07 11:29:04.860874] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.355 [2024-10-07 11:29:04.860953] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.355 [2024-10-07 11:29:04.860981] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.355 [2024-10-07 11:29:04.861021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.355 [2024-10-07 11:29:04.861154] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.355 [2024-10-07 11:29:04.861219] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.355 [2024-10-07 11:29:04.861242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.355 [2024-10-07 11:29:04.861256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.355 [2024-10-07 11:29:04.861288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.355 [2024-10-07 11:29:04.868620] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.355 [2024-10-07 11:29:04.868786] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.355 [2024-10-07 11:29:04.868820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.355 [2024-10-07 11:29:04.868838] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.355 [2024-10-07 11:29:04.870058] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.355 [2024-10-07 11:29:04.870295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.355 [2024-10-07 11:29:04.870331] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.355 [2024-10-07 11:29:04.870350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.355 [2024-10-07 11:29:04.871481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.355 [2024-10-07 11:29:04.872457] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.355 [2024-10-07 11:29:04.872585] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.355 [2024-10-07 11:29:04.872627] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.355 [2024-10-07 11:29:04.872647] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.355 [2024-10-07 11:29:04.872681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.355 [2024-10-07 11:29:04.872713] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.355 [2024-10-07 11:29:04.872730] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.355 [2024-10-07 11:29:04.872744] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.355 [2024-10-07 11:29:04.872774] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.355 [2024-10-07 11:29:04.878747] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.355 [2024-10-07 11:29:04.878901] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.355 [2024-10-07 11:29:04.878935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.355 [2024-10-07 11:29:04.878953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.355 [2024-10-07 11:29:04.878987] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.355 [2024-10-07 11:29:04.879018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.355 [2024-10-07 11:29:04.879035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.355 [2024-10-07 11:29:04.879077] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.355 [2024-10-07 11:29:04.879110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.355 [2024-10-07 11:29:04.882552] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.355 [2024-10-07 11:29:04.883394] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.355 [2024-10-07 11:29:04.883451] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.355 [2024-10-07 11:29:04.883471] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.355 [2024-10-07 11:29:04.883654] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.355 [2024-10-07 11:29:04.883782] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.355 [2024-10-07 11:29:04.883815] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.355 [2024-10-07 11:29:04.883832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.355 [2024-10-07 11:29:04.883865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.355 [2024-10-07 11:29:04.888875] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.355 [2024-10-07 11:29:04.889962] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.355 [2024-10-07 11:29:04.890010] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.355 [2024-10-07 11:29:04.890031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.355 [2024-10-07 11:29:04.890814] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.355 [2024-10-07 11:29:04.890936] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.355 [2024-10-07 11:29:04.890969] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.355 [2024-10-07 11:29:04.890988] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.355 [2024-10-07 11:29:04.891215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.355 [2024-10-07 11:29:04.892647] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.355 [2024-10-07 11:29:04.892758] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.355 [2024-10-07 11:29:04.892791] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.355 [2024-10-07 11:29:04.892809] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.355 [2024-10-07 11:29:04.893557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.355 [2024-10-07 11:29:04.893764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.355 [2024-10-07 11:29:04.893799] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.355 [2024-10-07 11:29:04.893817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.355 [2024-10-07 11:29:04.893901] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.355 [2024-10-07 11:29:04.899607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.355 [2024-10-07 11:29:04.899778] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.355 [2024-10-07 11:29:04.899814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.355 [2024-10-07 11:29:04.899832] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.355 [2024-10-07 11:29:04.899867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.355 [2024-10-07 11:29:04.899900] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.355 [2024-10-07 11:29:04.899917] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.355 [2024-10-07 11:29:04.899933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.355 [2024-10-07 11:29:04.899981] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.355 [2024-10-07 11:29:04.903785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.355 [2024-10-07 11:29:04.903925] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.355 [2024-10-07 11:29:04.903965] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.355 [2024-10-07 11:29:04.903985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.355 [2024-10-07 11:29:04.904019] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.355 [2024-10-07 11:29:04.904219] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.355 [2024-10-07 11:29:04.904255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.355 [2024-10-07 11:29:04.904274] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.355 [2024-10-07 11:29:04.904429] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.355 [2024-10-07 11:29:04.909748] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.355 [2024-10-07 11:29:04.909895] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.355 [2024-10-07 11:29:04.909928] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.355 [2024-10-07 11:29:04.909947] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.355 [2024-10-07 11:29:04.909981] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.355 [2024-10-07 11:29:04.910012] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.355 [2024-10-07 11:29:04.910028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.355 [2024-10-07 11:29:04.910044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.355 [2024-10-07 11:29:04.910075] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.355 [2024-10-07 11:29:04.915035] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.355 [2024-10-07 11:29:04.915208] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.355 [2024-10-07 11:29:04.915244] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.355 [2024-10-07 11:29:04.915263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.355 [2024-10-07 11:29:04.916521] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.355 [2024-10-07 11:29:04.916788] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.355 [2024-10-07 11:29:04.916827] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.355 [2024-10-07 11:29:04.916847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.355 [2024-10-07 11:29:04.918035] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.355 [2024-10-07 11:29:04.919862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.355 [2024-10-07 11:29:04.920005] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.355 [2024-10-07 11:29:04.920051] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.355 [2024-10-07 11:29:04.920073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.355 [2024-10-07 11:29:04.920108] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.356 [2024-10-07 11:29:04.920139] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.356 [2024-10-07 11:29:04.920156] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.356 [2024-10-07 11:29:04.920171] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.356 [2024-10-07 11:29:04.920202] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.356 [2024-10-07 11:29:04.925166] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.356 [2024-10-07 11:29:04.925315] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.356 [2024-10-07 11:29:04.925349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.356 [2024-10-07 11:29:04.925367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.356 [2024-10-07 11:29:04.925416] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.356 [2024-10-07 11:29:04.925468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.356 [2024-10-07 11:29:04.925490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.356 [2024-10-07 11:29:04.925505] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.356 [2024-10-07 11:29:04.925536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.356 [2024-10-07 11:29:04.930083] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.356 [2024-10-07 11:29:04.930232] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.356 [2024-10-07 11:29:04.930265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.356 [2024-10-07 11:29:04.930283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.356 [2024-10-07 11:29:04.930316] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.356 [2024-10-07 11:29:04.930348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.356 [2024-10-07 11:29:04.930365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.356 [2024-10-07 11:29:04.930422] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.356 [2024-10-07 11:29:04.930459] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.356 [2024-10-07 11:29:04.935284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.356 [2024-10-07 11:29:04.936356] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.356 [2024-10-07 11:29:04.936416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.356 [2024-10-07 11:29:04.936441] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.356 [2024-10-07 11:29:04.937209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.356 [2024-10-07 11:29:04.937334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.356 [2024-10-07 11:29:04.937368] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.356 [2024-10-07 11:29:04.937386] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.356 [2024-10-07 11:29:04.937435] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.356 [2024-10-07 11:29:04.940199] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.356 [2024-10-07 11:29:04.940328] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.356 [2024-10-07 11:29:04.940372] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.356 [2024-10-07 11:29:04.940392] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.356 [2024-10-07 11:29:04.940441] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.356 [2024-10-07 11:29:04.940473] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.356 [2024-10-07 11:29:04.940490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.356 [2024-10-07 11:29:04.940505] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.356 [2024-10-07 11:29:04.940535] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.356 [2024-10-07 11:29:04.945428] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.356 [2024-10-07 11:29:04.945594] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.356 [2024-10-07 11:29:04.945629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.356 [2024-10-07 11:29:04.945648] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.356 [2024-10-07 11:29:04.945684] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.356 [2024-10-07 11:29:04.946879] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.356 [2024-10-07 11:29:04.946918] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.356 [2024-10-07 11:29:04.946939] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.356 [2024-10-07 11:29:04.947172] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.356 [2024-10-07 11:29:04.950305] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.356 [2024-10-07 11:29:04.950485] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.356 [2024-10-07 11:29:04.950549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.356 [2024-10-07 11:29:04.950570] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.356 [2024-10-07 11:29:04.950607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.356 [2024-10-07 11:29:04.950639] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.356 [2024-10-07 11:29:04.950656] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.356 [2024-10-07 11:29:04.950672] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.356 [2024-10-07 11:29:04.950703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.356 [2024-10-07 11:29:04.955562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.356 [2024-10-07 11:29:04.955762] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.356 [2024-10-07 11:29:04.955800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.356 [2024-10-07 11:29:04.955818] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.356 [2024-10-07 11:29:04.955872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.356 [2024-10-07 11:29:04.955908] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.356 [2024-10-07 11:29:04.955926] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.356 [2024-10-07 11:29:04.955941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.356 [2024-10-07 11:29:04.955972] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.356 [2024-10-07 11:29:04.960552] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.356 [2024-10-07 11:29:04.960730] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.356 [2024-10-07 11:29:04.960764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.356 [2024-10-07 11:29:04.960783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.356 [2024-10-07 11:29:04.960817] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.356 [2024-10-07 11:29:04.960849] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.356 [2024-10-07 11:29:04.960866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.356 [2024-10-07 11:29:04.960881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.356 [2024-10-07 11:29:04.960912] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.356 [2024-10-07 11:29:04.965711] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.356 [2024-10-07 11:29:04.965873] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.356 [2024-10-07 11:29:04.965907] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.356 [2024-10-07 11:29:04.965926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.356 [2024-10-07 11:29:04.966871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.356 [2024-10-07 11:29:04.967679] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.356 [2024-10-07 11:29:04.967719] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.356 [2024-10-07 11:29:04.967739] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.356 [2024-10-07 11:29:04.967843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.356 [2024-10-07 11:29:04.970687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.356 [2024-10-07 11:29:04.970834] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.356 [2024-10-07 11:29:04.970869] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.356 [2024-10-07 11:29:04.970887] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.356 [2024-10-07 11:29:04.970921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.356 [2024-10-07 11:29:04.970952] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.356 [2024-10-07 11:29:04.970969] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.356 [2024-10-07 11:29:04.970984] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.356 [2024-10-07 11:29:04.971014] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.356 [2024-10-07 11:29:04.975850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.356 [2024-10-07 11:29:04.976045] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.356 [2024-10-07 11:29:04.976081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.356 [2024-10-07 11:29:04.976100] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.356 [2024-10-07 11:29:04.976135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.356 [2024-10-07 11:29:04.977347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.356 [2024-10-07 11:29:04.977388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.356 [2024-10-07 11:29:04.977425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.356 [2024-10-07 11:29:04.977664] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.356 [2024-10-07 11:29:04.980799] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.356 [2024-10-07 11:29:04.980966] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.356 [2024-10-07 11:29:04.981000] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.356 [2024-10-07 11:29:04.981019] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.356 [2024-10-07 11:29:04.981068] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.356 [2024-10-07 11:29:04.981104] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.356 [2024-10-07 11:29:04.981122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.357 [2024-10-07 11:29:04.981137] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.357 [2024-10-07 11:29:04.982117] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.357 [2024-10-07 11:29:04.986007] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.357 [2024-10-07 11:29:04.986197] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.357 [2024-10-07 11:29:04.986236] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.357 [2024-10-07 11:29:04.986254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.357 [2024-10-07 11:29:04.986290] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.357 [2024-10-07 11:29:04.986343] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.357 [2024-10-07 11:29:04.986364] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.357 [2024-10-07 11:29:04.986379] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.357 [2024-10-07 11:29:04.986428] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.357 [2024-10-07 11:29:04.991028] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.357 [2024-10-07 11:29:04.991220] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.357 [2024-10-07 11:29:04.991255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.357 [2024-10-07 11:29:04.991274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.357 [2024-10-07 11:29:04.991311] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.357 [2024-10-07 11:29:04.991344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.357 [2024-10-07 11:29:04.991361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.357 [2024-10-07 11:29:04.991376] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.357 [2024-10-07 11:29:04.992595] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.357 [2024-10-07 11:29:04.996162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.357 [2024-10-07 11:29:04.996437] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.357 [2024-10-07 11:29:04.996478] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.357 [2024-10-07 11:29:04.996498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.357 [2024-10-07 11:29:04.997490] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.357 [2024-10-07 11:29:04.998271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.357 [2024-10-07 11:29:04.998311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.357 [2024-10-07 11:29:04.998334] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.357 [2024-10-07 11:29:04.998474] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.357 [2024-10-07 11:29:05.001372] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.357 [2024-10-07 11:29:05.001606] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.357 [2024-10-07 11:29:05.001648] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.357 [2024-10-07 11:29:05.001699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.357 [2024-10-07 11:29:05.001740] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.357 [2024-10-07 11:29:05.001773] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.357 [2024-10-07 11:29:05.001791] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.357 [2024-10-07 11:29:05.001807] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.357 [2024-10-07 11:29:05.001840] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.357 [2024-10-07 11:29:05.006599] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.357 [2024-10-07 11:29:05.006848] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.357 [2024-10-07 11:29:05.006885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.357 [2024-10-07 11:29:05.006904] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.357 [2024-10-07 11:29:05.006941] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.357 [2024-10-07 11:29:05.006974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.357 [2024-10-07 11:29:05.006992] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.357 [2024-10-07 11:29:05.007008] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.357 [2024-10-07 11:29:05.008230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.357 [2024-10-07 11:29:05.011548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.357 [2024-10-07 11:29:05.011760] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.357 [2024-10-07 11:29:05.011797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.357 [2024-10-07 11:29:05.011816] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.357 [2024-10-07 11:29:05.011853] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.357 [2024-10-07 11:29:05.011886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.357 [2024-10-07 11:29:05.011903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.357 [2024-10-07 11:29:05.011919] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.357 [2024-10-07 11:29:05.011950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.357 [2024-10-07 11:29:05.016797] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.357 [2024-10-07 11:29:05.017081] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.357 [2024-10-07 11:29:05.017124] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.357 [2024-10-07 11:29:05.017144] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.357 [2024-10-07 11:29:05.017207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.357 [2024-10-07 11:29:05.017244] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.357 [2024-10-07 11:29:05.017295] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.357 [2024-10-07 11:29:05.017313] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.357 [2024-10-07 11:29:05.017346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.357 [2024-10-07 11:29:05.021989] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.357 [2024-10-07 11:29:05.022250] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.357 [2024-10-07 11:29:05.022288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.357 [2024-10-07 11:29:05.022308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.357 [2024-10-07 11:29:05.022348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.357 [2024-10-07 11:29:05.023590] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.357 [2024-10-07 11:29:05.023634] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.357 [2024-10-07 11:29:05.023654] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.357 [2024-10-07 11:29:05.023880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.357 [2024-10-07 11:29:05.027002] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.357 [2024-10-07 11:29:05.027204] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.357 [2024-10-07 11:29:05.027240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.357 [2024-10-07 11:29:05.027259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.357 [2024-10-07 11:29:05.027294] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.357 [2024-10-07 11:29:05.027326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.357 [2024-10-07 11:29:05.027344] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.357 [2024-10-07 11:29:05.027360] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.357 [2024-10-07 11:29:05.027392] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.357 [2024-10-07 11:29:05.032276] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.357 [2024-10-07 11:29:05.032521] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.357 [2024-10-07 11:29:05.032560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.357 [2024-10-07 11:29:05.032580] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.357 [2024-10-07 11:29:05.032617] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.357 [2024-10-07 11:29:05.032649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.357 [2024-10-07 11:29:05.032666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.357 [2024-10-07 11:29:05.032682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.357 [2024-10-07 11:29:05.032714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.357 [2024-10-07 11:29:05.037390] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.357 [2024-10-07 11:29:05.037629] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.357 [2024-10-07 11:29:05.037667] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.357 [2024-10-07 11:29:05.037687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.357 [2024-10-07 11:29:05.037724] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.357 [2024-10-07 11:29:05.037757] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.357 [2024-10-07 11:29:05.037775] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.357 [2024-10-07 11:29:05.037791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.357 [2024-10-07 11:29:05.037823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.357 [2024-10-07 11:29:05.042466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.357 [2024-10-07 11:29:05.042685] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.357 [2024-10-07 11:29:05.042723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.357 [2024-10-07 11:29:05.042742] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.357 [2024-10-07 11:29:05.042779] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.357 [2024-10-07 11:29:05.043753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.357 [2024-10-07 11:29:05.043797] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.357 [2024-10-07 11:29:05.043817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.357 [2024-10-07 11:29:05.044619] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.357 [2024-10-07 11:29:05.047607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.357 [2024-10-07 11:29:05.047799] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.357 [2024-10-07 11:29:05.047841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.357 [2024-10-07 11:29:05.047861] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.357 [2024-10-07 11:29:05.047896] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.357 [2024-10-07 11:29:05.047950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.357 [2024-10-07 11:29:05.047971] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.357 [2024-10-07 11:29:05.047987] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.358 [2024-10-07 11:29:05.048019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.358 [2024-10-07 11:29:05.052794] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.358 [2024-10-07 11:29:05.053005] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.358 [2024-10-07 11:29:05.053042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.358 [2024-10-07 11:29:05.053084] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.358 [2024-10-07 11:29:05.053154] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.358 [2024-10-07 11:29:05.054353] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.358 [2024-10-07 11:29:05.054393] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.358 [2024-10-07 11:29:05.054427] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.358 [2024-10-07 11:29:05.054643] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.358 [2024-10-07 11:29:05.057736] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.358 [2024-10-07 11:29:05.057874] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.358 [2024-10-07 11:29:05.057908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.358 [2024-10-07 11:29:05.057925] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.358 [2024-10-07 11:29:05.057958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.358 [2024-10-07 11:29:05.057990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.358 [2024-10-07 11:29:05.058007] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.358 [2024-10-07 11:29:05.058021] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.358 [2024-10-07 11:29:05.058051] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.358 [2024-10-07 11:29:05.062954] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.358 [2024-10-07 11:29:05.063092] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.358 [2024-10-07 11:29:05.063125] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.358 [2024-10-07 11:29:05.063142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.358 [2024-10-07 11:29:05.063176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.358 [2024-10-07 11:29:05.063208] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.358 [2024-10-07 11:29:05.063224] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.358 [2024-10-07 11:29:05.063239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.358 [2024-10-07 11:29:05.063269] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.358 [2024-10-07 11:29:05.067973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.358 [2024-10-07 11:29:05.068119] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.358 [2024-10-07 11:29:05.068152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.358 [2024-10-07 11:29:05.068170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.358 [2024-10-07 11:29:05.068204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.358 [2024-10-07 11:29:05.068235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.358 [2024-10-07 11:29:05.068252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.358 [2024-10-07 11:29:05.068293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.358 [2024-10-07 11:29:05.068326] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.358 [2024-10-07 11:29:05.073085] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.358 [2024-10-07 11:29:05.073231] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.358 [2024-10-07 11:29:05.073265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.358 [2024-10-07 11:29:05.073283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.358 [2024-10-07 11:29:05.074238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.358 [2024-10-07 11:29:05.075118] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.358 [2024-10-07 11:29:05.075166] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.358 [2024-10-07 11:29:05.075187] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.358 [2024-10-07 11:29:05.075298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.358 [2024-10-07 11:29:05.078091] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.358 [2024-10-07 11:29:05.078250] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.358 [2024-10-07 11:29:05.078292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.358 [2024-10-07 11:29:05.078311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.358 [2024-10-07 11:29:05.078346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.358 [2024-10-07 11:29:05.078416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.358 [2024-10-07 11:29:05.078440] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.358 [2024-10-07 11:29:05.078456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.358 [2024-10-07 11:29:05.078488] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.358 [2024-10-07 11:29:05.083211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.358 [2024-10-07 11:29:05.083435] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.358 [2024-10-07 11:29:05.083484] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.358 [2024-10-07 11:29:05.083507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.358 [2024-10-07 11:29:05.083549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.358 [2024-10-07 11:29:05.084753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.358 [2024-10-07 11:29:05.084794] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.358 [2024-10-07 11:29:05.084814] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.358 [2024-10-07 11:29:05.085031] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.358 [2024-10-07 11:29:05.088209] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.358 [2024-10-07 11:29:05.088396] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.358 [2024-10-07 11:29:05.088455] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.358 [2024-10-07 11:29:05.088477] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.358 [2024-10-07 11:29:05.088514] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.358 [2024-10-07 11:29:05.089534] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.358 [2024-10-07 11:29:05.089584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.358 [2024-10-07 11:29:05.089605] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.358 [2024-10-07 11:29:05.090369] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.358 [2024-10-07 11:29:05.093358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.358 [2024-10-07 11:29:05.093511] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.358 [2024-10-07 11:29:05.093556] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.358 [2024-10-07 11:29:05.093577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.358 [2024-10-07 11:29:05.093613] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.358 [2024-10-07 11:29:05.093645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.358 [2024-10-07 11:29:05.093662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.358 [2024-10-07 11:29:05.093677] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.358 [2024-10-07 11:29:05.093707] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.358 [2024-10-07 11:29:05.098461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.358 [2024-10-07 11:29:05.098601] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.358 [2024-10-07 11:29:05.098635] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.358 [2024-10-07 11:29:05.098653] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.358 [2024-10-07 11:29:05.098688] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.358 [2024-10-07 11:29:05.098720] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.358 [2024-10-07 11:29:05.098738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.358 [2024-10-07 11:29:05.098753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.358 [2024-10-07 11:29:05.098783] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.358 8280.08 IOPS, 32.34 MiB/s [2024-10-07T11:29:08.069Z] [2024-10-07 11:29:05.106307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.358 [2024-10-07 11:29:05.106621] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.358 [2024-10-07 11:29:05.106670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.358 [2024-10-07 11:29:05.106693] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.358 [2024-10-07 11:29:05.106778] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.358 [2024-10-07 11:29:05.106818] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.358 [2024-10-07 11:29:05.106836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.358 [2024-10-07 11:29:05.106852] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.358 [2024-10-07 11:29:05.106884] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.358 [2024-10-07 11:29:05.108570] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.358 [2024-10-07 11:29:05.108686] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.358 [2024-10-07 11:29:05.108723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.358 [2024-10-07 11:29:05.108743] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.358 [2024-10-07 11:29:05.108776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.358 [2024-10-07 11:29:05.108807] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.358 [2024-10-07 11:29:05.108824] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.358 [2024-10-07 11:29:05.108839] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.358 [2024-10-07 11:29:05.108868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.358 [2024-10-07 11:29:05.117588] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.358 [2024-10-07 11:29:05.117805] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.358 [2024-10-07 11:29:05.117842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.358 [2024-10-07 11:29:05.117861] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.358 [2024-10-07 11:29:05.117898] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.358 [2024-10-07 11:29:05.118098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.358 [2024-10-07 11:29:05.118126] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.358 [2024-10-07 11:29:05.118142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.358 [2024-10-07 11:29:05.118283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.358 [2024-10-07 11:29:05.118662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.358 [2024-10-07 11:29:05.118769] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.358 [2024-10-07 11:29:05.118801] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.358 [2024-10-07 11:29:05.118819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.358 [2024-10-07 11:29:05.118850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.358 [2024-10-07 11:29:05.118880] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.358 [2024-10-07 11:29:05.118897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.358 [2024-10-07 11:29:05.118938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.358 [2024-10-07 11:29:05.118970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.358 [2024-10-07 11:29:05.128626] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.358 [2024-10-07 11:29:05.128820] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.358 [2024-10-07 11:29:05.128857] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.358 [2024-10-07 11:29:05.128876] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.358 [2024-10-07 11:29:05.128930] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.358 [2024-10-07 11:29:05.128971] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.358 [2024-10-07 11:29:05.129003] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.358 [2024-10-07 11:29:05.129020] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.359 [2024-10-07 11:29:05.129035] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.359 [2024-10-07 11:29:05.130240] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.359 [2024-10-07 11:29:05.130326] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.359 [2024-10-07 11:29:05.130355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.359 [2024-10-07 11:29:05.130372] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.359 [2024-10-07 11:29:05.130615] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.359 [2024-10-07 11:29:05.131770] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.359 [2024-10-07 11:29:05.131813] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.359 [2024-10-07 11:29:05.131833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.359 [2024-10-07 11:29:05.132678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.359 [2024-10-07 11:29:05.138804] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.359 [2024-10-07 11:29:05.139025] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.359 [2024-10-07 11:29:05.139063] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.359 [2024-10-07 11:29:05.139083] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.359 [2024-10-07 11:29:05.139119] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.359 [2024-10-07 11:29:05.139188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.359 [2024-10-07 11:29:05.139212] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.359 [2024-10-07 11:29:05.139229] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.359 [2024-10-07 11:29:05.139262] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.359 [2024-10-07 11:29:05.139285] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.359 [2024-10-07 11:29:05.139358] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.359 [2024-10-07 11:29:05.139438] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.359 [2024-10-07 11:29:05.139472] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.359 [2024-10-07 11:29:05.139510] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.359 [2024-10-07 11:29:05.139542] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.359 [2024-10-07 11:29:05.139559] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.359 [2024-10-07 11:29:05.139573] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.359 [2024-10-07 11:29:05.139604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.359 [2024-10-07 11:29:05.148980] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.359 [2024-10-07 11:29:05.150119] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.359 [2024-10-07 11:29:05.150172] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.359 [2024-10-07 11:29:05.150196] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.359 [2024-10-07 11:29:05.150990] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.359 [2024-10-07 11:29:05.151122] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.359 [2024-10-07 11:29:05.151173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.359 [2024-10-07 11:29:05.151194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.359 [2024-10-07 11:29:05.151210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.359 [2024-10-07 11:29:05.151481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.359 [2024-10-07 11:29:05.151571] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.359 [2024-10-07 11:29:05.151600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.359 [2024-10-07 11:29:05.151617] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.359 [2024-10-07 11:29:05.151735] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.359 [2024-10-07 11:29:05.151804] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.359 [2024-10-07 11:29:05.151828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.359 [2024-10-07 11:29:05.151843] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.359 [2024-10-07 11:29:05.151898] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.359 [2024-10-07 11:29:05.159154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.359 [2024-10-07 11:29:05.159348] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.359 [2024-10-07 11:29:05.159386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.359 [2024-10-07 11:29:05.159430] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.359 [2024-10-07 11:29:05.160647] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.359 [2024-10-07 11:29:05.160936] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.359 [2024-10-07 11:29:05.160975] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.359 [2024-10-07 11:29:05.160996] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.359 [2024-10-07 11:29:05.162149] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.359 [2024-10-07 11:29:05.163112] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.359 [2024-10-07 11:29:05.163249] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.359 [2024-10-07 11:29:05.163292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.359 [2024-10-07 11:29:05.163313] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.359 [2024-10-07 11:29:05.163348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.359 [2024-10-07 11:29:05.163380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.359 [2024-10-07 11:29:05.163413] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.359 [2024-10-07 11:29:05.163445] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.359 [2024-10-07 11:29:05.163491] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.359 [2024-10-07 11:29:05.169336] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.359 [2024-10-07 11:29:05.169539] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.359 [2024-10-07 11:29:05.169577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.359 [2024-10-07 11:29:05.169595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.359 [2024-10-07 11:29:05.169630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.359 [2024-10-07 11:29:05.169663] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.359 [2024-10-07 11:29:05.169680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.359 [2024-10-07 11:29:05.169695] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.359 [2024-10-07 11:29:05.169726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.359 [2024-10-07 11:29:05.173217] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.359 [2024-10-07 11:29:05.173378] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.359 [2024-10-07 11:29:05.173429] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.359 [2024-10-07 11:29:05.173450] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.359 [2024-10-07 11:29:05.173487] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.359 [2024-10-07 11:29:05.174265] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.359 [2024-10-07 11:29:05.174304] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.359 [2024-10-07 11:29:05.174324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.359 [2024-10-07 11:29:05.174570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.359 [2024-10-07 11:29:05.179525] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.359 [2024-10-07 11:29:05.179720] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.359 [2024-10-07 11:29:05.179757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.359 [2024-10-07 11:29:05.179776] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.359 [2024-10-07 11:29:05.179812] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.359 [2024-10-07 11:29:05.179845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.359 [2024-10-07 11:29:05.179862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.359 [2024-10-07 11:29:05.179878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.359 [2024-10-07 11:29:05.179911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.359 [2024-10-07 11:29:05.183348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.359 [2024-10-07 11:29:05.183570] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.359 [2024-10-07 11:29:05.183608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.359 [2024-10-07 11:29:05.183629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.359 [2024-10-07 11:29:05.183664] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.359 [2024-10-07 11:29:05.183697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.359 [2024-10-07 11:29:05.183714] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.359 [2024-10-07 11:29:05.183730] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.359 [2024-10-07 11:29:05.183761] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.359 [2024-10-07 11:29:05.190132] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.359 [2024-10-07 11:29:05.190328] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.359 [2024-10-07 11:29:05.190364] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.359 [2024-10-07 11:29:05.190383] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.359 [2024-10-07 11:29:05.190434] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.359 [2024-10-07 11:29:05.190469] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.359 [2024-10-07 11:29:05.190487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.359 [2024-10-07 11:29:05.190503] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.359 [2024-10-07 11:29:05.190535] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.359 [2024-10-07 11:29:05.194149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.359 [2024-10-07 11:29:05.194318] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.359 [2024-10-07 11:29:05.194353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.359 [2024-10-07 11:29:05.194413] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.359 [2024-10-07 11:29:05.194455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.359 [2024-10-07 11:29:05.194488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.359 [2024-10-07 11:29:05.194506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.359 [2024-10-07 11:29:05.194521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.359 [2024-10-07 11:29:05.194552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.359 [2024-10-07 11:29:05.200292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.359 [2024-10-07 11:29:05.200518] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.359 [2024-10-07 11:29:05.200558] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.360 [2024-10-07 11:29:05.200578] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.360 [2024-10-07 11:29:05.200616] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.360 [2024-10-07 11:29:05.200649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.360 [2024-10-07 11:29:05.200666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.360 [2024-10-07 11:29:05.200681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.360 [2024-10-07 11:29:05.200714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.360 [2024-10-07 11:29:05.204285] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.360 [2024-10-07 11:29:05.204479] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.360 [2024-10-07 11:29:05.204517] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.360 [2024-10-07 11:29:05.204536] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.360 [2024-10-07 11:29:05.205339] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.360 [2024-10-07 11:29:05.205576] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.360 [2024-10-07 11:29:05.205616] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.360 [2024-10-07 11:29:05.205635] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.360 [2024-10-07 11:29:05.205735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.360 [2024-10-07 11:29:05.210463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.360 [2024-10-07 11:29:05.210647] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.360 [2024-10-07 11:29:05.210684] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.360 [2024-10-07 11:29:05.210703] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.360 [2024-10-07 11:29:05.210739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.360 [2024-10-07 11:29:05.210770] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.360 [2024-10-07 11:29:05.210813] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.360 [2024-10-07 11:29:05.210829] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.360 [2024-10-07 11:29:05.211780] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.360 [2024-10-07 11:29:05.214433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.360 [2024-10-07 11:29:05.214587] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.360 [2024-10-07 11:29:05.214629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.360 [2024-10-07 11:29:05.214650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.360 [2024-10-07 11:29:05.215385] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.360 [2024-10-07 11:29:05.215611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.360 [2024-10-07 11:29:05.215648] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.360 [2024-10-07 11:29:05.215667] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.360 [2024-10-07 11:29:05.215739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.360 [2024-10-07 11:29:05.220729] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.360 [2024-10-07 11:29:05.220909] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.360 [2024-10-07 11:29:05.220945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.360 [2024-10-07 11:29:05.220964] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.360 [2024-10-07 11:29:05.221001] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.360 [2024-10-07 11:29:05.221033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.360 [2024-10-07 11:29:05.221051] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.360 [2024-10-07 11:29:05.221086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.360 [2024-10-07 11:29:05.221121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.360 [2024-10-07 11:29:05.224719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.360 [2024-10-07 11:29:05.224870] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.360 [2024-10-07 11:29:05.224914] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.360 [2024-10-07 11:29:05.224932] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.360 [2024-10-07 11:29:05.224965] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.360 [2024-10-07 11:29:05.224996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.360 [2024-10-07 11:29:05.225014] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.360 [2024-10-07 11:29:05.225029] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.360 [2024-10-07 11:29:05.225076] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.360 [2024-10-07 11:29:05.230926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.360 [2024-10-07 11:29:05.231116] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.360 [2024-10-07 11:29:05.231151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.360 [2024-10-07 11:29:05.231169] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.360 [2024-10-07 11:29:05.231204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.360 [2024-10-07 11:29:05.231236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.360 [2024-10-07 11:29:05.231253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.360 [2024-10-07 11:29:05.231268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.360 [2024-10-07 11:29:05.231299] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.360 [2024-10-07 11:29:05.234838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.360 [2024-10-07 11:29:05.234991] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.360 [2024-10-07 11:29:05.235026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.360 [2024-10-07 11:29:05.235044] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.360 [2024-10-07 11:29:05.235826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.360 [2024-10-07 11:29:05.236031] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.360 [2024-10-07 11:29:05.236067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.360 [2024-10-07 11:29:05.236086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.360 [2024-10-07 11:29:05.236185] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.360 [2024-10-07 11:29:05.241093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.360 [2024-10-07 11:29:05.241267] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.360 [2024-10-07 11:29:05.241304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.360 [2024-10-07 11:29:05.241323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.360 [2024-10-07 11:29:05.241358] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.360 [2024-10-07 11:29:05.241396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.360 [2024-10-07 11:29:05.241448] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.360 [2024-10-07 11:29:05.241472] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.360 [2024-10-07 11:29:05.242425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.360 [2024-10-07 11:29:05.244956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.360 [2024-10-07 11:29:05.245107] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.360 [2024-10-07 11:29:05.245143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.360 [2024-10-07 11:29:05.245168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.360 [2024-10-07 11:29:05.245984] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.360 [2024-10-07 11:29:05.246205] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.360 [2024-10-07 11:29:05.246242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.360 [2024-10-07 11:29:05.246261] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.360 [2024-10-07 11:29:05.246335] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.360 [2024-10-07 11:29:05.251378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.360 [2024-10-07 11:29:05.251571] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.360 [2024-10-07 11:29:05.251608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.360 [2024-10-07 11:29:05.251628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.360 [2024-10-07 11:29:05.251663] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.360 [2024-10-07 11:29:05.251696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.360 [2024-10-07 11:29:05.251713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.360 [2024-10-07 11:29:05.251729] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.360 [2024-10-07 11:29:05.252975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.360 [2024-10-07 11:29:05.255467] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.360 [2024-10-07 11:29:05.255609] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.360 [2024-10-07 11:29:05.255645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.360 [2024-10-07 11:29:05.255664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.360 [2024-10-07 11:29:05.255698] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.360 [2024-10-07 11:29:05.255729] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.360 [2024-10-07 11:29:05.255747] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.360 [2024-10-07 11:29:05.255763] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.360 [2024-10-07 11:29:05.255957] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.360 [2024-10-07 11:29:05.261534] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.360 [2024-10-07 11:29:05.261694] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.360 [2024-10-07 11:29:05.261730] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.360 [2024-10-07 11:29:05.261749] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.360 [2024-10-07 11:29:05.261782] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.360 [2024-10-07 11:29:05.261814] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.360 [2024-10-07 11:29:05.261832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.360 [2024-10-07 11:29:05.261871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.360 [2024-10-07 11:29:05.261904] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.360 [2024-10-07 11:29:05.266513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.360 [2024-10-07 11:29:05.266677] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.360 [2024-10-07 11:29:05.266713] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.360 [2024-10-07 11:29:05.266732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.360 [2024-10-07 11:29:05.266765] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.360 [2024-10-07 11:29:05.266797] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.360 [2024-10-07 11:29:05.266814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.360 [2024-10-07 11:29:05.266829] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.360 [2024-10-07 11:29:05.266859] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.360 [2024-10-07 11:29:05.271656] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.360 [2024-10-07 11:29:05.271805] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.360 [2024-10-07 11:29:05.271839] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.361 [2024-10-07 11:29:05.271858] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.361 [2024-10-07 11:29:05.272810] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.361 [2024-10-07 11:29:05.273622] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.361 [2024-10-07 11:29:05.273661] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.361 [2024-10-07 11:29:05.273681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.361 [2024-10-07 11:29:05.273976] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.361 [2024-10-07 11:29:05.276632] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.361 [2024-10-07 11:29:05.276764] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.361 [2024-10-07 11:29:05.276797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.361 [2024-10-07 11:29:05.276815] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.361 [2024-10-07 11:29:05.276848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.361 [2024-10-07 11:29:05.276901] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.361 [2024-10-07 11:29:05.276922] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.361 [2024-10-07 11:29:05.276937] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.361 [2024-10-07 11:29:05.276967] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.361 [2024-10-07 11:29:05.281773] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.361 [2024-10-07 11:29:05.283103] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.361 [2024-10-07 11:29:05.283151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.361 [2024-10-07 11:29:05.283174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.361 [2024-10-07 11:29:05.283385] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.361 [2024-10-07 11:29:05.284534] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.361 [2024-10-07 11:29:05.284571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.361 [2024-10-07 11:29:05.284591] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.361 [2024-10-07 11:29:05.285449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.361 [2024-10-07 11:29:05.288390] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.361 [2024-10-07 11:29:05.288539] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.361 [2024-10-07 11:29:05.288573] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.361 [2024-10-07 11:29:05.288592] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.361 [2024-10-07 11:29:05.288626] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.361 [2024-10-07 11:29:05.288658] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.361 [2024-10-07 11:29:05.288675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.361 [2024-10-07 11:29:05.288689] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.361 [2024-10-07 11:29:05.288719] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.361 [2024-10-07 11:29:05.292186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.361 [2024-10-07 11:29:05.292393] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.361 [2024-10-07 11:29:05.292483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.361 [2024-10-07 11:29:05.292520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.361 [2024-10-07 11:29:05.292570] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.361 [2024-10-07 11:29:05.292620] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.361 [2024-10-07 11:29:05.292658] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.361 [2024-10-07 11:29:05.292685] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.361 [2024-10-07 11:29:05.292737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.361 [2024-10-07 11:29:05.301052] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.361 [2024-10-07 11:29:05.302536] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.361 [2024-10-07 11:29:05.302603] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.361 [2024-10-07 11:29:05.302629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.361 [2024-10-07 11:29:05.302890] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.361 [2024-10-07 11:29:05.303937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.361 [2024-10-07 11:29:05.303994] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.361 [2024-10-07 11:29:05.304014] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.361 [2024-10-07 11:29:05.304030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.361 [2024-10-07 11:29:05.304825] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.361 [2024-10-07 11:29:05.304914] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.361 [2024-10-07 11:29:05.304944] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.361 [2024-10-07 11:29:05.304962] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.361 [2024-10-07 11:29:05.305284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.361 [2024-10-07 11:29:05.305437] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.361 [2024-10-07 11:29:05.305474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.361 [2024-10-07 11:29:05.305493] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.361 [2024-10-07 11:29:05.305548] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.361 [2024-10-07 11:29:05.311283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.361 [2024-10-07 11:29:05.311476] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.361 [2024-10-07 11:29:05.311513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.361 [2024-10-07 11:29:05.311532] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.361 [2024-10-07 11:29:05.311569] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.361 [2024-10-07 11:29:05.312331] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.361 [2024-10-07 11:29:05.312368] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.361 [2024-10-07 11:29:05.312388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.361 [2024-10-07 11:29:05.312615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.361 [2024-10-07 11:29:05.314367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.361 [2024-10-07 11:29:05.315591] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.361 [2024-10-07 11:29:05.315637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.361 [2024-10-07 11:29:05.315658] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.361 [2024-10-07 11:29:05.316502] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.361 [2024-10-07 11:29:05.316651] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.361 [2024-10-07 11:29:05.316678] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.361 [2024-10-07 11:29:05.316724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.361 [2024-10-07 11:29:05.316762] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.361 [2024-10-07 11:29:05.322246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.362 [2024-10-07 11:29:05.322459] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.362 [2024-10-07 11:29:05.322497] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.362 [2024-10-07 11:29:05.322516] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.362 [2024-10-07 11:29:05.322552] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.362 [2024-10-07 11:29:05.322584] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.362 [2024-10-07 11:29:05.322603] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.362 [2024-10-07 11:29:05.322618] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.362 [2024-10-07 11:29:05.322649] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.362 [2024-10-07 11:29:05.325714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.362 [2024-10-07 11:29:05.326018] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.362 [2024-10-07 11:29:05.326064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.362 [2024-10-07 11:29:05.326085] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.362 [2024-10-07 11:29:05.326120] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.362 [2024-10-07 11:29:05.326153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.362 [2024-10-07 11:29:05.326170] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.362 [2024-10-07 11:29:05.326184] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.362 [2024-10-07 11:29:05.326968] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.362 [2024-10-07 11:29:05.334086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.362 [2024-10-07 11:29:05.334263] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.362 [2024-10-07 11:29:05.334299] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.362 [2024-10-07 11:29:05.334318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.362 [2024-10-07 11:29:05.334587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.362 [2024-10-07 11:29:05.334716] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.362 [2024-10-07 11:29:05.334755] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.362 [2024-10-07 11:29:05.334775] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.362 [2024-10-07 11:29:05.334830] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.362 [2024-10-07 11:29:05.335815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.362 [2024-10-07 11:29:05.336651] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.362 [2024-10-07 11:29:05.336723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.362 [2024-10-07 11:29:05.336745] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.362 [2024-10-07 11:29:05.336933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.362 [2024-10-07 11:29:05.337012] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.362 [2024-10-07 11:29:05.337037] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.362 [2024-10-07 11:29:05.337067] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.362 [2024-10-07 11:29:05.337134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.362 [2024-10-07 11:29:05.345578] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.362 [2024-10-07 11:29:05.345764] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.362 [2024-10-07 11:29:05.345800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.362 [2024-10-07 11:29:05.345818] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.362 [2024-10-07 11:29:05.345854] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.362 [2024-10-07 11:29:05.345891] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.362 [2024-10-07 11:29:05.345909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.362 [2024-10-07 11:29:05.345924] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.362 [2024-10-07 11:29:05.346132] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.362 [2024-10-07 11:29:05.346280] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.362 [2024-10-07 11:29:05.346477] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.362 [2024-10-07 11:29:05.346509] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.362 [2024-10-07 11:29:05.346527] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.362 [2024-10-07 11:29:05.346581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.362 [2024-10-07 11:29:05.346617] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.362 [2024-10-07 11:29:05.346635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.362 [2024-10-07 11:29:05.346649] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.362 [2024-10-07 11:29:05.346679] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.362 [2024-10-07 11:29:05.356312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.362 [2024-10-07 11:29:05.356537] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.362 [2024-10-07 11:29:05.356575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.362 [2024-10-07 11:29:05.356595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.362 [2024-10-07 11:29:05.356648] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.362 [2024-10-07 11:29:05.357946] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.362 [2024-10-07 11:29:05.358011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.362 [2024-10-07 11:29:05.358033] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.362 [2024-10-07 11:29:05.358049] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.362 [2024-10-07 11:29:05.358276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.362 [2024-10-07 11:29:05.358353] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.362 [2024-10-07 11:29:05.358382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.362 [2024-10-07 11:29:05.358414] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.362 [2024-10-07 11:29:05.359547] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.362 [2024-10-07 11:29:05.360411] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.362 [2024-10-07 11:29:05.360450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.362 [2024-10-07 11:29:05.360468] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.362 [2024-10-07 11:29:05.360762] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.362 [2024-10-07 11:29:05.366500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.362 [2024-10-07 11:29:05.366691] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.362 [2024-10-07 11:29:05.366729] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.362 [2024-10-07 11:29:05.366749] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.362 [2024-10-07 11:29:05.367706] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.362 [2024-10-07 11:29:05.367934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.362 [2024-10-07 11:29:05.367965] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.362 [2024-10-07 11:29:05.367982] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.362 [2024-10-07 11:29:05.368063] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.362 [2024-10-07 11:29:05.369358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.362 [2024-10-07 11:29:05.369678] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.362 [2024-10-07 11:29:05.369727] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.362 [2024-10-07 11:29:05.369749] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.362 [2024-10-07 11:29:05.369785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.362 [2024-10-07 11:29:05.369817] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.362 [2024-10-07 11:29:05.369835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.362 [2024-10-07 11:29:05.369849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.362 [2024-10-07 11:29:05.370653] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.362 [2024-10-07 11:29:05.377855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.362 [2024-10-07 11:29:05.378324] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.362 [2024-10-07 11:29:05.378376] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.362 [2024-10-07 11:29:05.378414] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.362 [2024-10-07 11:29:05.378545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.362 [2024-10-07 11:29:05.378611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.362 [2024-10-07 11:29:05.378635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.363 [2024-10-07 11:29:05.378652] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.363 [2024-10-07 11:29:05.378685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.363 [2024-10-07 11:29:05.379462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.363 [2024-10-07 11:29:05.379565] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.363 [2024-10-07 11:29:05.379596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.363 [2024-10-07 11:29:05.379613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.363 [2024-10-07 11:29:05.380382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.363 [2024-10-07 11:29:05.380625] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.363 [2024-10-07 11:29:05.380661] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.363 [2024-10-07 11:29:05.380678] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.363 [2024-10-07 11:29:05.380754] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.363 [2024-10-07 11:29:05.389267] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.363 [2024-10-07 11:29:05.389485] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.363 [2024-10-07 11:29:05.389523] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.363 [2024-10-07 11:29:05.389542] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.363 [2024-10-07 11:29:05.389580] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.363 [2024-10-07 11:29:05.389632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.363 [2024-10-07 11:29:05.389653] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.363 [2024-10-07 11:29:05.389669] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.363 [2024-10-07 11:29:05.389871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.363 [2024-10-07 11:29:05.389902] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.363 [2024-10-07 11:29:05.390089] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.363 [2024-10-07 11:29:05.390121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.363 [2024-10-07 11:29:05.390164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.363 [2024-10-07 11:29:05.390290] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.363 [2024-10-07 11:29:05.390354] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.363 [2024-10-07 11:29:05.390377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.363 [2024-10-07 11:29:05.390392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.363 [2024-10-07 11:29:05.390442] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.363 [2024-10-07 11:29:05.400156] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.363 [2024-10-07 11:29:05.400292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.363 [2024-10-07 11:29:05.400432] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.363 [2024-10-07 11:29:05.400468] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.363 [2024-10-07 11:29:05.400487] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.363 [2024-10-07 11:29:05.401826] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.363 [2024-10-07 11:29:05.401882] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.363 [2024-10-07 11:29:05.401905] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.363 [2024-10-07 11:29:05.401929] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.363 [2024-10-07 11:29:05.402151] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.363 [2024-10-07 11:29:05.402182] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.363 [2024-10-07 11:29:05.402197] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.363 [2024-10-07 11:29:05.402214] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.363 [2024-10-07 11:29:05.403359] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.363 [2024-10-07 11:29:05.403436] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.363 [2024-10-07 11:29:05.403471] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.363 [2024-10-07 11:29:05.403496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.363 [2024-10-07 11:29:05.404578] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.363 [2024-10-07 11:29:05.410330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.363 [2024-10-07 11:29:05.410524] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.363 [2024-10-07 11:29:05.410562] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.363 [2024-10-07 11:29:05.410581] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.363 [2024-10-07 11:29:05.411549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.363 [2024-10-07 11:29:05.411798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.363 [2024-10-07 11:29:05.411874] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.363 [2024-10-07 11:29:05.411895] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.363 [2024-10-07 11:29:05.411912] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.363 [2024-10-07 11:29:05.413219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.363 [2024-10-07 11:29:05.413313] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.363 [2024-10-07 11:29:05.413344] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.363 [2024-10-07 11:29:05.413362] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.363 [2024-10-07 11:29:05.413587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.363 [2024-10-07 11:29:05.413642] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.363 [2024-10-07 11:29:05.413662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.363 [2024-10-07 11:29:05.413678] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.363 [2024-10-07 11:29:05.414460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.363 [2024-10-07 11:29:05.422188] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.363 [2024-10-07 11:29:05.422309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.363 [2024-10-07 11:29:05.422441] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.363 [2024-10-07 11:29:05.422475] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.363 [2024-10-07 11:29:05.422494] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.363 [2024-10-07 11:29:05.422772] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.363 [2024-10-07 11:29:05.422803] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.363 [2024-10-07 11:29:05.422820] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.363 [2024-10-07 11:29:05.422842] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.363 [2024-10-07 11:29:05.422958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.363 [2024-10-07 11:29:05.422988] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.363 [2024-10-07 11:29:05.423003] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.363 [2024-10-07 11:29:05.423019] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.363 [2024-10-07 11:29:05.423072] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.363 [2024-10-07 11:29:05.423096] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.363 [2024-10-07 11:29:05.423109] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.364 [2024-10-07 11:29:05.423124] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.364 [2024-10-07 11:29:05.423154] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.364 [2024-10-07 11:29:05.433862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.364 [2024-10-07 11:29:05.433957] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.364 [2024-10-07 11:29:05.434092] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.364 [2024-10-07 11:29:05.434128] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.364 [2024-10-07 11:29:05.434147] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.364 [2024-10-07 11:29:05.434198] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.364 [2024-10-07 11:29:05.434222] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.364 [2024-10-07 11:29:05.434238] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.364 [2024-10-07 11:29:05.434463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.364 [2024-10-07 11:29:05.434496] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.364 [2024-10-07 11:29:05.434632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.364 [2024-10-07 11:29:05.434659] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.364 [2024-10-07 11:29:05.434675] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.364 [2024-10-07 11:29:05.434692] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.364 [2024-10-07 11:29:05.434707] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.364 [2024-10-07 11:29:05.434720] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.364 [2024-10-07 11:29:05.434840] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.364 [2024-10-07 11:29:05.434864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.364 [2024-10-07 11:29:05.444845] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.364 [2024-10-07 11:29:05.444938] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.364 [2024-10-07 11:29:05.445083] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.364 [2024-10-07 11:29:05.445118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.364 [2024-10-07 11:29:05.445138] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.364 [2024-10-07 11:29:05.445189] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.364 [2024-10-07 11:29:05.445212] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.364 [2024-10-07 11:29:05.445227] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.364 [2024-10-07 11:29:05.446451] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.364 [2024-10-07 11:29:05.446498] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.364 [2024-10-07 11:29:05.446712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.364 [2024-10-07 11:29:05.446740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.364 [2024-10-07 11:29:05.446782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.364 [2024-10-07 11:29:05.446805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.364 [2024-10-07 11:29:05.446820] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.364 [2024-10-07 11:29:05.446833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.364 [2024-10-07 11:29:05.447962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.364 [2024-10-07 11:29:05.448004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.364 [2024-10-07 11:29:05.455030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.364 [2024-10-07 11:29:05.455155] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.364 [2024-10-07 11:29:05.455272] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.364 [2024-10-07 11:29:05.455305] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.364 [2024-10-07 11:29:05.455324] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.364 [2024-10-07 11:29:05.455391] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.364 [2024-10-07 11:29:05.455436] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.364 [2024-10-07 11:29:05.455454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.364 [2024-10-07 11:29:05.455475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.364 [2024-10-07 11:29:05.456427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.364 [2024-10-07 11:29:05.456468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.364 [2024-10-07 11:29:05.456486] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.364 [2024-10-07 11:29:05.456502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.364 [2024-10-07 11:29:05.456708] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.364 [2024-10-07 11:29:05.456734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.364 [2024-10-07 11:29:05.456748] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.364 [2024-10-07 11:29:05.456762] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.364 [2024-10-07 11:29:05.456838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.364 [2024-10-07 11:29:05.466724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.364 [2024-10-07 11:29:05.466824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.364 [2024-10-07 11:29:05.467167] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.364 [2024-10-07 11:29:05.467214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.364 [2024-10-07 11:29:05.467236] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.364 [2024-10-07 11:29:05.467289] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.364 [2024-10-07 11:29:05.467313] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.364 [2024-10-07 11:29:05.467355] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.364 [2024-10-07 11:29:05.467496] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.364 [2024-10-07 11:29:05.467540] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.364 [2024-10-07 11:29:05.467594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.364 [2024-10-07 11:29:05.467618] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.364 [2024-10-07 11:29:05.467634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.364 [2024-10-07 11:29:05.467652] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.364 [2024-10-07 11:29:05.467667] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.364 [2024-10-07 11:29:05.467680] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.364 [2024-10-07 11:29:05.467711] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.364 [2024-10-07 11:29:05.467729] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.364 [2024-10-07 11:29:05.478320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.364 [2024-10-07 11:29:05.478424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.364 [2024-10-07 11:29:05.478557] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.364 [2024-10-07 11:29:05.478592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.364 [2024-10-07 11:29:05.478610] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.364 [2024-10-07 11:29:05.478659] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.364 [2024-10-07 11:29:05.478682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.364 [2024-10-07 11:29:05.478697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.364 [2024-10-07 11:29:05.478900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.364 [2024-10-07 11:29:05.478931] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.364 [2024-10-07 11:29:05.479067] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.364 [2024-10-07 11:29:05.479103] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.364 [2024-10-07 11:29:05.479122] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.364 [2024-10-07 11:29:05.479140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.364 [2024-10-07 11:29:05.479154] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.364 [2024-10-07 11:29:05.479168] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.364 [2024-10-07 11:29:05.479288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.364 [2024-10-07 11:29:05.479312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.364 [2024-10-07 11:29:05.489315] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.365 [2024-10-07 11:29:05.489459] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.365 [2024-10-07 11:29:05.489597] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.365 [2024-10-07 11:29:05.489632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.365 [2024-10-07 11:29:05.489650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.365 [2024-10-07 11:29:05.489700] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.365 [2024-10-07 11:29:05.489724] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.365 [2024-10-07 11:29:05.489739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.365 [2024-10-07 11:29:05.490952] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.365 [2024-10-07 11:29:05.490997] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.365 [2024-10-07 11:29:05.491229] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.365 [2024-10-07 11:29:05.491267] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.365 [2024-10-07 11:29:05.491286] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.365 [2024-10-07 11:29:05.491305] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.365 [2024-10-07 11:29:05.491320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.365 [2024-10-07 11:29:05.491333] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.365 [2024-10-07 11:29:05.492462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.365 [2024-10-07 11:29:05.492498] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.365 [2024-10-07 11:29:05.499551] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.365 [2024-10-07 11:29:05.499656] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.365 [2024-10-07 11:29:05.499763] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.365 [2024-10-07 11:29:05.499794] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.365 [2024-10-07 11:29:05.499813] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.365 [2024-10-07 11:29:05.499878] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.365 [2024-10-07 11:29:05.499904] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.365 [2024-10-07 11:29:05.499921] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.365 [2024-10-07 11:29:05.499941] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.365 [2024-10-07 11:29:05.500894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.365 [2024-10-07 11:29:05.500938] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.365 [2024-10-07 11:29:05.500956] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.365 [2024-10-07 11:29:05.500973] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.365 [2024-10-07 11:29:05.501219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.365 [2024-10-07 11:29:05.501248] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.365 [2024-10-07 11:29:05.501262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.365 [2024-10-07 11:29:05.501276] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.365 [2024-10-07 11:29:05.502572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.365 [2024-10-07 11:29:05.511165] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.365 [2024-10-07 11:29:05.511248] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.365 [2024-10-07 11:29:05.511397] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.365 [2024-10-07 11:29:05.511449] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.365 [2024-10-07 11:29:05.511469] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.365 [2024-10-07 11:29:05.511520] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.365 [2024-10-07 11:29:05.511545] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.365 [2024-10-07 11:29:05.511560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.365 [2024-10-07 11:29:05.511801] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.365 [2024-10-07 11:29:05.511832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.365 [2024-10-07 11:29:05.511952] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.365 [2024-10-07 11:29:05.511980] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.365 [2024-10-07 11:29:05.511997] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.365 [2024-10-07 11:29:05.512015] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.365 [2024-10-07 11:29:05.512030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.365 [2024-10-07 11:29:05.512044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.365 [2024-10-07 11:29:05.512120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.365 [2024-10-07 11:29:05.512145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.365 [2024-10-07 11:29:05.522915] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.365 [2024-10-07 11:29:05.523020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.365 [2024-10-07 11:29:05.523153] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.365 [2024-10-07 11:29:05.523189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.365 [2024-10-07 11:29:05.523206] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.365 [2024-10-07 11:29:05.523256] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.365 [2024-10-07 11:29:05.523280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.365 [2024-10-07 11:29:05.523295] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.365 [2024-10-07 11:29:05.523356] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.365 [2024-10-07 11:29:05.523381] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.365 [2024-10-07 11:29:05.523424] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.365 [2024-10-07 11:29:05.523445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.365 [2024-10-07 11:29:05.523461] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.365 [2024-10-07 11:29:05.523478] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.365 [2024-10-07 11:29:05.523492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.365 [2024-10-07 11:29:05.523506] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.365 [2024-10-07 11:29:05.523703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.365 [2024-10-07 11:29:05.523729] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.365 [2024-10-07 11:29:05.533241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.365 [2024-10-07 11:29:05.533339] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.365 [2024-10-07 11:29:05.533493] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.365 [2024-10-07 11:29:05.533530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.365 [2024-10-07 11:29:05.533549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.365 [2024-10-07 11:29:05.533605] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.365 [2024-10-07 11:29:05.533629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.365 [2024-10-07 11:29:05.533645] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.365 [2024-10-07 11:29:05.534439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.365 [2024-10-07 11:29:05.534488] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.365 [2024-10-07 11:29:05.534701] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.365 [2024-10-07 11:29:05.534739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.365 [2024-10-07 11:29:05.534758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.365 [2024-10-07 11:29:05.534777] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.365 [2024-10-07 11:29:05.534792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.365 [2024-10-07 11:29:05.534806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.365 [2024-10-07 11:29:05.534903] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.365 [2024-10-07 11:29:05.534925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.365 [2024-10-07 11:29:05.543450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.365 [2024-10-07 11:29:05.543569] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.365 [2024-10-07 11:29:05.543702] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.365 [2024-10-07 11:29:05.543735] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.365 [2024-10-07 11:29:05.543753] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.365 [2024-10-07 11:29:05.544548] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.365 [2024-10-07 11:29:05.544592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.365 [2024-10-07 11:29:05.544612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.366 [2024-10-07 11:29:05.544633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.366 [2024-10-07 11:29:05.544833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.366 [2024-10-07 11:29:05.544863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.366 [2024-10-07 11:29:05.544878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.366 [2024-10-07 11:29:05.544893] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.366 [2024-10-07 11:29:05.544964] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.366 [2024-10-07 11:29:05.544990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.366 [2024-10-07 11:29:05.545004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.366 [2024-10-07 11:29:05.545018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.366 [2024-10-07 11:29:05.545082] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.366 [2024-10-07 11:29:05.553609] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.366 [2024-10-07 11:29:05.553812] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.366 [2024-10-07 11:29:05.553850] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.366 [2024-10-07 11:29:05.553869] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.366 [2024-10-07 11:29:05.554087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.366 [2024-10-07 11:29:05.554246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.366 [2024-10-07 11:29:05.554296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.366 [2024-10-07 11:29:05.554316] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.366 [2024-10-07 11:29:05.554332] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.366 [2024-10-07 11:29:05.554473] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.366 [2024-10-07 11:29:05.554545] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.366 [2024-10-07 11:29:05.554582] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.366 [2024-10-07 11:29:05.554599] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.366 [2024-10-07 11:29:05.554654] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.366 [2024-10-07 11:29:05.555651] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.366 [2024-10-07 11:29:05.555691] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.366 [2024-10-07 11:29:05.555710] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.366 [2024-10-07 11:29:05.556536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.366 [2024-10-07 11:29:05.563941] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.366 [2024-10-07 11:29:05.564153] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.366 [2024-10-07 11:29:05.564191] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.366 [2024-10-07 11:29:05.564210] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.366 [2024-10-07 11:29:05.565000] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.366 [2024-10-07 11:29:05.565259] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.366 [2024-10-07 11:29:05.565302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.366 [2024-10-07 11:29:05.565323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.366 [2024-10-07 11:29:05.565441] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.366 [2024-10-07 11:29:05.565469] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.366 [2024-10-07 11:29:05.565556] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.366 [2024-10-07 11:29:05.565587] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.366 [2024-10-07 11:29:05.565604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.366 [2024-10-07 11:29:05.566792] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.366 [2024-10-07 11:29:05.567024] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.366 [2024-10-07 11:29:05.567053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.366 [2024-10-07 11:29:05.567069] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.366 [2024-10-07 11:29:05.568193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.366 [2024-10-07 11:29:05.574860] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.366 [2024-10-07 11:29:05.575045] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.366 [2024-10-07 11:29:05.575080] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.366 [2024-10-07 11:29:05.575102] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.366 [2024-10-07 11:29:05.575138] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.366 [2024-10-07 11:29:05.575185] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.366 [2024-10-07 11:29:05.575205] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.366 [2024-10-07 11:29:05.575220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.366 [2024-10-07 11:29:05.575250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.366 [2024-10-07 11:29:05.575526] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.366 [2024-10-07 11:29:05.575617] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.366 [2024-10-07 11:29:05.575647] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.366 [2024-10-07 11:29:05.575665] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.366 [2024-10-07 11:29:05.576611] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.366 [2024-10-07 11:29:05.576856] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.366 [2024-10-07 11:29:05.576894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.366 [2024-10-07 11:29:05.576913] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.366 [2024-10-07 11:29:05.576997] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.366 [2024-10-07 11:29:05.586680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.366 [2024-10-07 11:29:05.586867] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.366 [2024-10-07 11:29:05.586981] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.366 [2024-10-07 11:29:05.587013] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.366 [2024-10-07 11:29:05.587032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.366 [2024-10-07 11:29:05.587306] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.366 [2024-10-07 11:29:05.587349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.366 [2024-10-07 11:29:05.587369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.366 [2024-10-07 11:29:05.587390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.366 [2024-10-07 11:29:05.587527] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.366 [2024-10-07 11:29:05.587558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.366 [2024-10-07 11:29:05.587573] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.366 [2024-10-07 11:29:05.587588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.366 [2024-10-07 11:29:05.587642] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.366 [2024-10-07 11:29:05.587666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.366 [2024-10-07 11:29:05.587679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.366 [2024-10-07 11:29:05.587694] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.366 [2024-10-07 11:29:05.587723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.366 [2024-10-07 11:29:05.598308] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.366 [2024-10-07 11:29:05.598414] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.366 [2024-10-07 11:29:05.598549] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.366 [2024-10-07 11:29:05.598610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.366 [2024-10-07 11:29:05.598631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.366 [2024-10-07 11:29:05.598683] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.366 [2024-10-07 11:29:05.598707] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.366 [2024-10-07 11:29:05.598722] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.366 [2024-10-07 11:29:05.598757] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.366 [2024-10-07 11:29:05.598780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.366 [2024-10-07 11:29:05.598807] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.366 [2024-10-07 11:29:05.598824] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.366 [2024-10-07 11:29:05.598839] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.366 [2024-10-07 11:29:05.598856] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.367 [2024-10-07 11:29:05.598870] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.367 [2024-10-07 11:29:05.598883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.367 [2024-10-07 11:29:05.598914] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.367 [2024-10-07 11:29:05.598931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.367 [2024-10-07 11:29:05.608801] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.367 [2024-10-07 11:29:05.608902] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.367 [2024-10-07 11:29:05.609107] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.367 [2024-10-07 11:29:05.609160] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.367 [2024-10-07 11:29:05.609191] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.367 [2024-10-07 11:29:05.609278] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.367 [2024-10-07 11:29:05.609309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.367 [2024-10-07 11:29:05.609326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.367 [2024-10-07 11:29:05.610151] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.367 [2024-10-07 11:29:05.610202] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.367 [2024-10-07 11:29:05.610395] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.367 [2024-10-07 11:29:05.610445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.367 [2024-10-07 11:29:05.610466] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.367 [2024-10-07 11:29:05.610489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.367 [2024-10-07 11:29:05.610504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.367 [2024-10-07 11:29:05.610546] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.367 [2024-10-07 11:29:05.610667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.367 [2024-10-07 11:29:05.610689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.367 [2024-10-07 11:29:05.619892] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.367 [2024-10-07 11:29:05.619985] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.367 [2024-10-07 11:29:05.620141] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.367 [2024-10-07 11:29:05.620179] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.367 [2024-10-07 11:29:05.620198] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.367 [2024-10-07 11:29:05.620249] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.367 [2024-10-07 11:29:05.620273] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.367 [2024-10-07 11:29:05.620290] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.367 [2024-10-07 11:29:05.620325] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.367 [2024-10-07 11:29:05.620348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.367 [2024-10-07 11:29:05.620414] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.367 [2024-10-07 11:29:05.620438] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.367 [2024-10-07 11:29:05.620454] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.367 [2024-10-07 11:29:05.620472] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.367 [2024-10-07 11:29:05.620487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.367 [2024-10-07 11:29:05.620500] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.367 [2024-10-07 11:29:05.620532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.367 [2024-10-07 11:29:05.620550] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.367 [2024-10-07 11:29:05.631006] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.367 [2024-10-07 11:29:05.631879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.367 [2024-10-07 11:29:05.632066] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.367 [2024-10-07 11:29:05.632116] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.367 [2024-10-07 11:29:05.632147] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.367 [2024-10-07 11:29:05.632545] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.367 [2024-10-07 11:29:05.632588] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.367 [2024-10-07 11:29:05.632608] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.367 [2024-10-07 11:29:05.632630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.367 [2024-10-07 11:29:05.632778] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.367 [2024-10-07 11:29:05.632810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.367 [2024-10-07 11:29:05.632825] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.367 [2024-10-07 11:29:05.632840] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.367 [2024-10-07 11:29:05.632925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.367 [2024-10-07 11:29:05.632952] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.367 [2024-10-07 11:29:05.632966] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.367 [2024-10-07 11:29:05.632980] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.367 [2024-10-07 11:29:05.633010] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.367 [2024-10-07 11:29:05.642577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.367 [2024-10-07 11:29:05.643617] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.367 [2024-10-07 11:29:05.643668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.367 [2024-10-07 11:29:05.643692] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.367 [2024-10-07 11:29:05.643803] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.367 [2024-10-07 11:29:05.643847] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.367 [2024-10-07 11:29:05.644093] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.367 [2024-10-07 11:29:05.644137] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.367 [2024-10-07 11:29:05.644157] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.367 [2024-10-07 11:29:05.644173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.367 [2024-10-07 11:29:05.644187] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.367 [2024-10-07 11:29:05.644203] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.367 [2024-10-07 11:29:05.644344] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.367 [2024-10-07 11:29:05.644373] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.367 [2024-10-07 11:29:05.644508] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.367 [2024-10-07 11:29:05.644535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.367 [2024-10-07 11:29:05.644550] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.367 [2024-10-07 11:29:05.644604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.367 [2024-10-07 11:29:05.652983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.367 [2024-10-07 11:29:05.653203] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.367 [2024-10-07 11:29:05.653242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.367 [2024-10-07 11:29:05.653261] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.367 [2024-10-07 11:29:05.654087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.367 [2024-10-07 11:29:05.654338] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.367 [2024-10-07 11:29:05.654378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.367 [2024-10-07 11:29:05.654411] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.367 [2024-10-07 11:29:05.654523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.367 [2024-10-07 11:29:05.654549] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.367 [2024-10-07 11:29:05.654630] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.367 [2024-10-07 11:29:05.654660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.368 [2024-10-07 11:29:05.654677] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.368 [2024-10-07 11:29:05.655916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.368 [2024-10-07 11:29:05.656186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.368 [2024-10-07 11:29:05.656216] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.368 [2024-10-07 11:29:05.656233] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.368 [2024-10-07 11:29:05.657388] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.368 [2024-10-07 11:29:05.663986] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.368 [2024-10-07 11:29:05.664199] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.368 [2024-10-07 11:29:05.664239] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.368 [2024-10-07 11:29:05.664259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.368 [2024-10-07 11:29:05.664301] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.368 [2024-10-07 11:29:05.664334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.368 [2024-10-07 11:29:05.664352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.368 [2024-10-07 11:29:05.664368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.368 [2024-10-07 11:29:05.664415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.368 [2024-10-07 11:29:05.664607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.368 [2024-10-07 11:29:05.664692] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.368 [2024-10-07 11:29:05.664722] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.368 [2024-10-07 11:29:05.664739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.368 [2024-10-07 11:29:05.665705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.368 [2024-10-07 11:29:05.665934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.368 [2024-10-07 11:29:05.665962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.368 [2024-10-07 11:29:05.666002] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.368 [2024-10-07 11:29:05.666084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.368 [2024-10-07 11:29:05.675051] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.368 [2024-10-07 11:29:05.675999] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.368 [2024-10-07 11:29:05.676050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.368 [2024-10-07 11:29:05.676072] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.368 [2024-10-07 11:29:05.676395] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.368 [2024-10-07 11:29:05.676474] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.368 [2024-10-07 11:29:05.676637] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.368 [2024-10-07 11:29:05.676671] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.368 [2024-10-07 11:29:05.676688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.368 [2024-10-07 11:29:05.676704] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.368 [2024-10-07 11:29:05.676717] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.368 [2024-10-07 11:29:05.676733] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.368 [2024-10-07 11:29:05.676789] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.368 [2024-10-07 11:29:05.676816] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.368 [2024-10-07 11:29:05.676845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.368 [2024-10-07 11:29:05.676863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.368 [2024-10-07 11:29:05.676877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.368 [2024-10-07 11:29:05.676905] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.368 [2024-10-07 11:29:05.686098] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.368 [2024-10-07 11:29:05.687460] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.368 [2024-10-07 11:29:05.687527] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.368 [2024-10-07 11:29:05.687552] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.368 [2024-10-07 11:29:05.688426] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.368 [2024-10-07 11:29:05.688566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.368 [2024-10-07 11:29:05.688609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.368 [2024-10-07 11:29:05.688627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.368 [2024-10-07 11:29:05.688643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.368 [2024-10-07 11:29:05.688861] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.368 [2024-10-07 11:29:05.688963] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.368 [2024-10-07 11:29:05.688992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.368 [2024-10-07 11:29:05.689010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.368 [2024-10-07 11:29:05.689181] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.368 [2024-10-07 11:29:05.689313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.368 [2024-10-07 11:29:05.689339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.368 [2024-10-07 11:29:05.689354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.368 [2024-10-07 11:29:05.689427] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.368 [2024-10-07 11:29:05.696269] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.368 [2024-10-07 11:29:05.697678] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.368 [2024-10-07 11:29:05.697728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.368 [2024-10-07 11:29:05.697751] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.368 [2024-10-07 11:29:05.697962] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.368 [2024-10-07 11:29:05.698006] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.368 [2024-10-07 11:29:05.698025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.368 [2024-10-07 11:29:05.698040] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.368 [2024-10-07 11:29:05.698817] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.368 [2024-10-07 11:29:05.699123] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.368 [2024-10-07 11:29:05.699232] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.368 [2024-10-07 11:29:05.699264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.368 [2024-10-07 11:29:05.699282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.368 [2024-10-07 11:29:05.699314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.368 [2024-10-07 11:29:05.699345] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.368 [2024-10-07 11:29:05.699362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.368 [2024-10-07 11:29:05.699376] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.368 [2024-10-07 11:29:05.699422] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.368 [2024-10-07 11:29:05.706422] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.368 [2024-10-07 11:29:05.706579] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.368 [2024-10-07 11:29:05.706614] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.368 [2024-10-07 11:29:05.706632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.368 [2024-10-07 11:29:05.706665] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.368 [2024-10-07 11:29:05.706724] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.368 [2024-10-07 11:29:05.706743] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.368 [2024-10-07 11:29:05.706758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.368 [2024-10-07 11:29:05.706788] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.369 [2024-10-07 11:29:05.709207] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.369 [2024-10-07 11:29:05.709319] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.369 [2024-10-07 11:29:05.709351] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.369 [2024-10-07 11:29:05.709368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.369 [2024-10-07 11:29:05.710301] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.369 [2024-10-07 11:29:05.710557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.369 [2024-10-07 11:29:05.710594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.369 [2024-10-07 11:29:05.710612] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.369 [2024-10-07 11:29:05.710691] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.369 [2024-10-07 11:29:05.717447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.369 [2024-10-07 11:29:05.717625] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.369 [2024-10-07 11:29:05.717660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.369 [2024-10-07 11:29:05.717679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.369 [2024-10-07 11:29:05.717714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.369 [2024-10-07 11:29:05.717746] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.369 [2024-10-07 11:29:05.717763] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.369 [2024-10-07 11:29:05.717779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.369 [2024-10-07 11:29:05.717974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.369 [2024-10-07 11:29:05.720504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.369 [2024-10-07 11:29:05.720637] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.369 [2024-10-07 11:29:05.720670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.369 [2024-10-07 11:29:05.720688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.369 [2024-10-07 11:29:05.720918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.369 [2024-10-07 11:29:05.721049] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.369 [2024-10-07 11:29:05.721096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.369 [2024-10-07 11:29:05.721113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.369 [2024-10-07 11:29:05.721192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.369 [2024-10-07 11:29:05.728218] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.369 [2024-10-07 11:29:05.728426] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.369 [2024-10-07 11:29:05.728462] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.369 [2024-10-07 11:29:05.728480] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.369 [2024-10-07 11:29:05.728517] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.369 [2024-10-07 11:29:05.729721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.369 [2024-10-07 11:29:05.729760] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.369 [2024-10-07 11:29:05.729779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.369 [2024-10-07 11:29:05.730008] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.369 [2024-10-07 11:29:05.732090] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.369 [2024-10-07 11:29:05.732214] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.369 [2024-10-07 11:29:05.732247] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.369 [2024-10-07 11:29:05.732265] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.369 [2024-10-07 11:29:05.732298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.369 [2024-10-07 11:29:05.732506] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.369 [2024-10-07 11:29:05.732543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.369 [2024-10-07 11:29:05.732561] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.369 [2024-10-07 11:29:05.732699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.369 [2024-10-07 11:29:05.738365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.369 [2024-10-07 11:29:05.738538] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.369 [2024-10-07 11:29:05.738573] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.369 [2024-10-07 11:29:05.738591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.369 [2024-10-07 11:29:05.739536] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.369 [2024-10-07 11:29:05.739758] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.369 [2024-10-07 11:29:05.739793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.369 [2024-10-07 11:29:05.739812] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.369 [2024-10-07 11:29:05.739938] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.369 [2024-10-07 11:29:05.742774] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.369 [2024-10-07 11:29:05.742915] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.369 [2024-10-07 11:29:05.742949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.369 [2024-10-07 11:29:05.742993] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.369 [2024-10-07 11:29:05.743030] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.369 [2024-10-07 11:29:05.743061] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.369 [2024-10-07 11:29:05.743078] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.369 [2024-10-07 11:29:05.743093] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.369 [2024-10-07 11:29:05.743123] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.369 [2024-10-07 11:29:05.749703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.369 [2024-10-07 11:29:05.749893] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.369 [2024-10-07 11:29:05.749929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.369 [2024-10-07 11:29:05.749947] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.369 [2024-10-07 11:29:05.750206] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.369 [2024-10-07 11:29:05.750340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.369 [2024-10-07 11:29:05.750377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.369 [2024-10-07 11:29:05.750396] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.369 [2024-10-07 11:29:05.750473] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.369 [2024-10-07 11:29:05.752882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.369 [2024-10-07 11:29:05.753004] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.369 [2024-10-07 11:29:05.753035] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.369 [2024-10-07 11:29:05.753052] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.369 [2024-10-07 11:29:05.753102] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.369 [2024-10-07 11:29:05.753134] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.369 [2024-10-07 11:29:05.753151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.369 [2024-10-07 11:29:05.753165] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.369 [2024-10-07 11:29:05.753195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.369 [2024-10-07 11:29:05.761232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.369 [2024-10-07 11:29:05.761445] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.369 [2024-10-07 11:29:05.761481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.369 [2024-10-07 11:29:05.761501] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.369 [2024-10-07 11:29:05.761537] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.369 [2024-10-07 11:29:05.761569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.369 [2024-10-07 11:29:05.761608] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.369 [2024-10-07 11:29:05.761624] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.369 [2024-10-07 11:29:05.761823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.369 [2024-10-07 11:29:05.764234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.369 [2024-10-07 11:29:05.764349] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.369 [2024-10-07 11:29:05.764380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.370 [2024-10-07 11:29:05.764397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.370 [2024-10-07 11:29:05.764648] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.370 [2024-10-07 11:29:05.764778] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.370 [2024-10-07 11:29:05.764814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.370 [2024-10-07 11:29:05.764832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.370 [2024-10-07 11:29:05.764885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.370 [2024-10-07 11:29:05.771939] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.370 [2024-10-07 11:29:05.772109] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.370 [2024-10-07 11:29:05.772144] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.370 [2024-10-07 11:29:05.772163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.370 [2024-10-07 11:29:05.772198] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.370 [2024-10-07 11:29:05.772229] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.370 [2024-10-07 11:29:05.772246] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.370 [2024-10-07 11:29:05.772262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.370 [2024-10-07 11:29:05.772292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.370 [2024-10-07 11:29:05.775752] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.370 [2024-10-07 11:29:05.775885] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.370 [2024-10-07 11:29:05.775918] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.370 [2024-10-07 11:29:05.775936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.370 [2024-10-07 11:29:05.775968] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.370 [2024-10-07 11:29:05.775999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.370 [2024-10-07 11:29:05.776016] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.370 [2024-10-07 11:29:05.776031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.370 [2024-10-07 11:29:05.776061] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.370 [2024-10-07 11:29:05.782073] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.370 [2024-10-07 11:29:05.782267] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.370 [2024-10-07 11:29:05.782302] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.370 [2024-10-07 11:29:05.782321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.370 [2024-10-07 11:29:05.782356] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.370 [2024-10-07 11:29:05.783299] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.370 [2024-10-07 11:29:05.783338] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.370 [2024-10-07 11:29:05.783359] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.370 [2024-10-07 11:29:05.783633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.370 [2024-10-07 11:29:05.786548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.370 [2024-10-07 11:29:05.786684] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.370 [2024-10-07 11:29:05.786718] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.370 [2024-10-07 11:29:05.786736] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.370 [2024-10-07 11:29:05.786770] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.370 [2024-10-07 11:29:05.786801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.370 [2024-10-07 11:29:05.786818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.370 [2024-10-07 11:29:05.786833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.370 [2024-10-07 11:29:05.786863] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.370 [2024-10-07 11:29:05.793438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.370 [2024-10-07 11:29:05.793612] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.370 [2024-10-07 11:29:05.793647] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.370 [2024-10-07 11:29:05.793664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.370 [2024-10-07 11:29:05.793897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.370 [2024-10-07 11:29:05.794029] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.370 [2024-10-07 11:29:05.794065] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.370 [2024-10-07 11:29:05.794085] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.370 [2024-10-07 11:29:05.794140] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.370 [2024-10-07 11:29:05.796648] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.370 [2024-10-07 11:29:05.796761] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.370 [2024-10-07 11:29:05.796792] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.370 [2024-10-07 11:29:05.796833] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.370 [2024-10-07 11:29:05.796870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.370 [2024-10-07 11:29:05.797829] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.370 [2024-10-07 11:29:05.797868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.370 [2024-10-07 11:29:05.797887] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.370 [2024-10-07 11:29:05.798088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.370 [2024-10-07 11:29:05.804896] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.370 [2024-10-07 11:29:05.805114] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.370 [2024-10-07 11:29:05.805151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.370 [2024-10-07 11:29:05.805171] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.370 [2024-10-07 11:29:05.805208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.370 [2024-10-07 11:29:05.805240] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.370 [2024-10-07 11:29:05.805257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.370 [2024-10-07 11:29:05.805273] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.370 [2024-10-07 11:29:05.805490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.370 [2024-10-07 11:29:05.807931] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.370 [2024-10-07 11:29:05.808060] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.370 [2024-10-07 11:29:05.808094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.370 [2024-10-07 11:29:05.808111] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.370 [2024-10-07 11:29:05.808341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.370 [2024-10-07 11:29:05.808485] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.370 [2024-10-07 11:29:05.808523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.370 [2024-10-07 11:29:05.808541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.370 [2024-10-07 11:29:05.808596] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.370 [2024-10-07 11:29:05.815714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.370 [2024-10-07 11:29:05.815917] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.370 [2024-10-07 11:29:05.815953] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.370 [2024-10-07 11:29:05.815972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.370 [2024-10-07 11:29:05.816008] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.370 [2024-10-07 11:29:05.817258] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.370 [2024-10-07 11:29:05.817329] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.370 [2024-10-07 11:29:05.817351] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.370 [2024-10-07 11:29:05.817593] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.370 [2024-10-07 11:29:05.819763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.370 [2024-10-07 11:29:05.819912] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.370 [2024-10-07 11:29:05.819955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.370 [2024-10-07 11:29:05.819975] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.371 [2024-10-07 11:29:05.820183] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.371 [2024-10-07 11:29:05.820390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.371 [2024-10-07 11:29:05.820445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.371 [2024-10-07 11:29:05.820464] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.371 [2024-10-07 11:29:05.820600] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.371 [2024-10-07 11:29:05.825871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.371 [2024-10-07 11:29:05.826060] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.371 [2024-10-07 11:29:05.826097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.371 [2024-10-07 11:29:05.826116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.371 [2024-10-07 11:29:05.826151] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.371 [2024-10-07 11:29:05.827100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.371 [2024-10-07 11:29:05.827138] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.371 [2024-10-07 11:29:05.827158] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.371 [2024-10-07 11:29:05.827387] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.371 [2024-10-07 11:29:05.830337] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.371 [2024-10-07 11:29:05.830521] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.371 [2024-10-07 11:29:05.830558] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.371 [2024-10-07 11:29:05.830577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.371 [2024-10-07 11:29:05.830612] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.371 [2024-10-07 11:29:05.830644] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.371 [2024-10-07 11:29:05.830662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.371 [2024-10-07 11:29:05.830677] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.371 [2024-10-07 11:29:05.830707] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.371 [2024-10-07 11:29:05.837269] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.371 [2024-10-07 11:29:05.837508] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.371 [2024-10-07 11:29:05.837546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.371 [2024-10-07 11:29:05.837565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.371 [2024-10-07 11:29:05.837804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.371 [2024-10-07 11:29:05.837938] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.371 [2024-10-07 11:29:05.837976] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.371 [2024-10-07 11:29:05.837996] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.371 [2024-10-07 11:29:05.838051] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.371 [2024-10-07 11:29:05.840464] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.371 [2024-10-07 11:29:05.840582] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.371 [2024-10-07 11:29:05.840615] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.371 [2024-10-07 11:29:05.840632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.371 [2024-10-07 11:29:05.840664] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.371 [2024-10-07 11:29:05.840695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.371 [2024-10-07 11:29:05.840713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.371 [2024-10-07 11:29:05.840727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.371 [2024-10-07 11:29:05.840757] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.371 [2024-10-07 11:29:05.848875] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.371 [2024-10-07 11:29:05.849090] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.371 [2024-10-07 11:29:05.849126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.371 [2024-10-07 11:29:05.849145] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.371 [2024-10-07 11:29:05.849181] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.371 [2024-10-07 11:29:05.849213] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.371 [2024-10-07 11:29:05.849230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.371 [2024-10-07 11:29:05.849245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.371 [2024-10-07 11:29:05.849276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.371 [2024-10-07 11:29:05.851930] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.371 [2024-10-07 11:29:05.852047] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.371 [2024-10-07 11:29:05.852078] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.371 [2024-10-07 11:29:05.852096] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.371 [2024-10-07 11:29:05.852156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.371 [2024-10-07 11:29:05.852201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.371 [2024-10-07 11:29:05.852221] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.371 [2024-10-07 11:29:05.852235] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.371 [2024-10-07 11:29:05.852479] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.371 [2024-10-07 11:29:05.859883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.371 [2024-10-07 11:29:05.860055] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.371 [2024-10-07 11:29:05.860089] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.371 [2024-10-07 11:29:05.860108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.371 [2024-10-07 11:29:05.860143] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.371 [2024-10-07 11:29:05.860174] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.371 [2024-10-07 11:29:05.860192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.371 [2024-10-07 11:29:05.860206] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.371 [2024-10-07 11:29:05.860237] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.371 [2024-10-07 11:29:05.863747] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.371 [2024-10-07 11:29:05.863882] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.371 [2024-10-07 11:29:05.863915] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.371 [2024-10-07 11:29:05.863933] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.371 [2024-10-07 11:29:05.863967] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.371 [2024-10-07 11:29:05.863999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.371 [2024-10-07 11:29:05.864017] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.371 [2024-10-07 11:29:05.864031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.371 [2024-10-07 11:29:05.864061] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.371 [2024-10-07 11:29:05.870032] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.371 [2024-10-07 11:29:05.870195] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.371 [2024-10-07 11:29:05.870229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.371 [2024-10-07 11:29:05.870248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.371 [2024-10-07 11:29:05.870282] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.371 [2024-10-07 11:29:05.871226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.371 [2024-10-07 11:29:05.871264] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.371 [2024-10-07 11:29:05.871308] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.371 [2024-10-07 11:29:05.871527] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.371 [2024-10-07 11:29:05.874567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.371 [2024-10-07 11:29:05.874687] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.371 [2024-10-07 11:29:05.874720] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.371 [2024-10-07 11:29:05.874737] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.371 [2024-10-07 11:29:05.874769] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.371 [2024-10-07 11:29:05.874800] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.371 [2024-10-07 11:29:05.874818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.372 [2024-10-07 11:29:05.874832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.372 [2024-10-07 11:29:05.874862] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.372 [2024-10-07 11:29:05.881547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.372 [2024-10-07 11:29:05.881710] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.372 [2024-10-07 11:29:05.881745] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.372 [2024-10-07 11:29:05.881763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.372 [2024-10-07 11:29:05.881994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.372 [2024-10-07 11:29:05.882125] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.372 [2024-10-07 11:29:05.882162] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.372 [2024-10-07 11:29:05.882182] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.372 [2024-10-07 11:29:05.882236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.372 [2024-10-07 11:29:05.884663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.372 [2024-10-07 11:29:05.884782] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.372 [2024-10-07 11:29:05.884814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.372 [2024-10-07 11:29:05.884832] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.372 [2024-10-07 11:29:05.884865] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.372 [2024-10-07 11:29:05.884895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.372 [2024-10-07 11:29:05.884913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.372 [2024-10-07 11:29:05.884927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.372 [2024-10-07 11:29:05.884957] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.372 [2024-10-07 11:29:05.893240] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.372 [2024-10-07 11:29:05.893459] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.372 [2024-10-07 11:29:05.893523] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.372 [2024-10-07 11:29:05.893544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.372 [2024-10-07 11:29:05.893768] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.372 [2024-10-07 11:29:05.893974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.372 [2024-10-07 11:29:05.894016] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.372 [2024-10-07 11:29:05.894038] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.372 [2024-10-07 11:29:05.894173] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.372 [2024-10-07 11:29:05.896344] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.372 [2024-10-07 11:29:05.896702] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.372 [2024-10-07 11:29:05.896749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.372 [2024-10-07 11:29:05.896771] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.372 [2024-10-07 11:29:05.896889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.372 [2024-10-07 11:29:05.896952] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.372 [2024-10-07 11:29:05.896975] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.372 [2024-10-07 11:29:05.896990] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.372 [2024-10-07 11:29:05.897024] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.372 [2024-10-07 11:29:05.903987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.372 [2024-10-07 11:29:05.904166] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.372 [2024-10-07 11:29:05.904201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.372 [2024-10-07 11:29:05.904220] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.372 [2024-10-07 11:29:05.904255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.372 [2024-10-07 11:29:05.904287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.372 [2024-10-07 11:29:05.904304] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.372 [2024-10-07 11:29:05.904320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.372 [2024-10-07 11:29:05.905539] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.372 [2024-10-07 11:29:05.907781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.372 [2024-10-07 11:29:05.907922] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.372 [2024-10-07 11:29:05.907955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.372 [2024-10-07 11:29:05.907973] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.372 [2024-10-07 11:29:05.908006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.372 [2024-10-07 11:29:05.908064] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.372 [2024-10-07 11:29:05.908083] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.372 [2024-10-07 11:29:05.908097] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.372 [2024-10-07 11:29:05.908289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.372 [2024-10-07 11:29:05.914140] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.372 [2024-10-07 11:29:05.914348] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.372 [2024-10-07 11:29:05.914387] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.372 [2024-10-07 11:29:05.914423] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.372 [2024-10-07 11:29:05.915368] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.372 [2024-10-07 11:29:05.915608] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.372 [2024-10-07 11:29:05.915645] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.372 [2024-10-07 11:29:05.915665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.372 [2024-10-07 11:29:05.915747] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.372 [2024-10-07 11:29:05.918599] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.372 [2024-10-07 11:29:05.918742] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.372 [2024-10-07 11:29:05.918778] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.372 [2024-10-07 11:29:05.918796] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.372 [2024-10-07 11:29:05.918829] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.372 [2024-10-07 11:29:05.918861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.372 [2024-10-07 11:29:05.918880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.372 [2024-10-07 11:29:05.918894] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.372 [2024-10-07 11:29:05.920141] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.372 [2024-10-07 11:29:05.925364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.372 [2024-10-07 11:29:05.925562] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.372 [2024-10-07 11:29:05.925599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.372 [2024-10-07 11:29:05.925619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.372 [2024-10-07 11:29:05.925855] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.372 [2024-10-07 11:29:05.926009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.372 [2024-10-07 11:29:05.926048] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.372 [2024-10-07 11:29:05.926069] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.372 [2024-10-07 11:29:05.926149] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.373 [2024-10-07 11:29:05.928729] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.373 [2024-10-07 11:29:05.928907] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.373 [2024-10-07 11:29:05.928954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.373 [2024-10-07 11:29:05.928985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.373 [2024-10-07 11:29:05.929998] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.373 [2024-10-07 11:29:05.930253] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.373 [2024-10-07 11:29:05.930291] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.373 [2024-10-07 11:29:05.930311] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.373 [2024-10-07 11:29:05.931613] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.373 [2024-10-07 11:29:05.936965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.373 [2024-10-07 11:29:05.937168] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.373 [2024-10-07 11:29:05.937206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.373 [2024-10-07 11:29:05.937226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.373 [2024-10-07 11:29:05.937262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.373 [2024-10-07 11:29:05.937294] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.373 [2024-10-07 11:29:05.937312] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.373 [2024-10-07 11:29:05.937328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.373 [2024-10-07 11:29:05.937541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.373 [2024-10-07 11:29:05.940051] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.373 [2024-10-07 11:29:05.940170] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.373 [2024-10-07 11:29:05.940202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.373 [2024-10-07 11:29:05.940220] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.373 [2024-10-07 11:29:05.940465] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.373 [2024-10-07 11:29:05.940596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.373 [2024-10-07 11:29:05.940633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.373 [2024-10-07 11:29:05.940652] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.373 [2024-10-07 11:29:05.940706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.373 [2024-10-07 11:29:05.947127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.373 [2024-10-07 11:29:05.948144] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.373 [2024-10-07 11:29:05.948201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.373 [2024-10-07 11:29:05.948250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.373 [2024-10-07 11:29:05.948514] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.373 [2024-10-07 11:29:05.948641] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.373 [2024-10-07 11:29:05.948667] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.373 [2024-10-07 11:29:05.948683] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.373 [2024-10-07 11:29:05.948718] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.373 [2024-10-07 11:29:05.950223] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.373 [2024-10-07 11:29:05.951485] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.373 [2024-10-07 11:29:05.951536] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.373 [2024-10-07 11:29:05.951557] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.373 [2024-10-07 11:29:05.952389] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.373 [2024-10-07 11:29:05.952570] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.373 [2024-10-07 11:29:05.952609] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.373 [2024-10-07 11:29:05.952629] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.373 [2024-10-07 11:29:05.952830] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.373 [2024-10-07 11:29:05.958186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.373 [2024-10-07 11:29:05.958430] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.373 [2024-10-07 11:29:05.958468] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.373 [2024-10-07 11:29:05.958488] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.373 [2024-10-07 11:29:05.958544] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.373 [2024-10-07 11:29:05.958582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.373 [2024-10-07 11:29:05.958600] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.373 [2024-10-07 11:29:05.958615] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.373 [2024-10-07 11:29:05.958648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.373 [2024-10-07 11:29:05.960320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.373 [2024-10-07 11:29:05.960450] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.373 [2024-10-07 11:29:05.960483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.373 [2024-10-07 11:29:05.960500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.373 [2024-10-07 11:29:05.961792] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.373 [2024-10-07 11:29:05.962004] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.373 [2024-10-07 11:29:05.962063] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.373 [2024-10-07 11:29:05.962084] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.373 [2024-10-07 11:29:05.962120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.373 [2024-10-07 11:29:05.968335] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.373 [2024-10-07 11:29:05.969507] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.373 [2024-10-07 11:29:05.969562] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.373 [2024-10-07 11:29:05.969584] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.373 [2024-10-07 11:29:05.970384] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.373 [2024-10-07 11:29:05.970740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.373 [2024-10-07 11:29:05.970780] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.373 [2024-10-07 11:29:05.970801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.373 [2024-10-07 11:29:05.970935] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.373 [2024-10-07 11:29:05.971000] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.373 [2024-10-07 11:29:05.971098] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.373 [2024-10-07 11:29:05.971146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.373 [2024-10-07 11:29:05.971166] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.373 [2024-10-07 11:29:05.971200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.373 [2024-10-07 11:29:05.971231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.373 [2024-10-07 11:29:05.971248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.373 [2024-10-07 11:29:05.971262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.373 [2024-10-07 11:29:05.971292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.373 [2024-10-07 11:29:05.978514] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.373 [2024-10-07 11:29:05.978716] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.373 [2024-10-07 11:29:05.978753] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.373 [2024-10-07 11:29:05.978772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.373 [2024-10-07 11:29:05.980002] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.373 [2024-10-07 11:29:05.980247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.374 [2024-10-07 11:29:05.980284] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.374 [2024-10-07 11:29:05.980304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.374 [2024-10-07 11:29:05.981452] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.374 [2024-10-07 11:29:05.982473] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.374 [2024-10-07 11:29:05.982604] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.374 [2024-10-07 11:29:05.982640] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.374 [2024-10-07 11:29:05.982659] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.374 [2024-10-07 11:29:05.982855] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.374 [2024-10-07 11:29:05.983012] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.374 [2024-10-07 11:29:05.983048] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.374 [2024-10-07 11:29:05.983077] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.374 [2024-10-07 11:29:05.983240] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.374 [2024-10-07 11:29:05.988670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.374 [2024-10-07 11:29:05.988878] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.374 [2024-10-07 11:29:05.988917] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.374 [2024-10-07 11:29:05.988937] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.374 [2024-10-07 11:29:05.989947] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.374 [2024-10-07 11:29:05.990183] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.374 [2024-10-07 11:29:05.990221] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.374 [2024-10-07 11:29:05.990242] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.374 [2024-10-07 11:29:05.990325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.374 [2024-10-07 11:29:05.993322] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.374 [2024-10-07 11:29:05.993492] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.374 [2024-10-07 11:29:05.993529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.374 [2024-10-07 11:29:05.993555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.374 [2024-10-07 11:29:05.993610] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.374 [2024-10-07 11:29:05.993652] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.374 [2024-10-07 11:29:05.993671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.374 [2024-10-07 11:29:05.993686] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.374 [2024-10-07 11:29:05.993718] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.374 [2024-10-07 11:29:06.000397] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.374 [2024-10-07 11:29:06.000610] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.374 [2024-10-07 11:29:06.000647] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.374 [2024-10-07 11:29:06.000667] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.374 [2024-10-07 11:29:06.000934] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.374 [2024-10-07 11:29:06.001084] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.374 [2024-10-07 11:29:06.001122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.374 [2024-10-07 11:29:06.001142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.374 [2024-10-07 11:29:06.001198] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.374 [2024-10-07 11:29:06.003447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.374 [2024-10-07 11:29:06.003569] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.374 [2024-10-07 11:29:06.003602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.374 [2024-10-07 11:29:06.003620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.374 [2024-10-07 11:29:06.003653] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.374 [2024-10-07 11:29:06.003704] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.374 [2024-10-07 11:29:06.003725] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.374 [2024-10-07 11:29:06.003740] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.374 [2024-10-07 11:29:06.003770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.374 [2024-10-07 11:29:06.011956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.374 [2024-10-07 11:29:06.012153] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.374 [2024-10-07 11:29:06.012190] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.374 [2024-10-07 11:29:06.012208] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.374 [2024-10-07 11:29:06.012244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.374 [2024-10-07 11:29:06.012474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.374 [2024-10-07 11:29:06.012504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.374 [2024-10-07 11:29:06.012521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.374 [2024-10-07 11:29:06.012661] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.374 [2024-10-07 11:29:06.014981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.374 [2024-10-07 11:29:06.015112] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.374 [2024-10-07 11:29:06.015146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.374 [2024-10-07 11:29:06.015164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.374 [2024-10-07 11:29:06.015424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.374 [2024-10-07 11:29:06.015556] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.374 [2024-10-07 11:29:06.015591] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.374 [2024-10-07 11:29:06.015633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.374 [2024-10-07 11:29:06.015690] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.374 [2024-10-07 11:29:06.022784] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.374 [2024-10-07 11:29:06.022963] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.374 [2024-10-07 11:29:06.022998] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.374 [2024-10-07 11:29:06.023016] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.374 [2024-10-07 11:29:06.023052] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.374 [2024-10-07 11:29:06.023084] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.374 [2024-10-07 11:29:06.023100] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.374 [2024-10-07 11:29:06.023117] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.374 [2024-10-07 11:29:06.023148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.374 [2024-10-07 11:29:06.026612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.374 [2024-10-07 11:29:06.026739] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.374 [2024-10-07 11:29:06.026773] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.374 [2024-10-07 11:29:06.026790] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.374 [2024-10-07 11:29:06.026823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.374 [2024-10-07 11:29:06.026854] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.374 [2024-10-07 11:29:06.026872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.374 [2024-10-07 11:29:06.026887] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.374 [2024-10-07 11:29:06.026917] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.374 [2024-10-07 11:29:06.032917] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.374 [2024-10-07 11:29:06.033087] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.374 [2024-10-07 11:29:06.033121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.374 [2024-10-07 11:29:06.033140] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.374 [2024-10-07 11:29:06.033175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.374 [2024-10-07 11:29:06.033207] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.374 [2024-10-07 11:29:06.033225] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.374 [2024-10-07 11:29:06.033240] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.374 [2024-10-07 11:29:06.033271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.374 [2024-10-07 11:29:06.037519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.374 [2024-10-07 11:29:06.037675] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.374 [2024-10-07 11:29:06.037709] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.374 [2024-10-07 11:29:06.037727] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.375 [2024-10-07 11:29:06.037761] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.375 [2024-10-07 11:29:06.037792] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.375 [2024-10-07 11:29:06.037809] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.375 [2024-10-07 11:29:06.037823] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.375 [2024-10-07 11:29:06.037854] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.375 [2024-10-07 11:29:06.044355] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.375 [2024-10-07 11:29:06.044549] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.375 [2024-10-07 11:29:06.044585] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.375 [2024-10-07 11:29:06.044604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.375 [2024-10-07 11:29:06.044837] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.375 [2024-10-07 11:29:06.044961] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.375 [2024-10-07 11:29:06.044999] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.375 [2024-10-07 11:29:06.045019] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.375 [2024-10-07 11:29:06.045088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.375 [2024-10-07 11:29:06.047646] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.375 [2024-10-07 11:29:06.047763] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.375 [2024-10-07 11:29:06.047795] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.375 [2024-10-07 11:29:06.047813] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.375 [2024-10-07 11:29:06.047845] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.375 [2024-10-07 11:29:06.047875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.375 [2024-10-07 11:29:06.047893] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.375 [2024-10-07 11:29:06.047907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.375 [2024-10-07 11:29:06.047950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.375 [2024-10-07 11:29:06.056664] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.375 [2024-10-07 11:29:06.056945] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.375 [2024-10-07 11:29:06.056995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.375 [2024-10-07 11:29:06.057017] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.375 [2024-10-07 11:29:06.057263] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.375 [2024-10-07 11:29:06.057445] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.375 [2024-10-07 11:29:06.057492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.375 [2024-10-07 11:29:06.057521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.375 [2024-10-07 11:29:06.057657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.375 [2024-10-07 11:29:06.057765] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.375 [2024-10-07 11:29:06.057870] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.375 [2024-10-07 11:29:06.057907] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.375 [2024-10-07 11:29:06.057926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.375 [2024-10-07 11:29:06.057958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.375 [2024-10-07 11:29:06.058928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.375 [2024-10-07 11:29:06.058970] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.375 [2024-10-07 11:29:06.058989] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.375 [2024-10-07 11:29:06.059797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.375 [2024-10-07 11:29:06.067732] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.375 [2024-10-07 11:29:06.067916] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.375 [2024-10-07 11:29:06.067953] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.375 [2024-10-07 11:29:06.067972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.375 [2024-10-07 11:29:06.068025] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.375 [2024-10-07 11:29:06.068078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.375 [2024-10-07 11:29:06.068111] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.375 [2024-10-07 11:29:06.068129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.375 [2024-10-07 11:29:06.068144] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.375 [2024-10-07 11:29:06.069344] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.375 [2024-10-07 11:29:06.069443] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.375 [2024-10-07 11:29:06.069473] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.375 [2024-10-07 11:29:06.069491] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.375 [2024-10-07 11:29:06.069701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.375 [2024-10-07 11:29:06.070842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.375 [2024-10-07 11:29:06.070880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.375 [2024-10-07 11:29:06.070930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.375 [2024-10-07 11:29:06.071778] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.375 [2024-10-07 11:29:06.077886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.375 [2024-10-07 11:29:06.078084] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.375 [2024-10-07 11:29:06.078136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.375 [2024-10-07 11:29:06.078169] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.375 [2024-10-07 11:29:06.078227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.375 [2024-10-07 11:29:06.079253] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.375 [2024-10-07 11:29:06.079298] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.375 [2024-10-07 11:29:06.079319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.375 [2024-10-07 11:29:06.079546] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.375 [2024-10-07 11:29:06.079596] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.375 [2024-10-07 11:29:06.079734] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.375 [2024-10-07 11:29:06.079776] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.375 [2024-10-07 11:29:06.079796] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.375 [2024-10-07 11:29:06.081045] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.375 [2024-10-07 11:29:06.081298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.375 [2024-10-07 11:29:06.081336] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.375 [2024-10-07 11:29:06.081354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.375 [2024-10-07 11:29:06.081389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.375 [2024-10-07 11:29:06.089574] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.375 [2024-10-07 11:29:06.089802] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.375 [2024-10-07 11:29:06.089839] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.375 [2024-10-07 11:29:06.089858] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.375 [2024-10-07 11:29:06.090114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.375 [2024-10-07 11:29:06.090255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.375 [2024-10-07 11:29:06.090308] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.375 [2024-10-07 11:29:06.090328] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.375 [2024-10-07 11:29:06.090344] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.375 [2024-10-07 11:29:06.090397] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.375 [2024-10-07 11:29:06.090483] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.376 [2024-10-07 11:29:06.090536] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.376 [2024-10-07 11:29:06.090555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.376 [2024-10-07 11:29:06.090589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.376 [2024-10-07 11:29:06.090621] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.376 [2024-10-07 11:29:06.090638] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.376 [2024-10-07 11:29:06.090652] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.376 [2024-10-07 11:29:06.090682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.376 [2024-10-07 11:29:06.101218] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.376 [2024-10-07 11:29:06.101339] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.376 [2024-10-07 11:29:06.101465] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.376 [2024-10-07 11:29:06.101500] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.376 [2024-10-07 11:29:06.101518] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.376 [2024-10-07 11:29:06.101586] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.376 [2024-10-07 11:29:06.101613] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.376 [2024-10-07 11:29:06.101629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.376 [2024-10-07 11:29:06.101650] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.376 8301.86 IOPS, 32.43 MiB/s [2024-10-07T11:29:08.087Z] [2024-10-07 11:29:06.103530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.376 [2024-10-07 11:29:06.103567] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.376 [2024-10-07 11:29:06.103585] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.376 [2024-10-07 11:29:06.103600] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.376 [2024-10-07 11:29:06.103765] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.376 [2024-10-07 11:29:06.103792] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.376 [2024-10-07 11:29:06.103806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.376 [2024-10-07 11:29:06.103821] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.376 [2024-10-07 11:29:06.104831] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.376 [2024-10-07 11:29:06.112206] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.376 [2024-10-07 11:29:06.112295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.376 [2024-10-07 11:29:06.112448] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.376 [2024-10-07 11:29:06.112485] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.376 [2024-10-07 11:29:06.112503] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.376 [2024-10-07 11:29:06.112589] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.376 [2024-10-07 11:29:06.112615] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.376 [2024-10-07 11:29:06.112631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.376 [2024-10-07 11:29:06.113860] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.376 [2024-10-07 11:29:06.113908] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.376 [2024-10-07 11:29:06.114124] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.376 [2024-10-07 11:29:06.114159] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.376 [2024-10-07 11:29:06.114178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.376 [2024-10-07 11:29:06.114197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.376 [2024-10-07 11:29:06.114212] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.376 [2024-10-07 11:29:06.114225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.376 [2024-10-07 11:29:06.115348] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.376 [2024-10-07 11:29:06.115386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.376 [2024-10-07 11:29:06.122386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.376 [2024-10-07 11:29:06.122511] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.376 [2024-10-07 11:29:06.122622] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.376 [2024-10-07 11:29:06.122655] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.376 [2024-10-07 11:29:06.122674] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.376 [2024-10-07 11:29:06.122739] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.376 [2024-10-07 11:29:06.122765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.376 [2024-10-07 11:29:06.122781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.376 [2024-10-07 11:29:06.122801] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.376 [2024-10-07 11:29:06.123748] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.376 [2024-10-07 11:29:06.123791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.376 [2024-10-07 11:29:06.123810] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.376 [2024-10-07 11:29:06.123826] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.376 [2024-10-07 11:29:06.124022] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.376 [2024-10-07 11:29:06.124047] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.376 [2024-10-07 11:29:06.124062] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.376 [2024-10-07 11:29:06.124075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.376 [2024-10-07 11:29:06.124175] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.376 [2024-10-07 11:29:06.133817] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.376 [2024-10-07 11:29:06.133901] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.376 [2024-10-07 11:29:06.134029] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.376 [2024-10-07 11:29:06.134063] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.376 [2024-10-07 11:29:06.134081] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.376 [2024-10-07 11:29:06.134130] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.376 [2024-10-07 11:29:06.134154] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.376 [2024-10-07 11:29:06.134170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.376 [2024-10-07 11:29:06.134438] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.376 [2024-10-07 11:29:06.134472] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.376 [2024-10-07 11:29:06.134582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.376 [2024-10-07 11:29:06.134612] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.376 [2024-10-07 11:29:06.134630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.376 [2024-10-07 11:29:06.134647] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.376 [2024-10-07 11:29:06.134662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.376 [2024-10-07 11:29:06.134675] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.376 [2024-10-07 11:29:06.134726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.376 [2024-10-07 11:29:06.134748] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.376 [2024-10-07 11:29:06.145511] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.376 [2024-10-07 11:29:06.145598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.376 [2024-10-07 11:29:06.145728] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.376 [2024-10-07 11:29:06.145762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.376 [2024-10-07 11:29:06.145781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.376 [2024-10-07 11:29:06.145830] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.377 [2024-10-07 11:29:06.145854] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.377 [2024-10-07 11:29:06.145870] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.377 [2024-10-07 11:29:06.146067] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.377 [2024-10-07 11:29:06.146099] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.377 [2024-10-07 11:29:06.146237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.377 [2024-10-07 11:29:06.146287] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.377 [2024-10-07 11:29:06.146304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.377 [2024-10-07 11:29:06.146322] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.377 [2024-10-07 11:29:06.146337] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.377 [2024-10-07 11:29:06.146351] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.377 [2024-10-07 11:29:06.146491] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.377 [2024-10-07 11:29:06.146518] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.377 [2024-10-07 11:29:06.156504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.377 [2024-10-07 11:29:06.156596] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.377 [2024-10-07 11:29:06.156727] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.377 [2024-10-07 11:29:06.156762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.377 [2024-10-07 11:29:06.156780] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.377 [2024-10-07 11:29:06.156829] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.377 [2024-10-07 11:29:06.156852] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.377 [2024-10-07 11:29:06.156868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.377 [2024-10-07 11:29:06.158075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.377 [2024-10-07 11:29:06.158121] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.377 [2024-10-07 11:29:06.158331] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.377 [2024-10-07 11:29:06.158366] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.377 [2024-10-07 11:29:06.158385] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.377 [2024-10-07 11:29:06.158419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.377 [2024-10-07 11:29:06.158437] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.377 [2024-10-07 11:29:06.158450] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.377 [2024-10-07 11:29:06.159565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.377 [2024-10-07 11:29:06.159602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.377 [2024-10-07 11:29:06.166697] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.377 [2024-10-07 11:29:06.166777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.377 [2024-10-07 11:29:06.166902] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.377 [2024-10-07 11:29:06.166936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.377 [2024-10-07 11:29:06.166955] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.377 [2024-10-07 11:29:06.167003] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.377 [2024-10-07 11:29:06.167051] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.377 [2024-10-07 11:29:06.167069] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.377 [2024-10-07 11:29:06.168022] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.377 [2024-10-07 11:29:06.168068] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.377 [2024-10-07 11:29:06.168272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.377 [2024-10-07 11:29:06.168308] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.377 [2024-10-07 11:29:06.168327] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.377 [2024-10-07 11:29:06.168346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.377 [2024-10-07 11:29:06.168360] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.377 [2024-10-07 11:29:06.168373] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.377 [2024-10-07 11:29:06.168500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.377 [2024-10-07 11:29:06.168523] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.377 [2024-10-07 11:29:06.178300] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.377 [2024-10-07 11:29:06.178421] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.377 [2024-10-07 11:29:06.178654] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.377 [2024-10-07 11:29:06.178693] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.377 [2024-10-07 11:29:06.178713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.377 [2024-10-07 11:29:06.178765] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.377 [2024-10-07 11:29:06.178789] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.377 [2024-10-07 11:29:06.178806] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.377 [2024-10-07 11:29:06.178861] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.377 [2024-10-07 11:29:06.178899] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.377 [2024-10-07 11:29:06.178927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.377 [2024-10-07 11:29:06.178945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.377 [2024-10-07 11:29:06.178962] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.377 [2024-10-07 11:29:06.178980] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.377 [2024-10-07 11:29:06.178994] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.377 [2024-10-07 11:29:06.179007] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.377 [2024-10-07 11:29:06.179039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.377 [2024-10-07 11:29:06.179056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.377 [2024-10-07 11:29:06.189445] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.377 [2024-10-07 11:29:06.189557] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.377 [2024-10-07 11:29:06.189728] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.377 [2024-10-07 11:29:06.189764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.377 [2024-10-07 11:29:06.189784] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.377 [2024-10-07 11:29:06.189834] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.377 [2024-10-07 11:29:06.189857] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.377 [2024-10-07 11:29:06.189873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.377 [2024-10-07 11:29:06.190080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.377 [2024-10-07 11:29:06.190112] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.377 [2024-10-07 11:29:06.190249] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.377 [2024-10-07 11:29:06.190275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.377 [2024-10-07 11:29:06.190293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.377 [2024-10-07 11:29:06.190311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.377 [2024-10-07 11:29:06.190326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.377 [2024-10-07 11:29:06.190339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.377 [2024-10-07 11:29:06.190482] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.377 [2024-10-07 11:29:06.190508] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.377 [2024-10-07 11:29:06.200150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.377 [2024-10-07 11:29:06.200247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.377 [2024-10-07 11:29:06.200379] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.377 [2024-10-07 11:29:06.200430] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.377 [2024-10-07 11:29:06.200451] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.377 [2024-10-07 11:29:06.200504] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.377 [2024-10-07 11:29:06.200528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.377 [2024-10-07 11:29:06.200544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.377 [2024-10-07 11:29:06.201841] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.377 [2024-10-07 11:29:06.201900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.377 [2024-10-07 11:29:06.202138] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.377 [2024-10-07 11:29:06.202177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.378 [2024-10-07 11:29:06.202221] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.378 [2024-10-07 11:29:06.202242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.378 [2024-10-07 11:29:06.202257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.378 [2024-10-07 11:29:06.202271] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.378 [2024-10-07 11:29:06.203466] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.378 [2024-10-07 11:29:06.203519] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.378 [2024-10-07 11:29:06.210343] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.378 [2024-10-07 11:29:06.210466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.378 [2024-10-07 11:29:06.210583] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.378 [2024-10-07 11:29:06.210616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.378 [2024-10-07 11:29:06.210635] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.378 [2024-10-07 11:29:06.211674] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.378 [2024-10-07 11:29:06.211723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.378 [2024-10-07 11:29:06.211744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.378 [2024-10-07 11:29:06.211768] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.378 [2024-10-07 11:29:06.212025] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.378 [2024-10-07 11:29:06.212077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.378 [2024-10-07 11:29:06.212096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.378 [2024-10-07 11:29:06.212113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.378 [2024-10-07 11:29:06.212255] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.378 [2024-10-07 11:29:06.212301] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.378 [2024-10-07 11:29:06.212327] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.378 [2024-10-07 11:29:06.212344] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.378 [2024-10-07 11:29:06.213676] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.378 [2024-10-07 11:29:06.220508] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.378 [2024-10-07 11:29:06.220712] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.378 [2024-10-07 11:29:06.220749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.378 [2024-10-07 11:29:06.220769] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.378 [2024-10-07 11:29:06.220805] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.378 [2024-10-07 11:29:06.220841] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.661 [2024-10-07 11:29:06.220912] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.661 [2024-10-07 11:29:06.220973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.661 [2024-10-07 11:29:06.220992] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.661 [2024-10-07 11:29:06.221008] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.661 [2024-10-07 11:29:06.221022] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.661 [2024-10-07 11:29:06.221037] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.661 [2024-10-07 11:29:06.222006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.661 [2024-10-07 11:29:06.222050] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.661 [2024-10-07 11:29:06.222825] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.661 [2024-10-07 11:29:06.222864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.661 [2024-10-07 11:29:06.222882] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.661 [2024-10-07 11:29:06.223192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.661 [2024-10-07 11:29:06.230657] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.661 [2024-10-07 11:29:06.230839] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.661 [2024-10-07 11:29:06.230876] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.661 [2024-10-07 11:29:06.230894] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.661 [2024-10-07 11:29:06.230930] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.661 [2024-10-07 11:29:06.232139] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.661 [2024-10-07 11:29:06.232178] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.661 [2024-10-07 11:29:06.232198] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.661 [2024-10-07 11:29:06.232447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.661 [2024-10-07 11:29:06.232480] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.661 [2024-10-07 11:29:06.233676] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.661 [2024-10-07 11:29:06.233722] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.661 [2024-10-07 11:29:06.233743] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.661 [2024-10-07 11:29:06.234591] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.661 [2024-10-07 11:29:06.234719] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.661 [2024-10-07 11:29:06.234745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.661 [2024-10-07 11:29:06.234760] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.661 [2024-10-07 11:29:06.234952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.661 [2024-10-07 11:29:06.240799] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.661 [2024-10-07 11:29:06.241016] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.661 [2024-10-07 11:29:06.241067] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.661 [2024-10-07 11:29:06.241091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.661 [2024-10-07 11:29:06.242058] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.661 [2024-10-07 11:29:06.242286] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.662 [2024-10-07 11:29:06.242323] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.662 [2024-10-07 11:29:06.242343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.662 [2024-10-07 11:29:06.243643] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.662 [2024-10-07 11:29:06.243892] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.662 [2024-10-07 11:29:06.246499] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.662 [2024-10-07 11:29:06.246565] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.662 [2024-10-07 11:29:06.246591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.662 [2024-10-07 11:29:06.247434] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.662 [2024-10-07 11:29:06.247695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.662 [2024-10-07 11:29:06.247737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.662 [2024-10-07 11:29:06.247756] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.662 [2024-10-07 11:29:06.247881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.662 [2024-10-07 11:29:06.253533] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.662 [2024-10-07 11:29:06.253868] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.662 [2024-10-07 11:29:06.253925] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.662 [2024-10-07 11:29:06.253949] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.662 [2024-10-07 11:29:06.254736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.662 [2024-10-07 11:29:06.254963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.662 [2024-10-07 11:29:06.255000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.662 [2024-10-07 11:29:06.255020] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.662 [2024-10-07 11:29:06.255097] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.662 [2024-10-07 11:29:06.255128] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.662 [2024-10-07 11:29:06.255234] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.662 [2024-10-07 11:29:06.255266] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.662 [2024-10-07 11:29:06.255283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.662 [2024-10-07 11:29:06.255345] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.662 [2024-10-07 11:29:06.255378] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.662 [2024-10-07 11:29:06.255395] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.662 [2024-10-07 11:29:06.255428] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.662 [2024-10-07 11:29:06.255461] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.662 [2024-10-07 11:29:06.263696] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.662 [2024-10-07 11:29:06.263911] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.662 [2024-10-07 11:29:06.263948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.662 [2024-10-07 11:29:06.263968] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.662 [2024-10-07 11:29:06.264018] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.662 [2024-10-07 11:29:06.264221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.662 [2024-10-07 11:29:06.264248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.662 [2024-10-07 11:29:06.264265] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.662 [2024-10-07 11:29:06.264430] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.662 [2024-10-07 11:29:06.266850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.662 [2024-10-07 11:29:06.266988] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.662 [2024-10-07 11:29:06.267021] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.662 [2024-10-07 11:29:06.267039] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.662 [2024-10-07 11:29:06.267072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.662 [2024-10-07 11:29:06.267301] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.662 [2024-10-07 11:29:06.267327] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.662 [2024-10-07 11:29:06.267343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.662 [2024-10-07 11:29:06.267471] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.662 [2024-10-07 11:29:06.275148] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.662 [2024-10-07 11:29:06.275344] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.662 [2024-10-07 11:29:06.275380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.662 [2024-10-07 11:29:06.275424] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.662 [2024-10-07 11:29:06.276671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.662 [2024-10-07 11:29:06.276938] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.662 [2024-10-07 11:29:06.276979] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.662 [2024-10-07 11:29:06.277031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.662 [2024-10-07 11:29:06.278435] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.662 [2024-10-07 11:29:06.279572] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.662 [2024-10-07 11:29:06.280122] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.662 [2024-10-07 11:29:06.280177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.662 [2024-10-07 11:29:06.280200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.662 [2024-10-07 11:29:06.280349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.662 [2024-10-07 11:29:06.280521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.662 [2024-10-07 11:29:06.280562] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.662 [2024-10-07 11:29:06.280583] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.662 [2024-10-07 11:29:06.281595] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.662 [2024-10-07 11:29:06.285297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.662 [2024-10-07 11:29:06.285497] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.662 [2024-10-07 11:29:06.285538] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.662 [2024-10-07 11:29:06.285558] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.662 [2024-10-07 11:29:06.285597] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.662 [2024-10-07 11:29:06.285630] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.662 [2024-10-07 11:29:06.285648] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.662 [2024-10-07 11:29:06.285663] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.662 [2024-10-07 11:29:06.285694] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.662 [2024-10-07 11:29:06.290340] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.662 [2024-10-07 11:29:06.290540] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.662 [2024-10-07 11:29:06.290576] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.662 [2024-10-07 11:29:06.290595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.662 [2024-10-07 11:29:06.290630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.662 [2024-10-07 11:29:06.290662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.662 [2024-10-07 11:29:06.290680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.662 [2024-10-07 11:29:06.290696] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.662 [2024-10-07 11:29:06.290727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.662 [2024-10-07 11:29:06.295458] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.662 [2024-10-07 11:29:06.296568] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.662 [2024-10-07 11:29:06.296645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.662 [2024-10-07 11:29:06.296669] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.662 [2024-10-07 11:29:06.297464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.662 [2024-10-07 11:29:06.297810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.662 [2024-10-07 11:29:06.297850] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.662 [2024-10-07 11:29:06.297870] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.662 [2024-10-07 11:29:06.297986] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.662 [2024-10-07 11:29:06.300492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.662 [2024-10-07 11:29:06.300643] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.662 [2024-10-07 11:29:06.300679] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.663 [2024-10-07 11:29:06.300697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.663 [2024-10-07 11:29:06.300731] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.663 [2024-10-07 11:29:06.300762] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.663 [2024-10-07 11:29:06.300780] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.663 [2024-10-07 11:29:06.300794] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.663 [2024-10-07 11:29:06.300824] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.663 [2024-10-07 11:29:06.306827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.663 [2024-10-07 11:29:06.308133] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.663 [2024-10-07 11:29:06.308184] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.663 [2024-10-07 11:29:06.308206] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.663 [2024-10-07 11:29:06.309072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.663 [2024-10-07 11:29:06.309378] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.663 [2024-10-07 11:29:06.309432] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.663 [2024-10-07 11:29:06.309451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.663 [2024-10-07 11:29:06.309598] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.663 [2024-10-07 11:29:06.311852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.663 [2024-10-07 11:29:06.311990] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.663 [2024-10-07 11:29:06.312024] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.663 [2024-10-07 11:29:06.312042] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.663 [2024-10-07 11:29:06.312075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.663 [2024-10-07 11:29:06.312335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.663 [2024-10-07 11:29:06.312373] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.663 [2024-10-07 11:29:06.312392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.663 [2024-10-07 11:29:06.312548] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.663 [2024-10-07 11:29:06.318290] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.663 [2024-10-07 11:29:06.318495] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.663 [2024-10-07 11:29:06.318533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.663 [2024-10-07 11:29:06.318558] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.663 [2024-10-07 11:29:06.319339] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.663 [2024-10-07 11:29:06.319583] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.663 [2024-10-07 11:29:06.319620] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.663 [2024-10-07 11:29:06.319639] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.663 [2024-10-07 11:29:06.319739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.663 [2024-10-07 11:29:06.323418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.663 [2024-10-07 11:29:06.323612] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.663 [2024-10-07 11:29:06.323649] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.663 [2024-10-07 11:29:06.323667] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.663 [2024-10-07 11:29:06.323703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.663 [2024-10-07 11:29:06.323736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.663 [2024-10-07 11:29:06.323753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.663 [2024-10-07 11:29:06.323769] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.663 [2024-10-07 11:29:06.323966] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.663 [2024-10-07 11:29:06.329192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.663 [2024-10-07 11:29:06.329447] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.663 [2024-10-07 11:29:06.329485] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.663 [2024-10-07 11:29:06.329505] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.663 [2024-10-07 11:29:06.329543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.663 [2024-10-07 11:29:06.329576] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.663 [2024-10-07 11:29:06.329593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.663 [2024-10-07 11:29:06.329610] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.663 [2024-10-07 11:29:06.329673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.663 [2024-10-07 11:29:06.334145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.663 [2024-10-07 11:29:06.334360] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.663 [2024-10-07 11:29:06.334416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.663 [2024-10-07 11:29:06.334440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.663 [2024-10-07 11:29:06.335645] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.663 [2024-10-07 11:29:06.335900] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.663 [2024-10-07 11:29:06.335938] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.663 [2024-10-07 11:29:06.335958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.663 [2024-10-07 11:29:06.337156] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.663 [2024-10-07 11:29:06.340867] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.663 [2024-10-07 11:29:06.341042] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.663 [2024-10-07 11:29:06.341106] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.663 [2024-10-07 11:29:06.341130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.663 [2024-10-07 11:29:06.341370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.663 [2024-10-07 11:29:06.341541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.663 [2024-10-07 11:29:06.341580] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.663 [2024-10-07 11:29:06.341600] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.663 [2024-10-07 11:29:06.341657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.663 [2024-10-07 11:29:06.344304] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.663 [2024-10-07 11:29:06.345445] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.663 [2024-10-07 11:29:06.345495] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.663 [2024-10-07 11:29:06.345523] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.663 [2024-10-07 11:29:06.345731] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.663 [2024-10-07 11:29:06.347081] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.663 [2024-10-07 11:29:06.347123] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.663 [2024-10-07 11:29:06.347144] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.663 [2024-10-07 11:29:06.347335] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.663 [2024-10-07 11:29:06.352564] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.663 [2024-10-07 11:29:06.352750] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.663 [2024-10-07 11:29:06.352786] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.663 [2024-10-07 11:29:06.352840] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.663 [2024-10-07 11:29:06.353048] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.663 [2024-10-07 11:29:06.353226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.663 [2024-10-07 11:29:06.353262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.664 [2024-10-07 11:29:06.353282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.664 [2024-10-07 11:29:06.353425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.664 [2024-10-07 11:29:06.355423] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.664 [2024-10-07 11:29:06.355554] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.664 [2024-10-07 11:29:06.355598] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.664 [2024-10-07 11:29:06.355619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.664 [2024-10-07 11:29:06.355853] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.664 [2024-10-07 11:29:06.355997] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.664 [2024-10-07 11:29:06.356035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.664 [2024-10-07 11:29:06.356054] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.664 [2024-10-07 11:29:06.356107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.664 [2024-10-07 11:29:06.363097] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.664 [2024-10-07 11:29:06.363287] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.664 [2024-10-07 11:29:06.363324] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.664 [2024-10-07 11:29:06.363343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.664 [2024-10-07 11:29:06.363379] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.664 [2024-10-07 11:29:06.363429] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.664 [2024-10-07 11:29:06.363450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.664 [2024-10-07 11:29:06.363465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.664 [2024-10-07 11:29:06.364675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.664 [2024-10-07 11:29:06.367019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.664 [2024-10-07 11:29:06.367169] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.664 [2024-10-07 11:29:06.367206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.664 [2024-10-07 11:29:06.367225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.664 [2024-10-07 11:29:06.367440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.664 [2024-10-07 11:29:06.367600] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.664 [2024-10-07 11:29:06.367661] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.664 [2024-10-07 11:29:06.367681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.664 [2024-10-07 11:29:06.367806] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.664 [2024-10-07 11:29:06.373246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.664 [2024-10-07 11:29:06.373444] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.664 [2024-10-07 11:29:06.373481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.664 [2024-10-07 11:29:06.373501] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.664 [2024-10-07 11:29:06.374454] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.664 [2024-10-07 11:29:06.374680] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.664 [2024-10-07 11:29:06.374716] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.664 [2024-10-07 11:29:06.374735] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.664 [2024-10-07 11:29:06.374816] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.664 [2024-10-07 11:29:06.377622] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.664 [2024-10-07 11:29:06.377751] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.664 [2024-10-07 11:29:06.377784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.664 [2024-10-07 11:29:06.377802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.664 [2024-10-07 11:29:06.377837] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.664 [2024-10-07 11:29:06.377867] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.664 [2024-10-07 11:29:06.377885] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.664 [2024-10-07 11:29:06.377900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.664 [2024-10-07 11:29:06.377930] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.664 [2024-10-07 11:29:06.384435] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.664 [2024-10-07 11:29:06.384623] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.664 [2024-10-07 11:29:06.384660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.664 [2024-10-07 11:29:06.384679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.664 [2024-10-07 11:29:06.384935] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.664 [2024-10-07 11:29:06.385087] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.664 [2024-10-07 11:29:06.385124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.664 [2024-10-07 11:29:06.385145] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.664 [2024-10-07 11:29:06.385200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.664 [2024-10-07 11:29:06.387722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.664 [2024-10-07 11:29:06.387846] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.664 [2024-10-07 11:29:06.387880] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.664 [2024-10-07 11:29:06.387898] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.664 [2024-10-07 11:29:06.387931] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.664 [2024-10-07 11:29:06.388888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.664 [2024-10-07 11:29:06.388932] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.664 [2024-10-07 11:29:06.388952] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.664 [2024-10-07 11:29:06.389197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.664 [2024-10-07 11:29:06.395942] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.664 [2024-10-07 11:29:06.396133] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.664 [2024-10-07 11:29:06.396170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.664 [2024-10-07 11:29:06.396190] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.664 [2024-10-07 11:29:06.396227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.664 [2024-10-07 11:29:06.396470] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.664 [2024-10-07 11:29:06.396511] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.664 [2024-10-07 11:29:06.396532] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.664 [2024-10-07 11:29:06.396678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.664 [2024-10-07 11:29:06.399002] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.664 [2024-10-07 11:29:06.399143] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.664 [2024-10-07 11:29:06.399176] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.664 [2024-10-07 11:29:06.399194] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.664 [2024-10-07 11:29:06.399228] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.664 [2024-10-07 11:29:06.399486] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.664 [2024-10-07 11:29:06.399526] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.664 [2024-10-07 11:29:06.399546] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.664 [2024-10-07 11:29:06.399665] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.664 [2024-10-07 11:29:06.406833] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.664 [2024-10-07 11:29:06.407022] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.664 [2024-10-07 11:29:06.407060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.664 [2024-10-07 11:29:06.407079] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.664 [2024-10-07 11:29:06.407143] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.664 [2024-10-07 11:29:06.408375] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.665 [2024-10-07 11:29:06.408436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.665 [2024-10-07 11:29:06.408458] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.665 [2024-10-07 11:29:06.408675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.665 [2024-10-07 11:29:06.410782] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.665 [2024-10-07 11:29:06.410914] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.665 [2024-10-07 11:29:06.410957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.665 [2024-10-07 11:29:06.410978] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.665 [2024-10-07 11:29:06.411176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.665 [2024-10-07 11:29:06.411332] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.665 [2024-10-07 11:29:06.411366] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.665 [2024-10-07 11:29:06.411384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.665 [2024-10-07 11:29:06.411539] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.665 [2024-10-07 11:29:06.416979] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.665 [2024-10-07 11:29:06.417142] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.665 [2024-10-07 11:29:06.417177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.665 [2024-10-07 11:29:06.417196] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.665 [2024-10-07 11:29:06.418147] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.665 [2024-10-07 11:29:06.418372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.665 [2024-10-07 11:29:06.418419] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.665 [2024-10-07 11:29:06.418440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.665 [2024-10-07 11:29:06.418522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.665 [2024-10-07 11:29:06.421388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.665 [2024-10-07 11:29:06.421536] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.665 [2024-10-07 11:29:06.421582] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.665 [2024-10-07 11:29:06.421604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.665 [2024-10-07 11:29:06.421638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.665 [2024-10-07 11:29:06.421669] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.665 [2024-10-07 11:29:06.421686] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.665 [2024-10-07 11:29:06.421726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.665 [2024-10-07 11:29:06.421759] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.665 [2024-10-07 11:29:06.428237] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.665 [2024-10-07 11:29:06.428429] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.665 [2024-10-07 11:29:06.428466] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.665 [2024-10-07 11:29:06.428486] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.665 [2024-10-07 11:29:06.428740] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.665 [2024-10-07 11:29:06.428875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.665 [2024-10-07 11:29:06.428912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.665 [2024-10-07 11:29:06.428940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.665 [2024-10-07 11:29:06.429017] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.665 [2024-10-07 11:29:06.431506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.665 [2024-10-07 11:29:06.431635] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.665 [2024-10-07 11:29:06.431679] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.665 [2024-10-07 11:29:06.431700] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.665 [2024-10-07 11:29:06.431733] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.665 [2024-10-07 11:29:06.432697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.665 [2024-10-07 11:29:06.432738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.665 [2024-10-07 11:29:06.432757] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.665 [2024-10-07 11:29:06.432981] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.665 [2024-10-07 11:29:06.439663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.665 [2024-10-07 11:29:06.439815] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.665 [2024-10-07 11:29:06.439851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.665 [2024-10-07 11:29:06.439869] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.665 [2024-10-07 11:29:06.439904] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.665 [2024-10-07 11:29:06.439943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.665 [2024-10-07 11:29:06.439960] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.665 [2024-10-07 11:29:06.439975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.665 [2024-10-07 11:29:06.440006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.665 [2024-10-07 11:29:06.442749] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.665 [2024-10-07 11:29:06.442899] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.665 [2024-10-07 11:29:06.442946] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.665 [2024-10-07 11:29:06.442967] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.665 [2024-10-07 11:29:06.443197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.665 [2024-10-07 11:29:06.443326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.665 [2024-10-07 11:29:06.443367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.665 [2024-10-07 11:29:06.443385] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.665 [2024-10-07 11:29:06.443454] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.665 [2024-10-07 11:29:06.450489] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.665 [2024-10-07 11:29:06.450633] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.665 [2024-10-07 11:29:06.450668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.665 [2024-10-07 11:29:06.450686] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.665 [2024-10-07 11:29:06.450720] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.665 [2024-10-07 11:29:06.450753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.665 [2024-10-07 11:29:06.450770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.665 [2024-10-07 11:29:06.450784] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.665 [2024-10-07 11:29:06.450815] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.665 [2024-10-07 11:29:06.454283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.665 [2024-10-07 11:29:06.454448] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.665 [2024-10-07 11:29:06.454493] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.665 [2024-10-07 11:29:06.454514] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.665 [2024-10-07 11:29:06.454549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.665 [2024-10-07 11:29:06.454582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.665 [2024-10-07 11:29:06.454600] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.665 [2024-10-07 11:29:06.454614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.665 [2024-10-07 11:29:06.454809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.665 [2024-10-07 11:29:06.460598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.665 [2024-10-07 11:29:06.460730] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.665 [2024-10-07 11:29:06.460762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.665 [2024-10-07 11:29:06.460780] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.665 [2024-10-07 11:29:06.460837] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.665 [2024-10-07 11:29:06.461796] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.665 [2024-10-07 11:29:06.461836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.665 [2024-10-07 11:29:06.461855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.665 [2024-10-07 11:29:06.462061] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.665 [2024-10-07 11:29:06.464962] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.665 [2024-10-07 11:29:06.465091] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.666 [2024-10-07 11:29:06.465126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.666 [2024-10-07 11:29:06.465145] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.666 [2024-10-07 11:29:06.465178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.666 [2024-10-07 11:29:06.465210] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.666 [2024-10-07 11:29:06.465228] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.666 [2024-10-07 11:29:06.465242] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.666 [2024-10-07 11:29:06.465272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.666 [2024-10-07 11:29:06.471758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.666 [2024-10-07 11:29:06.471893] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.666 [2024-10-07 11:29:06.471926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.666 [2024-10-07 11:29:06.471945] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.666 [2024-10-07 11:29:06.472173] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.666 [2024-10-07 11:29:06.472325] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.666 [2024-10-07 11:29:06.472362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.666 [2024-10-07 11:29:06.472381] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.666 [2024-10-07 11:29:06.472449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.666 [2024-10-07 11:29:06.475055] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.666 [2024-10-07 11:29:06.475172] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.666 [2024-10-07 11:29:06.475208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.666 [2024-10-07 11:29:06.475225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.666 [2024-10-07 11:29:06.475257] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.666 [2024-10-07 11:29:06.475289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.666 [2024-10-07 11:29:06.475306] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.666 [2024-10-07 11:29:06.475343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.666 [2024-10-07 11:29:06.475376] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.666 [2024-10-07 11:29:06.481889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.666 [2024-10-07 11:29:06.483134] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.666 [2024-10-07 11:29:06.483183] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.666 [2024-10-07 11:29:06.483205] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.666 [2024-10-07 11:29:06.484042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.666 [2024-10-07 11:29:06.484170] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.666 [2024-10-07 11:29:06.484196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.666 [2024-10-07 11:29:06.484212] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.666 [2024-10-07 11:29:06.484246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.666 [2024-10-07 11:29:06.485148] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.666 [2024-10-07 11:29:06.485258] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.666 [2024-10-07 11:29:06.485295] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.666 [2024-10-07 11:29:06.485315] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.666 [2024-10-07 11:29:06.486254] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.666 [2024-10-07 11:29:06.487046] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.666 [2024-10-07 11:29:06.487085] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.666 [2024-10-07 11:29:06.487105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.666 [2024-10-07 11:29:06.487208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.666 [2024-10-07 11:29:06.493230] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.666 [2024-10-07 11:29:06.493562] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.666 [2024-10-07 11:29:06.493610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.666 [2024-10-07 11:29:06.493633] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.666 [2024-10-07 11:29:06.493670] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.666 [2024-10-07 11:29:06.493703] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.666 [2024-10-07 11:29:06.493720] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.666 [2024-10-07 11:29:06.493735] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.666 [2024-10-07 11:29:06.494508] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.666 [2024-10-07 11:29:06.496531] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.666 [2024-10-07 11:29:06.497768] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.666 [2024-10-07 11:29:06.497840] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.666 [2024-10-07 11:29:06.497863] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.666 [2024-10-07 11:29:06.498696] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.666 [2024-10-07 11:29:06.498857] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.666 [2024-10-07 11:29:06.498893] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.666 [2024-10-07 11:29:06.498912] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.666 [2024-10-07 11:29:06.499107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.666 [2024-10-07 11:29:06.503357] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.666 [2024-10-07 11:29:06.504234] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.666 [2024-10-07 11:29:06.504285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.666 [2024-10-07 11:29:06.504308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.666 [2024-10-07 11:29:06.504511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.666 [2024-10-07 11:29:06.504603] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.667 [2024-10-07 11:29:06.504630] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.667 [2024-10-07 11:29:06.504646] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.667 [2024-10-07 11:29:06.504699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.667 [2024-10-07 11:29:06.507829] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.667 [2024-10-07 11:29:06.508145] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.667 [2024-10-07 11:29:06.508190] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.667 [2024-10-07 11:29:06.508212] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.667 [2024-10-07 11:29:06.508248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.667 [2024-10-07 11:29:06.508280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.667 [2024-10-07 11:29:06.508297] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.667 [2024-10-07 11:29:06.508311] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.667 [2024-10-07 11:29:06.509105] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.667 [2024-10-07 11:29:06.513485] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.667 [2024-10-07 11:29:06.513641] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.667 [2024-10-07 11:29:06.513675] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.667 [2024-10-07 11:29:06.513694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.667 [2024-10-07 11:29:06.513893] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.667 [2024-10-07 11:29:06.514076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.667 [2024-10-07 11:29:06.514111] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.667 [2024-10-07 11:29:06.514130] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.667 [2024-10-07 11:29:06.514254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.667 [2024-10-07 11:29:06.517934] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.667 [2024-10-07 11:29:06.518065] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.667 [2024-10-07 11:29:06.518098] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.667 [2024-10-07 11:29:06.518116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.667 [2024-10-07 11:29:06.518149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.667 [2024-10-07 11:29:06.518181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.667 [2024-10-07 11:29:06.518198] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.667 [2024-10-07 11:29:06.518213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.667 [2024-10-07 11:29:06.518243] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.667 [2024-10-07 11:29:06.523607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.667 [2024-10-07 11:29:06.523749] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.667 [2024-10-07 11:29:06.523782] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.667 [2024-10-07 11:29:06.523800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.667 [2024-10-07 11:29:06.523833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.667 [2024-10-07 11:29:06.523864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.667 [2024-10-07 11:29:06.523881] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.667 [2024-10-07 11:29:06.523895] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.667 [2024-10-07 11:29:06.523926] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.667 [2024-10-07 11:29:06.530035] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.667 [2024-10-07 11:29:06.530222] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.667 [2024-10-07 11:29:06.530259] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.667 [2024-10-07 11:29:06.530279] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.667 [2024-10-07 11:29:06.530315] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.667 [2024-10-07 11:29:06.530349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.667 [2024-10-07 11:29:06.530367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.667 [2024-10-07 11:29:06.530384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.667 [2024-10-07 11:29:06.530468] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.667 [2024-10-07 11:29:06.533775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.667 [2024-10-07 11:29:06.533913] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.667 [2024-10-07 11:29:06.533948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.667 [2024-10-07 11:29:06.533966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.667 [2024-10-07 11:29:06.534008] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.667 [2024-10-07 11:29:06.534060] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.667 [2024-10-07 11:29:06.534080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.667 [2024-10-07 11:29:06.534095] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.667 [2024-10-07 11:29:06.534126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.667 [2024-10-07 11:29:06.541089] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.667 [2024-10-07 11:29:06.541291] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.667 [2024-10-07 11:29:06.541343] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.667 [2024-10-07 11:29:06.541367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.667 [2024-10-07 11:29:06.541421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.667 [2024-10-07 11:29:06.541458] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.667 [2024-10-07 11:29:06.541477] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.667 [2024-10-07 11:29:06.541492] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.667 [2024-10-07 11:29:06.542692] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.667 [2024-10-07 11:29:06.545001] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.667 [2024-10-07 11:29:06.545144] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.667 [2024-10-07 11:29:06.545178] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.667 [2024-10-07 11:29:06.545196] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.667 [2024-10-07 11:29:06.545229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.667 [2024-10-07 11:29:06.545260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.667 [2024-10-07 11:29:06.545279] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.667 [2024-10-07 11:29:06.545294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.667 [2024-10-07 11:29:06.545514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.667 [2024-10-07 11:29:06.551237] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.667 [2024-10-07 11:29:06.551377] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.667 [2024-10-07 11:29:06.551427] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.667 [2024-10-07 11:29:06.551476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.667 [2024-10-07 11:29:06.551512] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.667 [2024-10-07 11:29:06.551544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.667 [2024-10-07 11:29:06.551561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.667 [2024-10-07 11:29:06.551576] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.667 [2024-10-07 11:29:06.551607] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.667 [2024-10-07 11:29:06.555850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.667 [2024-10-07 11:29:06.555992] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.667 [2024-10-07 11:29:06.556026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.667 [2024-10-07 11:29:06.556044] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.667 [2024-10-07 11:29:06.556078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.667 [2024-10-07 11:29:06.556111] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.667 [2024-10-07 11:29:06.556128] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.667 [2024-10-07 11:29:06.556142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.668 [2024-10-07 11:29:06.556173] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.668 [2024-10-07 11:29:06.562720] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.668 [2024-10-07 11:29:06.562873] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.668 [2024-10-07 11:29:06.562908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.668 [2024-10-07 11:29:06.562926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.668 [2024-10-07 11:29:06.563165] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.668 [2024-10-07 11:29:06.563286] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.668 [2024-10-07 11:29:06.563313] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.668 [2024-10-07 11:29:06.563329] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.668 [2024-10-07 11:29:06.563381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.668 [2024-10-07 11:29:06.565960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.668 [2024-10-07 11:29:06.566080] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.668 [2024-10-07 11:29:06.566112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.668 [2024-10-07 11:29:06.566130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.668 [2024-10-07 11:29:06.566162] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.668 [2024-10-07 11:29:06.566193] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.668 [2024-10-07 11:29:06.566235] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.668 [2024-10-07 11:29:06.566250] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.668 [2024-10-07 11:29:06.566282] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.668 [2024-10-07 11:29:06.574349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.668 [2024-10-07 11:29:06.574565] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.668 [2024-10-07 11:29:06.574602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.668 [2024-10-07 11:29:06.574621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.668 [2024-10-07 11:29:06.574656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.668 [2024-10-07 11:29:06.574854] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.668 [2024-10-07 11:29:06.574881] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.668 [2024-10-07 11:29:06.574897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.668 [2024-10-07 11:29:06.575036] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.668 [2024-10-07 11:29:06.577395] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.668 [2024-10-07 11:29:06.577536] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.668 [2024-10-07 11:29:06.577570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.668 [2024-10-07 11:29:06.577588] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.668 [2024-10-07 11:29:06.577817] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.668 [2024-10-07 11:29:06.577949] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.668 [2024-10-07 11:29:06.577997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.668 [2024-10-07 11:29:06.578016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.668 [2024-10-07 11:29:06.578069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.668 [2024-10-07 11:29:06.585177] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.668 [2024-10-07 11:29:06.585358] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.668 [2024-10-07 11:29:06.585393] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.668 [2024-10-07 11:29:06.585434] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.668 [2024-10-07 11:29:06.585471] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.668 [2024-10-07 11:29:06.585504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.668 [2024-10-07 11:29:06.585522] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.668 [2024-10-07 11:29:06.585538] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.668 [2024-10-07 11:29:06.586723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.668 [2024-10-07 11:29:06.589090] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.668 [2024-10-07 11:29:06.589229] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.668 [2024-10-07 11:29:06.589264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.668 [2024-10-07 11:29:06.589282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.668 [2024-10-07 11:29:06.589316] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.668 [2024-10-07 11:29:06.589532] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.668 [2024-10-07 11:29:06.589570] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.668 [2024-10-07 11:29:06.589590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.668 [2024-10-07 11:29:06.589733] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.668 [2024-10-07 11:29:06.595310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.668 [2024-10-07 11:29:06.595472] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.668 [2024-10-07 11:29:06.595508] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.668 [2024-10-07 11:29:06.595526] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.668 [2024-10-07 11:29:06.595560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.668 [2024-10-07 11:29:06.595593] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.668 [2024-10-07 11:29:06.595611] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.668 [2024-10-07 11:29:06.595626] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.668 [2024-10-07 11:29:06.595656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.668 [2024-10-07 11:29:06.599899] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.668 [2024-10-07 11:29:06.600050] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.668 [2024-10-07 11:29:06.600084] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.668 [2024-10-07 11:29:06.600107] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.668 [2024-10-07 11:29:06.600140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.668 [2024-10-07 11:29:06.600171] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.668 [2024-10-07 11:29:06.600188] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.668 [2024-10-07 11:29:06.600202] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.668 [2024-10-07 11:29:06.600233] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.668 [2024-10-07 11:29:06.606792] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.668 [2024-10-07 11:29:06.606934] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.668 [2024-10-07 11:29:06.606968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.668 [2024-10-07 11:29:06.606986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.668 [2024-10-07 11:29:06.607258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.668 [2024-10-07 11:29:06.607392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.668 [2024-10-07 11:29:06.607439] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.668 [2024-10-07 11:29:06.607456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.668 [2024-10-07 11:29:06.607511] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.668 [2024-10-07 11:29:06.610011] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.668 [2024-10-07 11:29:06.610127] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.669 [2024-10-07 11:29:06.610159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.669 [2024-10-07 11:29:06.610177] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.669 [2024-10-07 11:29:06.610209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.669 [2024-10-07 11:29:06.610240] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.669 [2024-10-07 11:29:06.610257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.669 [2024-10-07 11:29:06.610271] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.669 [2024-10-07 11:29:06.611212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.669 [2024-10-07 11:29:06.618277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.669 [2024-10-07 11:29:06.618455] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.669 [2024-10-07 11:29:06.618490] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.669 [2024-10-07 11:29:06.618509] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.669 [2024-10-07 11:29:06.618543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.669 [2024-10-07 11:29:06.618575] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.669 [2024-10-07 11:29:06.618593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.669 [2024-10-07 11:29:06.618608] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.669 [2024-10-07 11:29:06.618799] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.669 [2024-10-07 11:29:06.621292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.669 [2024-10-07 11:29:06.621425] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.669 [2024-10-07 11:29:06.621464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.669 [2024-10-07 11:29:06.621484] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.669 [2024-10-07 11:29:06.621710] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.669 [2024-10-07 11:29:06.621855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.669 [2024-10-07 11:29:06.621892] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.669 [2024-10-07 11:29:06.621946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.669 [2024-10-07 11:29:06.622003] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.669 [2024-10-07 11:29:06.629006] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.669 [2024-10-07 11:29:06.629232] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.669 [2024-10-07 11:29:06.629268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.669 [2024-10-07 11:29:06.629287] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.669 [2024-10-07 11:29:06.629323] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.669 [2024-10-07 11:29:06.629355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.669 [2024-10-07 11:29:06.629373] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.669 [2024-10-07 11:29:06.629388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.669 [2024-10-07 11:29:06.630600] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.669 [2024-10-07 11:29:06.632926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.669 [2024-10-07 11:29:06.633098] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.669 [2024-10-07 11:29:06.633142] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.669 [2024-10-07 11:29:06.633161] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.669 [2024-10-07 11:29:06.633363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.669 [2024-10-07 11:29:06.633531] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.669 [2024-10-07 11:29:06.633577] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.669 [2024-10-07 11:29:06.633597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.669 [2024-10-07 11:29:06.633722] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.669 [2024-10-07 11:29:06.639185] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.669 [2024-10-07 11:29:06.639382] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.669 [2024-10-07 11:29:06.639435] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.669 [2024-10-07 11:29:06.639456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.669 [2024-10-07 11:29:06.639492] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.669 [2024-10-07 11:29:06.640451] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.669 [2024-10-07 11:29:06.640499] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.669 [2024-10-07 11:29:06.640521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.669 [2024-10-07 11:29:06.640757] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.669 [2024-10-07 11:29:06.643726] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.669 [2024-10-07 11:29:06.643915] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.669 [2024-10-07 11:29:06.643952] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.669 [2024-10-07 11:29:06.643970] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.669 [2024-10-07 11:29:06.644005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.669 [2024-10-07 11:29:06.644037] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.669 [2024-10-07 11:29:06.644054] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.669 [2024-10-07 11:29:06.644069] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.669 [2024-10-07 11:29:06.644099] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.669 [2024-10-07 11:29:06.650760] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.669 [2024-10-07 11:29:06.650963] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.669 [2024-10-07 11:29:06.651001] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.669 [2024-10-07 11:29:06.651019] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.669 [2024-10-07 11:29:06.651255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.669 [2024-10-07 11:29:06.651375] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.669 [2024-10-07 11:29:06.651426] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.669 [2024-10-07 11:29:06.651447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.669 [2024-10-07 11:29:06.651503] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.669 [2024-10-07 11:29:06.653869] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.669 [2024-10-07 11:29:06.654007] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.669 [2024-10-07 11:29:06.654041] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.669 [2024-10-07 11:29:06.654059] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.669 [2024-10-07 11:29:06.654112] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.669 [2024-10-07 11:29:06.654147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.669 [2024-10-07 11:29:06.654165] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.669 [2024-10-07 11:29:06.654179] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.669 [2024-10-07 11:29:06.654210] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.669 [2024-10-07 11:29:06.662626] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.669 [2024-10-07 11:29:06.662868] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.669 [2024-10-07 11:29:06.662908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.669 [2024-10-07 11:29:06.662927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.669 [2024-10-07 11:29:06.663141] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.669 [2024-10-07 11:29:06.663346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.669 [2024-10-07 11:29:06.663384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.669 [2024-10-07 11:29:06.663420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.669 [2024-10-07 11:29:06.663552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.669 [2024-10-07 11:29:06.665645] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.669 [2024-10-07 11:29:06.665807] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.669 [2024-10-07 11:29:06.665842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.670 [2024-10-07 11:29:06.665860] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.670 [2024-10-07 11:29:06.666098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.670 [2024-10-07 11:29:06.666218] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.670 [2024-10-07 11:29:06.666263] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.670 [2024-10-07 11:29:06.666282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.670 [2024-10-07 11:29:06.666338] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.670 [2024-10-07 11:29:06.673713] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.670 [2024-10-07 11:29:06.673925] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.670 [2024-10-07 11:29:06.673965] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.670 [2024-10-07 11:29:06.673984] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.670 [2024-10-07 11:29:06.674021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.670 [2024-10-07 11:29:06.674053] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.670 [2024-10-07 11:29:06.674072] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.670 [2024-10-07 11:29:06.674087] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.670 [2024-10-07 11:29:06.674118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.670 [2024-10-07 11:29:06.677658] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.670 [2024-10-07 11:29:06.677846] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.670 [2024-10-07 11:29:06.677883] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.670 [2024-10-07 11:29:06.677901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.670 [2024-10-07 11:29:06.677938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.670 [2024-10-07 11:29:06.677972] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.670 [2024-10-07 11:29:06.677989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.670 [2024-10-07 11:29:06.678005] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.670 [2024-10-07 11:29:06.678238] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.670 [2024-10-07 11:29:06.683884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.670 [2024-10-07 11:29:06.684089] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.670 [2024-10-07 11:29:06.684127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.670 [2024-10-07 11:29:06.684146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.670 [2024-10-07 11:29:06.684204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.670 [2024-10-07 11:29:06.684239] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.670 [2024-10-07 11:29:06.684258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.670 [2024-10-07 11:29:06.684274] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.670 [2024-10-07 11:29:06.684306] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.670 [2024-10-07 11:29:06.687807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.670 [2024-10-07 11:29:06.688773] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.670 [2024-10-07 11:29:06.688826] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.670 [2024-10-07 11:29:06.688849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.670 [2024-10-07 11:29:06.689081] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.670 [2024-10-07 11:29:06.689198] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.670 [2024-10-07 11:29:06.689229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.670 [2024-10-07 11:29:06.689248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.670 [2024-10-07 11:29:06.689284] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.670 [2024-10-07 11:29:06.694116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.670 [2024-10-07 11:29:06.694297] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.670 [2024-10-07 11:29:06.694333] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.670 [2024-10-07 11:29:06.694351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.670 [2024-10-07 11:29:06.694387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.670 [2024-10-07 11:29:06.694468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.670 [2024-10-07 11:29:06.694492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.670 [2024-10-07 11:29:06.694508] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.670 [2024-10-07 11:29:06.694541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.670 [2024-10-07 11:29:06.697948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.670 [2024-10-07 11:29:06.698095] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.670 [2024-10-07 11:29:06.698128] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.670 [2024-10-07 11:29:06.698178] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.670 [2024-10-07 11:29:06.698215] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.670 [2024-10-07 11:29:06.698247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.670 [2024-10-07 11:29:06.698264] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.670 [2024-10-07 11:29:06.698279] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.670 [2024-10-07 11:29:06.698310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.670 [2024-10-07 11:29:06.704737] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.670 [2024-10-07 11:29:06.704920] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.670 [2024-10-07 11:29:06.704958] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.670 [2024-10-07 11:29:06.704977] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.670 [2024-10-07 11:29:06.705015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.670 [2024-10-07 11:29:06.705047] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.670 [2024-10-07 11:29:06.705085] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.670 [2024-10-07 11:29:06.705102] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.670 [2024-10-07 11:29:06.705136] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.670 [2024-10-07 11:29:06.709687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.670 [2024-10-07 11:29:06.709952] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.670 [2024-10-07 11:29:06.710001] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.670 [2024-10-07 11:29:06.710023] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.671 [2024-10-07 11:29:06.710084] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.671 [2024-10-07 11:29:06.710123] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.671 [2024-10-07 11:29:06.710140] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.671 [2024-10-07 11:29:06.710156] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.671 [2024-10-07 11:29:06.711116] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.671 [2024-10-07 11:29:06.714951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.671 [2024-10-07 11:29:06.715129] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.671 [2024-10-07 11:29:06.715169] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.671 [2024-10-07 11:29:06.715188] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.671 [2024-10-07 11:29:06.715223] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.671 [2024-10-07 11:29:06.715313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.671 [2024-10-07 11:29:06.715337] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.671 [2024-10-07 11:29:06.715353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.671 [2024-10-07 11:29:06.715385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.671 [2024-10-07 11:29:06.720282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.671 [2024-10-07 11:29:06.720543] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.671 [2024-10-07 11:29:06.720595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.671 [2024-10-07 11:29:06.720625] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.671 [2024-10-07 11:29:06.720677] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.671 [2024-10-07 11:29:06.721976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.671 [2024-10-07 11:29:06.722025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.671 [2024-10-07 11:29:06.722047] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.671 [2024-10-07 11:29:06.722276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.671 [2024-10-07 11:29:06.725439] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.671 [2024-10-07 11:29:06.725757] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.671 [2024-10-07 11:29:06.725832] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.671 [2024-10-07 11:29:06.725873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.671 [2024-10-07 11:29:06.727142] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.671 [2024-10-07 11:29:06.728272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.671 [2024-10-07 11:29:06.728323] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.671 [2024-10-07 11:29:06.728345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.671 [2024-10-07 11:29:06.728552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.671 [2024-10-07 11:29:06.730711] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.671 [2024-10-07 11:29:06.730889] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.671 [2024-10-07 11:29:06.730937] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.671 [2024-10-07 11:29:06.730959] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.671 [2024-10-07 11:29:06.730995] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.671 [2024-10-07 11:29:06.731027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.671 [2024-10-07 11:29:06.731044] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.671 [2024-10-07 11:29:06.731058] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.671 [2024-10-07 11:29:06.731090] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.671 [2024-10-07 11:29:06.735917] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.671 [2024-10-07 11:29:06.736114] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.671 [2024-10-07 11:29:06.736151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.671 [2024-10-07 11:29:06.736182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.671 [2024-10-07 11:29:06.736236] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.671 [2024-10-07 11:29:06.736289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.671 [2024-10-07 11:29:06.736320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.671 [2024-10-07 11:29:06.736346] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.671 [2024-10-07 11:29:06.737710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.671 [2024-10-07 11:29:06.740827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.671 [2024-10-07 11:29:06.741005] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.671 [2024-10-07 11:29:06.741042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.671 [2024-10-07 11:29:06.741082] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.671 [2024-10-07 11:29:06.741122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.671 [2024-10-07 11:29:06.742076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.671 [2024-10-07 11:29:06.742135] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.671 [2024-10-07 11:29:06.742172] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.671 [2024-10-07 11:29:06.743250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.671 [2024-10-07 11:29:06.746077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.671 [2024-10-07 11:29:06.746284] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.671 [2024-10-07 11:29:06.746332] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.671 [2024-10-07 11:29:06.746354] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.671 [2024-10-07 11:29:06.746391] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.671 [2024-10-07 11:29:06.746446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.671 [2024-10-07 11:29:06.746466] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.671 [2024-10-07 11:29:06.746482] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.671 [2024-10-07 11:29:06.746513] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.671 [2024-10-07 11:29:06.750973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.671 [2024-10-07 11:29:06.751192] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.671 [2024-10-07 11:29:06.751229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.671 [2024-10-07 11:29:06.751280] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.671 [2024-10-07 11:29:06.752525] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.671 [2024-10-07 11:29:06.752790] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.671 [2024-10-07 11:29:06.752826] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.671 [2024-10-07 11:29:06.752847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.671 [2024-10-07 11:29:06.754143] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.671 [2024-10-07 11:29:06.758020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.671 [2024-10-07 11:29:06.758247] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.671 [2024-10-07 11:29:06.758286] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.671 [2024-10-07 11:29:06.758307] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.671 [2024-10-07 11:29:06.758344] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.671 [2024-10-07 11:29:06.758387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.671 [2024-10-07 11:29:06.758424] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.671 [2024-10-07 11:29:06.758442] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.671 [2024-10-07 11:29:06.758680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.671 [2024-10-07 11:29:06.761472] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.671 [2024-10-07 11:29:06.761659] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.671 [2024-10-07 11:29:06.761726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.671 [2024-10-07 11:29:06.761765] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.671 [2024-10-07 11:29:06.761823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.672 [2024-10-07 11:29:06.762976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.672 [2024-10-07 11:29:06.763039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.672 [2024-10-07 11:29:06.763074] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.672 [2024-10-07 11:29:06.763315] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.672 [2024-10-07 11:29:06.770763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.672 [2024-10-07 11:29:06.771225] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.672 [2024-10-07 11:29:06.771294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.672 [2024-10-07 11:29:06.771329] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.672 [2024-10-07 11:29:06.772590] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.672 [2024-10-07 11:29:06.773895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.672 [2024-10-07 11:29:06.773992] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.672 [2024-10-07 11:29:06.774026] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.672 [2024-10-07 11:29:06.774259] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.672 [2024-10-07 11:29:06.774321] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.672 [2024-10-07 11:29:06.774513] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.672 [2024-10-07 11:29:06.774572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.672 [2024-10-07 11:29:06.774606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.672 [2024-10-07 11:29:06.774656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.672 [2024-10-07 11:29:06.774703] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.672 [2024-10-07 11:29:06.774731] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.672 [2024-10-07 11:29:06.774754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.672 [2024-10-07 11:29:06.774800] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.672 [2024-10-07 11:29:06.781257] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.672 [2024-10-07 11:29:06.782791] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.672 [2024-10-07 11:29:06.782850] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.672 [2024-10-07 11:29:06.782874] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.672 [2024-10-07 11:29:06.783100] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.672 [2024-10-07 11:29:06.784254] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.672 [2024-10-07 11:29:06.784294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.672 [2024-10-07 11:29:06.784315] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.672 [2024-10-07 11:29:06.785195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.672 [2024-10-07 11:29:06.785677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.672 [2024-10-07 11:29:06.785891] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.672 [2024-10-07 11:29:06.785935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.672 [2024-10-07 11:29:06.785956] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.672 [2024-10-07 11:29:06.786013] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.672 [2024-10-07 11:29:06.786051] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.672 [2024-10-07 11:29:06.786069] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.672 [2024-10-07 11:29:06.786083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.672 [2024-10-07 11:29:06.787038] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.672 [2024-10-07 11:29:06.792597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.672 [2024-10-07 11:29:06.792831] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.672 [2024-10-07 11:29:06.792868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.672 [2024-10-07 11:29:06.792887] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.672 [2024-10-07 11:29:06.794166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.672 [2024-10-07 11:29:06.794421] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.672 [2024-10-07 11:29:06.794460] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.672 [2024-10-07 11:29:06.794480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.672 [2024-10-07 11:29:06.794517] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.672 [2024-10-07 11:29:06.795775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.672 [2024-10-07 11:29:06.795900] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.672 [2024-10-07 11:29:06.795942] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.672 [2024-10-07 11:29:06.795964] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.672 [2024-10-07 11:29:06.795997] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.672 [2024-10-07 11:29:06.796028] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.672 [2024-10-07 11:29:06.796045] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.672 [2024-10-07 11:29:06.796060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.672 [2024-10-07 11:29:06.797275] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.672 [2024-10-07 11:29:06.803062] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.672 [2024-10-07 11:29:06.803266] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.672 [2024-10-07 11:29:06.803304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.672 [2024-10-07 11:29:06.803323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.672 [2024-10-07 11:29:06.803360] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.672 [2024-10-07 11:29:06.803392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.672 [2024-10-07 11:29:06.803429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.672 [2024-10-07 11:29:06.803447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.672 [2024-10-07 11:29:06.803479] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.672 [2024-10-07 11:29:06.805874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.672 [2024-10-07 11:29:06.805999] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.672 [2024-10-07 11:29:06.806032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.672 [2024-10-07 11:29:06.806050] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.672 [2024-10-07 11:29:06.806110] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.672 [2024-10-07 11:29:06.806143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.672 [2024-10-07 11:29:06.806160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.672 [2024-10-07 11:29:06.806174] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.672 [2024-10-07 11:29:06.807120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.672 [2024-10-07 11:29:06.815320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.672 [2024-10-07 11:29:06.815729] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.672 [2024-10-07 11:29:06.815799] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.672 [2024-10-07 11:29:06.815836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.672 [2024-10-07 11:29:06.817014] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.672 [2024-10-07 11:29:06.818304] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.672 [2024-10-07 11:29:06.818367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.672 [2024-10-07 11:29:06.818417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.672 [2024-10-07 11:29:06.818669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.672 [2024-10-07 11:29:06.818736] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.672 [2024-10-07 11:29:06.818903] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.672 [2024-10-07 11:29:06.818963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.672 [2024-10-07 11:29:06.818999] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.672 [2024-10-07 11:29:06.819054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.672 [2024-10-07 11:29:06.819106] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.672 [2024-10-07 11:29:06.819137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.672 [2024-10-07 11:29:06.819164] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.672 [2024-10-07 11:29:06.819214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.672 [2024-10-07 11:29:06.826433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.673 [2024-10-07 11:29:06.826695] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.673 [2024-10-07 11:29:06.826747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.673 [2024-10-07 11:29:06.826778] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.673 [2024-10-07 11:29:06.826831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.673 [2024-10-07 11:29:06.826881] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.673 [2024-10-07 11:29:06.826910] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.673 [2024-10-07 11:29:06.826974] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.673 [2024-10-07 11:29:06.828449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.673 [2024-10-07 11:29:06.831467] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.673 [2024-10-07 11:29:06.831892] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.673 [2024-10-07 11:29:06.831967] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.673 [2024-10-07 11:29:06.832005] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.673 [2024-10-07 11:29:06.832190] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.673 [2024-10-07 11:29:06.833433] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.673 [2024-10-07 11:29:06.833494] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.673 [2024-10-07 11:29:06.833529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.673 [2024-10-07 11:29:06.834714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.673 [2024-10-07 11:29:06.837009] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.673 [2024-10-07 11:29:06.837254] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.673 [2024-10-07 11:29:06.837318] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.673 [2024-10-07 11:29:06.837352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.673 [2024-10-07 11:29:06.837423] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.673 [2024-10-07 11:29:06.837476] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.673 [2024-10-07 11:29:06.837506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.673 [2024-10-07 11:29:06.837531] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.673 [2024-10-07 11:29:06.837583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.673 [2024-10-07 11:29:06.842090] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.673 [2024-10-07 11:29:06.842296] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.673 [2024-10-07 11:29:06.842344] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.673 [2024-10-07 11:29:06.842373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.673 [2024-10-07 11:29:06.843785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.673 [2024-10-07 11:29:06.844108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.673 [2024-10-07 11:29:06.844168] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.673 [2024-10-07 11:29:06.844200] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.673 [2024-10-07 11:29:06.845645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.673 [2024-10-07 11:29:06.849704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.673 [2024-10-07 11:29:06.850113] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.673 [2024-10-07 11:29:06.850220] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.673 [2024-10-07 11:29:06.850259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.673 [2024-10-07 11:29:06.850347] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.673 [2024-10-07 11:29:06.850430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.673 [2024-10-07 11:29:06.850464] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.673 [2024-10-07 11:29:06.850497] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.673 [2024-10-07 11:29:06.850555] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.673 [2024-10-07 11:29:06.852247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.673 [2024-10-07 11:29:06.852446] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.673 [2024-10-07 11:29:06.852504] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.673 [2024-10-07 11:29:06.852539] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.673 [2024-10-07 11:29:06.853701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.673 [2024-10-07 11:29:06.853992] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.673 [2024-10-07 11:29:06.854032] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.673 [2024-10-07 11:29:06.854052] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.673 [2024-10-07 11:29:06.854175] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.673 [2024-10-07 11:29:06.860676] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.673 [2024-10-07 11:29:06.860926] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.673 [2024-10-07 11:29:06.860968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.673 [2024-10-07 11:29:06.860988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.673 [2024-10-07 11:29:06.861226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.673 [2024-10-07 11:29:06.861385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.673 [2024-10-07 11:29:06.861441] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.673 [2024-10-07 11:29:06.861462] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.673 [2024-10-07 11:29:06.861591] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.673 [2024-10-07 11:29:06.863800] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.673 [2024-10-07 11:29:06.863964] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.673 [2024-10-07 11:29:06.863999] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.673 [2024-10-07 11:29:06.864018] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.673 [2024-10-07 11:29:06.864259] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.673 [2024-10-07 11:29:06.864447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.673 [2024-10-07 11:29:06.864485] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.673 [2024-10-07 11:29:06.864512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.673 [2024-10-07 11:29:06.864585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.673 [2024-10-07 11:29:06.871656] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.673 [2024-10-07 11:29:06.871896] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.673 [2024-10-07 11:29:06.871935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.673 [2024-10-07 11:29:06.871956] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.673 [2024-10-07 11:29:06.873229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.673 [2024-10-07 11:29:06.873511] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.673 [2024-10-07 11:29:06.873550] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.673 [2024-10-07 11:29:06.873570] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.673 [2024-10-07 11:29:06.874754] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.673 [2024-10-07 11:29:06.876365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.673 [2024-10-07 11:29:06.876745] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.673 [2024-10-07 11:29:06.876799] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.673 [2024-10-07 11:29:06.876825] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.673 [2024-10-07 11:29:06.877902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.673 [2024-10-07 11:29:06.878975] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.673 [2024-10-07 11:29:06.879045] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.673 [2024-10-07 11:29:06.879081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.673 [2024-10-07 11:29:06.879548] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.673 [2024-10-07 11:29:06.881964] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.673 [2024-10-07 11:29:06.882263] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.673 [2024-10-07 11:29:06.882338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.673 [2024-10-07 11:29:06.882376] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.673 [2024-10-07 11:29:06.883575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.673 [2024-10-07 11:29:06.883891] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.673 [2024-10-07 11:29:06.883952] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.673 [2024-10-07 11:29:06.883990] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.674 [2024-10-07 11:29:06.884218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.674 [2024-10-07 11:29:06.887600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.674 [2024-10-07 11:29:06.889560] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.674 [2024-10-07 11:29:06.889648] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.674 [2024-10-07 11:29:06.889685] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.674 [2024-10-07 11:29:06.891557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.674 [2024-10-07 11:29:06.893073] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.674 [2024-10-07 11:29:06.893144] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.674 [2024-10-07 11:29:06.893181] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.674 [2024-10-07 11:29:06.894933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.674 [2024-10-07 11:29:06.896357] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.674 [2024-10-07 11:29:06.897941] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.674 [2024-10-07 11:29:06.898024] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.674 [2024-10-07 11:29:06.898065] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.674 [2024-10-07 11:29:06.898367] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.674 [2024-10-07 11:29:06.899689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.674 [2024-10-07 11:29:06.899798] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.674 [2024-10-07 11:29:06.899840] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.674 [2024-10-07 11:29:06.899874] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.674 [2024-10-07 11:29:06.901942] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.674 [2024-10-07 11:29:06.902141] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.674 [2024-10-07 11:29:06.902205] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.674 [2024-10-07 11:29:06.902239] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.674 [2024-10-07 11:29:06.903437] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.674 [2024-10-07 11:29:06.905291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.674 [2024-10-07 11:29:06.905360] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.674 [2024-10-07 11:29:06.905392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.674 [2024-10-07 11:29:06.905784] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.674 [2024-10-07 11:29:06.908718] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.674 [2024-10-07 11:29:06.910199] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.674 [2024-10-07 11:29:06.910270] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.674 [2024-10-07 11:29:06.910349] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.674 [2024-10-07 11:29:06.911573] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.674 [2024-10-07 11:29:06.912694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.674 [2024-10-07 11:29:06.912787] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.674 [2024-10-07 11:29:06.912823] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.674 [2024-10-07 11:29:06.912852] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.674 [2024-10-07 11:29:06.914275] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.674 [2024-10-07 11:29:06.914488] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.674 [2024-10-07 11:29:06.914553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.674 [2024-10-07 11:29:06.914588] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.674 [2024-10-07 11:29:06.914885] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.674 [2024-10-07 11:29:06.915067] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.674 [2024-10-07 11:29:06.915114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.674 [2024-10-07 11:29:06.915142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.674 [2024-10-07 11:29:06.916701] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.674 [2024-10-07 11:29:06.922673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.674 [2024-10-07 11:29:06.923219] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.674 [2024-10-07 11:29:06.923292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.674 [2024-10-07 11:29:06.923328] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.674 [2024-10-07 11:29:06.924583] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.674 [2024-10-07 11:29:06.925970] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.674 [2024-10-07 11:29:06.926081] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.674 [2024-10-07 11:29:06.926118] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.674 [2024-10-07 11:29:06.926147] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.674 [2024-10-07 11:29:06.926397] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.674 [2024-10-07 11:29:06.926601] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.674 [2024-10-07 11:29:06.926665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.674 [2024-10-07 11:29:06.926701] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.674 [2024-10-07 11:29:06.927694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.674 [2024-10-07 11:29:06.927991] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.674 [2024-10-07 11:29:06.928098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.674 [2024-10-07 11:29:06.928130] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.674 [2024-10-07 11:29:06.928248] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.674 [2024-10-07 11:29:06.933016] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.674 [2024-10-07 11:29:06.934725] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.674 [2024-10-07 11:29:06.934818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.674 [2024-10-07 11:29:06.934854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.674 [2024-10-07 11:29:06.935231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.674 [2024-10-07 11:29:06.936705] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.674 [2024-10-07 11:29:06.936784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.674 [2024-10-07 11:29:06.936820] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.674 [2024-10-07 11:29:06.938163] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.674 [2024-10-07 11:29:06.938483] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.674 [2024-10-07 11:29:06.939820] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.674 [2024-10-07 11:29:06.939901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.674 [2024-10-07 11:29:06.939940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.674 [2024-10-07 11:29:06.941298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.674 [2024-10-07 11:29:06.941640] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.674 [2024-10-07 11:29:06.941701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.674 [2024-10-07 11:29:06.941735] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.674 [2024-10-07 11:29:06.941838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.674 [2024-10-07 11:29:06.943705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.674 [2024-10-07 11:29:06.943998] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.674 [2024-10-07 11:29:06.944067] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.674 [2024-10-07 11:29:06.944104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.674 [2024-10-07 11:29:06.944161] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.674 [2024-10-07 11:29:06.945360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.674 [2024-10-07 11:29:06.945449] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.674 [2024-10-07 11:29:06.945495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.674 [2024-10-07 11:29:06.945809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.674 [2024-10-07 11:29:06.948844] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.674 [2024-10-07 11:29:06.950594] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.674 [2024-10-07 11:29:06.950681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.674 [2024-10-07 11:29:06.950720] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.674 [2024-10-07 11:29:06.951029] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.674 [2024-10-07 11:29:06.952461] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.675 [2024-10-07 11:29:06.952523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.675 [2024-10-07 11:29:06.952556] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.675 [2024-10-07 11:29:06.953782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.675 [2024-10-07 11:29:06.956461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.675 [2024-10-07 11:29:06.956943] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.675 [2024-10-07 11:29:06.957017] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.675 [2024-10-07 11:29:06.957075] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.675 [2024-10-07 11:29:06.957197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.675 [2024-10-07 11:29:06.957275] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.675 [2024-10-07 11:29:06.957309] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.675 [2024-10-07 11:29:06.957336] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.675 [2024-10-07 11:29:06.957389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.675 [2024-10-07 11:29:06.959048] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.675 [2024-10-07 11:29:06.959220] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.675 [2024-10-07 11:29:06.959268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.675 [2024-10-07 11:29:06.959300] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.675 [2024-10-07 11:29:06.960508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.675 [2024-10-07 11:29:06.960814] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.675 [2024-10-07 11:29:06.960871] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.675 [2024-10-07 11:29:06.960903] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.675 [2024-10-07 11:29:06.961076] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.675 [2024-10-07 11:29:06.968655] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.675 [2024-10-07 11:29:06.970096] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.675 [2024-10-07 11:29:06.970165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.675 [2024-10-07 11:29:06.970242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.675 [2024-10-07 11:29:06.971489] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.675 [2024-10-07 11:29:06.971757] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.675 [2024-10-07 11:29:06.971835] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.675 [2024-10-07 11:29:06.971869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.675 [2024-10-07 11:29:06.971895] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.675 [2024-10-07 11:29:06.971975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.675 [2024-10-07 11:29:06.972070] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.675 [2024-10-07 11:29:06.972110] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.675 [2024-10-07 11:29:06.972137] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.675 [2024-10-07 11:29:06.973022] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.675 [2024-10-07 11:29:06.973338] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.675 [2024-10-07 11:29:06.973396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.675 [2024-10-07 11:29:06.973451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.675 [2024-10-07 11:29:06.973572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.675 [2024-10-07 11:29:06.981791] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.675 [2024-10-07 11:29:06.983310] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.675 [2024-10-07 11:29:06.983388] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.675 [2024-10-07 11:29:06.983451] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.675 [2024-10-07 11:29:06.983742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.675 [2024-10-07 11:29:06.985023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.675 [2024-10-07 11:29:06.985126] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.675 [2024-10-07 11:29:06.985161] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.675 [2024-10-07 11:29:06.985186] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.675 [2024-10-07 11:29:06.986363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.675 [2024-10-07 11:29:06.986546] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.675 [2024-10-07 11:29:06.986608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.675 [2024-10-07 11:29:06.986642] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.675 [2024-10-07 11:29:06.986879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.675 [2024-10-07 11:29:06.987924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.675 [2024-10-07 11:29:06.988025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.675 [2024-10-07 11:29:06.988060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.675 [2024-10-07 11:29:06.988321] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.675 [2024-10-07 11:29:06.993270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.675 [2024-10-07 11:29:06.994953] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.675 [2024-10-07 11:29:06.995030] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.675 [2024-10-07 11:29:06.995065] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.675 [2024-10-07 11:29:06.995440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.675 [2024-10-07 11:29:06.996792] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.675 [2024-10-07 11:29:06.996858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.675 [2024-10-07 11:29:06.996897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.675 [2024-10-07 11:29:06.998154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.675 [2024-10-07 11:29:06.998225] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.675 [2024-10-07 11:29:06.998586] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.675 [2024-10-07 11:29:06.998649] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.675 [2024-10-07 11:29:06.998683] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.675 [2024-10-07 11:29:06.999946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.675 [2024-10-07 11:29:07.001237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.675 [2024-10-07 11:29:07.001304] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.675 [2024-10-07 11:29:07.001339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.675 [2024-10-07 11:29:07.002500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.675 [2024-10-07 11:29:07.004925] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.675 [2024-10-07 11:29:07.006753] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.675 [2024-10-07 11:29:07.006838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.675 [2024-10-07 11:29:07.006871] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.675 [2024-10-07 11:29:07.007956] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.675 [2024-10-07 11:29:07.008219] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.675 [2024-10-07 11:29:07.008270] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.675 [2024-10-07 11:29:07.008300] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.675 [2024-10-07 11:29:07.008481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.675 [2024-10-07 11:29:07.011539] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.675 [2024-10-07 11:29:07.012904] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.676 [2024-10-07 11:29:07.012971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.676 [2024-10-07 11:29:07.013003] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.676 [2024-10-07 11:29:07.014395] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.676 [2024-10-07 11:29:07.015616] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.676 [2024-10-07 11:29:07.015672] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.676 [2024-10-07 11:29:07.015703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.676 [2024-10-07 11:29:07.015970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.676 [2024-10-07 11:29:07.016074] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.676 [2024-10-07 11:29:07.016211] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.676 [2024-10-07 11:29:07.016265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.676 [2024-10-07 11:29:07.016295] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.676 [2024-10-07 11:29:07.017188] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.676 [2024-10-07 11:29:07.017474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.676 [2024-10-07 11:29:07.017524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.676 [2024-10-07 11:29:07.017553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.676 [2024-10-07 11:29:07.017651] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.676 [2024-10-07 11:29:07.022325] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.676 [2024-10-07 11:29:07.022612] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.676 [2024-10-07 11:29:07.022664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.676 [2024-10-07 11:29:07.022693] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.676 [2024-10-07 11:29:07.024026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.676 [2024-10-07 11:29:07.024367] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.676 [2024-10-07 11:29:07.024436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.676 [2024-10-07 11:29:07.024469] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.676 [2024-10-07 11:29:07.025773] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.676 [2024-10-07 11:29:07.027320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.676 [2024-10-07 11:29:07.028735] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.676 [2024-10-07 11:29:07.028821] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.676 [2024-10-07 11:29:07.028859] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.676 [2024-10-07 11:29:07.030171] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.676 [2024-10-07 11:29:07.030479] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.676 [2024-10-07 11:29:07.030535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.676 [2024-10-07 11:29:07.030566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.676 [2024-10-07 11:29:07.030661] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.676 [2024-10-07 11:29:07.032545] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.676 [2024-10-07 11:29:07.032756] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.676 [2024-10-07 11:29:07.032810] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.676 [2024-10-07 11:29:07.032839] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.676 [2024-10-07 11:29:07.033946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.676 [2024-10-07 11:29:07.034232] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.676 [2024-10-07 11:29:07.034286] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.676 [2024-10-07 11:29:07.034317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.676 [2024-10-07 11:29:07.034480] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.676 [2024-10-07 11:29:07.040425] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.676 [2024-10-07 11:29:07.041916] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.676 [2024-10-07 11:29:07.041992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.676 [2024-10-07 11:29:07.042033] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.676 [2024-10-07 11:29:07.042329] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.676 [2024-10-07 11:29:07.043525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.676 [2024-10-07 11:29:07.043583] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.676 [2024-10-07 11:29:07.043616] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.676 [2024-10-07 11:29:07.044766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.676 [2024-10-07 11:29:07.045034] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.676 [2024-10-07 11:29:07.045290] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.676 [2024-10-07 11:29:07.045357] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.676 [2024-10-07 11:29:07.045390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.676 [2024-10-07 11:29:07.045475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.676 [2024-10-07 11:29:07.045524] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.676 [2024-10-07 11:29:07.045552] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.676 [2024-10-07 11:29:07.045622] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.676 [2024-10-07 11:29:07.045673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.676 [2024-10-07 11:29:07.050739] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.676 [2024-10-07 11:29:07.051863] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.676 [2024-10-07 11:29:07.051930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.676 [2024-10-07 11:29:07.051964] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.676 [2024-10-07 11:29:07.052191] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.676 [2024-10-07 11:29:07.052372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.676 [2024-10-07 11:29:07.052435] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.676 [2024-10-07 11:29:07.052467] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.676 [2024-10-07 11:29:07.053824] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.676 [2024-10-07 11:29:07.056745] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.676 [2024-10-07 11:29:07.058270] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.676 [2024-10-07 11:29:07.058358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.676 [2024-10-07 11:29:07.058396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.676 [2024-10-07 11:29:07.059705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.676 [2024-10-07 11:29:07.060029] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.676 [2024-10-07 11:29:07.060085] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.676 [2024-10-07 11:29:07.060118] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.676 [2024-10-07 11:29:07.060212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.676 [2024-10-07 11:29:07.061792] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.676 [2024-10-07 11:29:07.062028] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.676 [2024-10-07 11:29:07.062090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.676 [2024-10-07 11:29:07.062124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.676 [2024-10-07 11:29:07.062178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.676 [2024-10-07 11:29:07.062226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.676 [2024-10-07 11:29:07.062256] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.676 [2024-10-07 11:29:07.062284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.676 [2024-10-07 11:29:07.063455] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.676 [2024-10-07 11:29:07.066948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.676 [2024-10-07 11:29:07.068739] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.676 [2024-10-07 11:29:07.068869] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.676 [2024-10-07 11:29:07.068907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.676 [2024-10-07 11:29:07.069274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.676 [2024-10-07 11:29:07.070681] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.676 [2024-10-07 11:29:07.070739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.676 [2024-10-07 11:29:07.070772] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.676 [2024-10-07 11:29:07.071962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.677 [2024-10-07 11:29:07.073450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.677 [2024-10-07 11:29:07.074901] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.677 [2024-10-07 11:29:07.074986] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.677 [2024-10-07 11:29:07.075019] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.677 [2024-10-07 11:29:07.075257] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.677 [2024-10-07 11:29:07.075363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.677 [2024-10-07 11:29:07.075427] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.677 [2024-10-07 11:29:07.075458] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.677 [2024-10-07 11:29:07.076276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.677 [2024-10-07 11:29:07.077132] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.677 [2024-10-07 11:29:07.078305] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.677 [2024-10-07 11:29:07.078368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.677 [2024-10-07 11:29:07.078419] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.677 [2024-10-07 11:29:07.078695] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.677 [2024-10-07 11:29:07.078858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.677 [2024-10-07 11:29:07.078901] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.677 [2024-10-07 11:29:07.078927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.677 [2024-10-07 11:29:07.080318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.677 [2024-10-07 11:29:07.085826] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.677 [2024-10-07 11:29:07.086188] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.677 [2024-10-07 11:29:07.086255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.677 [2024-10-07 11:29:07.086288] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.677 [2024-10-07 11:29:07.086484] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.677 [2024-10-07 11:29:07.087642] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.677 [2024-10-07 11:29:07.087701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.677 [2024-10-07 11:29:07.087734] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.677 [2024-10-07 11:29:07.088878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.677 [2024-10-07 11:29:07.089170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.677 [2024-10-07 11:29:07.089365] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.677 [2024-10-07 11:29:07.089439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.677 [2024-10-07 11:29:07.089473] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.677 [2024-10-07 11:29:07.089525] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.677 [2024-10-07 11:29:07.089576] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.677 [2024-10-07 11:29:07.089604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.677 [2024-10-07 11:29:07.089628] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.677 [2024-10-07 11:29:07.089674] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.677 [2024-10-07 11:29:07.096799] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.677 [2024-10-07 11:29:07.097045] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.677 [2024-10-07 11:29:07.097112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.677 [2024-10-07 11:29:07.097143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.677 [2024-10-07 11:29:07.097759] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.677 [2024-10-07 11:29:07.097981] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.677 [2024-10-07 11:29:07.098034] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.677 [2024-10-07 11:29:07.098064] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.677 [2024-10-07 11:29:07.098135] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.677 [2024-10-07 11:29:07.099971] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.677 [2024-10-07 11:29:07.100176] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.677 [2024-10-07 11:29:07.100237] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.677 [2024-10-07 11:29:07.100270] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.677 [2024-10-07 11:29:07.100321] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.677 [2024-10-07 11:29:07.100368] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.677 [2024-10-07 11:29:07.100396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.677 [2024-10-07 11:29:07.100440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.677 [2024-10-07 11:29:07.100533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.677 8320.13 IOPS, 32.50 MiB/s 00:18:26.677 Latency(us) 00:18:26.677 [2024-10-07T11:29:08.388Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:26.677 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:18:26.677 Verification LBA range: start 0x0 length 0x4000 00:18:26.677 NVMe0n1 : 15.01 8319.67 32.50 0.00 0.00 15349.00 1683.08 18588.39 00:18:26.677 [2024-10-07T11:29:08.388Z] =================================================================================================================== 00:18:26.677 [2024-10-07T11:29:08.388Z] Total : 8319.67 32.50 0.00 0.00 15349.00 1683.08 18588.39 00:18:26.677 [2024-10-07 11:29:07.109835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.677 [2024-10-07 11:29:07.110194] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.677 [2024-10-07 11:29:07.110258] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.677 [2024-10-07 11:29:07.110292] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.677 [2024-10-07 11:29:07.111137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.677 [2024-10-07 11:29:07.111205] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.677 [2024-10-07 11:29:07.111257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.677 [2024-10-07 11:29:07.111286] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.677 [2024-10-07 11:29:07.111311] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.677 [2024-10-07 11:29:07.111340] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.677 [2024-10-07 11:29:07.111446] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.677 [2024-10-07 11:29:07.111488] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.677 [2024-10-07 11:29:07.111517] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.677 [2024-10-07 11:29:07.111551] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.677 [2024-10-07 11:29:07.111582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.677 [2024-10-07 11:29:07.111606] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.677 [2024-10-07 11:29:07.111628] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.677 [2024-10-07 11:29:07.111656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.677 [2024-10-07 11:29:07.119987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.677 [2024-10-07 11:29:07.120262] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.677 [2024-10-07 11:29:07.120311] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.677 [2024-10-07 11:29:07.120349] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.677 [2024-10-07 11:29:07.120390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.677 [2024-10-07 11:29:07.120460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.677 [2024-10-07 11:29:07.120547] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.677 [2024-10-07 11:29:07.120574] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.677 [2024-10-07 11:29:07.120605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.677 [2024-10-07 11:29:07.121278] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.677 [2024-10-07 11:29:07.121429] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.677 [2024-10-07 11:29:07.121474] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.677 [2024-10-07 11:29:07.121515] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.677 [2024-10-07 11:29:07.121550] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.677 [2024-10-07 11:29:07.121616] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.677 [2024-10-07 11:29:07.121646] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.677 [2024-10-07 11:29:07.121671] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.677 [2024-10-07 11:29:07.121699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.678 [2024-10-07 11:29:07.130159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.678 [2024-10-07 11:29:07.130380] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.678 [2024-10-07 11:29:07.130449] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.678 [2024-10-07 11:29:07.130483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.678 [2024-10-07 11:29:07.130522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.678 [2024-10-07 11:29:07.130557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.678 [2024-10-07 11:29:07.130583] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.678 [2024-10-07 11:29:07.130606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.678 [2024-10-07 11:29:07.130644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.678 [2024-10-07 11:29:07.131368] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.678 [2024-10-07 11:29:07.131543] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.678 [2024-10-07 11:29:07.131599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.678 [2024-10-07 11:29:07.131633] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.678 [2024-10-07 11:29:07.131669] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.678 [2024-10-07 11:29:07.131703] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.678 [2024-10-07 11:29:07.131728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.678 [2024-10-07 11:29:07.131761] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.678 [2024-10-07 11:29:07.131790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.678 [2024-10-07 11:29:07.140309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.678 [2024-10-07 11:29:07.140574] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.678 [2024-10-07 11:29:07.140627] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.678 [2024-10-07 11:29:07.140658] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.678 [2024-10-07 11:29:07.140713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.678 [2024-10-07 11:29:07.140749] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.678 [2024-10-07 11:29:07.140772] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.678 [2024-10-07 11:29:07.140796] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.678 [2024-10-07 11:29:07.140823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.678 [2024-10-07 11:29:07.141488] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.678 [2024-10-07 11:29:07.141610] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.678 [2024-10-07 11:29:07.141666] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.678 [2024-10-07 11:29:07.141697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.678 [2024-10-07 11:29:07.141748] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.678 [2024-10-07 11:29:07.141782] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.678 [2024-10-07 11:29:07.141808] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.678 [2024-10-07 11:29:07.141829] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.678 [2024-10-07 11:29:07.141855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.678 [2024-10-07 11:29:07.150482] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.678 [2024-10-07 11:29:07.150737] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.678 [2024-10-07 11:29:07.150784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147b280 with addr=10.0.0.3, port=4421 00:18:26.678 [2024-10-07 11:29:07.150813] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x147b280 is same with the state(6) to be set 00:18:26.678 [2024-10-07 11:29:07.150848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x147b280 (9): Bad file descriptor 00:18:26.678 [2024-10-07 11:29:07.150880] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.678 [2024-10-07 11:29:07.150904] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.678 [2024-10-07 11:29:07.150927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.678 [2024-10-07 11:29:07.150955] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.678 [2024-10-07 11:29:07.151570] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:26.678 [2024-10-07 11:29:07.151699] uring.c: 665:uring_sock_create: *ERROR*: connect() failed, errno = 111 00:18:26.678 [2024-10-07 11:29:07.151741] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14739a0 with addr=10.0.0.3, port=4422 00:18:26.678 [2024-10-07 11:29:07.151767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14739a0 is same with the state(6) to be set 00:18:26.678 [2024-10-07 11:29:07.151831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14739a0 (9): Bad file descriptor 00:18:26.678 [2024-10-07 11:29:07.151862] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:26.678 [2024-10-07 11:29:07.151885] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:26.678 [2024-10-07 11:29:07.151907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:26.678 [2024-10-07 11:29:07.151932] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:26.678 Received shutdown signal, test time was about 15.000000 seconds 00:18:26.678 00:18:26.678 Latency(us) 00:18:26.678 [2024-10-07T11:29:08.389Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:26.678 [2024-10-07T11:29:08.389Z] =================================================================================================================== 00:18:26.678 [2024-10-07T11:29:08.389Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/host/try.txt 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # killprocess 75360 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@950 -- # '[' -z 75360 ']' 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@954 -- # kill -0 75360 00:18:26.678 /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh: line 954: kill: (75360) - No such process 00:18:26.678 Process with pid 75360 is not found 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@977 -- # echo 'Process with pid 75360 is not found' 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # nvmftestfini 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@514 -- # nvmfcleanup 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@121 -- # sync 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@124 -- # set +e 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@125 -- # for i in {1..20} 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:18:26.678 rmmod nvme_tcp 00:18:26.678 rmmod nvme_fabrics 00:18:26.678 rmmod nvme_keyring 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@128 -- # set -e 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@129 -- # return 0 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@515 -- # '[' -n 75301 ']' 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@516 -- # killprocess 75301 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@950 -- # '[' -z 75301 ']' 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@954 -- # kill -0 75301 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@955 -- # uname 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 75301 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:18:26.678 killing process with pid 75301 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@968 -- # echo 'killing process with pid 75301' 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@969 -- # kill 75301 00:18:26.678 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@974 -- # wait 75301 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@297 -- # iptr 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@789 -- # iptables-save 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@789 -- # iptables-restore 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:18:26.678 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@246 -- # remove_spdk_ns 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@300 -- # return 0 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # exit 1 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1125 -- # trap - ERR 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1125 -- # print_backtrace 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1153 -- # [[ ehxBET =~ e ]] 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1155 -- # args=('--transport=tcp' '/home/vagrant/spdk_repo/spdk/test/nvmf/host/failover.sh' 'nvmf_failover' '--transport=tcp') 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1155 -- # local args 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1157 -- # xtrace_disable 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:18:26.679 ========== Backtrace start: ========== 00:18:26.679 00:18:26.679 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_failover"],["/home/vagrant/spdk_repo/spdk/test/nvmf/host/failover.sh"],["--transport=tcp"]) 00:18:26.679 ... 00:18:26.679 1120 timing_enter $test_name 00:18:26.679 1121 echo "************************************" 00:18:26.679 1122 echo "START TEST $test_name" 00:18:26.679 1123 echo "************************************" 00:18:26.679 1124 xtrace_restore 00:18:26.679 1125 time "$@" 00:18:26.679 1126 xtrace_disable 00:18:26.679 1127 echo "************************************" 00:18:26.679 1128 echo "END TEST $test_name" 00:18:26.679 1129 echo "************************************" 00:18:26.679 1130 timing_exit $test_name 00:18:26.679 ... 00:18:26.679 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh:25 -> main(["--transport=tcp"]) 00:18:26.679 ... 00:18:26.679 20 fi 00:18:26.679 21 00:18:26.679 22 run_test "nvmf_identify" $rootdir/test/nvmf/host/identify.sh "${TEST_ARGS[@]}" 00:18:26.679 23 run_test "nvmf_perf" $rootdir/test/nvmf/host/perf.sh "${TEST_ARGS[@]}" 00:18:26.679 24 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 00:18:26.679 => 25 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 00:18:26.679 26 run_test "nvmf_host_discovery" $rootdir/test/nvmf/host/discovery.sh "${TEST_ARGS[@]}" 00:18:26.679 27 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 00:18:26.679 28 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 00:18:26.679 29 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 00:18:26.679 30 run_test "nvmf_auth_host" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 00:18:26.679 ... 00:18:26.679 00:18:26.679 ========== Backtrace end ========== 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1194 -- # return 0 00:18:26.679 00:18:26.679 real 0m21.304s 00:18:26.679 user 1m17.319s 00:18:26.679 sys 0m5.167s 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1 -- # exit 1 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1125 -- # trap - ERR 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1125 -- # print_backtrace 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1153 -- # [[ ehxBET =~ e ]] 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1155 -- # args=('--transport=tcp' '/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh' 'nvmf_host' '--transport=tcp') 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1155 -- # local args 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1157 -- # xtrace_disable 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:18:26.679 ========== Backtrace start: ========== 00:18:26.679 00:18:26.679 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_host"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh"],["--transport=tcp"]) 00:18:26.679 ... 00:18:26.679 1120 timing_enter $test_name 00:18:26.679 1121 echo "************************************" 00:18:26.679 1122 echo "START TEST $test_name" 00:18:26.679 1123 echo "************************************" 00:18:26.679 1124 xtrace_restore 00:18:26.679 1125 time "$@" 00:18:26.679 1126 xtrace_disable 00:18:26.679 1127 echo "************************************" 00:18:26.679 1128 echo "END TEST $test_name" 00:18:26.679 1129 echo "************************************" 00:18:26.679 1130 timing_exit $test_name 00:18:26.679 ... 00:18:26.679 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh:16 -> main(["--transport=tcp"]) 00:18:26.679 ... 00:18:26.679 11 exit 0 00:18:26.679 12 fi 00:18:26.679 13 00:18:26.679 14 run_test "nvmf_target_core" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:18:26.679 15 run_test "nvmf_target_extra" $rootdir/test/nvmf/nvmf_target_extra.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:18:26.679 => 16 run_test "nvmf_host" $rootdir/test/nvmf/nvmf_host.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:18:26.679 17 00:18:26.679 18 # Interrupt mode for now is supported only on the target, with the TCP transport and posix or ssl socket implementations. 00:18:26.679 19 if [[ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" && $SPDK_TEST_URING -eq 0 ]]; then 00:18:26.679 20 run_test "nvmf_target_core_interrupt_mode" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:18:26.679 21 run_test "nvmf_interrupt" $rootdir/test/nvmf/target/interrupt.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:18:26.679 ... 00:18:26.679 00:18:26.679 ========== Backtrace end ========== 00:18:26.679 11:29:08 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1194 -- # return 0 00:18:26.679 00:18:26.679 real 0m47.652s 00:18:26.679 user 2m51.541s 00:18:26.679 sys 0m12.778s 00:18:26.679 11:29:08 nvmf_tcp -- common/autotest_common.sh@1125 -- # trap - ERR 00:18:26.679 11:29:08 nvmf_tcp -- common/autotest_common.sh@1125 -- # print_backtrace 00:18:26.679 11:29:08 nvmf_tcp -- common/autotest_common.sh@1153 -- # [[ ehxBET =~ e ]] 00:18:26.679 11:29:08 nvmf_tcp -- common/autotest_common.sh@1155 -- # args=('--transport=tcp' '/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh' 'nvmf_tcp' '/home/vagrant/spdk_repo/autorun-spdk.conf') 00:18:26.679 11:29:08 nvmf_tcp -- common/autotest_common.sh@1155 -- # local args 00:18:26.679 11:29:08 nvmf_tcp -- common/autotest_common.sh@1157 -- # xtrace_disable 00:18:26.679 11:29:08 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:18:26.679 ========== Backtrace start: ========== 00:18:26.679 00:18:26.679 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_tcp"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 00:18:26.679 ... 00:18:26.679 1120 timing_enter $test_name 00:18:26.679 1121 echo "************************************" 00:18:26.679 1122 echo "START TEST $test_name" 00:18:26.679 1123 echo "************************************" 00:18:26.679 1124 xtrace_restore 00:18:26.679 1125 time "$@" 00:18:26.679 1126 xtrace_disable 00:18:26.679 1127 echo "************************************" 00:18:26.679 1128 echo "END TEST $test_name" 00:18:26.679 1129 echo "************************************" 00:18:26.679 1130 timing_exit $test_name 00:18:26.679 ... 00:18:26.679 in /home/vagrant/spdk_repo/spdk/autotest.sh:280 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:18:26.679 ... 00:18:26.679 275 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:18:26.679 276 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:18:26.679 277 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:18:26.679 278 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:18:26.679 279 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:18:26.680 => 280 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:18:26.680 281 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:18:26.680 282 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:18:26.680 283 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:18:26.680 284 fi 00:18:26.680 285 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 00:18:26.680 ... 00:18:26.680 00:18:26.680 ========== Backtrace end ========== 00:18:26.680 11:29:08 nvmf_tcp -- common/autotest_common.sh@1194 -- # return 0 00:18:26.680 00:18:26.680 real 8m47.349s 00:18:26.680 user 21m13.100s 00:18:26.680 sys 2m11.771s 00:18:26.680 11:29:08 nvmf_tcp -- common/autotest_common.sh@1 -- # autotest_cleanup 00:18:26.680 11:29:08 nvmf_tcp -- common/autotest_common.sh@1392 -- # local autotest_es=1 00:18:26.680 11:29:08 nvmf_tcp -- common/autotest_common.sh@1393 -- # xtrace_disable 00:18:26.680 11:29:08 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:18:38.909 INFO: APP EXITING 00:18:38.909 INFO: killing all VMs 00:18:38.909 INFO: killing vhost app 00:18:38.909 INFO: EXIT DONE 00:18:38.909 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:18:38.909 Waiting for block devices as requested 00:18:38.909 0000:00:11.0 (1b36 0010): uio_pci_generic -> nvme 00:18:38.909 0000:00:10.0 (1b36 0010): uio_pci_generic -> nvme 00:18:39.475 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:18:39.733 Cleaning 00:18:39.733 Removing: /var/run/dpdk/spdk0/config 00:18:39.733 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:18:39.733 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:18:39.733 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:18:39.733 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:18:39.733 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:18:39.733 Removing: /var/run/dpdk/spdk0/hugepage_info 00:18:39.733 Removing: /var/run/dpdk/spdk1/config 00:18:39.733 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:18:39.733 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:18:39.733 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:18:39.733 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:18:39.733 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:18:39.733 Removing: /var/run/dpdk/spdk1/hugepage_info 00:18:39.733 Removing: /var/run/dpdk/spdk2/config 00:18:39.733 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:18:39.733 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:18:39.733 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:18:39.733 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:18:39.733 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:18:39.733 Removing: /var/run/dpdk/spdk2/hugepage_info 00:18:39.733 Removing: /var/run/dpdk/spdk3/config 00:18:39.733 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:18:39.733 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:18:39.733 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:18:39.733 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:18:39.733 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:18:39.733 Removing: /var/run/dpdk/spdk3/hugepage_info 00:18:39.733 Removing: /var/run/dpdk/spdk4/config 00:18:39.733 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:18:39.733 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:18:39.733 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:18:39.733 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:18:39.733 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:18:39.733 Removing: /var/run/dpdk/spdk4/hugepage_info 00:18:39.733 Removing: /dev/shm/nvmf_trace.0 00:18:39.733 Removing: /dev/shm/spdk_tgt_trace.pid56979 00:18:39.733 Removing: /var/run/dpdk/spdk0 00:18:39.733 Removing: /var/run/dpdk/spdk1 00:18:39.733 Removing: /var/run/dpdk/spdk2 00:18:39.733 Removing: /var/run/dpdk/spdk3 00:18:39.733 Removing: /var/run/dpdk/spdk4 00:18:39.733 Removing: /var/run/dpdk/spdk_pid56831 00:18:39.733 Removing: /var/run/dpdk/spdk_pid56979 00:18:39.733 Removing: /var/run/dpdk/spdk_pid57172 00:18:39.733 Removing: /var/run/dpdk/spdk_pid57258 00:18:39.733 Removing: /var/run/dpdk/spdk_pid57273 00:18:39.733 Removing: /var/run/dpdk/spdk_pid57388 00:18:39.733 Removing: /var/run/dpdk/spdk_pid57393 00:18:39.733 Removing: /var/run/dpdk/spdk_pid57527 00:18:39.733 Removing: /var/run/dpdk/spdk_pid57739 00:18:39.733 Removing: /var/run/dpdk/spdk_pid57893 00:18:39.733 Removing: /var/run/dpdk/spdk_pid57961 00:18:39.733 Removing: /var/run/dpdk/spdk_pid58042 00:18:39.733 Removing: /var/run/dpdk/spdk_pid58128 00:18:39.733 Removing: /var/run/dpdk/spdk_pid58200 00:18:39.733 Removing: /var/run/dpdk/spdk_pid58233 00:18:39.733 Removing: /var/run/dpdk/spdk_pid58274 00:18:39.733 Removing: /var/run/dpdk/spdk_pid58338 00:18:39.733 Removing: /var/run/dpdk/spdk_pid58441 00:18:39.733 Removing: /var/run/dpdk/spdk_pid58902 00:18:39.733 Removing: /var/run/dpdk/spdk_pid58941 00:18:39.733 Removing: /var/run/dpdk/spdk_pid58990 00:18:39.733 Removing: /var/run/dpdk/spdk_pid58993 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59053 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59061 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59121 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59129 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59175 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59197 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59238 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59243 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59378 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59409 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59492 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59818 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59836 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59867 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59882 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59898 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59922 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59936 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59951 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59976 00:18:39.733 Removing: /var/run/dpdk/spdk_pid59984 00:18:39.733 Removing: /var/run/dpdk/spdk_pid60005 00:18:39.733 Removing: /var/run/dpdk/spdk_pid60024 00:18:39.733 Removing: /var/run/dpdk/spdk_pid60037 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60053 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60074 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60093 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60103 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60122 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60141 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60156 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60188 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60207 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60231 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60303 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60330 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60341 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60370 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60379 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60381 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60429 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60437 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60471 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60475 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60490 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60494 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60509 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60513 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60528 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60532 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60565 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60587 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60601 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60625 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60635 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60642 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60683 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60694 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60725 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60728 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60737 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60744 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60752 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60759 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60767 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60774 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60856 00:18:39.991 Removing: /var/run/dpdk/spdk_pid60904 00:18:39.991 Removing: /var/run/dpdk/spdk_pid61018 00:18:39.991 Removing: /var/run/dpdk/spdk_pid61053 00:18:39.991 Removing: /var/run/dpdk/spdk_pid61091 00:18:39.991 Removing: /var/run/dpdk/spdk_pid61106 00:18:39.991 Removing: /var/run/dpdk/spdk_pid61128 00:18:39.991 Removing: /var/run/dpdk/spdk_pid61148 00:18:39.991 Removing: /var/run/dpdk/spdk_pid61174 00:18:39.991 Removing: /var/run/dpdk/spdk_pid61195 00:18:39.991 Removing: /var/run/dpdk/spdk_pid61275 00:18:39.991 Removing: /var/run/dpdk/spdk_pid61291 00:18:39.991 Removing: /var/run/dpdk/spdk_pid61335 00:18:39.991 Removing: /var/run/dpdk/spdk_pid61413 00:18:39.991 Removing: /var/run/dpdk/spdk_pid61474 00:18:39.991 Removing: /var/run/dpdk/spdk_pid61503 00:18:39.991 Removing: /var/run/dpdk/spdk_pid61597 00:18:39.991 Removing: /var/run/dpdk/spdk_pid61644 00:18:39.991 Removing: /var/run/dpdk/spdk_pid61678 00:18:39.991 Removing: /var/run/dpdk/spdk_pid61904 00:18:39.991 Removing: /var/run/dpdk/spdk_pid62002 00:18:39.991 Removing: /var/run/dpdk/spdk_pid62025 00:18:39.991 Removing: /var/run/dpdk/spdk_pid62060 00:18:39.991 Removing: /var/run/dpdk/spdk_pid62088 00:18:39.991 Removing: /var/run/dpdk/spdk_pid62127 00:18:39.991 Removing: /var/run/dpdk/spdk_pid62155 00:18:39.991 Removing: /var/run/dpdk/spdk_pid62192 00:18:39.991 Removing: /var/run/dpdk/spdk_pid62580 00:18:39.991 Removing: /var/run/dpdk/spdk_pid62616 00:18:39.991 Removing: /var/run/dpdk/spdk_pid62962 00:18:39.991 Removing: /var/run/dpdk/spdk_pid63441 00:18:39.991 Removing: /var/run/dpdk/spdk_pid63723 00:18:39.991 Removing: /var/run/dpdk/spdk_pid64584 00:18:39.991 Removing: /var/run/dpdk/spdk_pid65505 00:18:39.991 Removing: /var/run/dpdk/spdk_pid65622 00:18:39.992 Removing: /var/run/dpdk/spdk_pid65684 00:18:39.992 Removing: /var/run/dpdk/spdk_pid67111 00:18:39.992 Removing: /var/run/dpdk/spdk_pid67427 00:18:39.992 Removing: /var/run/dpdk/spdk_pid71352 00:18:39.992 Removing: /var/run/dpdk/spdk_pid71730 00:18:39.992 Removing: /var/run/dpdk/spdk_pid71845 00:18:39.992 Removing: /var/run/dpdk/spdk_pid71980 00:18:39.992 Removing: /var/run/dpdk/spdk_pid72001 00:18:39.992 Removing: /var/run/dpdk/spdk_pid72029 00:18:39.992 Removing: /var/run/dpdk/spdk_pid72062 00:18:39.992 Removing: /var/run/dpdk/spdk_pid72168 00:18:39.992 Removing: /var/run/dpdk/spdk_pid72297 00:18:39.992 Removing: /var/run/dpdk/spdk_pid72445 00:18:39.992 Removing: /var/run/dpdk/spdk_pid72525 00:18:39.992 Removing: /var/run/dpdk/spdk_pid72721 00:18:39.992 Removing: /var/run/dpdk/spdk_pid72788 00:18:39.992 Removing: /var/run/dpdk/spdk_pid72875 00:18:39.992 Removing: /var/run/dpdk/spdk_pid73234 00:18:39.992 Removing: /var/run/dpdk/spdk_pid73662 00:18:39.992 Removing: /var/run/dpdk/spdk_pid73663 00:18:39.992 Removing: /var/run/dpdk/spdk_pid73664 00:18:39.992 Removing: /var/run/dpdk/spdk_pid73917 00:18:39.992 Removing: /var/run/dpdk/spdk_pid74243 00:18:39.992 Removing: /var/run/dpdk/spdk_pid74245 00:18:39.992 Removing: /var/run/dpdk/spdk_pid74567 00:18:39.992 Removing: /var/run/dpdk/spdk_pid74581 00:18:39.992 Removing: /var/run/dpdk/spdk_pid74595 00:18:39.992 Removing: /var/run/dpdk/spdk_pid74626 00:18:39.992 Removing: /var/run/dpdk/spdk_pid74635 00:18:39.992 Removing: /var/run/dpdk/spdk_pid74982 00:18:39.992 Removing: /var/run/dpdk/spdk_pid75025 00:18:40.249 Removing: /var/run/dpdk/spdk_pid75360 00:18:40.249 Clean 00:18:48.348 11:29:28 nvmf_tcp -- common/autotest_common.sh@1451 -- # return 1 00:18:48.348 11:29:28 nvmf_tcp -- common/autotest_common.sh@1 -- # : 00:18:48.348 11:29:28 nvmf_tcp -- common/autotest_common.sh@1 -- # exit 1 00:18:48.361 [Pipeline] } 00:18:48.381 [Pipeline] // timeout 00:18:48.389 [Pipeline] } 00:18:48.407 [Pipeline] // stage 00:18:48.416 [Pipeline] } 00:18:48.420 ERROR: script returned exit code 1 00:18:48.421 Setting overall build result to FAILURE 00:18:48.439 [Pipeline] // catchError 00:18:48.452 [Pipeline] stage 00:18:48.457 [Pipeline] { (Stop VM) 00:18:48.467 [Pipeline] sh 00:18:48.750 + vagrant halt 00:18:52.947 ==> default: Halting domain... 00:18:58.219 [Pipeline] sh 00:18:58.497 + vagrant destroy -f 00:19:02.697 ==> default: Removing domain... 00:19:02.707 [Pipeline] sh 00:19:02.982 + mv output /var/jenkins/workspace/nvmf-tcp-uring-vg-autotest_2/output 00:19:02.990 [Pipeline] } 00:19:03.020 [Pipeline] // stage 00:19:03.025 [Pipeline] } 00:19:03.039 [Pipeline] // dir 00:19:03.043 [Pipeline] } 00:19:03.056 [Pipeline] // wrap 00:19:03.061 [Pipeline] } 00:19:03.072 [Pipeline] // catchError 00:19:03.081 [Pipeline] stage 00:19:03.082 [Pipeline] { (Epilogue) 00:19:03.094 [Pipeline] sh 00:19:03.439 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:19:05.991 [Pipeline] catchError 00:19:05.993 [Pipeline] { 00:19:06.006 [Pipeline] sh 00:19:06.285 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:19:06.542 Artifacts sizes are good 00:19:06.550 [Pipeline] } 00:19:06.563 [Pipeline] // catchError 00:19:06.572 [Pipeline] archiveArtifacts 00:19:06.579 Archiving artifacts 00:19:06.769 [Pipeline] cleanWs 00:19:06.790 [WS-CLEANUP] Deleting project workspace... 00:19:06.790 [WS-CLEANUP] Deferred wipeout is used... 00:19:06.794 [WS-CLEANUP] done 00:19:06.795 [Pipeline] } 00:19:06.805 [Pipeline] // stage 00:19:06.808 [Pipeline] } 00:19:06.817 [Pipeline] // node 00:19:06.820 [Pipeline] End of Pipeline 00:19:06.842 Finished: FAILURE